00010000:00010000:3.0:1784938438.266703:0:24202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f99917 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.266720:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f99917 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.266727:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f99917 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.266803:0:24202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938438.266834:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f99910 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.266841:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f99910 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.266848:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f99910 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.266855:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3e400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938438.266860:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f99910 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.266870:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f99910 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.266882:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2d:0x0].0x0 (ffff9f238dd4b800) 00010000:00010000:3.0:1784938438.266886:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784938438.266891:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f99910 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.266897:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f99910 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.266943:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238e483200/0x7b044d4128f99902 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.266949:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238e483200/0x7b044d4128f99902 lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.266955:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238e483200/0x7b044d4128f99902 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.266960:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238e483200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938438.266964:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238e483200/0x7b044d4128f99902 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.266970:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238e483200/0x7b044d4128f99902 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.266980:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff9f238dd4b300) 00010000:00010000:3.0:1784938438.266983:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938438.266986:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238e483200/0x7b044d4128f99902 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.266993:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238e483200/0x7b044d4128f99902 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938438.267003:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003e7a1192 reply state 000000009e38c5eb transno 8589934653 ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f99909 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.267017:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f99909 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.267033:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xff118af2 (ffff9f238dd4b600) 00010000:00010000:3.0:1784938438.267041:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938438.267045:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938438.267195:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+145:17072:x1871643337325568:12345-192.168.202.54@tcp:36:rm.0 Request processed in 2047us (2294us total) trans 8589934653 rc 0/0 00000100:00100000:3.0:1784938438.267205:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 101 00000100:00100000:3.0:1784938438.270988:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938438.280661:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337326080 00000100:00100000:3.0:1784938438.280679:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337326080 00000100:00100000:3.0:1784938438.280764:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 103 00000100:00100000:3.0:1784938438.280779:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+146:17072:x1871643337326080:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:3.0:1784938438.280875:0:24202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938438.280914:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5db000/0x7b044d4128f99145 lrc: 0/0,0 mode: --/PR res: [0x240000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663162 expref: 146 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.280951:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xf:0x0].0x0 (ffff9f2490bf2a00) 00010000:00010000:3.0:1784938438.280967:0:24202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938438.280998:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9993a lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.281017:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9993a lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.281029:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9993a lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.281046:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f800/0x7b044d4128f99941 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x9b815f19 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.281053:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f800/0x7b044d4128f99941 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.281098:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f800/0x7b044d4128f99941 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.281447:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f99948 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.281457:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f99948 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.281466:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f99948 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784938438.281784:0:24202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].28, 64 off9984 00010000:00010000:3.0:1784938438.281848:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e200/0x7b044d4128f9994f lrc: 3/0,1 mode: --/PW res: [0x240000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.281858:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e200/0x7b044d4128f9994f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.281867:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e200/0x7b044d4128f9994f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.281875:0:24202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e200/0x7b044d4128f9994f lrc: 4/0,1 mode: PW/PW res: [0x240000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.281881:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e200/0x7b044d4128f9994f lrc: 4/0,1 mode: PW/PW res: [0x240000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.281888:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e200/0x7b044d4128f9994f lrc: 3/0,0 mode: PW/PW res: [0x240000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.281921:0:24202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938438.281964:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f99948 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.281972:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f99948 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.281979:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f99948 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.281985:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3f600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938438.281992:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f99948 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.282002:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f99948 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.282015:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xf:0x0].0x0 (ffff9f238dd4b500) 00010000:00010000:3.0:1784938438.282018:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784938438.282023:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f99948 lrc: 2/0,0 mode: --/EX res: [0x240000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.282029:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f99948 lrc: 0/0,0 mode: --/EX res: [0x240000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.282049:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9993a lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.282055:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9993a lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.282072:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9993a lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.282091:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3e400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938438.282095:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9993a lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.282101:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9993a lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.282109:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff9f238dd4b300) 00010000:00010000:3.0:1784938438.282111:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938438.282115:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9993a lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.282120:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9993a lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938438.282142:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006110544e reply state 000000002ed28b0d transno 8589934655 ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f800/0x7b044d4128f99941 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.282184:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f800/0x7b044d4128f99941 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.282192:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x9b815f19 (ffff9f238dd4b400) 00010000:00010000:3.0:1784938438.282194:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938438.282198:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938438.282314:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+147:17072:x1871643337326080:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1533us (1930us total) trans 8589934655 rc 0/0 00000100:00100000:3.0:1784938438.282325:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 103 00000100:00100000:3.0:1784938438.292991:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938438.299915:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337326848 00000100:00100000:3.0:1784938438.299929:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337326848 00000100:00100000:3.0:1784938438.300044:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 106 00000100:00100000:3.0:1784938438.300056:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+149:17072:x1871643337326848:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:3.0:1784938438.300183:0:24203:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938438.300220:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27c200/0x7b044d4128f991b5 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663177 expref: 149 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.300244:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2f:0x0].0x0 (ffff9f23861f4500) 00010000:00010000:3.0:1784938438.300257:0:24203:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938438.300284:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9998e lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.300301:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9998e lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.300313:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9998e lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.300337:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f99995 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x4958ff4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.300344:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f99995 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.300350:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f99995 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.300466:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9999c lrc: 3/0,1 mode: --/EX res: [0x240000402:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.300475:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9999c lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.300494:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9999c lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784938438.300786:0:24203:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].30, 64 off10112 00010000:00010000:3.0:1784938438.300846:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f999a3 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.300856:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f999a3 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.300864:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f999a3 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.300871:0:24203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f999a3 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.300879:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f999a3 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.300886:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f999a3 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.301752:0:24203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784938438.301759:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f999a3 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938438.306010:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938438.313413:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938438.320706:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337327616 00000100:00100000:3.0:1784938438.320722:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337327616 00000100:00100000:3.0:1784938438.320800:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 109 00000100:00100000:3.0:1784938438.320834:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+152:17072:x1871643337327616:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:3.0:1784938438.320921:0:24202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938438.320972:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc64c00/0x7b044d4128f99209 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766318c expref: 152 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.320995:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff9f238dbbf300) 00010000:00010000:3.0:1784938438.321018:0:24202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938438.321045:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f999e2 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.321062:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f999e2 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.321073:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f999e2 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.321091:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f999e9 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x45c0cf9c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.321100:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f999e9 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.321106:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f999e9 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.343904:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938438.343913:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b800/0x7b044d4128f99a2f lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.343920:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61b800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938438.343924:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b800/0x7b044d4128f99a2f lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.343954:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b800/0x7b044d4128f99a2f lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.343964:0:19222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42:0x0].0x0 (ffff9f23861f8f00) 00010000:00010000:3.0:1784938438.343966:0:19222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938438.343969:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b800/0x7b044d4128f99a2f lrc: 1/0,0 mode: --/PW res: [0x240000402:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.343975:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b800/0x7b044d4128f99a2f lrc: 0/0,0 mode: --/PW res: [0x240000402:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.344007:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938438.344009:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938438.344010:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938438.369881:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337328896 00000100:00100000:3.0:1784938438.369895:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337328896 00000100:00100000:3.0:1784938438.370174:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 114 00000100:00100000:3.0:1784938438.370191:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+157:17072:x1871643337328896:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:3.0:1784938438.370333:0:24202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938438.370380:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27c000/0x7b044d4128f992b1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476631af expref: 157 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.370408:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x31:0x0].0x0 (ffff9f23861f4000) 00010000:00010000:3.0:1784938438.370423:0:24202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938438.370456:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f99a6e lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.370472:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f99a6e lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.370496:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f99a6e lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.370517:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ee00/0x7b044d4128f99a75 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x407c6222 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.370525:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ee00/0x7b044d4128f99a75 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.370531:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ee00/0x7b044d4128f99a75 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.370643:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fa00/0x7b044d4128f99a7c lrc: 3/0,1 mode: --/EX res: [0x240000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.370653:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fa00/0x7b044d4128f99a7c lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.370660:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fa00/0x7b044d4128f99a7c lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784938438.371406:0:24202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].34, 64 off10368 00000004:00080000:3.0:1784938438.371419:0:24202:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 704538272771ns, next at 705538269349ns, rc = 0 00010000:00010000:3.0:1784938438.371488:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f99a83 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.371500:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f99a83 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.371510:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f99a83 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.371534:0:24202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f99a83 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.371541:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f99a83 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.371548:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f99a83 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.371575:0:24202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938438.371607:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938438.371614:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f99a83 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.371622:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3f000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938438.371627:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f99a83 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.371636:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f99a83 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.371649:0:19222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x31:0x0].0x0 (ffff9f238dbbf700) 00010000:00010000:3.0:1784938438.371652:0:19222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938438.371657:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f99a83 lrc: 1/0,0 mode: --/PW res: [0x240000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.371663:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f99a83 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.371678:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938438.371680:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938438.371688:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938438.371707:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fa00/0x7b044d4128f99a7c lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.371714:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fa00/0x7b044d4128f99a7c lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.371720:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fa00/0x7b044d4128f99a7c lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.371725:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3fa00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938438.371730:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fa00/0x7b044d4128f99a7c lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.371737:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fa00/0x7b044d4128f99a7c lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.371745:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x31:0x0].0x0 (ffff9f238dbbf700) 00010000:00010000:3.0:1784938438.371747:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784938438.371750:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fa00/0x7b044d4128f99a7c lrc: 2/0,0 mode: --/EX res: [0x240000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.371756:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fa00/0x7b044d4128f99a7c lrc: 0/0,0 mode: --/EX res: [0x240000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.371784:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f99a6e lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.371790:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f99a6e lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.371797:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f99a6e lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.371812:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3e600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938438.371815:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f99a6e lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.371822:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f99a6e lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.371830:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff9f238dd4b300) 00010000:00010000:3.0:1784938438.371833:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938438.371837:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f99a6e lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.371842:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f99a6e lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938438.371854:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b59a4208 reply state 00000000650d5b2f transno 8589934666 ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ee00/0x7b044d4128f99a75 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.371866:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ee00/0x7b044d4128f99a75 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.371872:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x407c6222 (ffff9f238dbbf300) 00010000:00010000:3.0:1784938438.371874:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938438.371877:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938438.372096:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+158:17072:x1871643337328896:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1905us (2308us total) trans 8589934666 rc 0/0 00000100:00100000:3.0:1784938438.372107:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 114 00000100:00100000:3.0:1784938438.378336:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337329152 00000100:00100000:3.0:1784938438.378350:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337329152 00000100:00100000:3.0:1784938438.378432:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 115 00000100:00100000:3.0:1784938438.378465:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+158:17072:x1871643337329152:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:3.0:1784938438.378552:0:24201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938438.378589:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ce00/0x7b044d4128f992cd lrc: 0/0,0 mode: --/PR res: [0x240000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476631b6 expref: 158 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.378614:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x45:0x0].0x0 (ffff9f23861f4700) 00010000:00010000:3.0:1784938438.378627:0:24201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938438.378657:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f400/0x7b044d4128f99a8a lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.378672:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f400/0x7b044d4128f99a8a lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.378684:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f400/0x7b044d4128f99a8a lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.378699:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f99a91 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x7772308b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.378705:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f99a91 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.378712:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f99a91 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.378816:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f99a98 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.378825:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f99a98 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.378832:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f99a98 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784938438.379185:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].35, 64 off10432 00010000:00010000:3.0:1784938438.379245:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e200/0x7b044d4128f99a9f lrc: 3/0,1 mode: --/PW res: [0x240000402:0x45:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.379254:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e200/0x7b044d4128f99a9f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.379263:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e200/0x7b044d4128f99a9f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.379270:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e200/0x7b044d4128f99a9f lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.379277:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e200/0x7b044d4128f99a9f lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.379285:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e200/0x7b044d4128f99a9f lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.379312:0:24201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938438.379335:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f99a98 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.379343:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f99a98 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.379350:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f99a98 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.379357:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3f200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938438.379361:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f99a98 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.379387:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f99a98 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.379398:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x45:0x0].0x0 (ffff9f238dbbfe00) 00010000:00010000:3.0:1784938438.379402:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784938438.379406:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f99a98 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.379412:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f99a98 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.379433:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f400/0x7b044d4128f99a8a lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.379439:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f400/0x7b044d4128f99a8a lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.379445:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f400/0x7b044d4128f99a8a lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.379449:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3f400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938438.379452:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f400/0x7b044d4128f99a8a lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.379458:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f400/0x7b044d4128f99a8a lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.379466:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff9f238dd4b300) 00010000:00010000:3.0:1784938438.379468:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938438.379471:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f400/0x7b044d4128f99a8a lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.379488:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f400/0x7b044d4128f99a8a lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938438.379499:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a11035ff reply state 000000009c8a5778 transno 8589934667 ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f99a91 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.379512:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f99a91 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.379518:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x7772308b (ffff9f238dbbff00) 00010000:00010000:3.0:1784938438.379521:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938438.379524:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938438.379988:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+159:17072:x1871643337329152:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1518us (1774us total) trans 8589934667 rc 0/0 00000100:00100000:3.0:1784938438.379999:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 115 00010000:00010000:3.0:1784938438.386977:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938438.386985:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625e200/0x7b044d4128f99abb lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.386992:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c625e200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938438.386995:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625e200/0x7b044d4128f99abb lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.387002:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625e200/0x7b044d4128f99abb lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.387010:0:19222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3c:0x0].0x0 (ffff9f238dcb3900) 00010000:00010000:3.0:1784938438.387013:0:19222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938438.387016:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625e200/0x7b044d4128f99abb lrc: 1/0,0 mode: --/PW res: [0x240000402:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.387033:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625e200/0x7b044d4128f99abb lrc: 0/0,0 mode: --/PW res: [0x240000402:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.387055:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938438.387068:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938438.387070:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938438.391427:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337329664 00000100:00100000:3.0:1784938438.391443:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337329664 00000100:00100000:3.0:1784938438.391522:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 117 00000100:00100000:3.0:1784938438.391533:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d146680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+160:17072:x1871643337329664:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:3.0:1784938438.391620:0:24945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938438.391660:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f99305 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476631c4 expref: 160 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.391686:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x9:0x0].0x0 (ffff9f23861f4b00) 00010000:00010000:3.0:1784938438.391701:0:24945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938438.391732:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f99ac2 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.391751:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f99ac2 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.391762:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f99ac2 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.391781:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238e483200/0x7b044d4128f99ac9 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x15c8a56e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.391789:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238e483200/0x7b044d4128f99ac9 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.391821:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238e483200/0x7b044d4128f99ac9 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.391941:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b400/0x7b044d4128f99ad0 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.391949:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b400/0x7b044d4128f99ad0 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.391957:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b400/0x7b044d4128f99ad0 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784938438.392545:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].36, 64 off10496 00010000:00010000:3.0:1784938438.392613:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17ae00/0x7b044d4128f99ad7 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.392626:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17ae00/0x7b044d4128f99ad7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.392635:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17ae00/0x7b044d4128f99ad7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.392643:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17ae00/0x7b044d4128f99ad7 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.392649:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17ae00/0x7b044d4128f99ad7 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.392656:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17ae00/0x7b044d4128f99ad7 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.392719:0:24945:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938438.392757:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b400/0x7b044d4128f99ad0 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.392764:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b400/0x7b044d4128f99ad0 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.392770:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b400/0x7b044d4128f99ad0 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.392775:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17b400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938438.392780:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b400/0x7b044d4128f99ad0 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.392788:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b400/0x7b044d4128f99ad0 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.392800:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x9:0x0].0x0 (ffff9f238dbbf900) 00010000:00010000:3.0:1784938438.392803:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784938438.392808:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b400/0x7b044d4128f99ad0 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.392814:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b400/0x7b044d4128f99ad0 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.392837:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f99ac2 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.392843:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f99ac2 lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.392848:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f99ac2 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.392864:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3ec00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938438.392867:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f99ac2 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.392874:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f99ac2 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.392883:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff9f238dd4b300) 00010000:00010000:3.0:1784938438.392885:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938438.392889:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f99ac2 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.392894:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f99ac2 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938438.392905:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e689b1ad reply state 000000001ce9e1c2 transno 8589934669 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238e483200/0x7b044d4128f99ac9 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.392917:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238e483200/0x7b044d4128f99ac9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.392923:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x15c8a56e (ffff9f238dbbfa00) 00010000:00010000:3.0:1784938438.392937:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938438.392941:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938438.393052:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d146680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+161:17072:x1871643337329664:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1516us (2041us total) trans 8589934669 rc 0/0 00000100:00100000:3.0:1784938438.393073:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 117 00000100:00100000:3.0:1784938438.397079:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938438.404792:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337330176 00000100:00100000:3.0:1784938438.404806:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337330176 00000100:00100000:3.0:1784938438.404907:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 119 00000100:00100000:3.0:1784938438.404919:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+162:17072:x1871643337330176:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:3.0:1784938438.405013:0:24201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938438.405051:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9933d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476631d2 expref: 162 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.405089:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2e:0x0].0x0 (ffff9f23861f4200) 00010000:00010000:3.0:1784938438.405106:0:24201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938438.405206:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057800/0x7b044d4128f99afa lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.405223:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057800/0x7b044d4128f99afa lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.405236:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057800/0x7b044d4128f99afa lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.405252:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056000/0x7b044d4128f99b01 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0xb2d5a33e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.405259:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056000/0x7b044d4128f99b01 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.405266:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056000/0x7b044d4128f99b01 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.405381:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057a00/0x7b044d4128f99b08 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.405390:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057a00/0x7b044d4128f99b08 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.405412:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057a00/0x7b044d4128f99b08 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784938438.405705:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].33, 64 off10304 00010000:00010000:3.0:1784938438.405762:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056a00/0x7b044d4128f99b0f lrc: 3/0,1 mode: --/PW res: [0x240000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.405772:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056a00/0x7b044d4128f99b0f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.405781:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056a00/0x7b044d4128f99b0f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.405789:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056a00/0x7b044d4128f99b0f lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.405797:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056a00/0x7b044d4128f99b0f lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.405804:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056a00/0x7b044d4128f99b0f lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.405826:0:24201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938438.405851:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938438.405857:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056a00/0x7b044d4128f99b0f lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.405864:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4056a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938438.405869:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056a00/0x7b044d4128f99b0f lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.405889:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056a00/0x7b044d4128f99b0f lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.405900:0:19222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2e:0x0].0x0 (ffff9f238dbbf500) 00010000:00010000:3.0:1784938438.405903:0:19222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938438.405908:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056a00/0x7b044d4128f99b0f lrc: 1/0,0 mode: --/PW res: [0x240000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.405914:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056a00/0x7b044d4128f99b0f lrc: 0/0,0 mode: --/PW res: [0x240000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.405927:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938438.405929:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938438.405931:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938438.405945:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057a00/0x7b044d4128f99b08 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.405952:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057a00/0x7b044d4128f99b08 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.405958:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057a00/0x7b044d4128f99b08 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.405963:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938438.405968:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057a00/0x7b044d4128f99b08 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.405974:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057a00/0x7b044d4128f99b08 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.405981:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2e:0x0].0x0 (ffff9f238dbbf500) 00010000:00010000:3.0:1784938438.405990:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784938438.405993:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057a00/0x7b044d4128f99b08 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.405999:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057a00/0x7b044d4128f99b08 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.406021:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057800/0x7b044d4128f99afa lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.406027:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057800/0x7b044d4128f99afa lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.406033:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057800/0x7b044d4128f99afa lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.406038:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938438.406041:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057800/0x7b044d4128f99afa lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.406046:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057800/0x7b044d4128f99afa lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.406054:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff9f238dd4b300) 00010000:00010000:3.0:1784938438.406056:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938438.406059:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057800/0x7b044d4128f99afa lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.406064:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057800/0x7b044d4128f99afa lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938438.406073:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003042621d reply state 0000000075ae5c76 transno 8589934671 ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056000/0x7b044d4128f99b01 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.406097:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056000/0x7b044d4128f99b01 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.406104:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xb2d5a33e (ffff9f238dbbf700) 00010000:00010000:3.0:1784938438.406106:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938438.406108:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938438.407024:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+163:17072:x1871643337330176:12345-192.168.202.54@tcp:36:rm.0 Request processed in 2097us (2312us total) trans 8589934671 rc 0/0 00000100:00100000:3.0:1784938438.407036:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 119 00000100:00100000:3.0:1784938438.410866:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337330432 00000100:00100000:3.0:1784938438.410879:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337330432 00000100:00100000:3.0:1784938438.410968:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 120 00000100:00100000:3.0:1784938438.410979:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+163:17072:x1871643337330432:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:3.0:1784938438.411076:0:24203:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938438.411112:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61bc00/0x7b044d4128f99359 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476631d9 expref: 163 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.411137:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x27:0x0].0x0 (ffff9f2490bf2b00) 00010000:00010000:3.0:1784938438.411187:0:24203:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938438.411215:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99b16 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.411230:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99b16 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.411242:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99b16 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.411281:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057400/0x7b044d4128f99b1d lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x10fe8da8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.411289:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057400/0x7b044d4128f99b1d lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.411297:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057400/0x7b044d4128f99b1d lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.411416:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057c00/0x7b044d4128f99b24 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.411424:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057c00/0x7b044d4128f99b24 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.411430:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057c00/0x7b044d4128f99b24 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784938438.411737:0:24203:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].38, 64 off10624 00010000:00010000:3.0:1784938438.411798:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056800/0x7b044d4128f99b2b lrc: 3/0,1 mode: --/PW res: [0x240000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.411807:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056800/0x7b044d4128f99b2b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.411816:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056800/0x7b044d4128f99b2b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.411824:0:24203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056800/0x7b044d4128f99b2b lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.411831:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056800/0x7b044d4128f99b2b lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.411845:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056800/0x7b044d4128f99b2b lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.411865:0:24203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938438.411888:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057c00/0x7b044d4128f99b24 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.411894:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057c00/0x7b044d4128f99b24 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.411901:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057c00/0x7b044d4128f99b24 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.411907:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938438.411912:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057c00/0x7b044d4128f99b24 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.411920:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057c00/0x7b044d4128f99b24 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.411931:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x27:0x0].0x0 (ffff9f23861f8f00) 00010000:00010000:3.0:1784938438.411933:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784938438.411938:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057c00/0x7b044d4128f99b24 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.411944:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057c00/0x7b044d4128f99b24 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.411962:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99b16 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.411978:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99b16 lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.411983:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99b16 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.411988:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938438.411991:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99b16 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.411998:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99b16 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.412006:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff9f238dd4b300) 00010000:00010000:3.0:1784938438.412008:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938438.412012:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99b16 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.412018:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99b16 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938438.412028:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c1f14a67 reply state 0000000061b2ca1c transno 8589934672 ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057400/0x7b044d4128f99b1d lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.412041:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057400/0x7b044d4128f99b1d lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.412048:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x10fe8da8 (ffff9f238dbbfe00) 00010000:00010000:3.0:1784938438.412050:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938438.412053:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938438.412184:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+164:17072:x1871643337330432:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1204us (1434us total) trans 8589934672 rc 0/0 00000100:00100000:3.0:1784938438.412200:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 120 00000100:00100000:3.0:1784938438.416645:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337330688 00000100:00100000:3.0:1784938438.416659:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337330688 00000100:00100000:3.0:1784938438.416746:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 121 00000100:00100000:3.0:1784938438.416759:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+164:17072:x1871643337330688:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:3.0:1784938438.416858:0:24945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938438.416898:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a800/0x7b044d4128f99375 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476631e0 expref: 164 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.416924:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1d:0x0].0x0 (ffff9f2490bf2d00) 00010000:00010000:3.0:1784938438.416952:0:24945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938438.416983:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057200/0x7b044d4128f99b32 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.417000:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057200/0x7b044d4128f99b32 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.417011:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057200/0x7b044d4128f99b32 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.417031:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057000/0x7b044d4128f99b39 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x39c3d8fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.417038:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057000/0x7b044d4128f99b39 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.417045:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057000/0x7b044d4128f99b39 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938438.431312:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337330944 00000100:00100000:3.0:1784938438.431327:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337330944 00000100:00100000:3.0:1784938438.431415:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 122 00000100:00100000:3.0:1784938438.431429:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+165:17072:x1871643337330944:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:3.0:1784938438.431517:0:24203:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938438.431556:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9e4e00/0x7b044d4128f99391 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476631e7 expref: 165 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.431582:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff9f2490bf2500) 00010000:00010000:3.0:1784938438.431598:0:24203:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938438.431628:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99b4e lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.431647:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99b4e lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.431660:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99b4e lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.431678:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057c00/0x7b044d4128f99b55 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0xecc4f14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.431685:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057c00/0x7b044d4128f99b55 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.431692:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057c00/0x7b044d4128f99b55 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.431792:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057800/0x7b044d4128f99b5c lrc: 3/0,1 mode: --/EX res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.431818:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057800/0x7b044d4128f99b5c lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.431826:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057800/0x7b044d4128f99b5c lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784938438.432190:0:24203:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].34, 64 off10368 00010000:00010000:3.0:1784938438.432257:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057a00/0x7b044d4128f99b63 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.432267:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057a00/0x7b044d4128f99b63 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.432275:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057a00/0x7b044d4128f99b63 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.432283:0:24203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057a00/0x7b044d4128f99b63 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.432290:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057a00/0x7b044d4128f99b63 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.432297:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057a00/0x7b044d4128f99b63 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.432320:0:24203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938438.432343:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057800/0x7b044d4128f99b5c lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.432349:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057800/0x7b044d4128f99b5c lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.432378:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057800/0x7b044d4128f99b5c lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.432385:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938438.432391:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057800/0x7b044d4128f99b5c lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.432400:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057800/0x7b044d4128f99b5c lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.432411:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff9f238dcb2c00) 00010000:00010000:3.0:1784938438.432413:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784938438.432417:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057800/0x7b044d4128f99b5c lrc: 2/0,0 mode: --/EX res: [0x240000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.432422:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057800/0x7b044d4128f99b5c lrc: 0/0,0 mode: --/EX res: [0x240000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.432438:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99b4e lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.432443:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99b4e lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.432449:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99b4e lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.432453:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938438.432455:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99b4e lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.432472:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99b4e lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.432480:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff9f238dd4b300) 00010000:00010000:3.0:1784938438.432482:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938438.432485:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99b4e lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.432491:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99b4e lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938438.432501:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cd5527d4 reply state 00000000c5c2059b transno 8589934674 ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057c00/0x7b044d4128f99b55 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.432513:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057c00/0x7b044d4128f99b55 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.432519:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xecc4f14 (ffff9f238dcb2400) 00010000:00010000:3.0:1784938438.432522:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938438.432525:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938438.432632:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+166:17072:x1871643337330944:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1202us (1425us total) trans 8589934674 rc 0/0 00000100:00100000:3.0:1784938438.432642:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 122 00010000:00010000:3.0:1784938438.439965:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938438.439973:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625fc00/0x7b044d4128f99b7f lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.439980:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c625fc00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938438.439983:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625fc00/0x7b044d4128f99b7f lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.440012:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625fc00/0x7b044d4128f99b7f lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.440021:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x8:0x0].0x0 (ffff9f23861f4e00) 00010000:00010000:3.0:1784938438.440023:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938438.440027:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625fc00/0x7b044d4128f99b7f lrc: 1/0,0 mode: --/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.440033:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625fc00/0x7b044d4128f99b7f lrc: 0/0,0 mode: --/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.440051:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938438.440053:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938438.440055:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938438.444693:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337331456 00000100:00100000:3.0:1784938438.444706:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337331456 00000100:00100000:3.0:1784938438.444794:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 124 00000100:00100000:3.0:1784938438.444806:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+167:17072:x1871643337331456:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:3.0:1784938438.444902:0:24203:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938438.444954:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9e5800/0x7b044d4128f993c9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476631f5 expref: 167 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.444979:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa:0x0].0x0 (ffff9f24975b2c00) 00010000:00010000:3.0:1784938438.444994:0:24203:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938438.445021:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056a00/0x7b044d4128f99b86 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.445039:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056a00/0x7b044d4128f99b86 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.445088:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056a00/0x7b044d4128f99b86 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.445108:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057a00/0x7b044d4128f99b8d lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0xe7eb4718 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.445116:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057a00/0x7b044d4128f99b8d lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.445123:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057a00/0x7b044d4128f99b8d lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.445277:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057200/0x7b044d4128f99b94 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.445287:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057200/0x7b044d4128f99b94 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.445294:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057200/0x7b044d4128f99b94 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784938438.445600:0:24203:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].36, 64 off10496 00010000:00010000:3.0:1784938438.445662:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056800/0x7b044d4128f99b9b lrc: 3/0,1 mode: --/PW res: [0x240000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.445673:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056800/0x7b044d4128f99b9b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.445682:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056800/0x7b044d4128f99b9b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.445691:0:24203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056800/0x7b044d4128f99b9b lrc: 4/0,1 mode: PW/PW res: [0x240000402:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.445708:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056800/0x7b044d4128f99b9b lrc: 4/0,1 mode: PW/PW res: [0x240000402:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.445716:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056800/0x7b044d4128f99b9b lrc: 3/0,0 mode: PW/PW res: [0x240000402:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.445741:0:24203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938438.445767:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057200/0x7b044d4128f99b94 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.445774:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057200/0x7b044d4128f99b94 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.445782:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057200/0x7b044d4128f99b94 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.445789:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938438.445795:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057200/0x7b044d4128f99b94 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.445803:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057200/0x7b044d4128f99b94 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.445815:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa:0x0].0x0 (ffff9f238dcb2600) 00010000:00010000:3.0:1784938438.445818:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784938438.445823:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057200/0x7b044d4128f99b94 lrc: 2/0,0 mode: --/EX res: [0x240000402:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.445829:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057200/0x7b044d4128f99b94 lrc: 0/0,0 mode: --/EX res: [0x240000402:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.445848:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056a00/0x7b044d4128f99b86 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.445862:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056a00/0x7b044d4128f99b86 lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.445869:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056a00/0x7b044d4128f99b86 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.445874:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4056a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938438.445878:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056a00/0x7b044d4128f99b86 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.445885:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056a00/0x7b044d4128f99b86 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.445894:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff9f238dd4b300) 00010000:00010000:3.0:1784938438.445896:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938438.445900:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056a00/0x7b044d4128f99b86 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.445906:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056a00/0x7b044d4128f99b86 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938438.445918:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000075219fe3 reply state 00000000de51c11d transno 8589934676 ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057a00/0x7b044d4128f99b8d lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.445932:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057a00/0x7b044d4128f99b8d lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.445940:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xe7eb4718 (ffff9f238dcb2800) 00010000:00010000:3.0:1784938438.445942:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938438.445946:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938438.446043:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+168:17072:x1871643337331456:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1236us (1454us total) trans 8589934676 rc 0/0 00000100:00100000:3.0:1784938438.446059:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 124 00000100:00100000:3.0:1784938438.457041:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337331968 00000100:00100000:3.0:1784938438.457065:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337331968 00000100:00100000:3.0:1784938438.457189:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 126 00000100:00100000:3.0:1784938438.457203:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d145880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+169:17072:x1871643337331968:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:3.0:1784938438.457323:0:24203:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938438.457361:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6200/0x7b044d4128f99401 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663203 expref: 169 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.457397:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x14:0x0].0x0 (ffff9f24975b2f00) 00010000:00010000:3.0:1784938438.457413:0:24203:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938438.457445:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99bbe lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.457463:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99bbe lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.457475:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99bbe lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.457493:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057800/0x7b044d4128f99bc5 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x4ee593e6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.457500:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057800/0x7b044d4128f99bc5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.457507:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057800/0x7b044d4128f99bc5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.457633:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056800/0x7b044d4128f99bcc lrc: 3/0,1 mode: --/EX res: [0x240000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.457641:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056800/0x7b044d4128f99bcc lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.457649:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056800/0x7b044d4128f99bcc lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784938438.457948:0:24203:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].38, 64 off10624 00010000:00010000:3.0:1784938438.458008:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17ae00/0x7b044d4128f99bd3 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.458017:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17ae00/0x7b044d4128f99bd3 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.458025:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17ae00/0x7b044d4128f99bd3 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.458032:0:24203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17ae00/0x7b044d4128f99bd3 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.458039:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17ae00/0x7b044d4128f99bd3 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.458045:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17ae00/0x7b044d4128f99bd3 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.460581:0:24203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784938438.463550:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056800/0x7b044d4128f99bcc lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.463609:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056800/0x7b044d4128f99bcc lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.463618:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056800/0x7b044d4128f99bcc lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.463624:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4056800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938438.463630:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056800/0x7b044d4128f99bcc lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.463639:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056800/0x7b044d4128f99bcc lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.463661:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x14:0x0].0x0 (ffff9f238dcb2f00) 00010000:00010000:3.0:1784938438.463665:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784938438.463671:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056800/0x7b044d4128f99bcc lrc: 2/0,0 mode: --/EX res: [0x240000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.463678:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056800/0x7b044d4128f99bcc lrc: 0/0,0 mode: --/EX res: [0x240000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.463712:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99bbe lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.463720:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99bbe lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.463726:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99bbe lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.463731:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938438.463742:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99bbe lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.463748:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99bbe lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.463757:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff9f238dd4b300) 00010000:00010000:3.0:1784938438.463759:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938438.463762:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99bbe lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.463767:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99bbe lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938438.463777:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000057957b90 reply state 00000000f89d4a5f transno 8589934678 ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057800/0x7b044d4128f99bc5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.463791:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057800/0x7b044d4128f99bc5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.463799:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x4ee593e6 (ffff9f238dcb2300) 00010000:00010000:3.0:1784938438.463801:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938438.463805:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938438.463942:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d145880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+170:17072:x1871643337331968:12345-192.168.202.54@tcp:36:rm.0 Request processed in 6736us (7031us total) trans 8589934678 rc 0/0 00000100:00100000:3.0:1784938438.463951:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 126 00000100:00100000:3.0:1784938438.468896:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938438.473972:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:3.0:1784938438.476778:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938438.481475:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:3.0:1784938438.483347:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938438.483386:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42de00/0x7b044d4128f99c27 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.483393:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42de00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938438.483397:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42de00/0x7b044d4128f99c27 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.483404:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42de00/0x7b044d4128f99c27 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.483414:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x32:0x0].0x0 (ffff9f2484afd800) 00010000:00010000:3.0:1784938438.483416:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938438.483420:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42de00/0x7b044d4128f99c27 lrc: 1/0,0 mode: --/PW res: [0x240000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.483426:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42de00/0x7b044d4128f99c27 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.483444:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938438.483447:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938438.483449:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938438.487537:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337332992 00000100:00100000:3.0:1784938438.487553:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337332992 00000100:00100000:3.0:1784938438.487631:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 130 00000100:00100000:3.0:1784938438.487643:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+173:17072:x1871643337332992:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:3.0:1784938438.487738:0:24203:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938438.487776:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057600/0x7b044d4128f98ee4 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663250 expref: 173 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.487799:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4c:0x0].0x0 (ffff9f23861e3700) 00010000:00010000:3.0:1784938438.487841:0:24203:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938438.487872:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b400/0x7b044d4128f99c2e lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.487891:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b400/0x7b044d4128f99c2e lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.487903:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b400/0x7b044d4128f99c2e lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.487923:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17ae00/0x7b044d4128f99c35 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x9ce4d69c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.487942:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17ae00/0x7b044d4128f99c35 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.487948:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17ae00/0x7b044d4128f99c35 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.488054:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056600/0x7b044d4128f99c3c lrc: 3/0,1 mode: --/EX res: [0x240000402:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.488063:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056600/0x7b044d4128f99c3c lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.488070:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056600/0x7b044d4128f99c3c lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784938438.488460:0:24203:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].41, 64 off10816 00010000:00010000:3.0:1784938438.488523:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99c43 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.488533:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99c43 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.488552:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99c43 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.488561:0:24203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99c43 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.488567:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99c43 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.488573:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057e00/0x7b044d4128f99c43 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.488600:0:24203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938438.488625:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056600/0x7b044d4128f99c3c lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.488632:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056600/0x7b044d4128f99c3c lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.488638:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056600/0x7b044d4128f99c3c lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.488645:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4056600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938438.488650:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056600/0x7b044d4128f99c3c lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.488659:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056600/0x7b044d4128f99c3c lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.488670:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4c:0x0].0x0 (ffff9f238dcb2a00) 00010000:00010000:3.0:1784938438.488674:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784938438.488817:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056600/0x7b044d4128f99c3c lrc: 2/0,0 mode: --/EX res: [0x240000402:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.488825:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056600/0x7b044d4128f99c3c lrc: 0/0,0 mode: --/EX res: [0x240000402:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.488847:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b400/0x7b044d4128f99c2e lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.488854:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b400/0x7b044d4128f99c2e lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.488861:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b400/0x7b044d4128f99c2e lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.488867:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17b400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938438.488870:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b400/0x7b044d4128f99c2e lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.488876:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b400/0x7b044d4128f99c2e lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.488884:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff9f238dd4b300) 00010000:00010000:3.0:1784938438.488887:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938438.488890:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b400/0x7b044d4128f99c2e lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.488896:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b400/0x7b044d4128f99c2e lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938438.488906:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000027dc08e2 reply state 000000005a780d39 transno 8589934682 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17ae00/0x7b044d4128f99c35 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.488930:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17ae00/0x7b044d4128f99c35 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.488937:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x9ce4d69c (ffff9f238dcb2100) 00010000:00010000:3.0:1784938438.488940:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938438.488943:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938438.489083:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+174:17072:x1871643337332992:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1439us (1626us total) trans 8589934682 rc 0/0 00000100:00100000:3.0:1784938438.489093:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 130 00000100:00100000:3.0:1784938438.500943:0:21161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350824192 00000100:00100000:3.0:1784938438.500950:0:21161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350824192 00000100:00100000:3.0:1784938438.501005:0:21161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 45 00000100:00100000:3.0:1784938438.501014:0:21161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23880a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:24201:x1871643350824192:12345-192.168.202.154@tcp:101:mdt00_000.0 00010000:00010000:3.0:1784938438.501029:0:21161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938438.501047:0:21161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057600/0x7b044d4128f99c51 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b044d4128f99c4a expref: -99 pid: 21161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.501085:0:21161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f987ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947662f39 expref: 12 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.501097:0:21161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057600/0x7b044d4128f99c51 lrc: 4/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.154@tcp remote: 0x7b044d4128f99c4a expref: 7 pid: 21161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.501137:0:21161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f987ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x571025e947662f39 expref: 12 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.501177:0:21161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f987ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x571025e947662f39 expref: 12 pid: 24945 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938438.501214:0:21161:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387dae680 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:21161:1871643350824320:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938438.501286:0:21161:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238e8de480 going to sleep for 11 seconds 00000100:00100000:3.0:1784938438.504743:0:21161:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387dae680 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:21161:1871643350824320:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938438.504793:0:21161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057600/0x7b044d4128f99c51 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.154@tcp remote: 0x7b044d4128f99c4a expref: 7 pid: 21161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.504809:0:21161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f24898dd400) 00010000:00010000:3.0:1784938438.504812:0:21161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938438.504818:0:21161:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057600/0x7b044d4128f99c51 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.154@tcp remote: 0x7b044d4128f99c4a expref: 7 pid: 21161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.504829:0:21161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b4057600, rc 0) 00000100:00100000:3.0:1784938438.504914:0:21161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23880a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:24201:x1871643350824192:12345-192.168.202.154@tcp:101:mdt00_000.0 Request processed in 3900us (4088us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938438.504926:0:21161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 45 00000100:00100000:3.0:1784938438.506095:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938438.507035:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00010000:00010000:3.0:1784938438.509530:0:24201:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f24c625e000/0x7b044d4128f99c4a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b044d4128f99c51 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.509544:0:24201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f24c625e000/0x7b044d4128f99c4a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b044d4128f99c51 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938438.509573:0:24201:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x1:0x0] 00010000:00010000:3.0:1784938438.509631:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f24b4056800/0x7b044d4128f99c58 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xc4959c6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.509658:0:24201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f24b4056800/0x7b044d4128f99c58 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.509671:0:24201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f24b4056800/0x7b044d4128f99c58 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938438.509697:0:24201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387daca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:24201:1871643350824576:192.168.202.154@tcp:101:mdt00_000.0 00000100:00100000:3.0:1784938438.509771:0:24201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238e8de480 going to sleep for 11 seconds 00000100:00100000:3.0:1784938438.510885:0:21160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350824576 00000100:00100000:3.0:1784938438.510898:0:21160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350824576 00000100:00100000:3.0:1784938438.510973:0:21160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 46 00000100:00100000:3.0:1784938438.510984:0:21160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d3ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:24201:x1871643350824576:12345-192.168.202.154@tcp:101:mdt00_000.0 00010000:00010000:3.0:1784938438.511010:0:21160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938438.511042:0:21160:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056a00/0x7b044d4128f99c5f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1:0x0].0xc4959c6c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b044d4128f99c58 expref: -99 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.511077:0:21160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056a00/0x7b044d4128f99c5f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.154@tcp remote: 0x7b044d4128f99c58 expref: 8 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.511095:0:21160:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056a00/0x7b044d4128f99c5f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.154@tcp remote: 0x7b044d4128f99c58 expref: 8 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.511106:0:21160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xc4959c6c (ffff9f238dcb2b00) 00010000:00010000:3.0:1784938438.511109:0:21160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938438.511113:0:21160:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b4056a00, rc 0) 00000100:00100000:3.0:1784938438.511444:0:21160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d3ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:24201:x1871643350824576:12345-192.168.202.154@tcp:101:mdt00_000.0 Request processed in 460us (1510us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938438.511474:0:21160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 46 00000100:00100000:3.0:1784938438.512740:0:24201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387daca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:24201:1871643350824576:192.168.202.154@tcp:101:mdt00_000.0 00010000:00010000:3.0:1784938438.512776:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f24b4056800/0x7b044d4128f99c58 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b044d4128f99c5f expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.512799:0:24201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f24b4056800/0x7b044d4128f99c58 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b044d4128f99c5f expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938438.512829:0:24201:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x1:0x0] 00000100:00100000:3.0:1784938438.512898:0:24201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387daca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:24201:1871643350824704:192.168.202.154@tcp:1000:mdt00_000.0 00000100:00100000:3.0:1784938438.512990:0:24201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238e8de240 going to sleep for 11 seconds 00000100:00100000:3.0:1784938438.513905:0:21161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350824704 00000100:00100000:3.0:1784938438.513915:0:21161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350824704 00000100:00100000:3.0:1784938438.514023:0:21161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 47 00000100:00100000:3.0:1784938438.514035:0:21161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d3af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:24201:x1871643350824704:12345-192.168.202.154@tcp:1000:mdt00_000.0 00000100:00100000:3.0:1784938438.514444:0:21161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d3af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:24201:x1871643350824704:12345-192.168.202.154@tcp:1000:mdt00_000.0 Request processed in 409us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938438.514454:0:21161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 47 00000001:00080000:3.0:1784938438.550124:0:24188:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934604 is committed 00000100:00100000:3.0:1784938438.566250:0:24201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d4e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:24201:1871643350825856:192.168.202.154@tcp:1000:mdt00_000.0 00000040:00080000:3.0:1784938438.566371:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd1:0x1:0x0].1, 496 off33264 00000004:00080000:3.0:1784938438.566390:0:24201:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9f24917e7e40 with version 7 00000100:00100000:3.0:1784938438.566858:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000004:00200000:3.0:1784938438.582189:0:24201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1784938438.582251:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ce00/0x7b044d4128f99c74 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.582289:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ce00/0x7b044d4128f99c74 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.582298:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ce00/0x7b044d4128f99c74 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.582305:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27ce00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938438.582311:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ce00/0x7b044d4128f99c74 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.582320:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ce00/0x7b044d4128f99c74 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.582343:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff9f24975b2700) 00010000:00010000:3.0:1784938438.582346:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938438.582352:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ce00/0x7b044d4128f99c74 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.582359:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ce00/0x7b044d4128f99c74 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.582397:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238d27c400/0x7b044d4128f99c66 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b044d4128f99c6d expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.582407:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238d27c400/0x7b044d4128f99c66 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b044d4128f99c6d expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.582415:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238d27c400/0x7b044d4128f99c66 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b044d4128f99c6d expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.582460:0:24201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1784938438.582480:0:24201:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x1:0x0] 00010000:00010000:3.0:1784938438.582489:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f24c625e000/0x7b044d4128f99c4a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b044d4128f99c51 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.582496:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f24c625e000/0x7b044d4128f99c4a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b044d4128f99c51 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.582504:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f24c625e000/0x7b044d4128f99c4a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b044d4128f99c51 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.582525:0:24201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:3.0:1784938438.582530:0:24201:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x1:0x0] 00010000:00010000:3.0:1784938438.582535:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f24b4056800/0x7b044d4128f99c58 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b044d4128f99c5f expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.582544:0:24201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f24b4056800/0x7b044d4128f99c58 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b044d4128f99c5f expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938438.582669:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d3ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+174:17072:x1871643337333632:12345-192.168.202.54@tcp:36:rm.0 Request processed in 82758us (83638us total) trans 8589934684 rc 0/0 00000100:00100000:3.0:1784938438.582680:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 131 00000100:00100000:3.0:1784938438.585638:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23880a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350826240:192.168.202.154@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1784938438.587642:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350826240 00000100:00100000:3.0:1784938438.587654:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350826240 00000100:00100000:3.0:1784938438.587731:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 20 00000100:00100000:3.0:1784938438.587765:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:16392:x1871643350826240:12345-192.168.202.154@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938438.587786:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938438.587818:0:22955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c200/0x7b044d4128f99c6d lrc: 0/0,0 mode: --/EX res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.154@tcp remote: 0x7b044d4128f99c66 expref: 9 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.587841:0:22955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff9f2484afd100) 00010000:00010000:3.0:1784938438.587854:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938438.587910:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:16392:x1871643350826240:12345-192.168.202.154@tcp:103:ldlm_bl.0 Request processed in 148us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938438.587918:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 20 00000100:00100000:3.0:1784938438.588865:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23880a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350826240:192.168.202.154@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1784938438.605810:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938438.618645:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337334400 00000100:00100000:3.0:1784938438.618660:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337334400 00000100:00100000:3.0:1784938438.618746:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:3.0:1784938438.618758:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23880a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+10:17072:x1871643337334400:12345-192.168.202.54@tcp:35:rm.0 00000100:00100000:3.0:1784938438.619302:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23880a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+11:17072:x1871643337334400:12345-192.168.202.54@tcp:35:rm.0 Request processed in 542us (857us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1784938438.619312:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:3.0:1784938438.624528:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938438.633411:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337334784 00000100:00100000:3.0:1784938438.633425:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337334784 00000100:00100000:3.0:1784938438.633505:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 134 00000100:00100000:3.0:1784938438.633517:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+13:17072:x1871643337334784:12345-192.168.202.54@tcp:101:rm.0 00010000:00010000:3.0:1784938438.633555:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938438.633612:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057600/0x7b044d4128f99c9e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476633df expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.633712:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f99ca5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.633731:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f99ca5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.633746:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f99ca5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.633764:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f99cac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x151c8ac3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.633772:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f99cac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.633779:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f99cac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.634119:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f99cb3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.634130:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f99cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.634138:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f99cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938438.634228:0:24203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x9:0x0]: returning size 39343 00000004:00200000:3.0:1784938438.634233:0:24203:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784938438.634258:0:24203:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f99cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.634522:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f99cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.634534:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f99ca5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.634541:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f99ca5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.634549:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f99ca5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.634557:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938438.634562:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f99ca5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.634572:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f99ca5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.634588:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:3.0:1784938438.634592:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938438.634598:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f99ca5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.634606:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f99ca5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.634621:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f99cac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.634627:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f99cac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.634639:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f99cac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.634644:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4056600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938438.634647:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f99cac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.634653:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f99cac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.634661:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x151c8ac3 (ffff9f23861e4d00) 00010000:00010000:3.0:1784938438.634663:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938438.634666:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f99cac lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.634671:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f99cac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.634717:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057600/0x7b044d4128f99c9e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476633df expref: 15 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.634735:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f99cb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476633df expref: 14 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.634745:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f23861e4f00) 00010000:00010000:3.0:1784938438.634747:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938438.634751:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b4057e00, rc 0) 00000100:00100000:3.0:1784938438.634934:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+14:17072:x1871643337334784:12345-192.168.202.54@tcp:101:rm.0 Request processed in 1409us (1826us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938438.634953:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 134 00000100:00100000:3.0:1784938438.643410:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337335040 00000100:00100000:3.0:1784938438.643424:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337335040 00010000:00010000:2.0:1784938438.665723:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99d00 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.665739:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff9f2484afd100) 00010000:00010000:2.0:1784938438.665742:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784938438.665746:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99d00 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.665752:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99d00 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.665776:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99cf2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.665782:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99cf2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.665787:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99cf2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.665792:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42d400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938438.665795:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99cf2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.665801:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99cf2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.665808:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:2.0:1784938438.665811:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938438.665814:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99cf2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.665821:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99cf2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938438.665837:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003de57f45 reply state 00000000732a9256 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c000/0x7b044d4128f99cf9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.665851:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c000/0x7b044d4128f99cf9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.665857:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x130f79e0 (ffff9f2484afd800) 00010000:00010000:2.0:1784938438.665859:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938438.665862:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938438.665996:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+16:17072:x1871643337335424:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1474us (3465us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1784938438.666008:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 137 00010000:00010000:3.0:1784938438.666346:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938438.666356:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42de00/0x7b044d4128f99d07 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.666375:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42de00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938438.666380:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42de00/0x7b044d4128f99d07 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.666388:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42de00/0x7b044d4128f99d07 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.666402:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff9f2484afd100) 00010000:00010000:3.0:1784938438.666404:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938438.666408:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42de00/0x7b044d4128f99d07 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.666414:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42de00/0x7b044d4128f99d07 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.666438:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938438.666440:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938438.666443:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938438.672612:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337335552 00000100:00100000:3.0:1784938438.672625:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337335552 00000100:00100000:3.0:1784938438.672708:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 138 00000100:00100000:3.0:1784938438.672720:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+16:17072:x1871643337335552:12345-192.168.202.54@tcp:101:rm.0 00010000:00010000:3.0:1784938438.672755:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938438.672817:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057600/0x7b044d4128f99d0e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476633ed expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.672907:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f99d15 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.672925:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f99d15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.672940:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f99d15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.673130:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f99d1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x15c8a56e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.673226:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f99d1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.673240:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f99d1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.673663:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f99d23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.673673:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f99d23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.673680:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f99d23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938438.673720:0:24203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 15476 00000004:00200000:3.0:1784938438.673725:0:24203:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784938438.673752:0:24203:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f99d23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.673780:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f99d23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.673789:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f99d15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.673795:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f99d15 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.673803:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f99d15 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.673809:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4056600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938438.673813:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f99d15 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.673821:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f99d15 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.673833:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:3.0:1784938438.673837:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938438.673841:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f99d15 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.673848:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f99d15 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.673861:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f99d1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.673867:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f99d1c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.673880:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f99d1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.673885:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938438.673888:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f99d1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.673894:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f99d1c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.673901:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x15c8a56e (ffff9f23861e4d00) 00010000:00010000:3.0:1784938438.673904:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938438.673907:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f99d1c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.673912:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f99d1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.673952:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057600/0x7b044d4128f99d0e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476633ed expref: 18 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.673968:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f99d23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476633ed expref: 17 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.673976:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f23861e4b00) 00010000:00010000:3.0:1784938438.673977:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938438.673980:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b4057e00, rc 0) 00000100:00100000:3.0:1784938438.674122:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+17:17072:x1871643337335552:12345-192.168.202.54@tcp:101:rm.0 Request processed in 1404us (1795us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938438.674141:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 138 00000100:00100000:2.0:1784938438.686733:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938438.694895:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337335936 00000100:00100000:3.0:1784938438.694908:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337335936 00000100:00100000:3.0:1784938438.694998:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 140 00000100:00100000:3.0:1784938438.695011:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+18:17072:x1871643337335936:12345-192.168.202.54@tcp:101:rm.0 00010000:00010000:3.0:1784938438.695047:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938438.695078:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057600/0x7b044d4128f99d46 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476633f4 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.695219:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f99d4d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.695238:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f99d4d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.695251:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f99d4d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.708953:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99d54 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd946e4d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.708980:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99d54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.708993:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99d54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.709183:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99d5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.709191:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99d5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.709199:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99d5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938438.709257:0:24203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 4218 00000004:00200000:2.0:1784938438.709261:0:24203:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784938438.709286:0:24203:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99d5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.709297:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99d5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.709306:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f99d4d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.709313:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f99d4d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.709320:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f99d4d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.709326:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938438.709330:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f99d4d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.709337:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f99d4d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.709350:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:2.0:1784938438.709353:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938438.709357:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f99d4d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.709374:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f99d4d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.709805:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99d54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.709811:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99d54 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.709816:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99d54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.709821:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42d600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938438.709824:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99d54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.709829:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99d54 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.709837:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xd946e4d2 (ffff9f2484afd100) 00010000:00010000:2.0:1784938438.709839:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938438.709843:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99d54 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.709847:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99d54 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.709888:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057600/0x7b044d4128f99d46 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476633f4 expref: 20 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.709900:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99d5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476633f4 expref: 19 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.709913:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff9f23861f8f00) 00010000:00010000:2.0:1784938438.709915:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938438.709917:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d42d200, rc 0) 00000100:00100000:2.0:1784938438.710046:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+19:17072:x1871643337335936:12345-192.168.202.54@tcp:101:rm.0 Request processed in 15036us (15252us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938438.710055:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 140 00000100:00100000:2.0:1784938438.724652:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:3.0:1784938438.727464:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938438.727476:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27da00/0x7b044d4128f99d77 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.727484:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27da00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938438.727488:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27da00/0x7b044d4128f99d77 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.727495:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27da00/0x7b044d4128f99d77 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.727509:0:19223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff9f24975b2a00) 00010000:00010000:3.0:1784938438.727531:0:19223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938438.727536:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27da00/0x7b044d4128f99d77 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.727543:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27da00/0x7b044d4128f99d77 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.727566:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938438.727568:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938438.727571:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938438.737179:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337336320 00000100:00100000:2.0:1784938438.737190:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337336320 00000100:00100000:2.0:1784938438.737260:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 142 00000100:00100000:2.0:1784938438.737271:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+20:17072:x1871643337336320:12345-192.168.202.54@tcp:101:rm.0 00010000:00010000:2.0:1784938438.737298:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938438.737323:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99d7e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476633fb expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.737455:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99d85 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.737470:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99d85 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.737481:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99d85 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.737534:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99d8c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xbb599949 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.737543:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99d8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.737551:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99d8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.737737:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99d93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.737747:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99d93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.737754:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99d93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938438.737790:0:24945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3b:0x0]: returning size 143467 00000004:00200000:2.0:1784938438.737794:0:24945:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784938438.737816:0:24945:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99d93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.737828:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99d93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.737835:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99d85 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.737841:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99d85 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.737848:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99d85 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.737854:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42da00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938438.737858:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99d85 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.737866:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99d85 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.737879:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:2.0:1784938438.737882:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938438.737887:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99d85 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.737892:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99d85 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.737906:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99d8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.737913:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99d8c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.737918:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99d8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.737924:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42c600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938438.737926:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99d8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.737932:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99d8c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.737939:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xbb599949 (ffff9f23861f8f00) 00010000:00010000:2.0:1784938438.737941:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938438.737944:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99d8c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.737953:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99d8c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.737985:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99d7e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476633fb expref: 22 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.737999:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99d93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476633fb expref: 21 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.738006:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3b:0x0].0x0 (ffff9f2484afd100) 00010000:00010000:2.0:1784938438.738009:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938438.738011:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d42d200, rc 0) 00000100:00100000:2.0:1784938438.738085:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+21:17072:x1871643337336320:12345-192.168.202.54@tcp:101:rm.0 Request processed in 815us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938438.738093:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 142 00000100:00100000:2.0:1784938438.743584:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337336576 00000100:00100000:2.0:1784938438.743595:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337336576 00000100:00100000:2.0:1784938438.743660:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 143 00000100:00100000:2.0:1784938438.743670:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+21:17072:x1871643337336576:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:2.0:1784938438.743729:0:24202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938438.743758:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99d93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476633fb expref: 21 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.743779:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3b:0x0].0x0 (ffff9f2484afd100) 00010000:00010000:2.0:1784938438.743790:0:24202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938438.743811:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99d9a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.743824:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99d9a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.743834:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99d9a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.743850:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42de00/0x7b044d4128f99da1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0xbb599949 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.743856:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42de00/0x7b044d4128f99da1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.743861:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42de00/0x7b044d4128f99da1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.743953:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42cc00/0x7b044d4128f99da8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.743961:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42cc00/0x7b044d4128f99da8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.743968:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42cc00/0x7b044d4128f99da8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784938438.744238:0:24202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].3, 64 off8384 00010000:00010000:2.0:1784938438.744288:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c400/0x7b044d4128f99daf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.744296:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c400/0x7b044d4128f99daf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.744303:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c400/0x7b044d4128f99daf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.744309:0:24202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c400/0x7b044d4128f99daf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.744315:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c400/0x7b044d4128f99daf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.744320:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c400/0x7b044d4128f99daf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.744332:0:24202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938438.744349:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42cc00/0x7b044d4128f99da8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.744355:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42cc00/0x7b044d4128f99da8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.744371:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42cc00/0x7b044d4128f99da8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.744377:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42cc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938438.744381:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42cc00/0x7b044d4128f99da8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.744389:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42cc00/0x7b044d4128f99da8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.744397:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3b:0x0].0x0 (ffff9f23861e3e00) 00010000:00010000:2.0:1784938438.744400:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784938438.744404:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42cc00/0x7b044d4128f99da8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.744413:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42cc00/0x7b044d4128f99da8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.744502:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99d9a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.744509:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99d9a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.744514:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99d9a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.744518:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42d400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938438.744522:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99d9a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.744527:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99d9a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.744535:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:2.0:1784938438.744537:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938438.744539:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99d9a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.744545:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99d9a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938438.744554:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007957c246 reply state 000000009276123c transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42de00/0x7b044d4128f99da1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.744564:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42de00/0x7b044d4128f99da1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.744570:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xbb599949 (ffff9f23861e3700) 00010000:00010000:2.0:1784938438.744572:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938438.744574:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938438.744642:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+22:17072:x1871643337336576:12345-192.168.202.54@tcp:36:rm.0 Request processed in 973us (1201us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1784938438.744650:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 143 00010000:00010000:3.0:1784938438.744977:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938438.744984:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c400/0x7b044d4128f99daf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.744990:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42c400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938438.744994:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c400/0x7b044d4128f99daf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.745001:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c400/0x7b044d4128f99daf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.745010:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3b:0x0].0x0 (ffff9f23861e3e00) 00010000:00010000:3.0:1784938438.745013:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938438.745016:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c400/0x7b044d4128f99daf lrc: 1/0,0 mode: --/PW res: [0x200000402:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.745022:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c400/0x7b044d4128f99daf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.745036:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938438.745038:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938438.745039:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938438.754113:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938438.754462:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337336704 00000100:00100000:2.0:1784938438.754472:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337336704 00000100:00100000:2.0:1784938438.754528:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 144 00000100:00100000:2.0:1784938438.754539:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+22:17072:x1871643337336704:12345-192.168.202.54@tcp:101:rm.0 00010000:00010000:2.0:1784938438.754566:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938438.754586:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99db6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663402 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.754656:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99dbd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.754673:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99dbd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.754685:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99dbd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.754699:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99dc4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x4d2290fc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.754706:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.754716:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.754886:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d000/0x7b044d4128f99dcb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.754895:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d000/0x7b044d4128f99dcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x48:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.754903:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d000/0x7b044d4128f99dcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x48:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938438.754937:0:24945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x48:0x0]: returning size 1179443 00000004:00200000:2.0:1784938438.754942:0:24945:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784938438.754962:0:24945:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d000/0x7b044d4128f99dcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x48:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.754975:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d000/0x7b044d4128f99dcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.754983:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99dbd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.754990:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99dbd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.754995:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99dbd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.755002:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42c600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938438.755006:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99dbd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.755014:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99dbd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.755026:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:2.0:1784938438.755029:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938438.755034:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99dbd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.755039:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99dbd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.755052:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.755058:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99dc4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.755064:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99dc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.755085:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42da00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938438.755089:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99dc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.755094:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99dc4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.755101:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x4d2290fc (ffff9f23861e3c00) 00010000:00010000:2.0:1784938438.755105:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938438.755108:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99dc4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.755118:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99dc4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.755184:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99db6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663402 expref: 24 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.755198:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d000/0x7b044d4128f99dcb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663402 expref: 23 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.755205:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x48:0x0].0x0 (ffff9f23861e3b00) 00010000:00010000:2.0:1784938438.755208:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938438.755210:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d42d000, rc 0) 00000100:00100000:2.0:1784938438.755263:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+23:17072:x1871643337336704:12345-192.168.202.54@tcp:101:rm.0 Request processed in 726us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938438.755272:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 144 00000100:00100000:2.0:1784938438.764821:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337336960 00000100:00100000:2.0:1784938438.764834:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337336960 00000100:00100000:2.0:1784938438.764903:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 145 00000100:00100000:2.0:1784938438.764914:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+23:17072:x1871643337336960:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:2.0:1784938438.764982:0:24202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938438.765007:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d000/0x7b044d4128f99dcb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663402 expref: 23 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.765026:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x48:0x0].0x0 (ffff9f23861e3b00) 00010000:00010000:2.0:1784938438.765037:0:24202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938438.765058:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99dd2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.765071:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99dd2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.765081:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99dd2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.765094:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42cc00/0x7b044d4128f99dd9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x4d2290fc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.765101:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42cc00/0x7b044d4128f99dd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.765108:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42cc00/0x7b044d4128f99dd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.765233:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99de0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.765241:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99de0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.765248:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99de0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784938438.765584:0:24202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 64 off8512 00010000:00010000:2.0:1784938438.765634:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c200/0x7b044d4128f99de7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.765644:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c200/0x7b044d4128f99de7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.765651:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c200/0x7b044d4128f99de7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.765658:0:24202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c200/0x7b044d4128f99de7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.765665:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c200/0x7b044d4128f99de7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.765671:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c200/0x7b044d4128f99de7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.765686:0:24202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938438.765707:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99de0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x48:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.765714:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99de0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x48:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.765720:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99de0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x48:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.765727:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42d200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938438.765731:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99de0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x48:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.765739:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99de0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x48:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.765748:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x48:0x0].0x0 (ffff9f23861e3100) 00010000:00010000:2.0:1784938438.765751:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784938438.765754:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99de0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x48:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.765764:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99de0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x48:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.765780:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99dd2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.765786:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99dd2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.765791:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99dd2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.765796:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42d400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938438.765798:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99dd2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.765803:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99dd2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.765809:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:2.0:1784938438.765811:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938438.765814:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99dd2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.765819:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99dd2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938438.765827:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e021a9f0 reply state 00000000f6673bf2 transno 8589934614 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42cc00/0x7b044d4128f99dd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.765836:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42cc00/0x7b044d4128f99dd9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.765843:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x4d2290fc (ffff9f23861e3500) 00010000:00010000:2.0:1784938438.765845:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938438.765848:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938438.765929:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+24:17072:x1871643337336960:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1017us (1197us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1784938438.765937:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 145 00000100:00100000:2.0:1784938438.774235:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337337088 00000100:00100000:2.0:1784938438.774245:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337337088 00000100:00100000:2.0:1784938438.774310:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 146 00000100:00100000:2.0:1784938438.774320:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+24:17072:x1871643337337088:12345-192.168.202.54@tcp:101:rm.0 00010000:00010000:2.0:1784938438.774349:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938438.774382:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d000/0x7b044d4128f99dee lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663409 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.774471:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99df5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.774487:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99df5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.774499:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99df5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.774556:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99dfc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xf0a46efb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.774564:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99dfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.774575:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99dfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.774726:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99e03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.774735:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99e03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.774742:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99e03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938438.774777:0:24945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x16:0x0]: returning size 2858 00000004:00200000:2.0:1784938438.774781:0:24945:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784938438.774803:0:24945:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99e03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.774819:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99e03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.774829:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99df5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.774837:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99df5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.774844:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99df5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.774850:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42d600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938438.774854:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99df5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.774862:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99df5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.774874:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:2.0:1784938438.774878:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938438.774883:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99df5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.774889:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99df5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.774904:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99dfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.774909:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99dfc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.774915:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99dfc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.774920:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42da00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938438.774922:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99dfc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.774928:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99dfc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.774935:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xf0a46efb (ffff9f23861e3b00) 00010000:00010000:2.0:1784938438.774938:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938438.774941:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99dfc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.774950:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99dfc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.774983:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d000/0x7b044d4128f99dee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663409 expref: 26 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.774998:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99e03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663409 expref: 25 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.775005:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff9f23861e3c00) 00010000:00010000:2.0:1784938438.775007:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938438.775009:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d42c600, rc 0) 00000100:00100000:2.0:1784938438.775085:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+25:17072:x1871643337337088:12345-192.168.202.54@tcp:101:rm.0 Request processed in 765us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938438.775093:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 146 00000100:00100000:3.0:1784938438.784706:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938438.784798:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337337344 00000100:00100000:2.0:1784938438.784810:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337337344 00000100:00100000:2.0:1784938438.784876:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 147 00000100:00100000:2.0:1784938438.784886:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387daf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+25:17072:x1871643337337344:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:2.0:1784938438.784942:0:24202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938438.784971:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99e03 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663409 expref: 25 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.784991:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff9f23861e3c00) 00010000:00010000:2.0:1784938438.785003:0:24202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938438.785025:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d000/0x7b044d4128f99e0a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.785041:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d000/0x7b044d4128f99e0a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.785051:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d000/0x7b044d4128f99e0a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.785079:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99e11 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0xf0a46efb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.785088:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99e11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.785096:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99e11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.785223:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99e18 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.785232:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99e18 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.785239:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99e18 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784938438.785700:0:24202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 64 off8576 00010000:00010000:2.0:1784938438.785758:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99e1f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.785769:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99e1f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.785778:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99e1f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.785785:0:24202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99e1f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.785792:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99e1f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.785799:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99e1f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.785824:0:24202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938438.785843:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99e18 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.785849:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99e18 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.785855:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99e18 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.785862:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42d600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938438.785866:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99e18 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.785874:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99e18 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.785885:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff9f23861e3100) 00010000:00010000:2.0:1784938438.785888:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784938438.785891:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99e18 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.785901:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99e18 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.785917:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d000/0x7b044d4128f99e0a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.785923:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d000/0x7b044d4128f99e0a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.785929:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d000/0x7b044d4128f99e0a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.785934:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42d000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938438.785937:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d000/0x7b044d4128f99e0a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.785942:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d000/0x7b044d4128f99e0a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.785950:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:2.0:1784938438.785953:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938438.785956:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d000/0x7b044d4128f99e0a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.785961:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d000/0x7b044d4128f99e0a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938438.785972:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000039e92f7e reply state 00000000c3d15bc6 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99e11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.785983:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99e11 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.785989:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xf0a46efb (ffff9f23861e3b00) 00010000:00010000:2.0:1784938438.785991:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938438.785994:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938438.786079:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387daf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+26:17072:x1871643337337344:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1192us (1380us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1784938438.786088:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 147 00010000:00010000:3.0:1784938438.786457:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938438.786465:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99e1f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.786472:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42d400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938438.786476:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99e1f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.786483:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99e1f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.786493:0:19223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff9f23861e3100) 00010000:00010000:3.0:1784938438.786496:0:19223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938438.786499:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99e1f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.786505:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99e1f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.786522:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938438.786523:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938438.786525:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938438.795204:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938438.795304:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337337472 00000100:00100000:2.0:1784938438.795316:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337337472 00000100:00100000:2.0:1784938438.795383:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 148 00000100:00100000:2.0:1784938438.795393:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+26:17072:x1871643337337472:12345-192.168.202.54@tcp:101:rm.0 00010000:00010000:2.0:1784938438.795422:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938438.795457:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d000/0x7b044d4128f99e26 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663410 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.795539:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99e2d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.795553:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99e2d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.795566:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99e2d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.795580:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99e34 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xf2ca543e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.795586:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99e34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.795596:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99e34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.795748:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99e3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.795757:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99e3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.795765:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99e3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938438.795800:0:24945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4a:0x0]: returning size 2475 00000004:00200000:2.0:1784938438.795804:0:24945:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784938438.795826:0:24945:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99e3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.795837:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99e3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.795845:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99e2d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.795852:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99e2d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.795858:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99e2d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.795864:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42d600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938438.795869:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99e2d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.795877:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99e2d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.795889:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:2.0:1784938438.795893:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938438.795897:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99e2d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.795902:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99e2d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.795916:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99e34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.795923:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99e34 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.795929:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99e34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.795934:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42c600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938438.795937:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99e34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.795942:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99e34 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.795950:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xf2ca543e (ffff9f23861e3c00) 00010000:00010000:2.0:1784938438.795952:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938438.795955:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99e34 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.795965:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99e34 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.795995:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d000/0x7b044d4128f99e26 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663410 expref: 28 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.796008:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99e3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663410 expref: 27 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.796015:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4a:0x0].0x0 (ffff9f23861e3e00) 00010000:00010000:2.0:1784938438.796017:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938438.796019:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d42d200, rc 0) 00000100:00100000:2.0:1784938438.796086:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+27:17072:x1871643337337472:12345-192.168.202.54@tcp:101:rm.0 Request processed in 694us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938438.796094:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 148 00000100:00100000:2.0:1784938438.801414:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337337728 00000100:00100000:2.0:1784938438.801431:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337337728 00000100:00100000:2.0:1784938438.801496:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 149 00000100:00100000:2.0:1784938438.801505:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+27:17072:x1871643337337728:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:2.0:1784938438.801564:0:24201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938438.801591:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99e3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663410 expref: 27 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.801612:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4a:0x0].0x0 (ffff9f23861e3e00) 00010000:00010000:2.0:1784938438.801627:0:24201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938438.801651:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d800/0x7b044d4128f99e42 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.801667:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d800/0x7b044d4128f99e42 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.801679:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d800/0x7b044d4128f99e42 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.801696:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99e49 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0xf2ca543e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.801704:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99e49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.801711:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99e49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.801795:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c200/0x7b044d4128f99e50 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.801804:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c200/0x7b044d4128f99e50 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.801811:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c200/0x7b044d4128f99e50 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784938438.802046:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].7, 64 off8640 00010000:00010000:2.0:1784938438.802092:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c400/0x7b044d4128f99e57 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.802102:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c400/0x7b044d4128f99e57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.802109:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c400/0x7b044d4128f99e57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.802117:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c400/0x7b044d4128f99e57 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.802123:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c400/0x7b044d4128f99e57 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.802129:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c400/0x7b044d4128f99e57 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.802191:0:24201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938438.802210:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c200/0x7b044d4128f99e50 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.802217:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c200/0x7b044d4128f99e50 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.802223:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c200/0x7b044d4128f99e50 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.802229:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42c200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938438.802233:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c200/0x7b044d4128f99e50 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.802241:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c200/0x7b044d4128f99e50 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.802251:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4a:0x0].0x0 (ffff9f2484afd100) 00010000:00010000:2.0:1784938438.802254:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784938438.802258:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c200/0x7b044d4128f99e50 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.802268:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c200/0x7b044d4128f99e50 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.802287:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d800/0x7b044d4128f99e42 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.802294:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d800/0x7b044d4128f99e42 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.802299:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d800/0x7b044d4128f99e42 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.802305:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d800/0x7b044d4128f99e42 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.802310:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42d800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938438.802313:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d800/0x7b044d4128f99e42 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.802319:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d800/0x7b044d4128f99e42 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.802325:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:2.0:1784938438.802328:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938438.802331:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d800/0x7b044d4128f99e42 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.802337:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d800/0x7b044d4128f99e42 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938438.802345:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e0220788 reply state 00000000b3ffbe3e transno 8589934616 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99e49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.802357:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99e49 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.802375:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xf2ca543e (ffff9f23861e3100) 00010000:00010000:2.0:1784938438.802377:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938438.802380:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938438.802444:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+28:17072:x1871643337337728:12345-192.168.202.54@tcp:36:rm.0 Request processed in 939us (1126us total) trans 8589934616 rc 0/0 00000100:00100000:2.0:1784938438.802452:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 149 00010000:00010000:3.0:1784938438.803140:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938438.803177:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c400/0x7b044d4128f99e57 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.803185:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42c400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938438.803189:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c400/0x7b044d4128f99e57 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.803219:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c400/0x7b044d4128f99e57 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.803230:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4a:0x0].0x0 (ffff9f2484afd100) 00010000:00010000:3.0:1784938438.803233:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938438.803237:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c400/0x7b044d4128f99e57 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.803243:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c400/0x7b044d4128f99e57 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.803261:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938438.803263:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938438.803265:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938438.806465:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938438.806601:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337337856 00000100:00100000:2.0:1784938438.806613:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337337856 00000100:00100000:2.0:1784938438.806684:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 150 00000100:00100000:2.0:1784938438.806695:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387daf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+28:17072:x1871643337337856:12345-192.168.202.54@tcp:101:rm.0 00010000:00010000:2.0:1784938438.806724:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938438.806749:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d000/0x7b044d4128f99e5e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663417 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.806851:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99e65 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.806867:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99e65 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.806879:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99e65 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.806894:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99e6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xaa0c2c16 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.806903:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99e6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.806909:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99e6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.807070:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f99e73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.807079:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f99e73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x44:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.807086:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f99e73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x44:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938438.807121:0:24945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x44:0x0]: returning size 254129 00000004:00200000:2.0:1784938438.807127:0:24945:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784938438.807193:0:24945:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f99e73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x44:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.807206:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f99e73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.807214:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99e65 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.807220:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99e65 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.807226:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99e65 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.807236:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42c600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938438.807240:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99e65 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.807247:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99e65 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.807258:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:2.0:1784938438.807261:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938438.807265:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99e65 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.807270:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c600/0x7b044d4128f99e65 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.807283:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99e6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.807289:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99e6c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.807294:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99e6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.807299:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42d600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938438.807302:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99e6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.807308:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99e6c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.807318:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xaa0c2c16 (ffff9f23861e3c00) 00010000:00010000:2.0:1784938438.807320:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938438.807323:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99e6c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.807329:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99e6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.807372:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d000/0x7b044d4128f99e5e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663417 expref: 30 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.807387:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f99e73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663417 expref: 29 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.807394:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x44:0x0].0x0 (ffff9f23861f8f00) 00010000:00010000:2.0:1784938438.807396:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938438.807399:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c559000, rc 0) 00000100:00100000:2.0:1784938438.807745:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387daf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+29:17072:x1871643337337856:12345-192.168.202.54@tcp:101:rm.0 Request processed in 1050us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938438.807754:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 150 00000100:00100000:2.0:1784938438.814778:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337338112 00000100:00100000:2.0:1784938438.814788:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337338112 00000100:00100000:2.0:1784938438.814840:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 151 00000100:00100000:2.0:1784938438.814848:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+29:17072:x1871643337338112:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:2.0:1784938438.814909:0:24201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938438.814950:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f99e73 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663417 expref: 29 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.814976:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x44:0x0].0x0 (ffff9f23861f8f00) 00010000:00010000:2.0:1784938438.814988:0:24201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938438.815010:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99e7a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.815024:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99e7a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.815033:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99e7a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.815048:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dc65800/0x7b044d4128f99e81 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0xaa0c2c16 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.815056:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dc65800/0x7b044d4128f99e81 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.815063:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dc65800/0x7b044d4128f99e81 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.815193:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a800/0x7b044d4128f99e88 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.815202:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a800/0x7b044d4128f99e88 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.815209:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a800/0x7b044d4128f99e88 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784938438.815639:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].8, 64 off8704 00010000:00010000:2.0:1784938438.815698:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61bc00/0x7b044d4128f99e8f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.815709:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61bc00/0x7b044d4128f99e8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.815717:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61bc00/0x7b044d4128f99e8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.815723:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61bc00/0x7b044d4128f99e8f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.815729:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61bc00/0x7b044d4128f99e8f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.815735:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61bc00/0x7b044d4128f99e8f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.815749:0:24201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938438.815769:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a800/0x7b044d4128f99e88 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.815776:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a800/0x7b044d4128f99e88 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.815782:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a800/0x7b044d4128f99e88 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.815789:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61a800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938438.815794:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a800/0x7b044d4128f99e88 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.815802:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a800/0x7b044d4128f99e88 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.815816:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x44:0x0].0x0 (ffff9f24b67c7300) 00010000:00010000:2.0:1784938438.815819:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784938438.815824:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a800/0x7b044d4128f99e88 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.815830:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a800/0x7b044d4128f99e88 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.815850:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99e7a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.815857:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99e7a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.815863:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99e7a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.815869:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99e7a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.815874:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42d200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938438.815877:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99e7a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.815882:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99e7a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.815889:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:2.0:1784938438.815891:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938438.815894:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99e7a lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.815904:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99e7a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938438.815916:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aaf1d79d reply state 000000008a69ff73 transno 8589934617 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dc65800/0x7b044d4128f99e81 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.815927:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dc65800/0x7b044d4128f99e81 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.815934:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xaa0c2c16 (ffff9f23861e3e00) 00010000:00010000:2.0:1784938438.815936:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938438.815938:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938438.816284:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+30:17072:x1871643337338112:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1433us (1591us total) trans 8589934617 rc 0/0 00000100:00100000:2.0:1784938438.816293:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 151 00000100:00100000:3.0:1784938438.831830:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938438.834194:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337338496 00000100:00100000:2.0:1784938438.834210:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337338496 00000100:00100000:2.0:1784938438.834334:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 153 00000100:00100000:2.0:1784938438.834346:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+31:17072:x1871643337338496:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:2.0:1784938438.834423:0:24201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938438.834463:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625e000/0x7b044d4128f99eab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766341e expref: 31 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.834484:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff9f2490bf2200) 00010000:00010000:2.0:1784938438.834499:0:24201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938438.834523:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a400/0x7b044d4128f99eb2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.834540:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a400/0x7b044d4128f99eb2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.834551:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a400/0x7b044d4128f99eb2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.834565:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b800/0x7b044d4128f99eb9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0xb34b709f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.834571:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b800/0x7b044d4128f99eb9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.834577:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b800/0x7b044d4128f99eb9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.834673:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b000/0x7b044d4128f99ec0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.834681:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b000/0x7b044d4128f99ec0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.834688:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b000/0x7b044d4128f99ec0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784938438.834953:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4, 64 off8448 00010000:00010000:2.0:1784938438.835007:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b600/0x7b044d4128f99ec7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.835017:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b600/0x7b044d4128f99ec7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.835025:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b600/0x7b044d4128f99ec7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.835033:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b600/0x7b044d4128f99ec7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.835040:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b600/0x7b044d4128f99ec7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.835046:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b600/0x7b044d4128f99ec7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.835072:0:24201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938438.835092:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b000/0x7b044d4128f99ec0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.835099:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b000/0x7b044d4128f99ec0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.835106:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b000/0x7b044d4128f99ec0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.835112:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61b000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938438.835117:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b000/0x7b044d4128f99ec0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.835125:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b000/0x7b044d4128f99ec0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.835134:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff9f24b67c7700) 00010000:00010000:2.0:1784938438.835137:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784938438.835141:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b000/0x7b044d4128f99ec0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.835179:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b000/0x7b044d4128f99ec0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.835198:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a400/0x7b044d4128f99eb2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.835204:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a400/0x7b044d4128f99eb2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.835209:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a400/0x7b044d4128f99eb2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.835215:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a400/0x7b044d4128f99eb2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.835220:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61a400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938438.835223:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a400/0x7b044d4128f99eb2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.835229:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a400/0x7b044d4128f99eb2 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.835237:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:2.0:1784938438.835239:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938438.835242:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a400/0x7b044d4128f99eb2 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.835247:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a400/0x7b044d4128f99eb2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938438.835257:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000d9de1bf reply state 0000000043f86471 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b800/0x7b044d4128f99eb9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.835268:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b800/0x7b044d4128f99eb9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.835274:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xb34b709f (ffff9f24b67c7900) 00010000:00010000:2.0:1784938438.835277:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938438.835279:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938438.835378:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+32:17072:x1871643337338496:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1032us (3558us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1784938438.835386:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 153 00010000:00010000:3.0:1784938438.835477:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938438.835485:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b600/0x7b044d4128f99ec7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.835493:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61b600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938438.835497:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b600/0x7b044d4128f99ec7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.835504:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b600/0x7b044d4128f99ec7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.835514:0:19223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff9f24b67c7700) 00010000:00010000:3.0:1784938438.835516:0:19223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938438.835519:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b600/0x7b044d4128f99ec7 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.835543:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b600/0x7b044d4128f99ec7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.835559:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938438.835561:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938438.835564:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938438.845956:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337338624 00000100:00100000:2.0:1784938438.845965:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337338624 00000100:00100000:2.0:1784938438.846027:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 154 00000100:00100000:2.0:1784938438.846037:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+32:17072:x1871643337338624:12345-192.168.202.54@tcp:101:rm.0 00010000:00010000:2.0:1784938438.846585:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938438.846610:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a800/0x7b044d4128f99ece lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663425 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.846690:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61bc00/0x7b044d4128f99ed5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.846704:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61bc00/0x7b044d4128f99ed5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.846715:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61bc00/0x7b044d4128f99ed5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.846730:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f99edc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x322afea2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.846741:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f99edc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.846748:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f99edc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.846902:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99ee3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.846911:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x43:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.846918:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x43:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938438.846965:0:24203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x43:0x0]: returning size 88087 00000004:00200000:2.0:1784938438.846970:0:24203:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784938438.846989:0:24203:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x43:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.847001:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.847009:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61bc00/0x7b044d4128f99ed5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.847016:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61bc00/0x7b044d4128f99ed5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.847022:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61bc00/0x7b044d4128f99ed5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.847031:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61bc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938438.847035:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61bc00/0x7b044d4128f99ed5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.847042:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61bc00/0x7b044d4128f99ed5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.847609:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:2.0:1784938438.847614:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938438.847623:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61bc00/0x7b044d4128f99ed5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.847629:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61bc00/0x7b044d4128f99ed5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.847644:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f99edc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.847651:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f99edc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.847657:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f99edc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.847662:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c559000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938438.847665:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f99edc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.847671:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f99edc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.847684:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x322afea2 (ffff9f24b67c7c00) 00010000:00010000:2.0:1784938438.847686:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938438.847689:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f99edc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.847695:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f99edc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.847729:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a800/0x7b044d4128f99ece lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663425 expref: 34 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.847743:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d200/0x7b044d4128f99ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663425 expref: 33 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.847750:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x43:0x0].0x0 (ffff9f24b67c7800) 00010000:00010000:2.0:1784938438.847752:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938438.847754:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d42d200, rc 0) 00000100:00100000:2.0:1784938438.847910:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+33:17072:x1871643337338624:12345-192.168.202.54@tcp:101:rm.0 Request processed in 1872us (2044us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938438.847918:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 154 00010000:00010000:3.0:1784938438.860737:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938438.860747:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f99eff lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.860755:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27c800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938438.860759:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f99eff lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.860766:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f99eff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.860779:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x43:0x0].0x0 (ffff9f24975b2200) 00010000:00010000:3.0:1784938438.860782:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938438.860786:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f99eff lrc: 1/0,0 mode: --/PW res: [0x200000402:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.860791:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f99eff lrc: 0/0,0 mode: --/PW res: [0x200000402:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.860806:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938438.860807:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938438.860809:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938438.874018:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938438.891270:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:3.0:1784938438.897289:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938438.897303:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f99f6f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.897314:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db7be00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938438.897319:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f99f6f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.897330:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f99f6f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.897352:0:19223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x47:0x0].0x0 (ffff9f24975b2600) 00010000:00010000:3.0:1784938438.897355:0:19223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938438.897372:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f99f6f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.897378:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f99f6f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938438.897669:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938438.897671:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938438.897673:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938438.899269:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938438.908677:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337339904 00000100:00100000:2.0:1784938438.908687:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337339904 00000100:00100000:2.0:1784938438.908749:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 161 00000100:00100000:2.0:1784938438.908760:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+39:17072:x1871643337339904:12345-192.168.202.54@tcp:101:rm.0 00010000:00010000:2.0:1784938438.908780:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938438.908802:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d000/0x7b044d4128f99f92 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663441 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.908845:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d000/0x7b044d4128f99f92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663441 expref: 40 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.908861:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d000/0x7b044d4128f99f92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663441 expref: 40 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.908872:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:2.0:1784938438.908876:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938438.908880:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d42d000, rc 0) 00000100:00100000:2.0:1784938438.908942:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+40:17072:x1871643337339904:12345-192.168.202.54@tcp:101:rm.0 Request processed in 184us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938438.908949:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 161 00000100:00100000:3.0:1784938438.912944:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938438.913461:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:3.0:1784938438.913476:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24857fb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+40:17072:x1871643337340032:12345-192.168.202.54@tcp:37:rm.0 00000100:00100000:2.0:1784938438.937945:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337340288 00000100:00100000:2.0:1784938438.937957:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337340288 00000100:00100000:2.0:1784938438.939332:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 162 00000100:00100000:2.0:1784938438.939349:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+42:17072:x1871643337340288:12345-192.168.202.54@tcp:101:rm.0 00010000:00010000:2.0:1784938438.939376:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938438.939393:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99fae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663448 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938438.939490:0:24945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x50:0x0]: returning size 4096 00010000:00010000:2.0:1784938438.939601:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99fae lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663448 expref: 44 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.939615:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:2.0:1784938438.939618:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784938438.939624:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d600/0x7b044d4128f99fae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663448 expref: 44 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.939639:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d42d600, rc 0) 00000100:00100000:2.0:1784938438.939705:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+43:17072:x1871643337340288:12345-192.168.202.54@tcp:101:rm.0 Request processed in 363us (2022us total) trans 8589934622 rc 301/301 00000100:00100000:2.0:1784938438.939713:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 162 00000100:00100000:3.0:1784938438.949223:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938438.970725:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938438.970776:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938438.974111:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938438.977919:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938438.977979:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938438.978029:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938438.978058:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938438.978090:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938438.978122:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938438.978455:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337341184 00000100:00100000:2.0:1784938438.978469:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337341184 00000100:00100000:2.0:1784938438.978544:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337341568 00000100:00100000:2.0:1784938438.978547:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337341568 00000100:00100000:2.0:1784938438.978568:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337340928 00000100:00100000:2.0:1784938438.978570:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337340928 00000100:00100000:2.0:1784938438.978579:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337341312 00000100:00100000:2.0:1784938438.978582:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337341312 00000100:00100000:2.0:1784938438.978598:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 437 00000100:00100000:2.0:1784938438.978610:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+43:10958:x1871643337341184:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:2.0:1784938438.978636:0:25716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938438.978668:0:25716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8fceeb1/0x7b044d4128f9a095 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476634a3 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938438.978703:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 4915, mtime: 0x6a63ff72, atime: 0x0, ctime: 0x6a63ff72, blocks: 0x10 00010000:00010000:2.0:1784938438.978733:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=705s v=(0 0) 00010000:00010000:2.0:1784938438.978738:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938438.978749:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8fceeb1/0x7b044d4128f9a095 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476634a3 expref: 44 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.978773:0:25716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d8fceeb1/0x7b044d4128f9a095 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476634a3 expref: 44 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.978791:0:25716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d42d600, rc 0) 00000100:00100000:2.0:1784938438.978868:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+44:10958:x1871643337341184:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 259us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938438.978877:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 437 00000100:00100000:2.0:1784938438.978917:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 438 00000100:00100000:2.0:1784938438.978938:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+43:10958:x1871643337341568:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:2.0:1784938438.978947:0:25716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938438.978960:0:25716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031260482/0x7b044d4128f9a09c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476634b8 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938438.978978:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 35427, mtime: 0x6a63ff73, atime: 0x0, ctime: 0x6a63ff73, blocks: 0x48 00010000:00010000:2.0:1784938438.978990:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=705s v=(0 0) 00010000:00010000:2.0:1784938438.978993:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938438.978999:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031260482/0x7b044d4128f9a09c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476634b8 expref: 44 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.979012:0:25716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000031260482/0x7b044d4128f9a09c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476634b8 expref: 44 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.979034:0:25716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d42c600, rc 0) 00000100:00100000:2.0:1784938438.979058:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+44:10958:x1871643337341568:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 134us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938438.979065:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 438 00000100:00100000:2.0:1784938438.979080:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 439 00000100:00100000:2.0:1784938438.979087:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+43:10960:x1871643337340928:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:2.0:1784938438.979094:0:25716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938438.979105:0:25716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce6ccfc3/0x7b044d4128f9a0a3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663495 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938438.979118:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 2129, mtime: 0x6a63ff73, atime: 0x0, ctime: 0x6a63ff73, blocks: 0x8 00010000:00010000:2.0:1784938438.979139:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=705s v=(0 0) 00010000:00010000:2.0:1784938438.979182:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938438.979189:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce6ccfc3/0x7b044d4128f9a0a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663495 expref: 44 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.979200:0:25716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ce6ccfc3/0x7b044d4128f9a0a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663495 expref: 44 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.979210:0:25716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d42c400, rc 0) 00000100:00100000:2.0:1784938438.979230:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+44:10960:x1871643337340928:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 144us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938438.979236:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 439 00000100:00100000:2.0:1784938438.979249:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 440 00000100:00100000:2.0:1784938438.979257:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+43:10959:x1871643337341312:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:2.0:1784938438.979264:0:25716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938438.979273:0:25716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d7ba9d5/0x7b044d4128f9a0aa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476634aa expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938438.979292:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 31711, mtime: 0x6a63ff73, atime: 0x0, ctime: 0x6a63ff73, blocks: 0x40 00010000:00010000:2.0:1784938438.979302:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=705s v=(0 0) 00010000:00010000:2.0:1784938438.979305:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938438.979310:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d7ba9d5/0x7b044d4128f9a0aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476634aa expref: 44 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.979322:0:25716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003d7ba9d5/0x7b044d4128f9a0aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476634aa expref: 44 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.979331:0:25716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d42d800, rc 0) 00000100:00100000:2.0:1784938438.979351:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+44:10959:x1871643337341312:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 95us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938438.979358:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 440 00000100:00100000:2.0:1784938438.982389:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 442 00000100:00100000:2.0:1784938438.982405:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+45:10958:x1871643337341056:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:2.0:1784938438.982430:0:25715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938438.982460:0:25715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006839d5f0/0x7b044d4128f9a0b8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766349c expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938438.982496:0:25715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 24288, mtime: 0x6a63ff74, atime: 0x0, ctime: 0x6a63ff74, blocks: 0x30 00010000:00010000:2.0:1784938438.982529:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=705s v=(0 0) 00010000:00010000:2.0:1784938438.982534:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938438.982545:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006839d5f0/0x7b044d4128f9a0b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766349c expref: 46 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.982571:0:25715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006839d5f0/0x7b044d4128f9a0b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766349c expref: 46 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.982587:0:25715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c95d600, rc 0) 00000100:00100000:2.0:1784938438.982647:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+46:10958:x1871643337341056:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 246us (8549us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938438.982655:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 442 00000100:00100000:3.0:1784938438.991242:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938438.991345:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337342080 00000100:00100000:2.0:1784938438.991367:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337342080 00000100:00100000:2.0:1784938438.991441:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 163 00000100:00100000:2.0:1784938438.991452:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+50:17072:x1871643337342080:12345-192.168.202.54@tcp:101:rm.0 00010000:00010000:2.0:1784938438.991486:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938438.991517:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95cc00/0x7b044d4128f9a0bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476634bf expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.991665:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d800/0x7b044d4128f9a0c6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x50:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.991683:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d800/0x7b044d4128f9a0c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x50:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.991695:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d800/0x7b044d4128f9a0c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x50:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938438.991709:0:24201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x50:0x0]: returning size 4096 00010000:00010000:2.0:1784938438.991888:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95cc00/0x7b044d4128f9a0bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476634bf expref: 53 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.991914:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d800/0x7b044d4128f9a0c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x50:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476634bf expref: 52 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938438.992010:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x50:0x0].0x0 (ffff9f2490bf2b00) 00010000:00010000:2.0:1784938438.992014:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784938438.992019:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c95d800, rc 0) 00000100:00100000:2.0:1784938438.992355:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+52:17072:x1871643337342080:12345-192.168.202.54@tcp:101:rm.0 Request processed in 902us (1125us total) trans 8589934624 rc 0/0 00000100:00100000:2.0:1784938438.992373:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 163 00000100:00100000:2.0:1784938438.997194:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938439.008039:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:3.0:1784938439.009732:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938439.009754:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9a105 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.009768:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5db200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938439.009776:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9a105 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.009811:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9a105 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.009850:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x52:0x0].0x0 (ffff9f238dbbf000) 00010000:00010000:3.0:1784938439.009859:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938439.009868:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9a105 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.009878:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9a105 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938439.018581:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938439.026730:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938439.036904:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337342976 00000100:00100000:3.0:1784938439.036929:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337342976 00000100:00100000:3.0:1784938439.037013:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 168 00000100:00100000:3.0:1784938439.037027:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+55:17072:x1871643337342976:12345-192.168.202.54@tcp:101:rm.0 00010000:00010000:3.0:1784938439.037106:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938439.037179:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f9a144 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476634d4 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.037269:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057600/0x7b044d4128f9a14b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.037286:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057600/0x7b044d4128f9a14b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.037300:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057600/0x7b044d4128f9a14b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.037323:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f9a152 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x7026f06f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.037330:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f9a152 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7026f06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.037337:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f9a152 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7026f06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.037456:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9a159 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x50:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.037465:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9a159 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x50:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.037472:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9a159 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x50:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938439.037526:0:24203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x50:0x0]: returning size 4096 00000004:00200000:3.0:1784938439.037536:0:24203:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784938439.037566:0:24203:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9a159 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x50:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.037583:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057600/0x7b044d4128f9a14b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.037592:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057600/0x7b044d4128f9a14b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.037601:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057600/0x7b044d4128f9a14b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.037610:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938439.037617:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057600/0x7b044d4128f9a14b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.037627:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057600/0x7b044d4128f9a14b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.037644:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:3.0:1784938439.037647:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938439.037653:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057600/0x7b044d4128f9a14b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.037660:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057600/0x7b044d4128f9a14b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.037674:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f9a152 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7026f06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.037681:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f9a152 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7026f06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.037698:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f9a152 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7026f06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.037704:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938439.037707:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f9a152 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7026f06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.037713:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f9a152 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7026f06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.037722:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x7026f06f (ffff9f23861e4d00) 00010000:00010000:3.0:1784938439.037724:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938439.037727:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f9a152 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x7026f06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.037734:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057200/0x7b044d4128f9a152 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x7026f06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.037771:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f9a144 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476634d4 expref: 57 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.037787:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9a159 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x50:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476634d4 expref: 56 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.037795:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x50:0x0].0x0 (ffff9f2490bf2b00) 00010000:00010000:3.0:1784938439.037797:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784938439.037800:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b4057e00, rc 0) 00000100:00100000:3.0:1784938439.038613:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+56:17072:x1871643337342976:12345-192.168.202.54@tcp:101:rm.0 Request processed in 1582us (1812us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938439.038640:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 168 00000100:00100000:3.0:1784938439.043784:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938439.051816:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938439.066479:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938439.066528:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:3.0:1784938439.067886:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938439.067913:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625fc00/0x7b044d4128f9a18a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.068010:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c625fc00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938439.068022:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625fc00/0x7b044d4128f9a18a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.068063:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625fc00/0x7b044d4128f9a18a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.068103:0:19223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9f2490bf2200) 00010000:00010000:3.0:1784938439.068888:0:19223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938439.068895:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625fc00/0x7b044d4128f9a18a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.068903:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625fc00/0x7b044d4128f9a18a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.068999:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.069001:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.069003:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938439.071819:0:21160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7bc00/0x7b044d4128f9a232 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.071829:0:21160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9a224 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.071835:0:21160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9a224 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.071840:0:21160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9a224 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.071844:0:21160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27c800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.071847:0:21160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9a224 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.071852:0:21160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9a224 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.071862:0:21160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.071865:0:21160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.071869:0:21160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9a224 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.071875:0:21160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9a224 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.071885:0:21160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ce00/0x7b044d4128f9a22b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.071891:0:21160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ce00/0x7b044d4128f9a22b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.071896:0:21160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ce00/0x7b044d4128f9a22b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.071901:0:21160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27ce00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.071904:0:21160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ce00/0x7b044d4128f9a22b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.071909:0:21160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ce00/0x7b044d4128f9a22b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.071916:0:21160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xbf580d0c (ffff9f248fb6ae00) 00010000:00010000:1.0:1784938439.071918:0:21160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.071920:0:21160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ce00/0x7b044d4128f9a22b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.071925:0:21160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ce00/0x7b044d4128f9a22b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.071945:0:21160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8ae00/0x7b044d4128f9a21d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476634fe expref: 65 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.071955:0:21160:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7bc00/0x7b044d4128f9a232 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476634fe expref: 64 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.071962:0:21160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0x0 (ffff9f248fb6a500) 00010000:00010000:1.0:1784938439.071964:0:21160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938439.071966:0:21160:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238db7bc00, rc 0) 00010000:00010000:1.0:1784938439.071970:0:21160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.071977:0:21160:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9a239 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663505 expref: -99 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.071997:0:21160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ac00/0x7b044d4128f9a240 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.072006:0:21160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ac00/0x7b044d4128f9a240 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.072013:0:21160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ac00/0x7b044d4128f9a240 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.072023:0:21160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ae00/0x7b044d4128f9a247 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x868dff87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.072030:0:21160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ae00/0x7b044d4128f9a247 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.072035:0:21160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ae00/0x7b044d4128f9a247 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.072110:0:21160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34c00/0x7b044d4128f9a24e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.072119:0:21160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34c00/0x7b044d4128f9a24e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.072127:0:21160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34c00/0x7b044d4128f9a24e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938439.072192:0:21160:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1d:0x0]: returning size 6813 00000004:00200000:1.0:1784938439.072197:0:21160:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938439.072208:0:21160:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34c00/0x7b044d4128f9a24e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.072216:0:21160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34c00/0x7b044d4128f9a24e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.072226:0:21160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ac00/0x7b044d4128f9a240 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.072232:0:21160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ac00/0x7b044d4128f9a240 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.072237:0:21160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ac00/0x7b044d4128f9a240 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.072242:0:21160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db7ac00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.072245:0:21160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ac00/0x7b044d4128f9a240 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.072250:0:21160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ac00/0x7b044d4128f9a240 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.072260:0:21160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.072263:0:21160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.072266:0:21160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ac00/0x7b044d4128f9a240 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.072271:0:21160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ac00/0x7b044d4128f9a240 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.072282:0:21160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ae00/0x7b044d4128f9a247 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.072289:0:21160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ae00/0x7b044d4128f9a247 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.072294:0:21160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ae00/0x7b044d4128f9a247 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.072300:0:21160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db7ae00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.072304:0:21160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ae00/0x7b044d4128f9a247 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.072311:0:21160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ae00/0x7b044d4128f9a247 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.072318:0:21160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x868dff87 (ffff9f248fb6a100) 00010000:00010000:1.0:1784938439.072320:0:21160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.072323:0:21160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ae00/0x7b044d4128f9a247 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.072329:0:21160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ae00/0x7b044d4128f9a247 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.072356:0:21160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9a239 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663505 expref: 66 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938439.072471:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938439.072590:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337344128 00000100:00100000:2.0:1784938439.072605:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337344128 00000100:00100000:2.0:1784938439.072689:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 171 00000100:00100000:2.0:1784938439.072702:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+67:17072:x1871643337344128:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:2.0:1784938439.072771:0:24201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938439.072803:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8aa00/0x7b044d4128f99fd8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663456 expref: 67 pid: 21161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.072825:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9f24975b2a00) 00010000:00010000:2.0:1784938439.072842:0:24201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938439.072868:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95de00/0x7b044d4128f9a255 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.072890:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95de00/0x7b044d4128f9a255 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.072902:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95de00/0x7b044d4128f9a255 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.072921:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c000/0x7b044d4128f9a25c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x9e90f16b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.072940:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c000/0x7b044d4128f9a25c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.072946:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c000/0x7b044d4128f9a25c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.073043:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d200/0x7b044d4128f9a263 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.073050:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d200/0x7b044d4128f9a263 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.073057:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d200/0x7b044d4128f9a263 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784938439.073437:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].9, 64 off8768 00010000:00010000:2.0:1784938439.073513:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95ca00/0x7b044d4128f9a26a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.073524:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95ca00/0x7b044d4128f9a26a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.073532:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95ca00/0x7b044d4128f9a26a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.073541:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95ca00/0x7b044d4128f9a26a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.073547:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95ca00/0x7b044d4128f9a26a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.073554:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95ca00/0x7b044d4128f9a26a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.073584:0:24201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938439.073608:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d200/0x7b044d4128f9a263 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.073613:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d200/0x7b044d4128f9a263 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.073620:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d200/0x7b044d4128f9a263 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.073626:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c95d200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938439.073630:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d200/0x7b044d4128f9a263 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.073638:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d200/0x7b044d4128f9a263 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.073647:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9f24b67c7200) 00010000:00010000:2.0:1784938439.073650:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784938439.073654:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d200/0x7b044d4128f9a263 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.073665:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d200/0x7b044d4128f9a263 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.073683:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95de00/0x7b044d4128f9a255 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.073690:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95de00/0x7b044d4128f9a255 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.073695:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95de00/0x7b044d4128f9a255 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.073701:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95de00/0x7b044d4128f9a255 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.073707:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c95de00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938439.073709:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95de00/0x7b044d4128f9a255 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.073714:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95de00/0x7b044d4128f9a255 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.073722:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:2.0:1784938439.073724:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938439.073727:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95de00/0x7b044d4128f9a255 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.073733:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95de00/0x7b044d4128f9a255 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938439.073742:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e21c8a17 reply state 00000000ae4a0c9a transno 8589934630 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c000/0x7b044d4128f9a25c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.075495:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c000/0x7b044d4128f9a25c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.075504:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x9e90f16b (ffff9f24b67c7e00) 00010000:00010000:2.0:1784938439.075508:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938439.075514:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938439.075693:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+67:17072:x1871643337344128:12345-192.168.202.54@tcp:36:rm.0 Request processed in 2985us (3222us total) trans 8589934630 rc 0/0 00000100:00100000:2.0:1784938439.075705:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 171 00000100:00100000:2.0:1784938439.077836:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:1.0:1784938439.082750:0:21160:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34c00/0x7b044d4128f9a24e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663505 expref: 67 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.082761:0:21160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff9f248fb6aa00) 00010000:00010000:1.0:1784938439.082765:0:21160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938439.082768:0:21160:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b34c00, rc 0) 00010000:00010000:1.0:1784938439.082779:0:21160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1784938439.087876:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938439.087941:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938439.087995:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337344512 00000100:00100000:3.0:1784938439.088017:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337344512 00000100:00100000:3.0:1784938439.088122:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 172 00000100:00100000:3.0:1784938439.088183:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+70:17072:x1871643337344512:12345-192.168.202.54@tcp:36:rm.0 00000100:00100000:1.0:1784938439.088204:0:25714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337344640 00000100:00100000:1.0:1784938439.088215:0:25714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337344640 00010000:00010000:3.0:1784938439.088256:0:24203:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938439.088290:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8b200/0x7b044d4128f99ff4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766345d expref: 71 pid: 21161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.088312:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff9f238dbbf500) 00010000:00010000:3.0:1784938439.088333:0:24203:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938439.088354:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f9a2b7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.088378:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f9a2b7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.088389:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f9a2b7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.088407:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057600/0x7b044d4128f9a2be lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x2fbacb41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.088415:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057600/0x7b044d4128f9a2be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.088423:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057600/0x7b044d4128f9a2be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.088546:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9a2c5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.088558:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9a2c5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938439.088571:0:25714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 58 00010000:00010000:3.0:1784938439.088591:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9a2c5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938439.088593:0:25714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:7ea6e988-18ba-4c98-b179-17995571b98b+70:10960:x1871643337344640:12345-192.168.202.54@tcp:63:ll_sa.0 00000040:00080000:1.0:1784938439.089698:0:24203:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].10, 64 off8832 00010000:00010000:1.0:1784938439.089764:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9a2da lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.089775:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9a2da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.089783:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9a2da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.089790:0:24203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9a2da lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.089797:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9a2da lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.089803:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9a2da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.089828:0:24203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938439.089852:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9a2c5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.089857:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9a2c5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.089864:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9a2c5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.089871:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.089877:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9a2c5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.089890:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9a2c5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.089905:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff9f23861e4700) 00010000:00010000:1.0:1784938439.089909:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784938439.089915:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9a2c5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.089922:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9a2c5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.089946:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f9a2b7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.089952:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f9a2b7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.089958:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f9a2b7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.089963:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4056600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.089966:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f9a2b7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.089971:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f9a2b7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.089977:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.089980:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.089983:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f9a2b7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.089993:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f9a2b7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938439.090002:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000054b98fc9 reply state 000000009d5f3c67 transno 8589934631 ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057600/0x7b044d4128f9a2be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.090013:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057600/0x7b044d4128f9a2be lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.090019:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x2fbacb41 (ffff9f23861e4d00) 00010000:00010000:1.0:1784938439.090022:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938439.090025:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938439.092814:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+75:17072:x1871643337344512:12345-192.168.202.54@tcp:36:rm.0 Request processed in 4660us (4861us total) trans 8589934631 rc 0/0 00000100:00100000:1.0:1784938439.092830:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 172 00010000:00010000:3.0:1784938439.096065:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938439.096084:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9a2da lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.096097:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b34200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938439.096101:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9a2da lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.096460:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9a2da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.096484:0:19222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff9f23861e4700) 00010000:00010000:3.0:1784938439.096487:0:19222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938439.096493:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9a2da lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.096499:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9a2da lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.096530:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.096532:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.096535:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938439.105862:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938439.106093:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938439.106341:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938439.106390:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938439.106423:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938439.106456:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938439.106492:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938439.106515:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938439.106562:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938439.106604:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337345024 00000100:00100000:1.0:1784938439.106618:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337345024 00000100:00100000:1.0:1784938439.106690:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337345152 00000100:00100000:1.0:1784938439.106697:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337345152 00000100:00100000:1.0:1784938439.106722:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337345536 00000100:00100000:1.0:1784938439.106727:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337345536 00000100:00100000:1.0:1784938439.106746:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337345664 00000100:00100000:1.0:1784938439.106753:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337345664 00000100:00100000:1.0:1784938439.106779:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337344896 00000100:00100000:1.0:1784938439.106784:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337344896 00000100:00100000:1.0:1784938439.106798:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337345408 00000100:00100000:1.0:1784938439.106803:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337345408 00000100:00100000:1.0:1784938439.106817:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337344768 00000100:00100000:1.0:1784938439.106821:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337344768 00000100:00100000:1.0:1784938439.106833:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337345280 00000100:00100000:1.0:1784938439.106838:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337345280 00000100:00100000:1.0:1784938439.106855:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337345792 00000100:00100000:1.0:1784938439.106859:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337345792 00000100:00100000:1.0:1784938439.106888:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 443 00000100:00100000:1.0:1784938439.106902:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+50:10959:x1871643337345024:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:1.0:1784938439.109879:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.109984:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000018dca04/0x7b044d4128f9a3f9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766366a expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938439.110026:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 903, mtime: 0x6a63ff71, atime: 0x0, ctime: 0x6a63ff71, blocks: 0x8 00010000:00010000:1.0:1784938439.110238:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=705s v=(0 0) 00010000:00010000:1.0:1784938439.110245:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938439.110262:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000018dca04/0x7b044d4128f9a3f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766366a expref: 51 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.110284:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000018dca04/0x7b044d4128f9a3f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766366a expref: 51 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.110300:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b34400, rc 0) 00000100:00100000:1.0:1784938439.110399:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+51:10959:x1871643337345024:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 3498us (4544us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938439.110409:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 443 00000100:00100000:1.0:1784938439.110463:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 444 00000100:00100000:1.0:1784938439.110478:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+47:10960:x1871643337345152:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:1.0:1784938439.110494:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.110507:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f74bf49c/0x7b044d4128f9a400 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663671 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938439.110524:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 1654, mtime: 0x6a63ff73, atime: 0x0, ctime: 0x6a63ff73, blocks: 0x8 00010000:00010000:1.0:1784938439.110535:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=705s v=(0 0) 00010000:00010000:1.0:1784938439.110539:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938439.110544:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f74bf49c/0x7b044d4128f9a400 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663671 expref: 48 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.110555:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f74bf49c/0x7b044d4128f9a400 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663671 expref: 48 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.110564:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b35a00, rc 0) 00000100:00100000:1.0:1784938439.110589:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+48:10960:x1871643337345152:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 117us (4505us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938439.110595:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 444 00000100:00100000:1.0:1784938439.110609:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 445 00000100:00100000:1.0:1784938439.110616:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+50:10959:x1871643337345536:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:1.0:1784938439.110626:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.110638:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006336c443/0x7b044d4128f9a407 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663686 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938439.110652:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 6813, mtime: 0x6a63ff72, atime: 0x0, ctime: 0x6a63ff72, blocks: 0x10 00010000:00010000:1.0:1784938439.110665:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=705s v=(0 0) 00010000:00010000:1.0:1784938439.110668:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938439.110674:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006336c443/0x7b044d4128f9a407 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663686 expref: 51 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.110685:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006336c443/0x7b044d4128f9a407 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663686 expref: 51 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.110694:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b34800, rc 0) 00000100:00100000:1.0:1784938439.110715:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+51:10959:x1871643337345536:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 101us (4379us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938439.110721:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 445 00000100:00100000:1.0:1784938439.110736:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 446 00000100:00100000:1.0:1784938439.110744:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+47:10960:x1871643337345664:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:1.0:1784938439.110752:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.110763:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016494a26/0x7b044d4128f9a40e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766368d expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938439.110776:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 3079, mtime: 0x6a63ff72, atime: 0x0, ctime: 0x6a63ff72, blocks: 0x8 00010000:00010000:1.0:1784938439.110785:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=705s v=(0 0) 00010000:00010000:1.0:1784938439.110788:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938439.110793:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016494a26/0x7b044d4128f9a40e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766368d expref: 48 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.110804:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000016494a26/0x7b044d4128f9a40e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766368d expref: 48 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.110813:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b35600, rc 0) 00000100:00100000:1.0:1784938439.110837:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+48:10960:x1871643337345664:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 94us (4454us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938439.110843:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 446 00000100:00100000:1.0:1784938439.110857:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 447 00000100:00100000:1.0:1784938439.110864:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+47:10958:x1871643337344896:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:1.0:1784938439.110871:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.110882:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077eceeb9/0x7b044d4128f9a415 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663663 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938439.110895:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 9198, mtime: 0x6a63ff72, atime: 0x0, ctime: 0x6a63ff72, blocks: 0x18 00010000:00010000:1.0:1784938439.110904:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=705s v=(0 0) 00010000:00010000:1.0:1784938439.110907:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938439.110913:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077eceeb9/0x7b044d4128f9a415 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663663 expref: 48 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938439.111330:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 448 00000100:00100000:2.0:1784938439.111372:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23880a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+50:10958:x1871643337345408:12345-192.168.202.54@tcp:101:ll_agl.0 00000100:00100000:3.0:1784938439.111502:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 449 00000100:00100000:3.0:1784938439.111519:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d3aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+50:10958:x1871643337344768:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:3.0:1784938439.111531:0:21152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938439.111550:0:21152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005979dcbb/0x7b044d4128f9a41c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766365c expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938439.111595:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 5105, mtime: 0x6a63ff74, atime: 0x0, ctime: 0x6a63ff74, blocks: 0x10 00010000:00010000:3.0:1784938439.111610:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=705s v=(0 0) 00010000:00010000:3.0:1784938439.111613:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938439.111619:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005979dcbb/0x7b044d4128f9a41c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766365c expref: 51 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.111633:0:21152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005979dcbb/0x7b044d4128f9a41c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766365c expref: 51 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.111644:0:21152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c559000, rc 0) 00000100:00100000:3.0:1784938439.111678:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d3aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+51:10958:x1871643337344768:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 164us (5185us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938439.111685:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 449 00000100:00100000:3.0:1784938439.111703:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 450 00000100:00100000:3.0:1784938439.111710:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d3ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+48:10958:x1871643337345280:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:3.0:1784938439.111718:0:21152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938439.111729:0:21152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b01e28b4/0x7b044d4128f9a423 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663678 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938439.111743:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 429670, mtime: 0x6a63ff74, atime: 0x0, ctime: 0x6a63ff74, blocks: 0x348 00010000:00010000:3.0:1784938439.111754:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=705s v=(0 0) 00010000:00010000:3.0:1784938439.111757:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938439.111762:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b01e28b4/0x7b044d4128f9a423 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663678 expref: 49 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.111787:0:21152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b01e28b4/0x7b044d4128f9a423 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663678 expref: 49 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.111796:0:21152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b4057200, rc 0) 00000100:00100000:3.0:1784938439.111816:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d3ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+49:10958:x1871643337345280:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 107us (5300us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938439.111822:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 450 00000100:00100000:3.0:1784938439.111836:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 451 00000100:00100000:3.0:1784938439.111842:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+50:10958:x1871643337345792:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:3.0:1784938439.111849:0:21152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938439.111861:0:21152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000134d7650/0x7b044d4128f9a42a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663694 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938439.111875:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 37842, mtime: 0x6a63ff73, atime: 0x0, ctime: 0x6a63ff73, blocks: 0x50 00010000:00010000:3.0:1784938439.111885:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=705s v=(0 0) 00010000:00010000:3.0:1784938439.111887:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938439.111893:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000134d7650/0x7b044d4128f9a42a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663694 expref: 51 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.111902:0:21152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000134d7650/0x7b044d4128f9a42a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663694 expref: 51 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.111910:0:21152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d42d000, rc 0) 00010000:00010000:1.0:1784938439.112027:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000077eceeb9/0x7b044d4128f9a415 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663663 expref: 48 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.112039:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b35200, rc 0) 00000100:00100000:1.0:1784938439.112279:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+48:10958:x1871643337344896:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 1414us (5854us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938439.112287:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 447 00000100:00080000:1.0:1784938439.112319:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784938439.112326:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784938439.112403:0:25714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.112422:0:25714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9a431 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663591 expref: -99 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.112496:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9a438 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.112513:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9a438 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.112527:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9a438 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.112543:0:21149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.112544:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9a43f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xf4c8ca43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.112558:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9a43f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.112566:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9a43f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.112587:0:21149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038d84e22/0x7b044d4128f9a446 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766367f expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938439.112621:0:21149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 6548, mtime: 0x6a63ff73, atime: 0x0, ctime: 0x6a63ff73, blocks: 0x10 00010000:00010000:2.0:1784938439.112649:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=705s v=(0 0) 00010000:00010000:2.0:1784938439.112653:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938439.112666:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038d84e22/0x7b044d4128f9a446 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766367f expref: 52 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.112686:0:21149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000038d84e22/0x7b044d4128f9a446 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766367f expref: 52 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.112708:0:21149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c95de00, rc 0) 00000100:00100000:2.0:1784938439.112781:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23880a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+52:10958:x1871643337345408:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 1434us (6322us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938439.112790:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 448 00010000:00010000:1.0:1784938439.112808:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9a44d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.112819:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9a44d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.112832:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9a44d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938439.112866:0:25714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1a:0x0]: returning size 2192 00000004:00200000:1.0:1784938439.112871:0:25714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938439.112897:0:25714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9a44d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.112911:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9a44d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938439.113066:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+51:10958:x1871643337345792:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 1221us (6504us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938439.113073:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 451 00010000:00010000:1.0:1784938439.113564:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9a438 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.113574:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9a438 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.113581:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9a438 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.113587:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b34000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.113592:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9a438 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.113600:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9a438 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.113615:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.113618:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.113623:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9a438 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.113635:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9a438 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.113657:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9a43f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.113663:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9a43f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.113669:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9a43f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.113675:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.113679:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9a43f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.113685:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9a43f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.113694:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xf4c8ca43 (ffff9f24975b2000) 00010000:00010000:1.0:1784938439.113696:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.113699:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9a43f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.113705:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9a43f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.113745:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9a431 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663591 expref: 84 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.113763:0:25714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9a44d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663591 expref: 83 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.113770:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff9f24975b2600) 00010000:00010000:1.0:1784938439.113772:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938439.113774:0:25714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b34a00, rc 0) 00010000:00010000:1.0:1784938439.113781:0:25714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.113792:0:25714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34600/0x7b044d4128f9a454 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663598 expref: -99 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.113829:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34e00/0x7b044d4128f9a45b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.113839:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34e00/0x7b044d4128f9a45b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.113847:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34e00/0x7b044d4128f9a45b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.113883:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35e00/0x7b044d4128f9a462 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xe7eb4718 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.113892:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35e00/0x7b044d4128f9a462 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.113899:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35e00/0x7b044d4128f9a462 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.114399:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9a469 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.114411:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9a469 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.114418:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9a469 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938439.114443:0:25714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 674 00000004:00200000:1.0:1784938439.114447:0:25714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938439.114469:0:25714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9a469 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.114478:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9a469 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.114486:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34e00/0x7b044d4128f9a45b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.114491:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34e00/0x7b044d4128f9a45b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.114497:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34e00/0x7b044d4128f9a45b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.114503:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b34e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.114506:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34e00/0x7b044d4128f9a45b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.114512:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34e00/0x7b044d4128f9a45b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.114520:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.114524:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.114527:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34e00/0x7b044d4128f9a45b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.114532:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34e00/0x7b044d4128f9a45b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.114543:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35e00/0x7b044d4128f9a462 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.114549:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35e00/0x7b044d4128f9a462 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.114555:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35e00/0x7b044d4128f9a462 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.114561:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.114564:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35e00/0x7b044d4128f9a462 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.114570:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35e00/0x7b044d4128f9a462 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.114580:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xe7eb4718 (ffff9f248fb6bf00) 00010000:00010000:1.0:1784938439.114583:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.114586:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35e00/0x7b044d4128f9a462 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.114592:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35e00/0x7b044d4128f9a462 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.114625:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34600/0x7b044d4128f9a454 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663598 expref: 85 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.114651:0:25714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9a469 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663598 expref: 84 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.114664:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f248fb6b700) 00010000:00010000:1.0:1784938439.114668:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938439.114671:0:25714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b35800, rc 0) 00010000:00010000:1.0:1784938439.114678:0:25714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.114691:0:25714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35c00/0x7b044d4128f9a477 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766359f expref: -99 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.114736:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ce00/0x7b044d4128f9a47e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.114746:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ce00/0x7b044d4128f9a47e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.114756:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ce00/0x7b044d4128f9a47e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.114773:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9a48c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x49aa722d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.114784:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9a48c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.114815:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9a48c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.114918:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9a49a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.114995:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9a49a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115003:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9a49a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938439.115033:0:25714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x21:0x0]: returning size 4117 00000004:00200000:1.0:1784938439.115039:0:25714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938439.115052:0:25714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9a49a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115289:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9a49a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115298:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ce00/0x7b044d4128f9a47e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115304:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ce00/0x7b044d4128f9a47e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115310:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ce00/0x7b044d4128f9a47e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115316:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27ce00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.115320:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ce00/0x7b044d4128f9a47e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115327:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ce00/0x7b044d4128f9a47e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115336:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.115339:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.115343:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ce00/0x7b044d4128f9a47e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115348:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ce00/0x7b044d4128f9a47e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115370:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9a48c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115376:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9a48c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115382:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9a48c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115386:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27c800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.115389:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9a48c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115394:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9a48c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115400:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x49aa722d (ffff9f248fb6b300) 00010000:00010000:1.0:1784938439.115403:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.115405:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9a48c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115410:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9a48c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115435:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35c00/0x7b044d4128f9a477 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766359f expref: 87 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115452:0:25714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9a49a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766359f expref: 86 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115459:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff9f248fb6b900) 00010000:00010000:1.0:1784938439.115461:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938439.115463:0:25714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c6600, rc 0) 00010000:00010000:1.0:1784938439.115467:0:25714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.115477:0:25714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9a4a8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476635a6 expref: -99 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115504:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6800/0x7b044d4128f9a4af lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115513:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6800/0x7b044d4128f9a4af lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115521:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6800/0x7b044d4128f9a4af lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115539:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28a00/0x7b044d4128f9a4b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x22eacdcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115545:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28a00/0x7b044d4128f9a4b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115552:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28a00/0x7b044d4128f9a4b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115664:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28e00/0x7b044d4128f9a4bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115674:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28e00/0x7b044d4128f9a4bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4c:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115681:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28e00/0x7b044d4128f9a4bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4c:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938439.115702:0:25714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4c:0x0]: returning size 1611 00000004:00200000:1.0:1784938439.115706:0:25714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938439.115722:0:25714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28e00/0x7b044d4128f9a4bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4c:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115733:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28e00/0x7b044d4128f9a4bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115742:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6800/0x7b044d4128f9a4af lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115748:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6800/0x7b044d4128f9a4af lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115754:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6800/0x7b044d4128f9a4af lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115760:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c6800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.115763:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6800/0x7b044d4128f9a4af lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115770:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6800/0x7b044d4128f9a4af lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115778:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.115782:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.115785:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6800/0x7b044d4128f9a4af lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115792:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6800/0x7b044d4128f9a4af lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115802:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28a00/0x7b044d4128f9a4b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115808:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28a00/0x7b044d4128f9a4b6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115814:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28a00/0x7b044d4128f9a4b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115818:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b28a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.115821:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28a00/0x7b044d4128f9a4b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115827:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28a00/0x7b044d4128f9a4b6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115834:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x22eacdcf (ffff9f248fb6bc00) 00010000:00010000:1.0:1784938439.115837:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.115840:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28a00/0x7b044d4128f9a4b6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115846:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28a00/0x7b044d4128f9a4b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115869:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9a4a8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476635a6 expref: 88 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115885:0:25714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28e00/0x7b044d4128f9a4bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476635a6 expref: 87 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115893:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4c:0x0].0x0 (ffff9f248fb6be00) 00010000:00010000:1.0:1784938439.115895:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938439.115898:0:25714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24c5b28e00, rc 0) 00010000:00010000:1.0:1784938439.115902:0:25714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.115911:0:25714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9a4c4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476635ad expref: -99 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115939:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031400/0x7b044d4128f9a4cb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115948:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031400/0x7b044d4128f9a4cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115956:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031400/0x7b044d4128f9a4cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115968:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9a4d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x57ba1cca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115976:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9a4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.115982:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9a4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938439.116380:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:1.0:1784938439.116480:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9a4d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.116493:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9a4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.116501:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9a4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938439.116533:0:25714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x31:0x0]: returning size 1342 00000004:00200000:1.0:1784938439.116537:0:25714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938439.116553:0:25714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9a4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.116562:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9a4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.116569:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031400/0x7b044d4128f9a4cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.116575:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031400/0x7b044d4128f9a4cb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.116582:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031400/0x7b044d4128f9a4cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.116587:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2480031400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.116591:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031400/0x7b044d4128f9a4cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.116598:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031400/0x7b044d4128f9a4cb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.116607:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.116611:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.116615:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031400/0x7b044d4128f9a4cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.116621:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031400/0x7b044d4128f9a4cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.117230:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9a4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.117238:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9a4d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.117246:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9a4d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.117252:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f7000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.117255:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9a4d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.117261:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9a4d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.117271:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x57ba1cca (ffff9f248fb6b500) 00010000:00010000:1.0:1784938439.117274:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.117277:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9a4d2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.117283:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9a4d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.117323:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9a4c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476635ad expref: 89 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.117342:0:25714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9a4d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476635ad expref: 88 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.117350:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff9f248fb6b100) 00010000:00010000:1.0:1784938439.117352:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938439.117355:0:25714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238db39600, rc 0) 00010000:00010000:1.0:1784938439.117378:0:25714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.117396:0:25714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dae00/0x7b044d4128f9a4e0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476635b4 expref: -99 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.117442:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9a4e7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.117453:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9a4e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.117462:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9a4e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.117479:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4800/0x7b044d4128f9a4ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x52815b39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.117485:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4800/0x7b044d4128f9a4ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.117492:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4800/0x7b044d4128f9a4ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938439.117611:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337346048 00000100:00100000:2.0:1784938439.117630:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337346048 00010000:00010000:1.0:1784938439.117668:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4e00/0x7b044d4128f9a4f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.117681:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4e00/0x7b044d4128f9a4f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3e:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.117689:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4e00/0x7b044d4128f9a4f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3e:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938439.117716:0:25714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3e:0x0]: returning size 215293 00000004:00200000:1.0:1784938439.117721:0:25714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1784938439.117737:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 173 00000004:00010000:1.0:1784938439.117741:0:25714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4e00/0x7b044d4128f9a4f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3e:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.117753:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4e00/0x7b044d4128f9a4f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938439.117756:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+90:17072:x1871643337346048:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:1.0:1784938439.117780:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9a4e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.117788:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9a4e7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.117796:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9a4e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.117802:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5db200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.117805:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9a4e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.117811:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9a4e7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.117820:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.117824:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.117827:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9a4e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.117829:0:24202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938439.117841:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9a4e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.117854:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4800/0x7b044d4128f9a4ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.117861:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4800/0x7b044d4128f9a4ee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.117865:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9a010 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663464 expref: 90 pid: 21161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.117872:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4800/0x7b044d4128f9a4ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.117899:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9e4800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.117903:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4800/0x7b044d4128f9a4ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.117911:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4b:0x0].0x0 (ffff9f249863ba00) 00010000:00010000:1.0:1784938439.117912:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4800/0x7b044d4128f9a4ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.117932:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x52815b39 (ffff9f248fb6ba00) 00010000:00010000:1.0:1784938439.117935:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938439.117936:0:24202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938439.117939:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4800/0x7b044d4128f9a4ee lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.117946:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4800/0x7b044d4128f9a4ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.117968:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c600/0x7b044d4128f9a4fc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.117981:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dae00/0x7b044d4128f9a4e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476635b4 expref: 90 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.117986:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c600/0x7b044d4128f9a4fc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.118025:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c600/0x7b044d4128f9a4fc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.118032:0:25714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4e00/0x7b044d4128f9a4f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476635b4 expref: 89 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.118048:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3e:0x0].0x0 (ffff9f248fb6b600) 00010000:00010000:1.0:1784938439.118051:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938439.118053:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95da00/0x7b044d4128f9a503 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0xd06bcd9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.118055:0:25714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c9e4e00, rc 0) 00010000:00010000:1.0:1784938439.118065:0:25714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938439.118070:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95da00/0x7b044d4128f9a503 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.118078:0:25714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e5000/0x7b044d4128f9a50a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476635bb expref: -99 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.118083:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95da00/0x7b044d4128f9a503 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.118219:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9a511 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.118233:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9a511 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.118242:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9a511 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.118244:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95ce00/0x7b044d4128f9a518 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.118262:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95ce00/0x7b044d4128f9a518 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.118263:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe800/0x7b044d4128f9a51f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x89d48c8d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.118287:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95ce00/0x7b044d4128f9a518 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.118288:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe800/0x7b044d4128f9a51f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.118332:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe800/0x7b044d4128f9a51f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119342:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9a557 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119370:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9a557 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x39:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119381:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9a557 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x39:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938439.119410:0:25714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x39:0x0]: returning size 6821 00000004:00200000:1.0:1784938439.119416:0:25714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938439.119435:0:25714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9a557 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x39:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119445:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9a557 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119454:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9a511 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119461:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9a511 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119468:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9a511 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119474:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823ff600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.119478:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9a511 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119485:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9a511 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119497:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.119501:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.119505:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9a511 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119512:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9a511 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119528:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe800/0x7b044d4128f9a51f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119534:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe800/0x7b044d4128f9a51f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119541:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe800/0x7b044d4128f9a51f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119546:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fe800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.119548:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe800/0x7b044d4128f9a51f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119555:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe800/0x7b044d4128f9a51f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119562:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x89d48c8d (ffff9f248fb6b000) 00010000:00010000:1.0:1784938439.119565:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.119568:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe800/0x7b044d4128f9a51f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119574:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe800/0x7b044d4128f9a51f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119609:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e5000/0x7b044d4128f9a50a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476635bb expref: 93 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119629:0:25714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9a557 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476635bb expref: 92 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119638:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x39:0x0].0x0 (ffff9f248fb6b200) 00010000:00010000:1.0:1784938439.119640:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938439.119642:0:25714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823ff000, rc 0) 00010000:00010000:1.0:1784938439.119648:0:25714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.119658:0:25714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe200/0x7b044d4128f9a55e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476635c2 expref: -99 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119689:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9a565 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119698:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9a565 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119705:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9a565 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119718:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe400/0x7b044d4128f9a56c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xa6e7eec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119724:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe400/0x7b044d4128f9a56c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119730:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe400/0x7b044d4128f9a56c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119824:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9a573 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119833:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9a573 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119840:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9a573 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938439.119859:0:25714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x5:0x0]: returning size 391200 00000004:00200000:1.0:1784938439.119862:0:25714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938439.119872:0:25714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9a573 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119881:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9a573 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119888:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9a565 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119893:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9a565 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119898:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9a565 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119903:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fe000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.119906:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9a565 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119912:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9a565 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119920:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.119923:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.119926:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9a565 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119931:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9a565 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119942:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe400/0x7b044d4128f9a56c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119948:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe400/0x7b044d4128f9a56c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119953:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe400/0x7b044d4128f9a56c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119959:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fe400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.119962:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe400/0x7b044d4128f9a56c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119968:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe400/0x7b044d4128f9a56c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119975:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xa6e7eec (ffff9f248fb6b800) 00010000:00010000:1.0:1784938439.119978:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.119980:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe400/0x7b044d4128f9a56c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.119985:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe400/0x7b044d4128f9a56c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.120008:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe200/0x7b044d4128f9a55e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476635c2 expref: 94 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.120025:0:25714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9a573 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476635c2 expref: 93 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.120033:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x0 (ffff9f248fb6bb00) 00010000:00010000:1.0:1784938439.120036:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938439.120038:0:25714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823ff400, rc 0) 00010000:00010000:1.0:1784938439.120042:0:25714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.120050:0:25714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff200/0x7b044d4128f9a57a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476635c9 expref: -99 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.120966:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fee00/0x7b044d4128f9a596 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784938439.121345:0:24202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].11, 64 off8896 00010000:00010000:2.0:1784938439.123555:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9a5a4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.123569:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9a5a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.123579:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9a5a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.123587:0:24202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9a5a4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.123594:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9a5a4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.123601:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9a5a4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.123629:0:24202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938439.123653:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95ce00/0x7b044d4128f9a518 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.123660:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95ce00/0x7b044d4128f9a518 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.123666:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95ce00/0x7b044d4128f9a518 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.123673:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c95ce00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938439.123676:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95ce00/0x7b044d4128f9a518 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.123685:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95ce00/0x7b044d4128f9a518 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.123687:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938439.123708:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9a5a4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.123709:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4b:0x0].0x0 (ffff9f24b67c7300) 00010000:00010000:2.0:1784938439.123721:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784938439.123729:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95ce00/0x7b044d4128f9a518 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.123731:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c95c800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938439.123740:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9a5a4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.123746:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95ce00/0x7b044d4128f9a518 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.123754:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9a5a4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.123776:0:19223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4b:0x0].0x0 (ffff9f24b67c7300) 00010000:00010000:3.0:1784938439.123779:0:19223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938439.123784:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9a5a4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.123790:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9a5a4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.123819:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.123822:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.123823:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938439.123907:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fee00/0x7b044d4128f9a596 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.123921:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fee00/0x7b044d4128f9a596 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.123947:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9a5ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd13f1037 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.123955:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9a5ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.123962:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9a5ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.124624:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9a5b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.124644:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9a5b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x41:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.124657:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9a5b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x41:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938439.124691:0:25714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x41:0x0]: returning size 227516 00000004:00200000:1.0:1784938439.124699:0:25714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938439.124727:0:25714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9a5b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x41:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.124746:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9a5b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.124783:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fee00/0x7b044d4128f9a596 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.124793:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fee00/0x7b044d4128f9a596 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.124801:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fee00/0x7b044d4128f9a596 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.124807:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fee00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.124811:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fee00/0x7b044d4128f9a596 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.124818:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fee00/0x7b044d4128f9a596 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.124829:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.124833:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.124837:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fee00/0x7b044d4128f9a596 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.124843:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fee00/0x7b044d4128f9a596 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.124856:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9a5ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.124862:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9a5ab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.124868:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9a5ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.124873:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823ff800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.124875:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9a5ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.124881:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9a5ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.124888:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xd13f1037 (ffff9f248fb6b400) 00010000:00010000:1.0:1784938439.124890:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.124893:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9a5ab lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.124900:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9a5ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.124946:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff200/0x7b044d4128f9a57a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476635c9 expref: 97 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.124969:0:25714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9a5b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476635c9 expref: 96 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.124977:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x41:0x0].0x0 (ffff9f248fb6bd00) 00010000:00010000:1.0:1784938439.124980:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938439.124983:0:25714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823ffe00, rc 0) 00010000:00010000:1.0:1784938439.124993:0:25714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.125006:0:25714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe600/0x7b044d4128f9a5c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476635d0 expref: -99 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.125026:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c600/0x7b044d4128f9a4fc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.125037:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c600/0x7b044d4128f9a4fc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.125045:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c600/0x7b044d4128f9a4fc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.125055:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fec00/0x7b044d4128f9a5c7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.125056:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c95c600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938439.125062:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c600/0x7b044d4128f9a4fc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.125426:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fec00/0x7b044d4128f9a5c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.125436:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fec00/0x7b044d4128f9a5c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.125487:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9a5ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xe3541c1d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.125494:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9a5ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.125502:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9a5ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.125792:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffc00/0x7b044d4128f9a5d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.125803:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffc00/0x7b044d4128f9a5d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x38:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.125809:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffc00/0x7b044d4128f9a5d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x38:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938439.125831:0:25714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x38:0x0]: returning size 4750 00000004:00200000:1.0:1784938439.125835:0:25714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938439.125853:0:25714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffc00/0x7b044d4128f9a5d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x38:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.125861:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffc00/0x7b044d4128f9a5d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.125868:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fec00/0x7b044d4128f9a5c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.125874:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fec00/0x7b044d4128f9a5c7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.125880:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fec00/0x7b044d4128f9a5c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.125884:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fec00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.125888:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fec00/0x7b044d4128f9a5c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.125895:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fec00/0x7b044d4128f9a5c7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.125907:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.125911:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.125915:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fec00/0x7b044d4128f9a5c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.125921:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fec00/0x7b044d4128f9a5c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.125934:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9a5ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.125939:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9a5ce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.125947:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9a5ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.125952:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fea00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.125955:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9a5ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.125961:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9a5ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.125967:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xe3541c1d (ffff9f248fb6ca00) 00010000:00010000:1.0:1784938439.125970:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.125972:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9a5ce lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.125977:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9a5ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126010:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe600/0x7b044d4128f9a5c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476635d0 expref: 98 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126029:0:25714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffc00/0x7b044d4128f9a5d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476635d0 expref: 97 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126036:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x38:0x0].0x0 (ffff9f248fb6c600) 00010000:00010000:1.0:1784938439.126038:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938439.126040:0:25714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823ffc00, rc 0) 00010000:00010000:1.0:1784938439.126047:0:25714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.126137:0:25714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9a5dc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476635d7 expref: -99 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126331:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03400/0x7b044d4128f9a5e3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126378:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03400/0x7b044d4128f9a5e3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126412:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03400/0x7b044d4128f9a5e3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126436:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9a5ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x267dbf88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126445:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9a5ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126453:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9a5ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126585:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02e00/0x7b044d4128f9a5f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126595:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02e00/0x7b044d4128f9a5f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126602:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02e00/0x7b044d4128f9a5f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938439.126622:0:25714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x17:0x0]: returning size 18269 00000004:00200000:1.0:1784938439.126625:0:25714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938439.126642:0:25714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02e00/0x7b044d4128f9a5f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126650:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02e00/0x7b044d4128f9a5f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126658:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03400/0x7b044d4128f9a5e3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126663:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03400/0x7b044d4128f9a5e3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126670:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03400/0x7b044d4128f9a5e3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126675:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e03400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.126679:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03400/0x7b044d4128f9a5e3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126687:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03400/0x7b044d4128f9a5e3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126697:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.126701:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.126705:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03400/0x7b044d4128f9a5e3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126711:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03400/0x7b044d4128f9a5e3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126722:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9a5ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126729:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9a5ea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126735:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9a5ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126740:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e03200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.126742:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9a5ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126748:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9a5ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126756:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x267dbf88 (ffff9f248fb6c000) 00010000:00010000:1.0:1784938439.126759:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.126762:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9a5ea lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126768:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9a5ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126795:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9a5dc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476635d7 expref: 99 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126815:0:25714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02e00/0x7b044d4128f9a5f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476635d7 expref: 98 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126822:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9f248fb6c200) 00010000:00010000:1.0:1784938439.126824:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938439.126827:0:25714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e02e00, rc 0) 00010000:00010000:1.0:1784938439.126833:0:25714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.126841:0:25714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03800/0x7b044d4128f9a5f8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476635de expref: -99 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126864:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03e00/0x7b044d4128f9a5ff lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126872:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03e00/0x7b044d4128f9a5ff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126880:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03e00/0x7b044d4128f9a5ff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126892:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9a606 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x72a71b3d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126899:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9a606 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126906:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9a606 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126973:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9a60d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126982:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9a60d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.126988:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9a60d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938439.127002:0:25714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x24:0x0]: returning size 7185 00000004:00200000:1.0:1784938439.127005:0:25714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938439.127014:0:25714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9a60d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127022:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9a60d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127029:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03e00/0x7b044d4128f9a5ff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127034:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03e00/0x7b044d4128f9a5ff lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127040:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03e00/0x7b044d4128f9a5ff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127044:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e03e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.127047:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03e00/0x7b044d4128f9a5ff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127134:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03e00/0x7b044d4128f9a5ff lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127232:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.127236:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.127240:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03e00/0x7b044d4128f9a5ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127246:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03e00/0x7b044d4128f9a5ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127257:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9a606 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127263:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9a606 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127269:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9a606 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127273:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e02600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.127276:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9a606 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127282:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9a606 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127288:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x72a71b3d (ffff9f248fb6c800) 00010000:00010000:1.0:1784938439.127290:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.127293:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9a606 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127298:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9a606 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127318:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03800/0x7b044d4128f9a5f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476635de expref: 100 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127334:0:25714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9a60d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476635de expref: 99 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127341:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff9f248fb6cb00) 00010000:00010000:1.0:1784938439.127343:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938439.127345:0:25714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e02c00, rc 0) 00010000:00010000:1.0:1784938439.127348:0:25714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.127356:0:25714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02a00/0x7b044d4128f9a614 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476635e5 expref: -99 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127395:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9a61b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127404:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9a61b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127411:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9a61b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127423:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9a622 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xc2bba7e5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127429:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9a622 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127436:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9a622 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127521:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9a629 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127529:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9a629 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127535:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9a629 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938439.127554:0:25714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2c:0x0]: returning size 13879 00000004:00200000:1.0:1784938439.127557:0:25714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938439.127568:0:25714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9a629 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127576:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9a629 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127582:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9a61b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127587:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9a61b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127593:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9a61b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127597:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e03c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.127600:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9a61b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127605:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9a61b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127612:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.127615:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.127618:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9a61b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127623:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9a61b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127634:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9a622 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127640:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9a622 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127646:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9a622 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127651:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e03a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.127653:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9a622 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127659:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9a622 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127664:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xc2bba7e5 (ffff9f248fb6c400) 00010000:00010000:1.0:1784938439.127666:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.127668:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9a622 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127673:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9a622 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127691:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02a00/0x7b044d4128f9a614 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476635e5 expref: 101 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127918:0:25714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9a629 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476635e5 expref: 100 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127927:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff9f248fb6cd00) 00010000:00010000:1.0:1784938439.127929:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938439.127932:0:25714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e03600, rc 0) 00010000:00010000:1.0:1784938439.127936:0:25714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.127945:0:25714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02800/0x7b044d4128f9a630 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476635ec expref: -99 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127968:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03000/0x7b044d4128f9a637 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127976:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03000/0x7b044d4128f9a637 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127983:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03000/0x7b044d4128f9a637 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.127995:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9a63e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xe6b34bd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.128001:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9a63e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.128008:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9a63e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.128116:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c600/0x7b044d4128f9a4fc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.128133:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:2.0:1784938439.128136:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938439.128140:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c600/0x7b044d4128f9a4fc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.128153:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c600/0x7b044d4128f9a4fc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938439.128168:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f8fffe5a reply state 00000000b367534c transno 8589934632 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95da00/0x7b044d4128f9a503 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.128178:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95da00/0x7b044d4128f9a503 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.128185:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xd06bcd9f (ffff9f24b67c7700) 00010000:00010000:2.0:1784938439.128186:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938439.128190:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938439.128314:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+102:17072:x1871643337346048:12345-192.168.202.54@tcp:36:rm.0 Request processed in 10562us (11932us total) trans 8589934632 rc 0/0 00000100:00100000:2.0:1784938439.128320:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 173 00000100:00100000:3.0:1784938439.132036:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:1.0:1784938439.136619:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02000/0x7b044d4128f9a699 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.136649:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02000/0x7b044d4128f9a699 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.136663:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02000/0x7b044d4128f9a699 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938439.136702:0:25714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x6:0x0]: returning size 1735 00000004:00200000:1.0:1784938439.136707:0:25714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938439.136740:0:25714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02000/0x7b044d4128f9a699 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.136754:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02000/0x7b044d4128f9a699 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.136766:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03000/0x7b044d4128f9a637 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.136774:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03000/0x7b044d4128f9a637 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.136782:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03000/0x7b044d4128f9a637 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.136789:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e03000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.136795:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03000/0x7b044d4128f9a637 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.136803:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03000/0x7b044d4128f9a637 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.136822:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.136826:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.136833:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03000/0x7b044d4128f9a637 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.136840:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03000/0x7b044d4128f9a637 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.136858:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9a63e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.136865:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9a63e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.136872:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9a63e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.136877:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e02200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.136880:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9a63e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.136886:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9a63e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.136894:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xe6b34bd0 (ffff9f248fb6cf00) 00010000:00010000:1.0:1784938439.136897:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.136901:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9a63e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.136906:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9a63e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.136954:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02800/0x7b044d4128f9a630 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476635ec expref: 103 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.136976:0:25714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02000/0x7b044d4128f9a699 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476635ec expref: 102 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.136983:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f248fb6c700) 00010000:00010000:1.0:1784938439.136986:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938439.136988:0:25714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e02000, rc 0) 00010000:00010000:1.0:1784938439.137001:0:25714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.137015:0:25714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02400/0x7b044d4128f9a6a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476635f3 expref: -99 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137069:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f9a6a7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137078:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f9a6a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137085:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f9a6a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137099:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9a6ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xc701cb36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137105:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9a6ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137112:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9a6ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137377:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395600/0x7b044d4128f9a6b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137387:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395600/0x7b044d4128f9a6b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137394:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395600/0x7b044d4128f9a6b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938439.137416:0:25714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x42:0x0]: returning size 159678 00000004:00200000:1.0:1784938439.137419:0:25714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938439.137431:0:25714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395600/0x7b044d4128f9a6b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137440:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395600/0x7b044d4128f9a6b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137449:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f9a6a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137454:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f9a6a7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137461:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f9a6a7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137466:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4056600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.137470:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f9a6a7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137476:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f9a6a7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137484:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.137488:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.137492:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f9a6a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137498:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f9a6a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137508:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9a6ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137514:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9a6ae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137519:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9a6ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137523:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.137526:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9a6ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137531:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9a6ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137537:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xc701cb36 (ffff9f248fb6c300) 00010000:00010000:1.0:1784938439.137540:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.137542:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9a6ae lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137548:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9a6ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137573:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02400/0x7b044d4128f9a6a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476635f3 expref: 104 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137589:0:25714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395600/0x7b044d4128f9a6b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476635f3 expref: 103 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137597:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x42:0x0].0x0 (ffff9f248fb6c900) 00010000:00010000:1.0:1784938439.137600:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938439.137602:0:25714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382395600, rc 0) 00010000:00010000:1.0:1784938439.137607:0:25714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.137616:0:25714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394800/0x7b044d4128f9a6bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476635fa expref: -99 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137642:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9a6c3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137650:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9a6c3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137657:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9a6c3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137669:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9a6ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xc735cef4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137677:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9a6ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137684:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9a6ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137819:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9a6d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137829:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9a6d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137836:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9a6d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938439.137852:0:25714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x35:0x0]: returning size 855 00000004:00200000:1.0:1784938439.137854:0:25714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938439.137864:0:25714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9a6d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137872:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9a6d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137879:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9a6c3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137884:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9a6c3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137890:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9a6c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137895:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382395000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.137898:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9a6c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137904:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9a6c3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137912:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.137915:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.137918:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9a6c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137923:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9a6c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137934:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9a6ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137939:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9a6ca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137945:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9a6ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137950:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.137952:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9a6ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137958:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9a6ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137964:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xc735cef4 (ffff9f248fb6cc00) 00010000:00010000:1.0:1784938439.137966:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.137969:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9a6ca lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137975:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9a6ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.137996:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394800/0x7b044d4128f9a6bc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476635fa expref: 105 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138012:0:25714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9a6d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476635fa expref: 104 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138019:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff9f248fb6ce00) 00010000:00010000:1.0:1784938439.138022:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938439.138024:0:25714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382394000, rc 0) 00010000:00010000:1.0:1784938439.138028:0:25714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.138037:0:25714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394400/0x7b044d4128f9a6d8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663601 expref: -99 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138057:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9a6df lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138065:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9a6df lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138071:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9a6df lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138085:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9a6e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x47a21a83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138092:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9a6e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138100:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9a6e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138211:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394e00/0x7b044d4128f9a6ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138219:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394e00/0x7b044d4128f9a6ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138226:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394e00/0x7b044d4128f9a6ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938439.138244:0:25714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4f:0x0]: returning size 4512 00000004:00200000:1.0:1784938439.138247:0:25714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938439.138256:0:25714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394e00/0x7b044d4128f9a6ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138264:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394e00/0x7b044d4128f9a6ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138270:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9a6df lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138275:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9a6df lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138281:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9a6df lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138285:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382395400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.138289:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9a6df lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138294:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9a6df lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138301:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.138303:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.138306:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9a6df lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138312:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9a6df lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138319:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9a6e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138325:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9a6e6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138330:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9a6e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138335:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382395200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.138338:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9a6e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138344:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9a6e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138349:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x47a21a83 (ffff9f248fb6c500) 00010000:00010000:1.0:1784938439.138351:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.138354:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9a6e6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138375:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9a6e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138395:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394400/0x7b044d4128f9a6d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663601 expref: 106 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138410:0:25714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394e00/0x7b044d4128f9a6ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663601 expref: 105 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138417:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4f:0x0].0x0 (ffff9f248fb6c100) 00010000:00010000:1.0:1784938439.138419:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938439.138421:0:25714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382394e00, rc 0) 00010000:00010000:1.0:1784938439.138424:0:25714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.138430:0:25714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395800/0x7b044d4128f9a6f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663608 expref: -99 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138448:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395e00/0x7b044d4128f9a6fb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138455:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395e00/0x7b044d4128f9a6fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138462:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395e00/0x7b044d4128f9a6fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138486:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9a702 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x4958ff4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138494:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9a702 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138501:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9a702 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138574:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394c00/0x7b044d4128f9a709 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138583:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394c00/0x7b044d4128f9a709 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138591:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394c00/0x7b044d4128f9a709 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938439.138605:0:25714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x30:0x0]: returning size 423 00000004:00200000:1.0:1784938439.138608:0:25714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938439.138617:0:25714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394c00/0x7b044d4128f9a709 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138624:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394c00/0x7b044d4128f9a709 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138631:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395e00/0x7b044d4128f9a6fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138636:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395e00/0x7b044d4128f9a6fb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138641:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395e00/0x7b044d4128f9a6fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138646:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382395e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.138648:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395e00/0x7b044d4128f9a6fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138654:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395e00/0x7b044d4128f9a6fb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138662:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.138665:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.138667:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395e00/0x7b044d4128f9a6fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138673:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395e00/0x7b044d4128f9a6fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138681:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9a702 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138687:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9a702 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138692:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9a702 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138697:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.138700:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9a702 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138706:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9a702 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138713:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x4958ff4 (ffff9f248fb6ec00) 00010000:00010000:1.0:1784938439.138715:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.138718:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9a702 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138723:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9a702 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138743:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395800/0x7b044d4128f9a6f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663608 expref: 107 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138757:0:25714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394c00/0x7b044d4128f9a709 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663608 expref: 106 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138764:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff9f248fb6ee00) 00010000:00010000:1.0:1784938439.138766:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938439.138768:0:25714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382394c00, rc 0) 00010000:00010000:1.0:1784938439.138772:0:25714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.138778:0:25714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9a710 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766360f expref: -99 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138797:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395c00/0x7b044d4128f9a717 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138804:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395c00/0x7b044d4128f9a717 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138810:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395c00/0x7b044d4128f9a717 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138823:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395a00/0x7b044d4128f9a71e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x5b30f298 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138828:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395a00/0x7b044d4128f9a71e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138834:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395a00/0x7b044d4128f9a71e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138916:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238b600/0x7b044d4128f9a725 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138925:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238b600/0x7b044d4128f9a725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138931:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238b600/0x7b044d4128f9a725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938439.138947:0:25714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1f:0x0]: returning size 269 00000004:00200000:1.0:1784938439.138950:0:25714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938439.138959:0:25714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238b600/0x7b044d4128f9a725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138966:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238b600/0x7b044d4128f9a725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138972:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395c00/0x7b044d4128f9a717 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138978:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395c00/0x7b044d4128f9a717 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138985:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395c00/0x7b044d4128f9a717 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138989:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382395c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.138991:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395c00/0x7b044d4128f9a717 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.138996:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395c00/0x7b044d4128f9a717 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.139003:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.139006:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.139009:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395c00/0x7b044d4128f9a717 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.139014:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395c00/0x7b044d4128f9a717 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.139022:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395a00/0x7b044d4128f9a71e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.139027:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395a00/0x7b044d4128f9a71e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.139033:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395a00/0x7b044d4128f9a71e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.139038:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382395a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.139042:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395a00/0x7b044d4128f9a71e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.139048:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395a00/0x7b044d4128f9a71e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.139053:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x5b30f298 (ffff9f248fb6e500) 00010000:00010000:1.0:1784938439.139055:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.139058:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395a00/0x7b044d4128f9a71e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.139063:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395a00/0x7b044d4128f9a71e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.139082:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9a710 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766360f expref: 108 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.139097:0:25714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238b600/0x7b044d4128f9a725 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766360f expref: 107 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.139104:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff9f248fb6e100) 00010000:00010000:1.0:1784938439.139107:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938439.139109:0:25714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238238b600, rc 0) 00010000:00010000:1.0:1784938439.139111:0:25714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.139119:0:25714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a800/0x7b044d4128f9a72c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663616 expref: -99 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.139135:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238b000/0x7b044d4128f9a733 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.139184:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238b000/0x7b044d4128f9a733 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.139192:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238b000/0x7b044d4128f9a733 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.139203:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a200/0x7b044d4128f9a73a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x6b7bd7c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.139210:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a200/0x7b044d4128f9a73a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.139217:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a200/0x7b044d4128f9a73a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.139292:0:25714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9a741 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.139300:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9a741 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.139306:0:25714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9a741 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938439.139321:0:25714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x29:0x0]: returning size 6234 00000004:00200000:1.0:1784938439.139324:0:25714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938439.139332:0:25714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9a741 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.139339:0:25714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9a741 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.139346:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238b000/0x7b044d4128f9a733 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.139352:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238b000/0x7b044d4128f9a733 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.139726:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938439.139739:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00800/0x7b044d4128f9a692 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.139764:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938439.139768:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00800/0x7b044d4128f9a692 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.139775:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00800/0x7b044d4128f9a692 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.139786:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9f248300ab00) 00010000:00010000:3.0:1784938439.139788:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938439.139792:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00800/0x7b044d4128f9a692 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.139797:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00800/0x7b044d4128f9a692 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.139822:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.139824:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.139826:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938439.143970:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938439.144019:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938439.144068:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938439.144105:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337346560 00000100:00100000:2.0:1784938439.144118:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337346560 00000100:00100000:3.0:1784938439.144301:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337346688 00000100:00100000:3.0:1784938439.144307:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337346688 00000100:00100000:3.0:1784938439.144379:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337347072 00000100:00100000:3.0:1784938439.144383:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337347072 00000100:00100000:3.0:1784938439.144413:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 452 00000100:00100000:3.0:1784938439.144426:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+50:10959:x1871643337346688:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:3.0:1784938439.144454:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938439.144489:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000986122ce/0x7b044d4128f9a748 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476636a9 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938439.144527:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 704, mtime: 0x6a63ff72, atime: 0x0, ctime: 0x6a63ff72, blocks: 0x8 00010000:00010000:3.0:1784938439.144588:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=705s v=(0 0) 00010000:00010000:3.0:1784938439.144594:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938439.144608:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000986122ce/0x7b044d4128f9a748 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636a9 expref: 51 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.144632:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000986122ce/0x7b044d4128f9a748 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636a9 expref: 51 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.144654:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d42d200, rc 0) 00000100:00100000:3.0:1784938439.144752:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+51:10959:x1871643337346688:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 324us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938439.144764:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 452 00000100:00100000:3.0:1784938439.144839:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938439.144874:0:21152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337347200 00000100:00100000:3.0:1784938439.144885:0:21152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337347200 00000100:00100000:3.0:1784938439.144922:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 454 00000100:00100000:3.0:1784938439.144932:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+51:10959:x1871643337347200:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:3.0:1784938439.144943:0:21152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938439.144959:0:21152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074ea0a07/0x7b044d4128f9a756 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476636c5 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938439.144979:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 42517, mtime: 0x6a63ff74, atime: 0x0, ctime: 0x6a63ff74, blocks: 0x58 00010000:00010000:3.0:1784938439.144995:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=705s v=(0 0) 00010000:00010000:3.0:1784938439.144999:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938439.145008:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074ea0a07/0x7b044d4128f9a756 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636c5 expref: 52 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.145061:0:21152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000074ea0a07/0x7b044d4128f9a756 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636c5 expref: 52 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.145073:0:21152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d42c200, rc 0) 00000100:00100000:3.0:1784938439.145104:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+52:10959:x1871643337347200:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 172us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938439.145112:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 454 00000100:00100000:3.0:1784938439.145311:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938439.145326:0:21152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337346432 00000100:00100000:3.0:1784938439.145329:0:21152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337346432 00000100:00100000:3.0:1784938439.145348:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 455 00000100:00100000:3.0:1784938439.145355:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+52:10958:x1871643337346432:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:3.0:1784938439.145375:0:21152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938439.145388:0:21152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026699c1b/0x7b044d4128f9a75d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766369b expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938439.145403:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 170595, mtime: 0x6a63ff73, atime: 0x0, ctime: 0x6a63ff73, blocks: 0x150 00010000:00010000:3.0:1784938439.145413:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=705s v=(0 0) 00010000:00010000:3.0:1784938439.145416:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938439.145422:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026699c1b/0x7b044d4128f9a75d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766369b expref: 53 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.145433:0:21152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000026699c1b/0x7b044d4128f9a75d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766369b expref: 53 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.145456:0:21152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61bc00, rc 0) 00000100:00100000:3.0:1784938439.145476:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+53:10958:x1871643337346432:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 121us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938439.145483:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 455 00000100:00100000:3.0:1784938439.145539:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938439.145605:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:1.0:1784938439.145784:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238b000/0x7b044d4128f9a733 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.145795:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238238b000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.145802:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238b000/0x7b044d4128f9a733 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.145812:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238b000/0x7b044d4128f9a733 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.145828:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.145832:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.145838:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238b000/0x7b044d4128f9a733 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.145846:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238b000/0x7b044d4128f9a733 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.145869:0:25714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a200/0x7b044d4128f9a73a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.145876:0:25714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a200/0x7b044d4128f9a73a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.145882:0:25714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a200/0x7b044d4128f9a73a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.145887:0:25714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238238a200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.145889:0:25714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a200/0x7b044d4128f9a73a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.145895:0:25714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a200/0x7b044d4128f9a73a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.145901:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x6b7bd7c (ffff9f248fb6ea00) 00010000:00010000:1.0:1784938439.145904:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.145906:0:25714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a200/0x7b044d4128f9a73a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.145912:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a200/0x7b044d4128f9a73a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.145963:0:25714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a800/0x7b044d4128f9a72c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663616 expref: 109 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.145980:0:25714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9a741 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663616 expref: 108 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.145988:0:25714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff9f248fb6e600) 00010000:00010000:1.0:1784938439.145990:0:25714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938439.145992:0:25714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238238a000, rc 0) 00010000:00010000:1.0:1784938439.146005:0:25714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1784938439.146053:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 456 00000100:00100000:3.0:1784938439.146063:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+53:10958:x1871643337346944:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:3.0:1784938439.146072:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938439.146089:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088ff705f/0x7b044d4128f9a764 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476636b7 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938439.146107:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 55540, mtime: 0x6a63ff72, atime: 0x0, ctime: 0x6a63ff72, blocks: 0x70 00010000:00010000:3.0:1784938439.146121:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=705s v=(0 0) 00010000:00010000:3.0:1784938439.146138:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938439.146180:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088ff705f/0x7b044d4128f9a764 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636b7 expref: 54 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.146192:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088ff705f/0x7b044d4128f9a764 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636b7 expref: 54 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.146202:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61a400, rc 0) 00000100:00100000:3.0:1784938439.146228:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+54:10958:x1871643337346944:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 167us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938439.146249:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 456 00000100:00100000:3.0:1784938439.146269:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 457 00000100:00100000:3.0:1784938439.146275:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+53:10958:x1871643337346816:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:3.0:1784938439.146282:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938439.146293:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9585a08/0x7b044d4128f9a76b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476636b0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938439.146306:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 111139, mtime: 0x6a63ff73, atime: 0x0, ctime: 0x6a63ff73, blocks: 0xe0 00010000:00010000:3.0:1784938439.146317:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=705s v=(0 0) 00010000:00010000:3.0:1784938439.146320:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938439.146325:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9585a08/0x7b044d4128f9a76b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636b0 expref: 54 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.146334:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9585a08/0x7b044d4128f9a76b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636b0 expref: 54 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.146341:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61b000, rc 0) 00000100:00100000:3.0:1784938439.146376:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+54:10958:x1871643337346816:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 102us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938439.146382:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 457 00000100:00100000:3.0:1784938439.146394:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 458 00000100:00100000:3.0:1784938439.146401:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+53:10959:x1871643337346560:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:3.0:1784938439.146408:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938439.146417:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ea8d30f/0x7b044d4128f9a772 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476636a2 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938439.146434:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 158096, mtime: 0x6a63ff73, atime: 0x0, ctime: 0x6a63ff73, blocks: 0x138 00010000:00010000:3.0:1784938439.146444:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=705s v=(0 0) 00010000:00010000:3.0:1784938439.146446:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938439.146452:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ea8d30f/0x7b044d4128f9a772 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636a2 expref: 54 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.146462:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008ea8d30f/0x7b044d4128f9a772 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636a2 expref: 54 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.146469:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61b600, rc 0) 00000100:00100000:3.0:1784938439.146489:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+54:10959:x1871643337346560:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 89us (2535us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938439.146495:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 458 00000100:00100000:3.0:1784938439.146778:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938439.146801:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337347328 00000100:00100000:3.0:1784938439.146809:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337347328 00000100:00100000:3.0:1784938439.146839:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 459 00000100:00100000:3.0:1784938439.146845:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+52:10958:x1871643337347328:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:3.0:1784938439.146853:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938439.146867:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e788d2b/0x7b044d4128f9a779 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476636cc expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938439.146884:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 2659, mtime: 0x6a63ff72, atime: 0x0, ctime: 0x6a63ff72, blocks: 0x8 00010000:00010000:3.0:1784938439.146894:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=705s v=(0 0) 00010000:00010000:3.0:1784938439.146904:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938439.146910:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e788d2b/0x7b044d4128f9a779 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636cc expref: 53 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.146923:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000e788d2b/0x7b044d4128f9a779 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636cc expref: 53 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.146932:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17a400, rc 0) 00000100:00100000:3.0:1784938439.146952:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+53:10958:x1871643337347328:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 107us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938439.146959:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 459 00000100:00100000:2.0:1784938439.153346:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938439.153397:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938439.153428:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337347456 00000100:00100000:2.0:1784938439.153443:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337347456 00000100:00100000:2.0:1784938439.153511:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337347968 00000100:00100000:2.0:1784938439.153514:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337347968 00000100:00100000:2.0:1784938439.153537:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 460 00000100:00100000:2.0:1784938439.153551:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+55:10958:x1871643337347456:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:2.0:1784938439.153581:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938439.153616:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009eea06dc/0x7b044d4128f9a7db lrc: 2/0,0 mode: --/PR res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476636d3 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938439.153650:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 6430, mtime: 0x6a63ff73, atime: 0x0, ctime: 0x6a63ff73, blocks: 0x10 00010000:00010000:2.0:1784938439.153678:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=705s v=(0 0) 00010000:00010000:2.0:1784938439.153684:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938439.153697:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009eea06dc/0x7b044d4128f9a7db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636d3 expref: 56 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.153718:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009eea06dc/0x7b044d4128f9a7db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636d3 expref: 56 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.153732:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c95c400, rc 0) 00000100:00100000:2.0:1784938439.153811:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+56:10958:x1871643337347456:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 262us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938439.153819:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 460 00000100:00100000:2.0:1784938439.153845:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 461 00000100:00100000:2.0:1784938439.153851:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+55:10958:x1871643337347968:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:2.0:1784938439.153858:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938439.153870:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000caa17f53/0x7b044d4128f9a7e2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476636ef expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938439.153884:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 1790, mtime: 0x6a63ff73, atime: 0x0, ctime: 0x6a63ff73, blocks: 0x8 00010000:00010000:2.0:1784938439.153895:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=705s v=(0 0) 00010000:00010000:2.0:1784938439.153898:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938439.153905:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000caa17f53/0x7b044d4128f9a7e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636ef expref: 56 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.153915:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000caa17f53/0x7b044d4128f9a7e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636ef expref: 56 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.153924:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c95d200, rc 0) 00000100:00100000:2.0:1784938439.153944:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+56:10958:x1871643337347968:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 93us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938439.153950:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 461 00000100:00100000:2.0:1784938439.153993:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938439.154015:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337348480 00000100:00100000:2.0:1784938439.154019:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337348480 00000100:00100000:2.0:1784938439.154039:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 462 00000100:00100000:2.0:1784938439.154045:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+53:10958:x1871643337348480:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:2.0:1784938439.154053:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938439.154066:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd5af998/0x7b044d4128f9a7e9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766370b expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938439.154084:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 838, mtime: 0x6a63ff72, atime: 0x0, ctime: 0x6a63ff72, blocks: 0x8 00010000:00010000:2.0:1784938439.154094:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=705s v=(0 0) 00010000:00010000:2.0:1784938439.154098:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938439.154104:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd5af998/0x7b044d4128f9a7e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766370b expref: 54 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.154116:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bd5af998/0x7b044d4128f9a7e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766370b expref: 54 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.154125:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c95ca00, rc 0) 00000100:00100000:2.0:1784938439.154179:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+54:10958:x1871643337348480:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 132us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938439.154186:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 462 00000100:00100000:2.0:1784938439.154263:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938439.154299:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337347840 00000100:00100000:2.0:1784938439.154303:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337347840 00000100:00100000:2.0:1784938439.154332:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 463 00000100:00100000:2.0:1784938439.154341:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+56:10958:x1871643337347840:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:2.0:1784938439.154351:0:25715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938439.154378:0:25715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c64a00d9/0x7b044d4128f9a7f0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476636e8 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938439.154397:0:25715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 10934, mtime: 0x6a63ff74, atime: 0x0, ctime: 0x6a63ff74, blocks: 0x18 00010000:00010000:2.0:1784938439.154407:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=705s v=(0 0) 00010000:00010000:2.0:1784938439.154411:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938439.154417:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c64a00d9/0x7b044d4128f9a7f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636e8 expref: 57 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.154428:0:25715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c64a00d9/0x7b044d4128f9a7f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636e8 expref: 57 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.154438:0:25715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c95d800, rc 0) 00000100:00100000:2.0:1784938439.154487:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+57:10958:x1871643337347840:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 145us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938439.154507:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 463 00000100:00100000:2.0:1784938439.154559:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938439.154587:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337348352 00000100:00100000:2.0:1784938439.154592:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337348352 00000100:00100000:2.0:1784938439.154631:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 464 00000100:00100000:2.0:1784938439.154642:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+54:10958:x1871643337348352:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:2.0:1784938439.154656:0:21149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938439.154672:0:21149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039cfb67e/0x7b044d4128f9a805 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663704 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938439.154704:0:21149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 1613, mtime: 0x6a63ff72, atime: 0x0, ctime: 0x6a63ff72, blocks: 0x8 00010000:00010000:2.0:1784938439.154716:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=705s v=(0 0) 00010000:00010000:2.0:1784938439.154718:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938439.154725:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039cfb67e/0x7b044d4128f9a805 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663704 expref: 55 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.154745:0:21149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000039cfb67e/0x7b044d4128f9a805 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663704 expref: 55 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.154754:0:21149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c95dc00, rc 0) 00000100:00100000:2.0:1784938439.154792:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+55:10958:x1871643337348352:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 152us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938439.154798:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 464 00000100:00100000:3.0:1784938439.157255:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938439.157298:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938439.157318:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938439.157336:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938439.158786:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337347584 00000100:00100000:1.0:1784938439.158803:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337347584 00000100:00100000:1.0:1784938439.158883:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337348096 00000100:00100000:1.0:1784938439.158889:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337348096 00000100:00100000:1.0:1784938439.158910:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337347712 00000100:00100000:1.0:1784938439.158916:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337347712 00000100:00100000:1.0:1784938439.158931:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337348224 00000100:00100000:1.0:1784938439.158936:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337348224 00000100:00100000:1.0:1784938439.158958:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 465 00000100:00100000:1.0:1784938439.158968:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+58:10959:x1871643337347584:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:1.0:1784938439.158992:0:21629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.159017:0:21629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062c9d3db/0x7b044d4128f9a84b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476636da expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938439.159050:0:21629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 38517, mtime: 0x6a63ff71, atime: 0x0, ctime: 0x6a63ff71, blocks: 0x50 00010000:00010000:1.0:1784938439.159079:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=705s v=(0 0) 00010000:00010000:1.0:1784938439.159085:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938439.159096:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062c9d3db/0x7b044d4128f9a84b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636da expref: 59 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.159119:0:21629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000062c9d3db/0x7b044d4128f9a84b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636da expref: 59 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.159141:0:21629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238238a400, rc 0) 00000100:00100000:1.0:1784938439.159252:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+59:10959:x1871643337347584:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 284us (2011us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938439.159260:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 465 00000100:00100000:1.0:1784938439.159281:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 466 00000100:00100000:1.0:1784938439.159287:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+56:10959:x1871643337348096:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:1.0:1784938439.159295:0:21629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.159307:0:21629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a04ce4d5/0x7b044d4128f9a852 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476636f6 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938439.159323:0:21629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 1765, mtime: 0x6a63ff75, atime: 0x0, ctime: 0x6a63ff75, blocks: 0x8 00010000:00010000:1.0:1784938439.159333:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=705s v=(0 0) 00010000:00010000:1.0:1784938439.159336:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938439.159342:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a04ce4d5/0x7b044d4128f9a852 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636f6 expref: 57 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.159352:0:21629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a04ce4d5/0x7b044d4128f9a852 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636f6 expref: 57 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.159376:0:21629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238238b400, rc 0) 00000100:00100000:1.0:1784938439.159396:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+57:10959:x1871643337348096:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 110us (2098us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938439.159402:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 466 00000100:00100000:1.0:1784938439.159414:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 467 00000100:00100000:1.0:1784938439.159419:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+56:10959:x1871643337347712:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:1.0:1784938439.159425:0:21629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.159435:0:21629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000545a8b07/0x7b044d4128f9a859 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476636e1 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938439.159446:0:21629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 198050, mtime: 0x6a63ff74, atime: 0x0, ctime: 0x6a63ff74, blocks: 0x188 00010000:00010000:1.0:1784938439.159455:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=705s v=(0 0) 00010000:00010000:1.0:1784938439.159458:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938439.159463:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000545a8b07/0x7b044d4128f9a859 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636e1 expref: 57 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.159473:0:21629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000545a8b07/0x7b044d4128f9a859 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636e1 expref: 57 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.159481:0:21629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238238b200, rc 0) 00000100:00100000:1.0:1784938439.159499:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+57:10959:x1871643337347712:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 80us (2179us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938439.159505:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 467 00000100:00100000:1.0:1784938439.159516:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 468 00000100:00100000:1.0:1784938439.159523:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+58:10959:x1871643337348224:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:1.0:1784938439.159530:0:21629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.159540:0:21629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000320d80b3/0x7b044d4128f9a860 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476636fd expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938439.159554:0:21629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 234, mtime: 0x6a63ff72, atime: 0x0, ctime: 0x6a63ff72, blocks: 0x8 00010000:00010000:1.0:1784938439.159565:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=705s v=(0 0) 00010000:00010000:1.0:1784938439.159569:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938439.159574:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000320d80b3/0x7b044d4128f9a860 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636fd expref: 59 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.159591:0:21629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000320d80b3/0x7b044d4128f9a860 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636fd expref: 59 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.159603:0:21629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238238ae00, rc 0) 00000100:00100000:1.0:1784938439.159629:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+59:10959:x1871643337348224:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 101us (2285us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938439.159644:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 468 00000100:00100000:2.0:1784938439.163045:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938439.173209:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337348736 00000100:00100000:3.0:1784938439.173237:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337348736 00000100:00100000:3.0:1784938439.173508:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 175 00000100:00100000:3.0:1784938439.173526:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+116:17072:x1871643337348736:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:3.0:1784938439.173619:0:24201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938439.173663:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030000/0x7b044d4128f9a048 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663472 expref: 116 pid: 21161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.173692:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3d:0x0].0x0 (ffff9f238dcb4c00) 00010000:00010000:3.0:1784938439.173709:0:24201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938439.173747:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9a8bb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.173793:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9a8bb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.173806:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9a8bb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.173825:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9a8c2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x6d38f012 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.173832:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9a8c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.173839:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9a8c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.173964:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9a8c9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.173971:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9a8c9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.173978:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9a8c9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784938439.174320:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].12, 64 off8960 00010000:00010000:3.0:1784938439.174396:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c600/0x7b044d4128f9a8d0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.174406:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c600/0x7b044d4128f9a8d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.174415:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c600/0x7b044d4128f9a8d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.174431:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c600/0x7b044d4128f9a8d0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.174438:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c600/0x7b044d4128f9a8d0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.174445:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c600/0x7b044d4128f9a8d0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.174472:0:24201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938439.174494:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9a8c9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.174500:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9a8c9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.174506:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9a8c9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.174514:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b34200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938439.174520:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9a8c9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.174542:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9a8c9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.174574:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3d:0x0].0x0 (ffff9f23861e4700) 00010000:00010000:3.0:1784938439.174585:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784938439.174593:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9a8c9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.174632:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9a8c9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.174694:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9a8bb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.174704:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9a8bb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.174729:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9a8bb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.174761:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9a8bb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.174770:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17ac00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938439.174773:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9a8bb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.174782:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9a8bb lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.174796:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:3.0:1784938439.174805:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938439.174811:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9a8bb lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.174818:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9a8bb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938439.174830:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003e6b7cb2 reply state 00000000ccd13475 transno 8589934634 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9a8c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.174849:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9a8c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.174856:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x6d38f012 (ffff9f24b67c7300) 00010000:00010000:3.0:1784938439.174858:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938439.174860:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938439.174974:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+117:17072:x1871643337348736:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1451us (11941us total) trans 8589934634 rc 0/0 00000100:00100000:3.0:1784938439.174984:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 175 00000100:00100000:3.0:1784938439.183456:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938439.183503:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938439.183534:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938439.183567:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938439.183585:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938439.183608:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938439.183626:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938439.183639:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938439.183655:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938439.183764:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337349120 00000100:00100000:1.0:1784938439.183776:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337349120 00000100:00100000:1.0:1784938439.183831:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337349632 00000100:00100000:1.0:1784938439.183834:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337349632 00000100:00100000:1.0:1784938439.183845:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337349248 00000100:00100000:1.0:1784938439.183847:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337349248 00000100:00100000:1.0:1784938439.183858:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337349760 00000100:00100000:1.0:1784938439.183860:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337349760 00000100:00100000:1.0:1784938439.183869:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337348864 00000100:00100000:1.0:1784938439.183871:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337348864 00000100:00100000:1.0:1784938439.183880:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337349376 00000100:00100000:1.0:1784938439.183882:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337349376 00000100:00100000:1.0:1784938439.183889:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337349888 00000100:00100000:1.0:1784938439.183893:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337349888 00000100:00100000:1.0:1784938439.183903:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337348992 00000100:00100000:1.0:1784938439.183905:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337348992 00000100:00100000:1.0:1784938439.183918:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337349504 00000100:00100000:1.0:1784938439.183920:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337349504 00000100:00100000:1.0:1784938439.183936:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 469 00000100:00100000:1.0:1784938439.183946:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+62:10957:x1871643337349120:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:1.0:1784938439.183972:0:21629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.184001:0:21629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b12ac78e/0x7b044d4128f9a8d7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663720 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938439.184036:0:21629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 4117, mtime: 0x6a63ff72, atime: 0x0, ctime: 0x6a63ff72, blocks: 0x10 00010000:00010000:1.0:1784938439.184067:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=705s v=(0 0) 00010000:00010000:1.0:1784938439.184072:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938439.184084:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b12ac78e/0x7b044d4128f9a8d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663720 expref: 63 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.184107:0:21629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b12ac78e/0x7b044d4128f9a8d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663720 expref: 63 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.184124:0:21629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238238a600, rc 0) 00000100:00100000:1.0:1784938439.184237:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+63:10957:x1871643337349120:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 291us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938439.184246:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 469 00000100:00100000:1.0:1784938439.184270:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 470 00000100:00100000:1.0:1784938439.184276:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+62:10957:x1871643337349632:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:1.0:1784938439.184286:0:21629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.184324:0:21629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056e6923c/0x7b044d4128f9a8de lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766373c expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938439.184338:0:21629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 6821, mtime: 0x6a63ff73, atime: 0x0, ctime: 0x6a63ff73, blocks: 0x10 00010000:00010000:1.0:1784938439.184349:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=705s v=(0 0) 00010000:00010000:1.0:1784938439.184352:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938439.184369:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056e6923c/0x7b044d4128f9a8de lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766373c expref: 63 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.184381:0:21629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000056e6923c/0x7b044d4128f9a8de lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766373c expref: 63 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.184390:0:21629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238238ac00, rc 0) 00000100:00100000:1.0:1784938439.184412:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+63:10957:x1871643337349632:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 136us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938439.184417:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 470 00000100:00100000:1.0:1784938439.184430:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 471 00000100:00100000:1.0:1784938439.184436:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+61:10957:x1871643337349248:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:1.0:1784938439.184444:0:21629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.184458:0:21629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097f32afe/0x7b044d4128f9a8e5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663727 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938439.184478:0:21629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 1611, mtime: 0x6a63ff74, atime: 0x0, ctime: 0x6a63ff74, blocks: 0x8 00010000:00010000:1.0:1784938439.184491:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=705s v=(0 0) 00010000:00010000:1.0:1784938439.184495:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938439.184501:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097f32afe/0x7b044d4128f9a8e5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663727 expref: 62 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.184515:0:21629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000097f32afe/0x7b044d4128f9a8e5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663727 expref: 62 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.184524:0:21629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238238aa00, rc 0) 00000100:00100000:1.0:1784938439.184544:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+62:10957:x1871643337349248:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 108us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938439.184550:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 471 00000100:00100000:1.0:1784938439.184563:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 472 00000100:00100000:1.0:1784938439.184569:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+62:10957:x1871643337349760:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:1.0:1784938439.184576:0:21629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.184586:0:21629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b94587ea/0x7b044d4128f9a8ec lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663743 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938439.184599:0:21629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 391200, mtime: 0x6a63ff71, atime: 0x0, ctime: 0x6a63ff71, blocks: 0x300 00010000:00010000:1.0:1784938439.184608:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=705s v=(0 0) 00010000:00010000:1.0:1784938439.184612:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938439.184617:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b94587ea/0x7b044d4128f9a8ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663743 expref: 63 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.184628:0:21629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b94587ea/0x7b044d4128f9a8ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663743 expref: 63 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.184645:0:21629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238238bc00, rc 0) 00000100:00100000:1.0:1784938439.184668:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+63:10957:x1871643337349760:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 99us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938439.184677:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 472 00000100:00100000:1.0:1784938439.184692:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 473 00000100:00100000:1.0:1784938439.184701:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+61:10959:x1871643337348864:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:1.0:1784938439.184709:0:21629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.184722:0:21629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096447157/0x7b044d4128f9a8f3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663712 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938439.184742:0:21629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 2192, mtime: 0x6a63ff72, atime: 0x0, ctime: 0x6a63ff72, blocks: 0x8 00010000:00010000:1.0:1784938439.184757:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=705s v=(0 0) 00010000:00010000:1.0:1784938439.184761:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938439.184769:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096447157/0x7b044d4128f9a8f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663712 expref: 62 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.184804:0:21629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000096447157/0x7b044d4128f9a8f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663712 expref: 62 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.184817:0:21629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238238ba00, rc 0) 00000100:00100000:1.0:1784938439.184848:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+62:10959:x1871643337348864:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 147us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938439.184870:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 473 00000100:00100000:1.0:1784938439.184898:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 475 00000100:00100000:1.0:1784938439.184911:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+62:10959:x1871643337349888:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:1.0:1784938439.184923:0:21629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.184938:0:21629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5824ac7/0x7b044d4128f9a901 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766374a expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938439.184970:0:21629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 227516, mtime: 0x6a63ff74, atime: 0x0, ctime: 0x6a63ff74, blocks: 0x1c0 00010000:00010000:1.0:1784938439.184991:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=705s v=(0 0) 00010000:00010000:1.0:1784938439.184997:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938439.185007:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5824ac7/0x7b044d4128f9a901 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766374a expref: 64 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.185046:0:21629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d5824ac7/0x7b044d4128f9a901 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766374a expref: 64 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.185066:0:21629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238238be00, rc 0) 00000100:00100000:1.0:1784938439.185093:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+64:10959:x1871643337349888:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 186us (1464us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938439.185100:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 475 00000100:00100000:1.0:1784938439.185116:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 476 00000100:00100000:1.0:1784938439.185125:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+63:10959:x1871643337348992:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:1.0:1784938439.185133:0:21629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.185178:0:21629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d310ee32/0x7b044d4128f9a908 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663719 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938439.185215:0:21629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 674, mtime: 0x6a63ff72, atime: 0x0, ctime: 0x6a63ff72, blocks: 0x8 00010000:00010000:1.0:1784938439.185234:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=705s v=(0 0) 00010000:00010000:1.0:1784938439.185245:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938439.185257:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d310ee32/0x7b044d4128f9a908 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663719 expref: 63 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.185277:0:21629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d310ee32/0x7b044d4128f9a908 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663719 expref: 63 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.185288:0:21629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238238b800, rc 0) 00000100:00100000:1.0:1784938439.185326:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+63:10959:x1871643337348992:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 201us (1683us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938439.185346:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 476 00000100:00100000:3.0:1784938439.189017:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938439.189180:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938439.189475:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337350144 00000100:00100000:2.0:1784938439.189485:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337350144 00000100:00100000:2.0:1784938439.189568:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 176 00000100:00100000:2.0:1784938439.189586:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+117:17072:x1871643337350144:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:2.0:1784938439.189680:0:24203:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938439.189722:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dac00/0x7b044d4128f9a064 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663479 expref: 117 pid: 21161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.189744:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9f238dcb4900) 00010000:00010000:2.0:1784938439.189756:0:24203:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938439.189781:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c600/0x7b044d4128f9a91d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.189795:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c600/0x7b044d4128f9a91d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.189805:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c600/0x7b044d4128f9a91d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.189824:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95ce00/0x7b044d4128f9a924 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x610aa076 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.189830:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95ce00/0x7b044d4128f9a924 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.189836:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95ce00/0x7b044d4128f9a924 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.189947:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c200/0x7b044d4128f9a92b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.189954:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c200/0x7b044d4128f9a92b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.189960:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c200/0x7b044d4128f9a92b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784938439.190311:0:24203:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].13, 64 off9024 00010000:00010000:2.0:1784938439.190391:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d400/0x7b044d4128f9a932 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.190401:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d400/0x7b044d4128f9a932 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.190409:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d400/0x7b044d4128f9a932 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.190417:0:24203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d400/0x7b044d4128f9a932 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.190423:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d400/0x7b044d4128f9a932 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.190431:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d400/0x7b044d4128f9a932 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.190457:0:24203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938439.190478:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c200/0x7b044d4128f9a92b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.190485:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c200/0x7b044d4128f9a92b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.190491:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c200/0x7b044d4128f9a92b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.190496:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c95c200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938439.190502:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c200/0x7b044d4128f9a92b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.190511:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c200/0x7b044d4128f9a92b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.190521:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9f238cf4ac00) 00010000:00010000:2.0:1784938439.190523:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784938439.190528:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c200/0x7b044d4128f9a92b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.190534:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c200/0x7b044d4128f9a92b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.190550:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c600/0x7b044d4128f9a91d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.190561:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c600/0x7b044d4128f9a91d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.190566:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c600/0x7b044d4128f9a91d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.190571:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c95c600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938439.190574:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c600/0x7b044d4128f9a91d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.190580:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c600/0x7b044d4128f9a91d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.190587:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:2.0:1784938439.190589:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938439.190592:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c600/0x7b044d4128f9a91d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.190597:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c600/0x7b044d4128f9a91d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938439.190606:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007051c016 reply state 0000000029693ae3 transno 8589934635 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95ce00/0x7b044d4128f9a924 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.190618:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95ce00/0x7b044d4128f9a924 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.190624:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x610aa076 (ffff9f238cf4a700) 00010000:00010000:2.0:1784938439.190626:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938439.190628:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938439.190698:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+118:17072:x1871643337350144:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1113us (1749us total) trans 8589934635 rc 0/0 00000100:00100000:2.0:1784938439.190707:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 176 00000100:00100000:3.0:1784938439.200020:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:1.0:1784938439.205313:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938439.205331:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc400/0x7b044d4128f9a94e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.205344:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fc400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938439.205349:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc400/0x7b044d4128f9a94e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.205371:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc400/0x7b044d4128f9a94e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.205393:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff9f2387231900) 00010000:00010000:1.0:1784938439.205396:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784938439.205402:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc400/0x7b044d4128f9a94e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.205409:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc400/0x7b044d4128f9a94e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.205442:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938439.205446:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938439.205448:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938439.211849:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 482 00000100:00100000:2.0:1784938439.211884:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+67:10959:x1871643337351040:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:2.0:1784938439.211919:0:21149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938439.211949:0:21149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006887c39c/0x7b044d4128f9a96a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766376d expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938439.211976:0:21149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 1735, mtime: 0x6a63ff71, atime: 0x0, ctime: 0x6a63ff71, blocks: 0x8 00010000:00010000:2.0:1784938439.212002:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=705s v=(0 0) 00010000:00010000:2.0:1784938439.212012:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938439.212031:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006887c39c/0x7b044d4128f9a96a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766376d expref: 68 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.212063:0:21149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006887c39c/0x7b044d4128f9a96a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766376d expref: 68 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.212082:0:21149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c95c200, rc 0) 00000100:00100000:2.0:1784938439.212201:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+67:10959:x1871643337351040:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 273us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938439.212215:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 482 00000100:00100000:2.0:1784938439.212248:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337351296 00000100:00100000:2.0:1784938439.212257:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337351296 00000100:00100000:2.0:1784938439.212317:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337351424 00000100:00100000:2.0:1784938439.212323:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337351424 00000100:00100000:2.0:1784938439.212379:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 484 00000100:00100000:2.0:1784938439.212400:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+65:10958:x1871643337351296:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:2.0:1784938439.212414:0:21149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938439.212433:0:21149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000744dbf0d/0x7b044d4128f9a978 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766377b expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938439.212467:0:21149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 855, mtime: 0x6a63ff73, atime: 0x0, ctime: 0x6a63ff73, blocks: 0x8 00010000:00010000:2.0:1784938439.212481:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=705s v=(0 0) 00010000:00010000:2.0:1784938439.212485:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938439.212493:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000744dbf0d/0x7b044d4128f9a978 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766377b expref: 66 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.212508:0:21149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000744dbf0d/0x7b044d4128f9a978 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766377b expref: 66 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.212519:0:21149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c95d400, rc 0) 00000100:00100000:2.0:1784938439.212562:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+66:10958:x1871643337351296:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 166us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938439.212571:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 484 00000100:00100000:2.0:1784938439.212595:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337351552 00000100:00100000:2.0:1784938439.212601:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337351552 00000100:00100000:2.0:1784938439.212625:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337351680 00000100:00100000:2.0:1784938439.212631:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337351680 00000100:00100000:2.0:1784938439.212655:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337351808 00000100:00100000:2.0:1784938439.212661:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337351808 00000100:00100000:2.0:1784938439.212696:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337352192 00000100:00100000:2.0:1784938439.212703:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337352192 00000100:00100000:2.0:1784938439.212721:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337352320 00000100:00100000:2.0:1784938439.212726:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337352320 00000100:00100000:2.0:1784938439.212750:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337352448 00000100:00100000:2.0:1784938439.212757:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337352448 00000100:00100000:2.0:1784938439.212799:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 485 00000100:00100000:2.0:1784938439.212914:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+69:10959:x1871643337351424:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:2.0:1784938439.212924:0:21149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938439.212940:0:21149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004435011c/0x7b044d4128f9a97f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663782 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938439.212955:0:21149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 4512, mtime: 0x6a63ff75, atime: 0x0, ctime: 0x6a63ff75, blocks: 0x10 00010000:00010000:2.0:1784938439.212968:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=705s v=(0 0) 00010000:00010000:2.0:1784938439.212972:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938439.212979:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004435011c/0x7b044d4128f9a97f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663782 expref: 70 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.212993:0:21149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004435011c/0x7b044d4128f9a97f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663782 expref: 70 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.213002:0:21149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c95cc00, rc 0) 00000100:00100000:2.0:1784938439.213037:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+70:10959:x1871643337351424:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 129us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938439.214807:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 487 00000100:00100000:1.0:1784938439.214843:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b35f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+70:10957:x1871643337351680:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:1.0:1784938439.214866:0:21152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.214892:0:21152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb10cc2f/0x7b044d4128f9a98d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663790 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938439.214942:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 269, mtime: 0x6a63ff72, atime: 0x0, ctime: 0x6a63ff72, blocks: 0x8 00010000:00010000:1.0:1784938439.214965:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=705s v=(0 0) 00010000:00010000:1.0:1784938439.214972:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938439.214989:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb10cc2f/0x7b044d4128f9a98d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663790 expref: 71 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.215028:0:21152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cb10cc2f/0x7b044d4128f9a98d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663790 expref: 71 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.215057:0:21152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238238a200, rc 0) 00000100:00100000:1.0:1784938439.215113:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b35f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+72:10957:x1871643337351680:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 286us (2692us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938439.215133:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 487 00000100:00100000:1.0:1784938439.215199:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 489 00000100:00100000:1.0:1784938439.215224:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+71:10957:x1871643337352192:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:1.0:1784938439.215239:0:21152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.215254:0:21152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b818fb0/0x7b044d4128f9a99b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476637ac expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938439.215279:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 1753, mtime: 0x6a63ff73, atime: 0x0, ctime: 0x6a63ff73, blocks: 0x8 00010000:00010000:1.0:1784938439.215295:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=705s v=(0 0) 00010000:00010000:1.0:1784938439.215301:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938439.215310:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b818fb0/0x7b044d4128f9a99b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476637ac expref: 71 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.215346:0:21152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004b818fb0/0x7b044d4128f9a99b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476637ac expref: 71 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.215371:0:21152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238238b000, rc 0) 00000100:00100000:1.0:1784938439.215409:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+71:10957:x1871643337352192:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 192us (2866us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938439.215438:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 489 00000100:00100000:1.0:1784938439.215476:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 491 00000100:00100000:1.0:1784938439.215502:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+71:10959:x1871643337351936:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:1.0:1784938439.215516:0:21152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.215534:0:21152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca568404/0x7b044d4128f9a9a9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766379e expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938439.215562:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 5634, mtime: 0x6a63ff71, atime: 0x0, ctime: 0x6a63ff71, blocks: 0x10 00010000:00010000:1.0:1784938439.215581:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=705s v=(0 0) 00010000:00010000:1.0:1784938439.215588:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938439.215611:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca568404/0x7b044d4128f9a9a9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766379e expref: 71 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.215645:0:21152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ca568404/0x7b044d4128f9a9a9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766379e expref: 71 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.215865:0:21152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238238a800, rc 0) 00000100:00100000:2.0:1784938439.216459:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 485 00000100:00100000:1.0:1784938439.216849:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+71:10959:x1871643337351936:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 1360us (4210us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938439.216857:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 491 00000100:00100000:2.0:1784938439.221894:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938439.221938:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938439.221974:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938439.222013:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938439.222067:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337352832 00000100:00100000:1.0:1784938439.222080:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337352832 00000100:00100000:1.0:1784938439.222186:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337352704 00000100:00100000:1.0:1784938439.222189:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337352704 00000100:00100000:1.0:1784938439.222213:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 494 00000100:00100000:1.0:1784938439.222224:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+71:10958:x1871643337352832:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:1.0:1784938439.222251:0:25715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.222288:0:25715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a14dc117/0x7b044d4128f9a9be lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476637cf expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938439.222323:0:25715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 1754, mtime: 0x6a63ff72, atime: 0x0, ctime: 0x6a63ff72, blocks: 0x8 00010000:00010000:1.0:1784938439.222347:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=705s v=(0 0) 00010000:00010000:1.0:1784938439.222353:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938439.222377:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a14dc117/0x7b044d4128f9a9be lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476637cf expref: 72 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.222399:0:25715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a14dc117/0x7b044d4128f9a9be lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476637cf expref: 72 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.222414:0:25715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fc200, rc 0) 00000100:00100000:1.0:1784938439.222490:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+73:10958:x1871643337352832:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 266us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938439.222498:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 494 00000100:00100000:1.0:1784938439.222526:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 495 00000100:00100000:1.0:1784938439.222541:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+72:10957:x1871643337352704:12345-192.168.202.54@tcp:101:ll_agl.0 00010000:00010000:1.0:1784938439.222548:0:25715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.222568:0:25715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ae6d3d8/0x7b044d4128f9a9c5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476637c8 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938439.222597:0:25715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 938, mtime: 0x6a63ff72, atime: 0x0, ctime: 0x6a63ff72, blocks: 0x8 00010000:00010000:1.0:1784938439.222608:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=705s v=(0 0) 00010000:00010000:1.0:1784938439.222614:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938439.222621:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ae6d3d8/0x7b044d4128f9a9c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476637c8 expref: 73 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.222634:0:25715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009ae6d3d8/0x7b044d4128f9a9c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476637c8 expref: 73 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.222771:0:25715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fc400, rc 0) 00000100:00100000:1.0:1784938439.222804:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+74:10957:x1871643337352704:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 267us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938439.222811:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 495 00000100:00100000:3.0:1784938439.222986:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337352960 00000100:00100000:3.0:1784938439.222993:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337352960 00000100:00100000:3.0:1784938439.223052:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 497 00000100:00100000:3.0:1784938439.223064:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+71:10959:x1871643337352960:12345-192.168.202.54@tcp:101:ll_agl.0 00000100:00100000:2.0:1784938439.223162:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938439.223254:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337353216 00000100:00100000:2.0:1784938439.223264:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337353216 00010000:00010000:3.0:1784938439.223272:0:21149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938439.223310:0:21149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005777c505/0x7b044d4128f9a9d3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476637d6 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938439.223321:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 178 00000100:00100000:2.0:1784938439.223335:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+119:17072:x1871643337353216:12345-192.168.202.54@tcp:36:rm.0 00002000:00010000:3.0:1784938439.223341:0:21149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 1659, mtime: 0x6a63ff73, atime: 0x0, ctime: 0x6a63ff73, blocks: 0x8 00010000:00010000:2.0:1784938439.223411:0:24203:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938439.223417:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=705s v=(0 0) 00010000:00010000:3.0:1784938439.223423:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938439.223442:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e5800/0x7b044d4128f9a1a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476634db expref: 119 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.223466:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x49:0x0].0x0 (ffff9f248fb6a800) 00010000:00010000:2.0:1784938439.223479:0:24203:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938439.223504:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d000/0x7b044d4128f9a9da lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.223518:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d000/0x7b044d4128f9a9da lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.223528:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d000/0x7b044d4128f9a9da lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.223545:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c600/0x7b044d4128f9a9e1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x489b8eb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.223552:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c600/0x7b044d4128f9a9e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.223559:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c600/0x7b044d4128f9a9e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.223664:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9a9e8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.223674:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9a9e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.223840:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005777c505/0x7b044d4128f9a9d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476637d6 expref: 72 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.223862:0:21149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005777c505/0x7b044d4128f9a9d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476637d6 expref: 72 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.223874:0:21149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61a800, rc 0) 00000100:00100000:3.0:1784938439.224081:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+72:10959:x1871643337352960:12345-192.168.202.54@tcp:101:ll_agl.0 Request processed in 1004us (2053us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938439.224090:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 497 00010000:00010000:2.0:1784938439.225215:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9a9e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784938439.225663:0:24203:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].15, 64 off9152 00010000:00010000:2.0:1784938439.227493:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6800/0x7b044d4128f9a9ef lrc: 3/0,1 mode: --/PW res: [0x200000402:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.227524:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6800/0x7b044d4128f9a9ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.227539:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6800/0x7b044d4128f9a9ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.227549:0:24203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6800/0x7b044d4128f9a9ef lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.227556:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6800/0x7b044d4128f9a9ef lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.227563:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6800/0x7b044d4128f9a9ef lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.227594:0:24203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938439.227625:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9a9e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.227633:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9a9e8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.227641:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9a9e8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.227653:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c6a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938439.227660:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9a9e8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.227669:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9a9e8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.227899:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x49:0x0].0x0 (ffff9f249863ba00) 00010000:00010000:2.0:1784938439.227909:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784938439.227918:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9a9e8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x49:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.227947:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9a9e8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x49:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.227982:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d000/0x7b044d4128f9a9da lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.227992:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d000/0x7b044d4128f9a9da lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.228055:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d000/0x7b044d4128f9a9da lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.228063:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c95d000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938439.228067:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d000/0x7b044d4128f9a9da lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.228074:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d000/0x7b044d4128f9a9da lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.228088:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:2.0:1784938439.228091:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938439.228094:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d000/0x7b044d4128f9a9da lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.228100:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d000/0x7b044d4128f9a9da lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938439.228113:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009463231f reply state 00000000a891ff9a transno 8589934637 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c600/0x7b044d4128f9a9e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.228134:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c600/0x7b044d4128f9a9e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.228142:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x489b8eb2 (ffff9f238cf4ac00) 00010000:00010000:2.0:1784938439.228175:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938439.228179:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938439.228322:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+120:17072:x1871643337353216:12345-192.168.202.54@tcp:36:rm.0 Request processed in 4982us (5173us total) trans 8589934637 rc 0/0 00000100:00100000:2.0:1784938439.228332:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 178 00000100:00100000:2.0:1784938439.233327:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337353472 00000100:00100000:2.0:1784938439.233344:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337353472 00000100:00100000:2.0:1784938439.233444:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 179 00000100:00100000:2.0:1784938439.233458:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+120:17072:x1871643337353472:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:2.0:1784938439.233547:0:24201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938439.233591:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9a1c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476634e2 expref: 120 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.233626:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xc:0x0].0x0 (ffff9f248fb6a400) 00010000:00010000:2.0:1784938439.233644:0:24201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938439.233677:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9a9f6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.233766:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9a9f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.233778:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9a9f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.233802:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8b200/0x7b044d4128f9a9fd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x48840fb6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.233809:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8b200/0x7b044d4128f9a9fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.233814:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8b200/0x7b044d4128f9a9fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.233924:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8ae00/0x7b044d4128f9aa04 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.233932:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8ae00/0x7b044d4128f9aa04 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.233939:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8ae00/0x7b044d4128f9aa04 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784938439.235178:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].12, 64 off8960 00010000:00010000:2.0:1784938439.235260:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8a800/0x7b044d4128f9aa0b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.235277:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8a800/0x7b044d4128f9aa0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.235288:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8a800/0x7b044d4128f9aa0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.235297:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8a800/0x7b044d4128f9aa0b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.235303:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8a800/0x7b044d4128f9aa0b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.235310:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8a800/0x7b044d4128f9aa0b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.235327:0:24201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938439.235351:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8ae00/0x7b044d4128f9aa04 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.235370:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8ae00/0x7b044d4128f9aa04 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.235377:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8ae00/0x7b044d4128f9aa04 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.235382:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b6b8ae00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938439.235387:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8ae00/0x7b044d4128f9aa04 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.235395:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8ae00/0x7b044d4128f9aa04 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.235411:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xc:0x0].0x0 (ffff9f248aad5f00) 00010000:00010000:2.0:1784938439.235413:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784938439.235419:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8ae00/0x7b044d4128f9aa04 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.235425:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8ae00/0x7b044d4128f9aa04 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.235447:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9a9f6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.235453:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9a9f6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.235458:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9a9f6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.235463:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9a9f6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.235468:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c7000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938439.235471:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9a9f6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.235476:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9a9f6 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.235483:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:2.0:1784938439.235485:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938439.235487:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9a9f6 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.235497:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9a9f6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938439.235508:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000584172ab reply state 00000000e5303fcf transno 8589934638 ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8b200/0x7b044d4128f9a9fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.235519:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8b200/0x7b044d4128f9a9fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.235525:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x48840fb6 (ffff9f248fb6a800) 00010000:00010000:2.0:1784938439.235528:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938439.235531:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938439.235653:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+121:17072:x1871643337353472:12345-192.168.202.54@tcp:36:rm.0 Request processed in 2193us (2407us total) trans 8589934638 rc 0/0 00000100:00100000:2.0:1784938439.235665:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 179 00000100:00100000:3.0:1784938439.239077:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938439.240627:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 180 00000100:00100000:1.0:1784938439.240644:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+121:17072:x1871643337353728:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:1.0:1784938439.240737:0:24945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938439.240768:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031200/0x7b044d4128f9a1de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476634e9 expref: 121 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.240792:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f248fb6af00) 00010000:00010000:1.0:1784938439.240806:0:24945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938439.240836:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9aa12 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.240852:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9aa12 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.240863:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9aa12 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.240879:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395a00/0x7b044d4128f9aa19 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x45c0cf9c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.240885:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395a00/0x7b044d4128f9aa19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.240896:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395a00/0x7b044d4128f9aa19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.241022:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395c00/0x7b044d4128f9aa20 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.241030:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395c00/0x7b044d4128f9aa20 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.241037:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395c00/0x7b044d4128f9aa20 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784938439.241747:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].16, 64 off9216 00010000:00010000:1.0:1784938439.241812:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395800/0x7b044d4128f9aa27 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.241825:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395800/0x7b044d4128f9aa27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.241835:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395800/0x7b044d4128f9aa27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.241842:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395800/0x7b044d4128f9aa27 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.241850:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395800/0x7b044d4128f9aa27 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.241857:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395800/0x7b044d4128f9aa27 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.241972:0:24945:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938439.242002:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395c00/0x7b044d4128f9aa20 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.242009:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395c00/0x7b044d4128f9aa20 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.242016:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395c00/0x7b044d4128f9aa20 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.242022:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382395c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.242027:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395c00/0x7b044d4128f9aa20 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.242034:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395c00/0x7b044d4128f9aa20 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.242045:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f248fb6cf00) 00010000:00010000:1.0:1784938439.242057:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784938439.242063:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395c00/0x7b044d4128f9aa20 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.242076:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395c00/0x7b044d4128f9aa20 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.242094:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9aa12 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.242099:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9aa12 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.242106:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9aa12 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.242115:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.242119:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9aa12 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.242124:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9aa12 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.242131:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.242133:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.242136:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9aa12 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.242141:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9aa12 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938439.242173:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a1614b1d reply state 00000000d2757667 transno 8589934639 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395a00/0x7b044d4128f9aa19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.242187:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395a00/0x7b044d4128f9aa19 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.242193:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x45c0cf9c (ffff9f248fb6c300) 00010000:00010000:1.0:1784938439.242196:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938439.242198:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938439.242303:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+122:17072:x1871643337353728:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1663us (3233us total) trans 8589934639 rc 0/0 00000100:00100000:1.0:1784938439.242312:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 180 00010000:00010000:3.0:1784938439.242792:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938439.242802:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395800/0x7b044d4128f9aa27 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.242810:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382395800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938439.242816:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395800/0x7b044d4128f9aa27 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.242824:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395800/0x7b044d4128f9aa27 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.242838:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f248fb6cf00) 00010000:00010000:3.0:1784938439.242856:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938439.242861:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395800/0x7b044d4128f9aa27 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.242867:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395800/0x7b044d4128f9aa27 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.242884:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.242886:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.242887:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938439.248980:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:1.0:1784938439.250572:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938439.250579:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00600/0x7b044d4128f9aa43 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.250588:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d00600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938439.250592:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00600/0x7b044d4128f9aa43 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.250598:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00600/0x7b044d4128f9aa43 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.250608:0:19222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36:0x0].0x0 (ffff9f24898dfe00) 00010000:00010000:1.0:1784938439.250610:0:19222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784938439.250613:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00600/0x7b044d4128f9aa43 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.250618:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00600/0x7b044d4128f9aa43 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.250638:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938439.250640:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938439.250642:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938439.264845:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337354240 00000100:00100000:2.0:1784938439.264865:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337354240 00000100:00100000:2.0:1784938439.264989:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 182 00000100:00100000:2.0:1784938439.265002:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+123:17072:x1871643337354240:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:2.0:1784938439.265068:0:24203:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938439.265099:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8b800/0x7b044d4128f9a216 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476634f7 expref: 123 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.265123:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x46:0x0].0x0 (ffff9f248fb6ac00) 00010000:00010000:2.0:1784938439.265136:0:24203:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938439.265186:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8aa00/0x7b044d4128f9aa4a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.265205:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8aa00/0x7b044d4128f9aa4a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.265216:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8aa00/0x7b044d4128f9aa4a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.265341:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8ae00/0x7b044d4128f9aa51 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x7772308b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.265350:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8ae00/0x7b044d4128f9aa51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.265367:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8ae00/0x7b044d4128f9aa51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.265626:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8a800/0x7b044d4128f9aa58 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x46:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.265636:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8a800/0x7b044d4128f9aa58 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.265644:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8a800/0x7b044d4128f9aa58 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784938439.265936:0:24203:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].14, 64 off9088 00010000:00010000:2.0:1784938439.266016:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d600/0x7b044d4128f9aa5f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x46:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.266026:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d600/0x7b044d4128f9aa5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.266034:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d600/0x7b044d4128f9aa5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.266041:0:24203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d600/0x7b044d4128f9aa5f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.266047:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d600/0x7b044d4128f9aa5f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.266053:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d600/0x7b044d4128f9aa5f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.266113:0:24203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938439.266137:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8a800/0x7b044d4128f9aa58 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.266172:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8a800/0x7b044d4128f9aa58 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.266180:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8a800/0x7b044d4128f9aa58 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.266187:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b6b8a800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938439.266191:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8a800/0x7b044d4128f9aa58 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.266199:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8a800/0x7b044d4128f9aa58 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.266209:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x46:0x0].0x0 (ffff9f248aad5b00) 00010000:00010000:2.0:1784938439.266213:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784938439.266217:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8a800/0x7b044d4128f9aa58 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.266237:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8a800/0x7b044d4128f9aa58 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.266255:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8aa00/0x7b044d4128f9aa4a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.266262:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8aa00/0x7b044d4128f9aa4a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.266267:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8aa00/0x7b044d4128f9aa4a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.266272:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b6b8aa00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938439.266275:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8aa00/0x7b044d4128f9aa4a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.266280:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8aa00/0x7b044d4128f9aa4a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.266287:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:2.0:1784938439.266289:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938439.266292:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8aa00/0x7b044d4128f9aa4a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.266296:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8aa00/0x7b044d4128f9aa4a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938439.266305:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000727c7fb5 reply state 00000000e0d8a90b transno 8589934641 ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8ae00/0x7b044d4128f9aa51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.266316:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8ae00/0x7b044d4128f9aa51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.266334:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x7772308b (ffff9f248aad5800) 00010000:00010000:2.0:1784938439.266336:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938439.266339:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938439.266437:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+124:17072:x1871643337354240:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1436us (4507us total) trans 8589934641 rc 0/0 00000100:00100000:2.0:1784938439.266445:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 182 00000100:00100000:2.0:1784938439.271250:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:1.0:1784938439.273191:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938439.273198:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9aa7b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.273203:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c7000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938439.273206:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9aa7b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.273210:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9aa7b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.273218:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0x0 (ffff9f24898df800) 00010000:00010000:1.0:1784938439.273220:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784938439.273230:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9aa7b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.273234:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9aa7b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.273247:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938439.273248:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938439.273249:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938439.286592:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938439.286962:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337354752 00000100:00100000:1.0:1784938439.286973:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337354752 00000100:00100000:1.0:1784938439.287039:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 184 00000100:00100000:1.0:1784938439.287048:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+125:17072:x1871643337354752:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:1.0:1784938439.287115:0:24945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938439.287188:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34c00/0x7b044d4128f9a24e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663505 expref: 125 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.287211:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff9f248fb6aa00) 00010000:00010000:1.0:1784938439.287236:0:24945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938439.287262:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9aa82 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.287276:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9aa82 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.287287:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9aa82 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.287300:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395c00/0x7b044d4128f9aa89 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x868dff87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.287312:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395c00/0x7b044d4128f9aa89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.287318:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395c00/0x7b044d4128f9aa89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.287423:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9aa90 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.287432:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9aa90 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.287439:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9aa90 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784938439.287679:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].18, 64 off9344 00010000:00010000:1.0:1784938439.287729:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395e00/0x7b044d4128f9aa97 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.287738:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395e00/0x7b044d4128f9aa97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.287747:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395e00/0x7b044d4128f9aa97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.287754:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395e00/0x7b044d4128f9aa97 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.287760:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395e00/0x7b044d4128f9aa97 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.287766:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395e00/0x7b044d4128f9aa97 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.287781:0:24945:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938439.287798:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9aa90 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.287804:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9aa90 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.287811:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9aa90 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.287817:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.287822:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9aa90 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.287830:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9aa90 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.287838:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff9f248fb6c800) 00010000:00010000:1.0:1784938439.287841:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784938439.287846:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9aa90 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.287852:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9aa90 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.287866:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9aa82 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.287872:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9aa82 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.287882:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9aa82 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.287887:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.287890:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9aa82 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.287896:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9aa82 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.287903:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.287906:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.287908:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9aa82 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.287914:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9aa82 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938439.287922:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f16f6e79 reply state 00000000c6c67454 transno 8589934643 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395c00/0x7b044d4128f9aa89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.287934:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395c00/0x7b044d4128f9aa89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.287940:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x868dff87 (ffff9f248fb6c400) 00010000:00010000:1.0:1784938439.287942:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938439.287945:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938439.288027:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+126:17072:x1871643337354752:12345-192.168.202.54@tcp:36:rm.0 Request processed in 979us (1445us total) trans 8589934643 rc 0/0 00000100:00100000:1.0:1784938439.288035:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 184 00000100:00100000:2.0:1784938439.300294:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337355008 00000100:00100000:2.0:1784938439.300304:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337355008 00000100:00100000:2.0:1784938439.300387:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 185 00000100:00100000:2.0:1784938439.300398:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+126:17072:x1871643337355008:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:2.0:1784938439.300472:0:24202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938439.300501:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379c000/0x7b044d4128f9a286 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766350c expref: 126 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.300526:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff9f2490bf2b00) 00010000:00010000:2.0:1784938439.300543:0:24202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938439.300566:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9aa9e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.300580:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9aa9e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.300589:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9aa9e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.300605:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d000/0x7b044d4128f9aaa5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x4c7a76ee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.300616:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d000/0x7b044d4128f9aaa5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.300623:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d000/0x7b044d4128f9aaa5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.300707:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c200/0x7b044d4128f9aaac lrc: 3/0,1 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.300715:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c200/0x7b044d4128f9aaac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.300721:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c200/0x7b044d4128f9aaac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784938439.301568:0:24202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].15, 64 off9152 00010000:00010000:2.0:1784938439.301633:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c000/0x7b044d4128f9aab3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.301645:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c000/0x7b044d4128f9aab3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.301654:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c000/0x7b044d4128f9aab3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.301662:0:24202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c000/0x7b044d4128f9aab3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.301669:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c000/0x7b044d4128f9aab3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.301675:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c000/0x7b044d4128f9aab3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.301690:0:24202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938439.301711:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c200/0x7b044d4128f9aaac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.301717:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c200/0x7b044d4128f9aaac lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.301724:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c200/0x7b044d4128f9aaac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.301731:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217c200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938439.301736:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c200/0x7b044d4128f9aaac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.301744:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c200/0x7b044d4128f9aaac lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.301756:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff9f248aad5400) 00010000:00010000:2.0:1784938439.301760:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784938439.301764:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c200/0x7b044d4128f9aaac lrc: 2/0,0 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.301771:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c200/0x7b044d4128f9aaac lrc: 0/0,0 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.301792:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9aa9e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.301798:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9aa9e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.301808:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9aa9e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.301813:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217c800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938439.301816:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9aa9e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.301823:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9aa9e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.301830:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:2.0:1784938439.301833:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938439.301836:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9aa9e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.301842:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9aa9e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938439.301852:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004cee3ba3 reply state 000000001d1372b6 transno 8589934644 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d000/0x7b044d4128f9aaa5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.301863:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d000/0x7b044d4128f9aaa5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.301869:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x4c7a76ee (ffff9f248aad5d00) 00010000:00010000:2.0:1784938439.301871:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938439.301874:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938439.301972:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+127:17072:x1871643337355008:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1573us (1873us total) trans 8589934644 rc 0/0 00000100:00100000:2.0:1784938439.301981:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 185 00000100:00100000:3.0:1784938439.307393:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938439.307601:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337355264 00000100:00100000:1.0:1784938439.307612:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337355264 00000100:00100000:1.0:1784938439.307680:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 186 00000100:00100000:1.0:1784938439.307691:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+127:17072:x1871643337355264:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:1.0:1784938439.307758:0:24945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938439.307790:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9a2a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663513 expref: 127 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.307810:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff9f2490bf2700) 00010000:00010000:1.0:1784938439.307821:0:24945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938439.307850:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9aaba lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.307865:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9aaba lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.307877:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9aaba lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.307893:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394400/0x7b044d4128f9aac1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0xb2d5a33e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.307899:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394400/0x7b044d4128f9aac1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.307906:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394400/0x7b044d4128f9aac1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.308075:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9aac8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.308089:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9aac8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.308096:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9aac8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784938439.308753:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].19, 64 off9408 00010000:00010000:1.0:1784938439.308814:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9aacf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.308825:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9aacf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.308833:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9aacf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.308841:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9aacf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.308847:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9aacf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.308853:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9aacf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.308878:0:24945:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938439.308898:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9aac8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.308905:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9aac8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.308916:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9aac8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.308922:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382395200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.308927:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9aac8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.308935:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9aac8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.308946:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff9f248fb6ca00) 00010000:00010000:1.0:1784938439.308949:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784938439.308953:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9aac8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.308959:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9aac8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.308976:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9aaba lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.308983:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9aaba lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.309105:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938439.309113:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9aacf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.309120:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382395400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938439.309124:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9aacf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.309131:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9aacf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.309142:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff9f248fb6ca00) 00010000:00010000:1.0:1784938439.309210:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9aaba lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.309215:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.309218:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9aaba lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.309307:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938439.309312:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9aacf lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.309319:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9aacf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.309594:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.309614:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.309616:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938439.309652:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9aaba lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.309662:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.309664:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.309668:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9aaba lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.309674:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9aaba lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938439.309685:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000039ebf0ee reply state 00000000c60d209f transno 8589934645 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394400/0x7b044d4128f9aac1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.309696:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394400/0x7b044d4128f9aac1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.309703:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xb2d5a33e (ffff9f248fb6c000) 00010000:00010000:1.0:1784938439.309705:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938439.309709:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938439.309803:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+128:17072:x1871643337355264:12345-192.168.202.54@tcp:36:rm.0 Request processed in 2111us (2429us total) trans 8589934645 rc 0/0 00000100:00100000:1.0:1784938439.309812:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 186 00000100:00100000:1.0:1784938439.318893:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:1.0:1784938439.320130:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938439.320137:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9aaeb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.320175:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c7000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938439.320180:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9aaeb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.320187:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9aaeb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.320196:0:19222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3c:0x0].0x0 (ffff9f24898df200) 00010000:00010000:1.0:1784938439.320198:0:19222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784938439.320201:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9aaeb lrc: 1/0,0 mode: --/PW res: [0x200000402:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.320207:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9aaeb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.320221:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938439.320223:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938439.320234:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938439.330340:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337355776 00000100:00100000:2.0:1784938439.330352:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337355776 00000100:00100000:2.0:1784938439.330426:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 188 00000100:00100000:2.0:1784938439.330436:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+129:17072:x1871643337355776:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:2.0:1784938439.330501:0:24203:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938439.330535:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6800/0x7b044d4128f9a2f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663521 expref: 129 pid: 21161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.330556:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff9f23861f4200) 00010000:00010000:2.0:1784938439.330572:0:24203:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938439.330604:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9aaf2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.330621:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9aaf2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.330634:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9aaf2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.330653:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c200/0x7b044d4128f9aaf9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0xff118af2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.330660:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c200/0x7b044d4128f9aaf9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.330665:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c200/0x7b044d4128f9aaf9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.330757:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c400/0x7b044d4128f9ab00 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.330770:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c400/0x7b044d4128f9ab00 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.330776:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c400/0x7b044d4128f9ab00 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784938439.331071:0:24203:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].17, 64 off9280 00010000:00010000:2.0:1784938439.331128:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d400/0x7b044d4128f9ab07 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.331138:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d400/0x7b044d4128f9ab07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.331201:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d400/0x7b044d4128f9ab07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.331209:0:24203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d400/0x7b044d4128f9ab07 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.331216:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d400/0x7b044d4128f9ab07 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.331230:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d400/0x7b044d4128f9ab07 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.331254:0:24203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938439.331273:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c400/0x7b044d4128f9ab00 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.331279:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c400/0x7b044d4128f9ab00 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.331290:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c400/0x7b044d4128f9ab00 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.331296:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217c400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938439.331301:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c400/0x7b044d4128f9ab00 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.331310:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c400/0x7b044d4128f9ab00 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.331321:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff9f248aad5b00) 00010000:00010000:2.0:1784938439.331324:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784938439.331328:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c400/0x7b044d4128f9ab00 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.331334:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c400/0x7b044d4128f9ab00 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.331351:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9aaf2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.331368:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9aaf2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.331374:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9aaf2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.331379:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217c800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938439.331382:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9aaf2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.331392:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9aaf2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.331400:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:2.0:1784938439.331402:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938439.331405:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9aaf2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.331411:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9aaf2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938439.331422:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aff7c78e reply state 00000000a5ee7ffd transno 8589934647 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c200/0x7b044d4128f9aaf9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.331434:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c200/0x7b044d4128f9aaf9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.331440:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xff118af2 (ffff9f248aad5400) 00010000:00010000:2.0:1784938439.331443:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938439.331445:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938439.331534:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+130:17072:x1871643337355776:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1099us (1306us total) trans 8589934647 rc 0/0 00000100:00100000:2.0:1784938439.331543:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 188 00000100:00100000:3.0:1784938439.334850:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:1.0:1784938439.336122:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938439.336129:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9ab23 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.336135:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d00c00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938439.336138:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9ab23 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.336178:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9ab23 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.336187:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f24898dff00) 00010000:00010000:1.0:1784938439.336189:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784938439.336192:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9ab23 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.336197:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9ab23 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.336212:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938439.336214:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938439.336215:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938439.346353:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337356288 00000100:00100000:2.0:1784938439.346374:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337356288 00000100:00100000:2.0:1784938439.346453:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 190 00000100:00100000:2.0:1784938439.346464:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23883ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+131:17072:x1871643337356288:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:2.0:1784938439.346529:0:24203:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938439.346556:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625f400/0x7b044d4128f9a32e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766352f expref: 131 pid: 21161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.346578:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff9f23861f4100) 00010000:00010000:2.0:1784938439.346590:0:24203:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938439.346614:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9ab2a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.346628:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9ab2a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.346638:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9ab2a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.346654:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c400/0x7b044d4128f9ab31 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x37dcc2d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.346660:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c400/0x7b044d4128f9ab31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.346667:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c400/0x7b044d4128f9ab31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.346745:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ce00/0x7b044d4128f9ab38 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.346753:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ce00/0x7b044d4128f9ab38 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.346759:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ce00/0x7b044d4128f9ab38 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784938439.347569:0:24203:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].19, 64 off9408 00010000:00010000:2.0:1784938439.347628:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d800/0x7b044d4128f9ab3f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.347640:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d800/0x7b044d4128f9ab3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.347649:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d800/0x7b044d4128f9ab3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.347656:0:24203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d800/0x7b044d4128f9ab3f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.347662:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d800/0x7b044d4128f9ab3f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.347669:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d800/0x7b044d4128f9ab3f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.347692:0:24203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938439.347711:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ce00/0x7b044d4128f9ab38 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.347718:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ce00/0x7b044d4128f9ab38 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.347725:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ce00/0x7b044d4128f9ab38 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.347731:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217ce00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938439.347736:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ce00/0x7b044d4128f9ab38 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.347745:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ce00/0x7b044d4128f9ab38 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.347760:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff9f248aad5b00) 00010000:00010000:2.0:1784938439.347763:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784938439.347766:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ce00/0x7b044d4128f9ab38 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.347772:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ce00/0x7b044d4128f9ab38 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.347803:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9ab2a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.347810:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9ab2a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.347815:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9ab2a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.347820:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217c800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938439.347823:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9ab2a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.347829:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9ab2a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.347836:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:2.0:1784938439.347839:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938439.347841:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9ab2a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.347847:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9ab2a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938439.347860:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000085f37b9e reply state 00000000fa1fbf42 transno 8589934649 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c400/0x7b044d4128f9ab31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.347871:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c400/0x7b044d4128f9ab31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.347878:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x37dcc2d3 (ffff9f248aad5f00) 00010000:00010000:2.0:1784938439.347880:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938439.347882:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938439.347971:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23883ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+132:17072:x1871643337356288:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1507us (2303us total) trans 8589934649 rc 0/0 00000100:00100000:2.0:1784938439.347980:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 190 00010000:00010000:1.0:1784938439.348535:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938439.348543:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d800/0x7b044d4128f9ab3f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.348551:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217d800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938439.348554:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d800/0x7b044d4128f9ab3f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.348562:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d800/0x7b044d4128f9ab3f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.348572:0:19222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff9f248aad5b00) 00010000:00010000:1.0:1784938439.348575:0:19222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784938439.348578:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d800/0x7b044d4128f9ab3f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.348584:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d800/0x7b044d4128f9ab3f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.348602:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938439.348603:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938439.348605:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938439.351769:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:3.0:1784938439.362978:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938439.363004:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9ab5b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.363018:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d00c00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938439.363023:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9ab5b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.363034:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9ab5b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.363053:0:19223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff9f24898dff00) 00010000:00010000:3.0:1784938439.363057:0:19223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938439.363062:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9ab5b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.363069:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9ab5b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.363093:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.363095:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.363097:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938439.364039:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938439.364111:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337356800 00000100:00100000:1.0:1784938439.364121:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337356800 00000100:00100000:1.0:1784938439.364199:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 192 00000100:00100000:1.0:1784938439.364209:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+133:17072:x1871643337356800:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:1.0:1784938439.364264:0:24945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938439.364301:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ae00/0x7b044d4128f9a366 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766353d expref: 133 pid: 21161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.364318:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3a:0x0].0x0 (ffff9f24898dfd00) 00010000:00010000:1.0:1784938439.364327:0:24945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938439.364346:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9ab62 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.364368:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9ab62 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.364379:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9ab62 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.364394:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394800/0x7b044d4128f9ab69 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0xa38d6329 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.364401:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394800/0x7b044d4128f9ab69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.364407:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394800/0x7b044d4128f9ab69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.364679:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ab70 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.364687:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ab70 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.364693:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ab70 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784938439.364923:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].21, 64 off9536 00010000:00010000:1.0:1784938439.364972:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9ab77 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.364981:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9ab77 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.364989:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9ab77 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.364998:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9ab77 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.365003:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9ab77 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.365009:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9ab77 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.365030:0:24945:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938439.365048:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ab70 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.365055:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ab70 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.365061:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ab70 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.365066:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.365070:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ab70 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.365079:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ab70 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.365088:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3a:0x0].0x0 (ffff9f248fb6c800) 00010000:00010000:1.0:1784938439.365091:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784938439.365095:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ab70 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.365100:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ab70 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.365114:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9ab62 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.365121:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9ab62 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.365125:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9ab62 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.365130:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382395200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.365132:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9ab62 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.365137:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9ab62 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.365523:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938439.365532:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9ab77 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.365540:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382395000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938439.365544:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9ab77 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.365573:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9ab77 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.365585:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3a:0x0].0x0 (ffff9f248fb6c800) 00010000:00010000:3.0:1784938439.365587:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938439.365591:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9ab77 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.365597:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9ab77 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.365614:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.365616:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.365618:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938439.365726:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.365730:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.365734:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9ab62 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.365740:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9ab62 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938439.365758:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003ea39cce reply state 00000000b16c5f19 transno 8589934651 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394800/0x7b044d4128f9ab69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.365770:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394800/0x7b044d4128f9ab69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.365776:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xa38d6329 (ffff9f248fb6ca00) 00010000:00010000:1.0:1784938439.365778:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938439.365781:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938439.365904:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+134:17072:x1871643337356800:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1693us (1867us total) trans 8589934651 rc 0/0 00000100:00100000:1.0:1784938439.365913:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 192 00000100:00100000:1.0:1784938439.374989:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938439.375241:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337357056 00000100:00100000:3.0:1784938439.375252:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337357056 00000100:00100000:3.0:1784938439.375312:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 193 00000100:00100000:3.0:1784938439.375335:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+134:17072:x1871643337357056:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:3.0:1784938439.375432:0:24201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938439.375460:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039c00/0x7b044d4128f9a382 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663544 expref: 134 pid: 21161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.375479:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff9f24898dfb00) 00010000:00010000:3.0:1784938439.375491:0:24201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938439.375514:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9ab7e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.375528:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9ab7e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.375552:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9ab7e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.375571:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d000/0x7b044d4128f9ab85 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0xd47b514a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.375579:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d000/0x7b044d4128f9ab85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.375586:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d000/0x7b044d4128f9ab85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.375672:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9ab8c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.375681:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9ab8c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.375687:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9ab8c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784938439.375935:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].20, 64 off9472 00010000:00010000:3.0:1784938439.375999:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01c00/0x7b044d4128f9ab93 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x45:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.376009:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01c00/0x7b044d4128f9ab93 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.376018:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01c00/0x7b044d4128f9ab93 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.376026:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01c00/0x7b044d4128f9ab93 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.376040:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01c00/0x7b044d4128f9ab93 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.376046:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01c00/0x7b044d4128f9ab93 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.376073:0:24201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938439.376095:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9ab8c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.376102:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9ab8c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.376108:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9ab8c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.376115:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17ac00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938439.376120:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9ab8c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.376128:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9ab8c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.376137:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff9f2485293d00) 00010000:00010000:3.0:1784938439.376140:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784938439.376785:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938439.376796:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01c00/0x7b044d4128f9ab93 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.376804:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e01c00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938439.376808:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01c00/0x7b044d4128f9ab93 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.376815:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01c00/0x7b044d4128f9ab93 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.376826:0:19222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff9f2485293d00) 00010000:00010000:1.0:1784938439.376829:0:19222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784938439.376833:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01c00/0x7b044d4128f9ab93 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.376839:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01c00/0x7b044d4128f9ab93 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.376855:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938439.376857:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938439.376858:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.378627:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9ab8c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.378644:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9ab8c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.378708:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9ab7e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.378716:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9ab7e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.378723:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9ab7e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.378729:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9ab7e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.378736:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c95c800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938439.378742:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9ab7e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.378750:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9ab7e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.378767:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:3.0:1784938439.378770:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938439.378775:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9ab7e lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.378781:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9ab7e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938439.378793:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d5a8b176 reply state 0000000058b34227 transno 8589934652 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d000/0x7b044d4128f9ab85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.378806:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d000/0x7b044d4128f9ab85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.378822:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xd47b514a (ffff9f2485293500) 00010000:00010000:3.0:1784938439.378825:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938439.378829:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938439.379383:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+135:17072:x1871643337357056:12345-192.168.202.54@tcp:36:rm.0 Request processed in 4055us (4401us total) trans 8589934652 rc 0/0 00000100:00100000:1.0:1784938439.379395:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 193 00000100:00100000:2.0:1784938439.395208:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:3.0:1784938439.396811:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938439.396819:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9abaf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.396826:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c6a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938439.396829:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9abaf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.396836:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9abaf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.396847:0:19223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f24898df800) 00010000:00010000:3.0:1784938439.396849:0:19223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938439.396852:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9abaf lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.396858:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9abaf lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.396874:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.396876:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.396878:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.400449:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938439.402835:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:2.0:1784938439.404455:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938439.404464:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9abcb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.404470:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3cc00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938439.404474:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9abcb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.404485:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9abcb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.404495:0:19222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff9f24898dfe00) 00010000:00010000:2.0:1784938439.404497:0:19222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784938439.404501:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9abcb lrc: 1/0,0 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.404506:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9abcb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.404521:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938439.404523:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938439.404525:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938439.408024:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938439.408183:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337357824 00000100:00100000:3.0:1784938439.408194:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337357824 00000100:00100000:3.0:1784938439.408253:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 196 00000100:00100000:3.0:1784938439.408264:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+137:17072:x1871643337357824:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:3.0:1784938439.408366:0:24945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938439.408395:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039e00/0x7b044d4128f9a3d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663559 expref: 137 pid: 21161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.408415:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8:0x0].0x0 (ffff9f24898df400) 00010000:00010000:3.0:1784938439.408426:0:24945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938439.408448:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01600/0x7b044d4128f9abd2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.408461:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01600/0x7b044d4128f9abd2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.408471:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01600/0x7b044d4128f9abd2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.408485:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00800/0x7b044d4128f9abd9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x9fe9a331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.408492:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00800/0x7b044d4128f9abd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.408498:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00800/0x7b044d4128f9abd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.408576:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01e00/0x7b044d4128f9abe0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.408584:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01e00/0x7b044d4128f9abe0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.408590:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01e00/0x7b044d4128f9abe0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784938439.408821:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].23, 64 off9664 00010000:00010000:3.0:1784938439.408869:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00c00/0x7b044d4128f9abe7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.408879:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00c00/0x7b044d4128f9abe7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.408887:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00c00/0x7b044d4128f9abe7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.408893:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00c00/0x7b044d4128f9abe7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.408899:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00c00/0x7b044d4128f9abe7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.408905:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00c00/0x7b044d4128f9abe7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.408926:0:24945:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938439.408943:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938439.408948:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00c00/0x7b044d4128f9abe7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.408954:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00c00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938439.408958:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00c00/0x7b044d4128f9abe7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.408966:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00c00/0x7b044d4128f9abe7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.408975:0:19223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8:0x0].0x0 (ffff9f2485293800) 00010000:00010000:3.0:1784938439.408985:0:19223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938439.408990:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00c00/0x7b044d4128f9abe7 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.408996:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00c00/0x7b044d4128f9abe7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.409007:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.409009:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.409011:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.409025:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01e00/0x7b044d4128f9abe0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.409031:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01e00/0x7b044d4128f9abe0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.409038:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01e00/0x7b044d4128f9abe0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.409043:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e01e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938439.409046:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01e00/0x7b044d4128f9abe0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.409066:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01e00/0x7b044d4128f9abe0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.409075:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8:0x0].0x0 (ffff9f2485293800) 00010000:00010000:3.0:1784938439.409077:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784938439.409080:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01e00/0x7b044d4128f9abe0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.409085:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01e00/0x7b044d4128f9abe0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.409112:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01600/0x7b044d4128f9abd2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.409119:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01600/0x7b044d4128f9abd2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.409124:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01600/0x7b044d4128f9abd2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.409130:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e01600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938439.409133:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01600/0x7b044d4128f9abd2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.409138:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01600/0x7b044d4128f9abd2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.409164:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:3.0:1784938439.409167:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938439.409170:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01600/0x7b044d4128f9abd2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.409176:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01600/0x7b044d4128f9abd2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938439.409185:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004b1aafb6 reply state 0000000070a30869 transno 8589934655 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00800/0x7b044d4128f9abd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.409195:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00800/0x7b044d4128f9abd9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.409200:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x9fe9a331 (ffff9f2485293d00) 00010000:00010000:3.0:1784938439.409208:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938439.409212:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938439.410172:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+138:17072:x1871643337357824:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1880us (2126us total) trans 8589934655 rc 0/0 00000100:00100000:3.0:1784938439.410183:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 196 00000100:00100000:3.0:1784938439.412695:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:3.0:1784938439.419703:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938439.419721:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d400/0x7b044d4128f9ac03 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.419732:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3d400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938439.419736:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d400/0x7b044d4128f9ac03 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.419746:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d400/0x7b044d4128f9ac03 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.419764:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3f:0x0].0x0 (ffff9f24898dfb00) 00010000:00010000:3.0:1784938439.419768:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938439.419773:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d400/0x7b044d4128f9ac03 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.419779:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d400/0x7b044d4128f9ac03 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938439.420175:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337358336 00000100:00100000:1.0:1784938439.420185:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337358336 00000100:00100000:1.0:1784938439.420244:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 198 00000100:00100000:1.0:1784938439.420253:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23883efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+139:17072:x1871643337358336:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:1.0:1784938439.420336:0:24203:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938439.420364:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fce00/0x7b044d4128f9a4a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663567 expref: 139 pid: 21161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.420377:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x40:0x0].0x0 (ffff9f24898dfa00) 00010000:00010000:1.0:1784938439.420385:0:24203:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938439.420411:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ac0a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.420424:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ac0a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.420434:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ac0a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.420448:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9ac11 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0xe708c894 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.420458:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9ac11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.420464:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9ac11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.420551:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9ac18 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.420559:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9ac18 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.420565:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9ac18 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784938439.420829:0:24203:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].24, 64 off9728 00010000:00010000:1.0:1784938439.420880:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9ac1f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.420889:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9ac1f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.420896:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9ac1f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.420903:0:24203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9ac1f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.420909:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9ac1f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.420915:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9ac1f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.420937:0:24203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938439.420955:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9ac18 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.420961:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9ac18 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.420967:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9ac18 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.420972:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382395000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.420976:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9ac18 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.420982:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9ac18 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.420990:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x40:0x0].0x0 (ffff9f248fb6c800) 00010000:00010000:1.0:1784938439.420993:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784938439.420996:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9ac18 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.421003:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9ac18 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.421018:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ac0a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.421023:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ac0a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.421033:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ac0a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.421038:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.421040:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ac0a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.421046:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ac0a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.421053:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.421056:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.421059:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ac0a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.421064:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ac0a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938439.421073:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000041eddf20 reply state 00000000f8a0d915 transno 8589934657 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9ac11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.421083:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9ac11 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.421090:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xe708c894 (ffff9f248fb6cf00) 00010000:00010000:1.0:1784938439.421092:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938439.421094:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938439.421192:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23883efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+140:17072:x1871643337358336:12345-192.168.202.54@tcp:36:rm.0 Request processed in 939us (1141us total) trans 8589934657 rc 0/0 00000100:00100000:1.0:1784938439.421199:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 198 00000100:00100000:1.0:1784938439.424623:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:3.0:1784938439.426403:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938439.426411:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9ac3b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.426419:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3d000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938439.426422:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9ac3b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.426446:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9ac3b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.426457:0:19223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x26:0x0].0x0 (ffff9f24898dfd00) 00010000:00010000:3.0:1784938439.426460:0:19223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938439.426464:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9ac3b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.426469:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9ac3b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.426489:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.426491:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.426492:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938439.427185:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938439.427190:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938439.427192:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938439.431773:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938439.431888:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337358848 00000100:00100000:1.0:1784938439.431901:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337358848 00000100:00100000:1.0:1784938439.431975:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 200 00000100:00100000:1.0:1784938439.431986:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+141:17072:x1871643337358848:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:1.0:1784938439.432047:0:24203:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938439.432089:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9a581 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663575 expref: 141 pid: 21161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.432110:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4d:0x0].0x0 (ffff9f248300a300) 00010000:00010000:1.0:1784938439.432122:0:24203:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938439.432187:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ac42 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.432201:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ac42 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.432212:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ac42 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.432230:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9ac49 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x9ce4d69c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.432238:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9ac49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.432244:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9ac49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.432333:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9ac50 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.432346:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9ac50 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.432352:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9ac50 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784938439.432604:0:24203:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].23, 64 off9664 00010000:00010000:1.0:1784938439.432662:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9ac57 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.432671:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9ac57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.432679:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9ac57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.432686:0:24203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9ac57 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.432692:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9ac57 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.432698:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9ac57 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.432717:0:24203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938439.432734:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9ac50 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.432740:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9ac50 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.432749:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9ac50 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.432756:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382395400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.432760:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9ac50 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.432767:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9ac50 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.432776:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4d:0x0].0x0 (ffff9f248fb6b400) 00010000:00010000:1.0:1784938439.432779:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784938439.432782:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9ac50 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.432788:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9ac50 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.432805:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ac42 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.432811:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ac42 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.432816:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ac42 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.432820:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.432823:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ac42 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.432832:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ac42 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.432839:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.432841:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.432844:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ac42 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.432849:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ac42 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938439.432857:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000d644d81 reply state 000000008e1982f2 transno 8589934659 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9ac49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.432867:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9ac49 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.432873:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x9ce4d69c (ffff9f248fb6c800) 00010000:00010000:1.0:1784938439.432875:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938439.432878:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938439.432955:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+142:17072:x1871643337358848:12345-192.168.202.54@tcp:36:rm.0 Request processed in 970us (1191us total) trans 8589934659 rc 0/0 00000100:00100000:1.0:1784938439.432963:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 200 00000100:00100000:1.0:1784938439.437495:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337359104 00000100:00100000:1.0:1784938439.437505:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337359104 00000100:00100000:1.0:1784938439.437565:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 201 00000100:00100000:1.0:1784938439.437575:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23883ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+142:17072:x1871643337359104:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:1.0:1784938439.437633:0:24201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938439.437658:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00400/0x7b044d4128f9a5b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766357c expref: 142 pid: 21161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.437678:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9f248300af00) 00010000:00010000:1.0:1784938439.437689:0:24201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938439.437709:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395e00/0x7b044d4128f9ac5e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.437722:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395e00/0x7b044d4128f9ac5e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.437731:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395e00/0x7b044d4128f9ac5e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.437744:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395800/0x7b044d4128f9ac65 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x2893e4db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.437750:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395800/0x7b044d4128f9ac65 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.437756:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395800/0x7b044d4128f9ac65 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.437843:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9ac6c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.437849:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9ac6c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.437855:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9ac6c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784938439.438087:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].26, 64 off9856 00010000:00010000:1.0:1784938439.438300:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9ac73 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.438312:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9ac73 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.438320:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9ac73 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.438327:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9ac73 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.438333:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9ac73 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.438340:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9ac73 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.438373:0:24201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938439.438393:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9ac6c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.438399:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9ac6c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.438405:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9ac6c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.438411:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.438415:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9ac6c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.438423:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9ac6c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.438437:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9f248fb6b000) 00010000:00010000:1.0:1784938439.438440:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784938439.438443:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9ac6c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.438449:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9ac6c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.438468:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395e00/0x7b044d4128f9ac5e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.438474:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395e00/0x7b044d4128f9ac5e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.438479:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395e00/0x7b044d4128f9ac5e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.438484:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395e00/0x7b044d4128f9ac5e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.438489:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382395e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.438492:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395e00/0x7b044d4128f9ac5e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.438498:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395e00/0x7b044d4128f9ac5e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.438505:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.438507:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.438510:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395e00/0x7b044d4128f9ac5e lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.438519:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395e00/0x7b044d4128f9ac5e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938439.438530:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d4941913 reply state 000000001e57b727 transno 8589934660 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395800/0x7b044d4128f9ac65 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.438540:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395800/0x7b044d4128f9ac65 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.438547:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x2893e4db (ffff9f248fb6b800) 00010000:00010000:1.0:1784938439.438549:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938439.438551:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938439.438625:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23883ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+143:17072:x1871643337359104:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1049us (1221us total) trans 8589934660 rc 0/0 00000100:00100000:1.0:1784938439.438633:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 201 00010000:00010000:3.0:1784938439.439003:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938439.439011:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9ac73 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.439017:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fcc00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938439.439021:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9ac73 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.439028:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9ac73 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.439038:0:19223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9f248fb6b000) 00010000:00010000:3.0:1784938439.439040:0:19223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938439.439043:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9ac73 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.439069:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9ac73 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.439085:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.439086:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.439088:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938439.443222:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938439.443320:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337359360 00000100:00100000:1.0:1784938439.443331:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337359360 00000100:00100000:1.0:1784938439.443402:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 202 00000100:00100000:1.0:1784938439.443415:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+143:17072:x1871643337359360:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:1.0:1784938439.443486:0:24203:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938439.443518:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01800/0x7b044d4128f9a65a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663583 expref: 143 pid: 21161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.443541:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff9f248300a200) 00010000:00010000:1.0:1784938439.443556:0:24203:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938439.443587:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9ac7a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.443604:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9ac7a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.443615:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9ac7a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.443629:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc000/0x7b044d4128f9ac81 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0xecc4f14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.443635:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc000/0x7b044d4128f9ac81 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.443641:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc000/0x7b044d4128f9ac81 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.443732:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fce00/0x7b044d4128f9ac88 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.443740:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fce00/0x7b044d4128f9ac88 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.443746:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fce00/0x7b044d4128f9ac88 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784938439.444017:0:24203:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].24, 64 off9728 00010000:00010000:1.0:1784938439.444066:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9ac8f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.444075:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9ac8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.444082:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9ac8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.444089:0:24203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9ac8f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.444095:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9ac8f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.444100:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9ac8f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.444125:0:24203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938439.444142:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fce00/0x7b044d4128f9ac88 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.444175:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fce00/0x7b044d4128f9ac88 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.444182:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fce00/0x7b044d4128f9ac88 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.444187:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fce00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.444190:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fce00/0x7b044d4128f9ac88 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.444197:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fce00/0x7b044d4128f9ac88 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.444205:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff9f248fb6b500) 00010000:00010000:1.0:1784938439.444208:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784938439.444211:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fce00/0x7b044d4128f9ac88 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.444220:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fce00/0x7b044d4128f9ac88 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.444235:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9ac7a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.444241:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9ac7a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.444246:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9ac7a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.444251:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fd600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.444253:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9ac7a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.444259:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9ac7a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.444267:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.444269:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.444272:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9ac7a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.444277:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9ac7a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938439.444286:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000024daa6ca reply state 0000000089172b3c transno 8589934661 ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc000/0x7b044d4128f9ac81 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.444296:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc000/0x7b044d4128f9ac81 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.444302:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xecc4f14 (ffff9f248fb6ba00) 00010000:00010000:1.0:1784938439.444304:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938439.444307:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938439.444383:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+144:17072:x1871643337359360:12345-192.168.202.54@tcp:36:rm.0 Request processed in 970us (1171us total) trans 8589934661 rc 0/0 00000100:00100000:1.0:1784938439.444391:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 202 00010000:00010000:2.0:1784938439.445101:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938439.445111:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9ac8f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.445118:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057e00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938439.445122:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9ac8f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.445130:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9ac8f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.445141:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff9f248fb6b500) 00010000:00010000:2.0:1784938439.445178:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784938439.445182:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9ac8f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.445188:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9ac8f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.445204:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938439.445207:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938439.445209:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938439.452308:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938439.452411:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337359616 00000100:00100000:1.0:1784938439.452422:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337359616 00000100:00100000:1.0:1784938439.452476:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 203 00000100:00100000:1.0:1784938439.452486:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+144:17072:x1871643337359616:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:1.0:1784938439.452553:0:24201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938439.452582:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9a676 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766358a expref: 144 pid: 21161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.452602:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff9f248300a800) 00010000:00010000:1.0:1784938439.452614:0:24201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938439.452640:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f9ac96 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.452653:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f9ac96 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.452663:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f9ac96 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.452680:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02400/0x7b044d4128f9ac9d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x4ee593e6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.452686:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02400/0x7b044d4128f9ac9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.452693:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02400/0x7b044d4128f9ac9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.452785:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02800/0x7b044d4128f9aca4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.452792:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02800/0x7b044d4128f9aca4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.452798:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02800/0x7b044d4128f9aca4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784938439.453065:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].25, 64 off9792 00010000:00010000:1.0:1784938439.457953:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9acab lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.457980:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9acab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.457993:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9acab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.458004:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9acab lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.458010:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9acab lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.458017:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9acab lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.458044:0:24201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938439.458081:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02800/0x7b044d4128f9aca4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.458087:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02800/0x7b044d4128f9aca4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.458093:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02800/0x7b044d4128f9aca4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.458099:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e02800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.458104:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02800/0x7b044d4128f9aca4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.458112:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02800/0x7b044d4128f9aca4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.458342:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff9f248fb6b300) 00010000:00010000:1.0:1784938439.458347:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784938439.458353:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02800/0x7b044d4128f9aca4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.458371:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02800/0x7b044d4128f9aca4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.458403:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f9ac96 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.458410:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f9ac96 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.458416:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f9ac96 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.458422:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f9ac96 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.458429:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4056600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.458432:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f9ac96 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.458438:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f9ac96 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.458447:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.458449:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.458452:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f9ac96 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.458458:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056600/0x7b044d4128f9ac96 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938439.458469:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ad3a6796 reply state 00000000e38efacb transno 8589934662 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02400/0x7b044d4128f9ac9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.458481:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02400/0x7b044d4128f9ac9d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.458487:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x4ee593e6 (ffff9f248fb6bc00) 00010000:00010000:1.0:1784938439.458489:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938439.458492:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938439.458589:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+145:17072:x1871643337359616:12345-192.168.202.54@tcp:36:rm.0 Request processed in 6100us (6286us total) trans 8589934662 rc 0/0 00000100:00100000:1.0:1784938439.458599:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 203 00000100:00100000:3.0:1784938439.461474:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938439.461673:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337359872 00000100:00100000:1.0:1784938439.461682:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337359872 00000100:00100000:1.0:1784938439.461727:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 204 00000100:00100000:1.0:1784938439.461734:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+145:17072:x1871643337359872:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:1.0:1784938439.461794:0:24203:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938439.461817:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9a44d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663591 expref: 145 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.461839:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff9f24975b2600) 00010000:00010000:1.0:1784938439.461850:0:24203:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938439.461884:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03000/0x7b044d4128f9acb2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.461895:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03000/0x7b044d4128f9acb2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.461904:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03000/0x7b044d4128f9acb2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.461915:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02a00/0x7b044d4128f9acb9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0xf4c8ca43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.461919:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02a00/0x7b044d4128f9acb9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.461929:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02a00/0x7b044d4128f9acb9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.462013:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9acc0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.462021:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9acc0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.462028:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9acc0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784938439.462259:0:24203:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].27, 64 off9920 00010000:00010000:1.0:1784938439.462304:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9acc7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.462310:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9acc7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.462316:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9acc7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.462321:0:24203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9acc7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.462327:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9acc7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.462334:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9acc7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.462351:0:24203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938439.462379:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9acc0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.462386:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9acc0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.462392:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9acc0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.462399:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e03a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.462403:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9acc0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.462412:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9acc0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.462421:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff9f248fb6b000) 00010000:00010000:1.0:1784938439.462423:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784938439.462427:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9acc0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.462432:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9acc0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.462447:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03000/0x7b044d4128f9acb2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.462453:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03000/0x7b044d4128f9acb2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.462460:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03000/0x7b044d4128f9acb2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.462465:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e03000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.462467:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03000/0x7b044d4128f9acb2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.462471:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03000/0x7b044d4128f9acb2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.462475:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.462477:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.462479:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03000/0x7b044d4128f9acb2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.462486:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03000/0x7b044d4128f9acb2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938439.462491:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001a865eda reply state 00000000e1cbb65a transno 8589934663 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02a00/0x7b044d4128f9acb9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.462499:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02a00/0x7b044d4128f9acb9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.462502:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xf4c8ca43 (ffff9f248fb6bf00) 00010000:00010000:1.0:1784938439.462504:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938439.462505:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938439.462564:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+146:17072:x1871643337359872:12345-192.168.202.54@tcp:36:rm.0 Request processed in 830us (1099us total) trans 8589934663 rc 0/0 00000100:00100000:1.0:1784938439.462570:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 204 00010000:00010000:3.0:1784938439.463200:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938439.463208:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9acc7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.463213:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e03c00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938439.463216:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9acc7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.463221:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9acc7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.463231:0:19223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff9f248fb6b000) 00010000:00010000:3.0:1784938439.463232:0:19223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938439.463234:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9acc7 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.463238:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9acc7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.463250:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.463251:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.463252:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938439.465108:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938439.465721:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337360128 00000100:00100000:1.0:1784938439.465730:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337360128 00000100:00100000:1.0:1784938439.465780:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 205 00000100:00100000:1.0:1784938439.465787:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d17c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+146:17072:x1871643337360128:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:1.0:1784938439.465840:0:24202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938439.466495:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9a469 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663598 expref: 146 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.466518:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f248fb6b700) 00010000:00010000:1.0:1784938439.466533:0:24202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938439.466559:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9acce lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.466576:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9acce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.466586:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9acce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.466602:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03e00/0x7b044d4128f9acd5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0xe7eb4718 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.466609:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03e00/0x7b044d4128f9acd5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.466614:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03e00/0x7b044d4128f9acd5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.466701:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9acdc lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.466709:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9acdc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.466715:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9acdc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784938439.467738:0:24202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].26, 64 off9856 00010000:00010000:1.0:1784938439.467802:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03400/0x7b044d4128f9ace3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.467816:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03400/0x7b044d4128f9ace3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.467825:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03400/0x7b044d4128f9ace3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.467833:0:24202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03400/0x7b044d4128f9ace3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.467839:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03400/0x7b044d4128f9ace3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.467844:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03400/0x7b044d4128f9ace3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.468467:0:24202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938439.468500:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9acdc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.468509:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9acdc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.468516:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9acdc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.468522:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e03200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.468527:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9acdc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.468534:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9acdc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.468546:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f24975b2000) 00010000:00010000:1.0:1784938439.468549:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784938439.468553:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9acdc lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.468565:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9acdc lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.468585:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9acce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.468591:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9acce lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.468597:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9acce lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.468602:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e02600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.468604:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9acce lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.468609:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9acce lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.468616:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.468618:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.468622:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9acce lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.468627:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9acce lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938439.468636:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000611758f5 reply state 000000002c7d5f46 transno 8589934664 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03e00/0x7b044d4128f9acd5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.468647:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03e00/0x7b044d4128f9acd5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.468654:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xe7eb4718 (ffff9f248fb6b400) 00010000:00010000:1.0:1784938439.468657:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938439.468660:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938439.468767:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d17c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+147:17072:x1871643337360128:12345-192.168.202.54@tcp:36:rm.0 Request processed in 2975us (3664us total) trans 8589934664 rc 0/0 00000100:00100000:1.0:1784938439.468776:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 205 00010000:00010000:2.0:1784938439.471871:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938439.471886:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03400/0x7b044d4128f9ace3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.471896:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e03400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938439.471900:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03400/0x7b044d4128f9ace3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.471910:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03400/0x7b044d4128f9ace3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.471938:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f24975b2000) 00010000:00010000:2.0:1784938439.471941:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784938439.471946:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03400/0x7b044d4128f9ace3 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.471952:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03400/0x7b044d4128f9ace3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.471977:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938439.471979:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938439.471981:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938439.473108:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:3.0:1784938439.474898:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938439.474906:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9acff lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.474912:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3da00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938439.474927:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9acff lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.474934:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9acff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.474943:0:19223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff9f24898dff00) 00010000:00010000:3.0:1784938439.474945:0:19223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938439.474948:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9acff lrc: 1/0,0 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.474954:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9acff lrc: 0/0,0 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.474968:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.474970:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.474972:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938439.483817:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938439.483859:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938439.483895:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938439.484019:0:24193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337360768 00000100:00100000:2.0:1784938439.484028:0:24193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337360768 00000100:00100000:2.0:1784938439.484093:0:24193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 97 00000100:00100000:2.0:1784938439.484104:0:24193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:357535a6-3234-42c0-bf92-af4663775ca3+10:10960:x1871643337360768:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1784938439.484202:0:24193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:357535a6-3234-42c0-bf92-af4663775ca3+10:10960:x1871643337360768:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 99us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938439.484213:0:24193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 97 00000100:00100000:1.0:1784938439.484650:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337360640 00000100:00100000:1.0:1784938439.484656:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337360640 00000100:00100000:1.0:1784938439.484698:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337360896 00000100:00100000:1.0:1784938439.484702:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337360896 00000100:00100000:1.0:1784938439.484742:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 32 00000100:00100000:1.0:1784938439.484749:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d17f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+174:10957:x1871643337360896:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1784938439.484798:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d17f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+174:10957:x1871643337360896:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 49us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938439.484804:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 32 00000100:00100000:1.0:1784938439.484819:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 207 00000100:00100000:1.0:1784938439.484825:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d17c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+148:17072:x1871643337360640:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:1.0:1784938439.484885:0:24201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938439.484916:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28e00/0x7b044d4128f9a4bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476635a6 expref: 148 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.484943:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4c:0x0].0x0 (ffff9f248fb6be00) 00010000:00010000:1.0:1784938439.484954:0:24201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938439.484976:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9ad06 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.484993:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9ad06 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.485003:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9ad06 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.485017:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03000/0x7b044d4128f9ad0d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x22eacdcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.485024:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03000/0x7b044d4128f9ad0d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.485030:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03000/0x7b044d4128f9ad0d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.485179:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ad14 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.485189:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ad14 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.485195:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ad14 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784938439.485435:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].28, 64 off9984 00010000:00010000:1.0:1784938439.485483:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02800/0x7b044d4128f9ad1b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.485493:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02800/0x7b044d4128f9ad1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.485500:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02800/0x7b044d4128f9ad1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.485506:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02800/0x7b044d4128f9ad1b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.485512:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02800/0x7b044d4128f9ad1b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.485517:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02800/0x7b044d4128f9ad1b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.485531:0:24201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938439.485549:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ad14 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.485555:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ad14 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.485562:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ad14 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.485568:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e03a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.485571:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ad14 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.485579:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ad14 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.485588:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4c:0x0].0x0 (ffff9f24975b2000) 00010000:00010000:1.0:1784938439.485591:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784938439.485595:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ad14 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.485604:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ad14 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.485621:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9ad06 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.485627:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9ad06 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.485633:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9ad06 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.485638:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9ad06 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.485643:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e03200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.485646:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9ad06 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.485652:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9ad06 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.485659:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.485661:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.485664:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9ad06 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.485669:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9ad06 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938439.485678:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a2a12e58 reply state 00000000754aa2e6 transno 8589934666 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03000/0x7b044d4128f9ad0d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.485688:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03000/0x7b044d4128f9ad0d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.485693:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x22eacdcf (ffff9f24975b2600) 00010000:00010000:1.0:1784938439.485695:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938439.485698:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938439.485741:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d17c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+149:17072:x1871643337360640:12345-192.168.202.54@tcp:36:rm.0 Request processed in 915us (1935us total) trans 8589934666 rc 0/0 00000100:00100000:1.0:1784938439.485748:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 207 00000100:00080000:2.0:1784938439.486449:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784938439.490033:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938439.491008:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337361152 00000100:00100000:1.0:1784938439.491019:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337361152 00000100:00100000:1.0:1784938439.491437:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 208 00000100:00100000:1.0:1784938439.491449:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d17dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+149:17072:x1871643337361152:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:1.0:1784938439.491539:0:24201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938439.491564:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9a4d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476635ad expref: 149 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.491581:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff9f248fb6b100) 00010000:00010000:1.0:1784938439.491591:0:24201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938439.491614:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9ad22 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.491626:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9ad22 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.491637:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9ad22 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.491665:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03400/0x7b044d4128f9ad29 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x57ba1cca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.491674:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03400/0x7b044d4128f9ad29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.491680:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03400/0x7b044d4128f9ad29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.491775:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9ad30 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.491783:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9ad30 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.491789:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9ad30 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784938439.492588:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].28, 64 off9984 00010000:00010000:1.0:1784938439.492651:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9ad37 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.492663:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9ad37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.492672:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9ad37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.492679:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9ad37 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.492686:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9ad37 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.492692:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9ad37 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.492706:0:24201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938439.492724:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9ad30 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.492729:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9ad30 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.492735:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9ad30 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.492741:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e03c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.492745:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9ad30 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.492752:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9ad30 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.492762:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff9f2381d78800) 00010000:00010000:1.0:1784938439.492765:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784938439.492768:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9ad30 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.492773:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9ad30 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.492793:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9ad22 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.492802:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9ad22 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.492807:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9ad22 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.492813:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9ad22 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.492818:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e02600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.492820:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9ad22 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.492826:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9ad22 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.492832:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.492835:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.492837:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9ad22 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.492843:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9ad22 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938439.492851:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e0034bf1 reply state 00000000e3d725e8 transno 8589934667 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03400/0x7b044d4128f9ad29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.493002:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938439.493008:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9ad37 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.493014:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e02200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938439.493017:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9ad37 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.493024:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9ad37 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.493033:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff9f2381d78800) 00010000:00010000:2.0:1784938439.493035:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784938439.493038:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9ad37 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.493044:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9ad37 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.493720:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938439.493722:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938439.493724:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938439.493781:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03400/0x7b044d4128f9ad29 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.493789:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x57ba1cca (ffff9f2381d78200) 00010000:00010000:1.0:1784938439.493792:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938439.493796:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938439.493912:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d17dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+150:17072:x1871643337361152:12345-192.168.202.54@tcp:36:rm.0 Request processed in 2462us (3879us total) trans 8589934667 rc 0/0 00000100:00100000:1.0:1784938439.493936:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 208 00000100:00100000:3.0:1784938439.501005:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:3.0:1784938439.503087:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938439.503096:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9ad53 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.503103:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3da00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938439.503139:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9ad53 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.503180:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9ad53 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.503193:0:19223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3e:0x0].0x0 (ffff9f24898dfd00) 00010000:00010000:3.0:1784938439.503196:0:19223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938439.503200:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9ad53 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.503206:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9ad53 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.503225:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.503227:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.503229:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938439.507627:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337361664 00000100:00100000:3.0:1784938439.507638:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337361664 00000100:00100000:3.0:1784938439.507696:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 210 00000100:00100000:3.0:1784938439.507706:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23883ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+151:17072:x1871643337361664:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:3.0:1784938439.507767:0:24945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938439.507795:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9a557 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476635bb expref: 151 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.507814:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x39:0x0].0x0 (ffff9f248fb6b200) 00010000:00010000:3.0:1784938439.507826:0:24945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938439.507877:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01600/0x7b044d4128f9ad5a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.507890:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01600/0x7b044d4128f9ad5a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.507926:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01600/0x7b044d4128f9ad5a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.507942:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01e00/0x7b044d4128f9ad61 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x89d48c8d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.507950:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01e00/0x7b044d4128f9ad61 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.507957:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01e00/0x7b044d4128f9ad61 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.508041:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00c00/0x7b044d4128f9ad68 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.508050:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00c00/0x7b044d4128f9ad68 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.508057:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00c00/0x7b044d4128f9ad68 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.509510:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938439.509517:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d800/0x7b044d4128f9ad6f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.509524:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3d800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938439.509527:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d800/0x7b044d4128f9ad6f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.509534:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d800/0x7b044d4128f9ad6f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.509544:0:19222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x39:0x0].0x0 (ffff9f2485293700) 00010000:00010000:2.0:1784938439.509546:0:19222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784938439.509550:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d800/0x7b044d4128f9ad6f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.509555:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d800/0x7b044d4128f9ad6f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.509571:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938439.509573:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938439.509574:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938439.513795:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938439.519678:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938439.520022:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337362176 00000100:00100000:1.0:1784938439.520034:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337362176 00000100:00100000:1.0:1784938439.520107:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 212 00000100:00100000:1.0:1784938439.520119:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d17f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+153:17072:x1871643337362176:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:1.0:1784938439.520218:0:24201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938439.520252:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9a5b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476635c9 expref: 153 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.520277:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x41:0x0].0x0 (ffff9f248fb6bd00) 00010000:00010000:1.0:1784938439.520288:0:24201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938439.520310:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9ad92 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.520323:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9ad92 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.520332:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9ad92 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.520346:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9ad99 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0xd13f1037 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.520365:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9ad99 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.520373:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9ad99 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.520536:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ada0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.520545:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ada0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.520552:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ada0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784938439.520807:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].31, 64 off10176 00010000:00010000:1.0:1784938439.520858:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03800/0x7b044d4128f9ada7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.520879:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03800/0x7b044d4128f9ada7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.520887:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03800/0x7b044d4128f9ada7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.520894:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03800/0x7b044d4128f9ada7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.520900:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03800/0x7b044d4128f9ada7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.520906:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03800/0x7b044d4128f9ada7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.521770:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938439.521779:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3ca00/0x7b044d4128f9ad8b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.521788:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3ca00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938439.521793:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3ca00/0x7b044d4128f9ad8b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.521801:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3ca00/0x7b044d4128f9ad8b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.521814:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x0 (ffff9f24898dfb00) 00010000:00010000:2.0:1784938439.521817:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784938439.521821:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3ca00/0x7b044d4128f9ad8b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.521831:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3ca00/0x7b044d4128f9ad8b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.521849:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938439.521861:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03800/0x7b044d4128f9ada7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.521866:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e03800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938439.521869:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03800/0x7b044d4128f9ada7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.521874:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03800/0x7b044d4128f9ada7 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.521881:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x41:0x0].0x0 (ffff9f2381d78400) 00010000:00010000:2.0:1784938439.521883:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784938439.521886:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03800/0x7b044d4128f9ada7 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.521893:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938439.521894:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938439.521896:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938439.522045:0:24201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784938439.522060:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03800/0x7b044d4128f9ada7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.522093:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ada0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.522099:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ada0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.522104:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ada0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.522109:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e03a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.522112:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ada0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.522118:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ada0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.522136:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x41:0x0].0x0 (ffff9f2381d78400) 00010000:00010000:1.0:1784938439.522138:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784938439.522141:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ada0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.522166:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ada0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.522189:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9ad92 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.522196:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9ad92 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.522202:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9ad92 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.522209:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9ad92 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.522213:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e03c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.522216:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9ad92 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.522221:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9ad92 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.522229:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.522232:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.522234:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9ad92 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.522239:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9ad92 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938439.522248:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000343828da reply state 000000006d0a5818 transno 8589934671 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9ad99 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.522259:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9ad99 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.522264:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xd13f1037 (ffff9f2381d78b00) 00010000:00010000:1.0:1784938439.522267:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938439.522269:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938439.522371:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d17f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+154:17072:x1871643337362176:12345-192.168.202.54@tcp:36:rm.0 Request processed in 2239us (2689us total) trans 8589934671 rc 0/0 00000100:00100000:1.0:1784938439.522380:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 212 00010000:00010000:2.0:1784938439.522574:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938439.535783:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:1.0:1784938439.537295:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938439.537302:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d400/0x7b044d4128f9adc3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.537308:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3d400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938439.537312:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d400/0x7b044d4128f9adc3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.537318:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d400/0x7b044d4128f9adc3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.537326:0:19222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x38:0x0].0x0 (ffff9f24898dfe00) 00010000:00010000:1.0:1784938439.537329:0:19222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784938439.537332:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d400/0x7b044d4128f9adc3 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.537337:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d400/0x7b044d4128f9adc3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.537363:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938439.537365:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938439.537366:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938439.547987:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:2.0:1784938439.549818:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938439.549825:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d400/0x7b044d4128f9addf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.549831:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3d400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938439.549834:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d400/0x7b044d4128f9addf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.549841:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d400/0x7b044d4128f9addf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.549850:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9f24898dfb00) 00010000:00010000:2.0:1784938439.549853:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784938439.549856:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d400/0x7b044d4128f9addf lrc: 1/0,0 mode: --/PW res: [0x200000402:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.549862:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d400/0x7b044d4128f9addf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.549876:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938439.549878:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938439.549880:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938439.554415:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:3.0:1784938439.556105:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938439.556114:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9adfb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.556120:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938439.556134:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9adfb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.556187:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9adfb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.556198:0:19223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff9f248fb6c600) 00010000:00010000:3.0:1784938439.556201:0:19223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938439.556204:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9adfb lrc: 1/0,0 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.556210:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9adfb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.556228:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.556230:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.556232:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938439.561033:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938439.561363:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337363200 00000100:00100000:1.0:1784938439.561373:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337363200 00000100:00100000:1.0:1784938439.561445:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 216 00000100:00100000:1.0:1784938439.561455:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d17ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+157:17072:x1871643337363200:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:1.0:1784938439.561523:0:24201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938439.561551:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9a629 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476635e5 expref: 157 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.561572:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff9f248fb6cd00) 00010000:00010000:1.0:1784938439.561583:0:24201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938439.561610:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ae02 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.561623:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ae02 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.561633:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ae02 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.561650:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03800/0x7b044d4128f9ae09 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0xc2bba7e5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.561656:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03800/0x7b044d4128f9ae09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.561662:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03800/0x7b044d4128f9ae09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.561756:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02e00/0x7b044d4128f9ae10 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.561764:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02e00/0x7b044d4128f9ae10 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.561771:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02e00/0x7b044d4128f9ae10 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784938439.562026:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].32, 64 off10240 00010000:00010000:1.0:1784938439.562090:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9ae17 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.562100:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9ae17 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.562107:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9ae17 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.562114:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9ae17 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.562121:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9ae17 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.562127:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9ae17 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.562430:0:24201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938439.562452:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02e00/0x7b044d4128f9ae10 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.562458:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02e00/0x7b044d4128f9ae10 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.562470:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02e00/0x7b044d4128f9ae10 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.562475:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e02e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.562479:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02e00/0x7b044d4128f9ae10 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.562487:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02e00/0x7b044d4128f9ae10 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.562503:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff9f2381d78d00) 00010000:00010000:1.0:1784938439.562505:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784938439.562510:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02e00/0x7b044d4128f9ae10 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.562515:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02e00/0x7b044d4128f9ae10 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.562532:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ae02 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.562538:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ae02 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.562542:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ae02 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.562547:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ae02 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.562551:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e03a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.562554:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ae02 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.562559:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ae02 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.562565:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.562567:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.562570:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ae02 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.562579:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ae02 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938439.562587:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fdcd2a99 reply state 00000000f3755923 transno 8589934675 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03800/0x7b044d4128f9ae09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.562597:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03800/0x7b044d4128f9ae09 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.562603:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xc2bba7e5 (ffff9f2381d78400) 00010000:00010000:1.0:1784938439.562605:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938439.562607:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938439.562694:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d17ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+158:17072:x1871643337363200:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1238us (1667us total) trans 8589934675 rc 0/0 00000100:00100000:1.0:1784938439.562702:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 216 00010000:00010000:2.0:1784938439.562796:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938439.562804:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9ae17 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.562811:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e03c00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938439.562814:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9ae17 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.562821:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9ae17 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.562831:0:19222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff9f2381d78d00) 00010000:00010000:2.0:1784938439.562834:0:19222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784938439.562837:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9ae17 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.562842:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9ae17 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.562859:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938439.562861:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938439.562863:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938439.577716:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:2.0:1784938439.579083:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938439.579091:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9ae33 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.579100:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938439.579104:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9ae33 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.579111:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9ae33 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.579122:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f248fb6c200) 00010000:00010000:2.0:1784938439.579199:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784938439.579204:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9ae33 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.579209:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9ae33 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.579223:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938439.579224:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938439.579226:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938439.586061:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+159:17072:x1871643337363456:12345-192.168.202.54@tcp:36:rm.0 Request processed in 8096us (8336us total) trans 8589934676 rc 0/0 00000100:00100000:1.0:1784938439.586077:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 217 00000100:00100000:3.0:1784938439.595230:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:3.0:1784938439.599872:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938439.599889:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00600/0x7b044d4128f9ae4f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.599901:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d00600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938439.599905:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00600/0x7b044d4128f9ae4f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.599924:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00600/0x7b044d4128f9ae4f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.599944:0:19223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x42:0x0].0x0 (ffff9f248fb6c700) 00010000:00010000:3.0:1784938439.599948:0:19223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938439.599953:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00600/0x7b044d4128f9ae4f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.599982:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00600/0x7b044d4128f9ae4f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.600008:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.600010:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.600012:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938439.606503:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938439.606613:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337363968 00000100:00100000:2.0:1784938439.606625:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337363968 00000100:00100000:2.0:1784938439.606695:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 219 00000100:00100000:2.0:1784938439.606706:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d17c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+160:17072:x1871643337363968:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:2.0:1784938439.606768:0:24203:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938439.606798:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9a6d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476635fa expref: 160 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.606818:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff9f248fb6ce00) 00010000:00010000:2.0:1784938439.606828:0:24203:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938439.606856:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217da00/0x7b044d4128f9ae56 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.606871:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217da00/0x7b044d4128f9ae56 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.606882:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217da00/0x7b044d4128f9ae56 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.606898:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217dc00/0x7b044d4128f9ae5d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0xc735cef4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.606905:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217dc00/0x7b044d4128f9ae5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.606911:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217dc00/0x7b044d4128f9ae5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.607004:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ca00/0x7b044d4128f9ae64 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.607012:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ca00/0x7b044d4128f9ae64 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.607018:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ca00/0x7b044d4128f9ae64 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784938439.607500:0:24203:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].33, 64 off10304 00010000:00010000:2.0:1784938439.607554:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9ae6b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.607709:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9ae6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.607720:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9ae6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.607728:0:24203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9ae6b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.607734:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9ae6b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.607740:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9ae6b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.607766:0:24203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938439.607788:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ca00/0x7b044d4128f9ae64 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.607794:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ca00/0x7b044d4128f9ae64 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.607799:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ca00/0x7b044d4128f9ae64 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.607804:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217ca00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938439.607809:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ca00/0x7b044d4128f9ae64 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.607817:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ca00/0x7b044d4128f9ae64 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.607828:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff9f24898dfb00) 00010000:00010000:2.0:1784938439.607831:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784938439.607835:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ca00/0x7b044d4128f9ae64 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.607840:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ca00/0x7b044d4128f9ae64 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.607858:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217da00/0x7b044d4128f9ae56 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.607864:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217da00/0x7b044d4128f9ae56 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.607869:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217da00/0x7b044d4128f9ae56 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.607874:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217da00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938439.607877:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217da00/0x7b044d4128f9ae56 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.607882:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217da00/0x7b044d4128f9ae56 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.607889:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:2.0:1784938439.607891:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938439.607894:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217da00/0x7b044d4128f9ae56 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.607899:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217da00/0x7b044d4128f9ae56 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938439.607912:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d805fe2f reply state 00000000fc4571a9 transno 8589934678 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217dc00/0x7b044d4128f9ae5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.607924:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217dc00/0x7b044d4128f9ae5d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.607930:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xc735cef4 (ffff9f248aad5b00) 00010000:00010000:2.0:1784938439.607933:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938439.607935:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938439.608025:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d17c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+161:17072:x1871643337363968:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1319us (1530us total) trans 8589934678 rc 0/0 00000100:00100000:2.0:1784938439.608033:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 219 00010000:00010000:1.0:1784938439.608686:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938439.608693:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9ae6b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.608701:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217cc00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938439.608704:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9ae6b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.608712:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9ae6b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.608727:0:19222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff9f24898dfb00) 00010000:00010000:1.0:1784938439.608729:0:19222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784938439.608733:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9ae6b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.608738:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9ae6b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.608757:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938439.608759:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938439.608761:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938439.615583:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:3.0:1784938439.617738:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938439.617745:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28a00/0x7b044d4128f9ae87 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.617751:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b28a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938439.617755:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28a00/0x7b044d4128f9ae87 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.617761:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28a00/0x7b044d4128f9ae87 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.617772:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4e:0x0].0x0 (ffff9f248fb6ce00) 00010000:00010000:3.0:1784938439.617774:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938439.617777:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28a00/0x7b044d4128f9ae87 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.617783:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28a00/0x7b044d4128f9ae87 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.617797:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.617799:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.617801:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938439.621460:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337364480 00000100:00100000:1.0:1784938439.621472:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337364480 00000100:00100000:1.0:1784938439.621640:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 221 00000100:00100000:1.0:1784938439.621653:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23883eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+162:17072:x1871643337364480:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:1.0:1784938439.621726:0:24202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938439.621760:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394e00/0x7b044d4128f9a6ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663601 expref: 162 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.621783:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4f:0x0].0x0 (ffff9f248fb6c100) 00010000:00010000:1.0:1784938439.621795:0:24202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938439.621820:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ae8e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.621836:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ae8e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.621846:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ae8e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.621864:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02e00/0x7b044d4128f9ae95 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x47a21a83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.621871:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02e00/0x7b044d4128f9ae95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.621878:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02e00/0x7b044d4128f9ae95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.621979:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9ae9c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.621988:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9ae9c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.621996:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9ae9c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784938439.622299:0:24202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].34, 64 off10368 00010000:00010000:1.0:1784938439.622348:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9aea3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.622371:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9aea3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.622379:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9aea3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.622387:0:24202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9aea3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.622393:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9aea3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.622400:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9aea3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.622420:0:24202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938439.622438:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9ae9c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.622445:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9ae9c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.622451:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9ae9c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.622457:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e03600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.622461:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9ae9c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.622470:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9ae9c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.622479:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4f:0x0].0x0 (ffff9f2381d78700) 00010000:00010000:1.0:1784938439.622482:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784938439.622486:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9ae9c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.622491:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9ae9c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.622505:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ae8e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.622516:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ae8e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.622521:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ae8e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.622525:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e03a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.622528:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ae8e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.622533:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ae8e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.622540:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.622542:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.622545:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ae8e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.622551:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9ae8e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938439.622560:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002f37fe3f reply state 00000000aaf4fe96 transno 8589934680 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02e00/0x7b044d4128f9ae95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.622570:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02e00/0x7b044d4128f9ae95 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.622576:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x47a21a83 (ffff9f2381d78f00) 00010000:00010000:1.0:1784938439.622579:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938439.622581:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938439.622741:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938439.622766:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9aea3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.622772:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e02600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938439.622775:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9aea3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.622782:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9aea3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.622791:0:19223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4f:0x0].0x0 (ffff9f2381d78700) 00010000:00010000:3.0:1784938439.622794:0:19223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938439.622797:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9aea3 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.622802:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9aea3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.622816:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.622818:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.622820:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938439.622857:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23883eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+163:17072:x1871643337364480:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1205us (1504us total) trans 8589934680 rc 0/0 00000100:00100000:1.0:1784938439.622866:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 221 00000100:00100000:1.0:1784938439.626650:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337364736 00000100:00100000:1.0:1784938439.626660:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337364736 00000100:00100000:1.0:1784938439.626755:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 222 00000100:00100000:1.0:1784938439.626766:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23883eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+163:17072:x1871643337364736:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:1.0:1784938439.626826:0:24201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938439.626858:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394c00/0x7b044d4128f9a709 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663608 expref: 163 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.626877:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff9f248fb6ee00) 00010000:00010000:1.0:1784938439.626888:0:24201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938439.626912:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9aeaa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.626939:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9aeaa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.626950:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9aeaa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.626963:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02800/0x7b044d4128f9aeb1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x4958ff4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.626969:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02800/0x7b044d4128f9aeb1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.626974:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02800/0x7b044d4128f9aeb1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.627259:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02000/0x7b044d4128f9aeb8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.627269:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02000/0x7b044d4128f9aeb8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.627276:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02000/0x7b044d4128f9aeb8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784938439.627548:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].36, 64 off10496 00010000:00010000:1.0:1784938439.627598:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9aebf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.627607:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9aebf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.627614:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9aebf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.627621:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9aebf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.627627:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9aebf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.627633:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9aebf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.627714:0:24201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938439.627733:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02000/0x7b044d4128f9aeb8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.627744:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02000/0x7b044d4128f9aeb8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.627750:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02000/0x7b044d4128f9aeb8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.627756:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e02000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.627760:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02000/0x7b044d4128f9aeb8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.627767:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02000/0x7b044d4128f9aeb8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.627778:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff9f2381d78900) 00010000:00010000:1.0:1784938439.627781:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784938439.627785:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02000/0x7b044d4128f9aeb8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.627790:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02000/0x7b044d4128f9aeb8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.627807:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9aeaa lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.627813:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9aeaa lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.627819:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9aeaa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.627824:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9aeaa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.627830:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e02200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.627833:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9aeaa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.627837:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9aeaa lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.627843:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.627844:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.627846:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9aeaa lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.627850:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9aeaa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938439.627856:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000660b120c reply state 000000009ce8b98c transno 8589934681 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02800/0x7b044d4128f9aeb1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.627863:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02800/0x7b044d4128f9aeb1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.627867:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x4958ff4 (ffff9f2381d78300) 00010000:00010000:1.0:1784938439.627869:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938439.627871:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938439.628053:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23883eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+164:17072:x1871643337364736:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1281us (1495us total) trans 8589934681 rc 0/0 00000100:00100000:1.0:1784938439.628059:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 222 00010000:00010000:2.0:1784938439.628296:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938439.628303:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9aebf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.628310:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e03c00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938439.628312:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9aebf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.628317:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9aebf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.628324:0:19222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff9f2381d78900) 00010000:00010000:2.0:1784938439.628325:0:19222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784938439.628327:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9aebf lrc: 1/0,0 mode: --/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.628331:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9aebf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.628344:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938439.628345:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938439.628347:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938439.631723:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:3.0:1784938439.632881:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938439.632887:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9aedb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.632893:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d00c00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938439.632896:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9aedb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.632900:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9aedb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.632906:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff9f248fb6cd00) 00010000:00010000:3.0:1784938439.632924:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938439.632928:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9aedb lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.632933:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9aedb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.632946:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.632948:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.632950:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938439.635545:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:3.0:1784938439.636717:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938439.636723:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039000/0x7b044d4128f9aef7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.636729:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382039000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938439.636733:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039000/0x7b044d4128f9aef7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.636740:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039000/0x7b044d4128f9aef7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.636749:0:19223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff9f248fb6c100) 00010000:00010000:3.0:1784938439.636752:0:19223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938439.636754:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039000/0x7b044d4128f9aef7 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.636759:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039000/0x7b044d4128f9aef7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.636773:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.636775:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.636792:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938439.639341:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938439.639499:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337365504 00000100:00100000:2.0:1784938439.639512:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337365504 00000100:00100000:2.0:1784938439.639614:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 225 00000100:00100000:2.0:1784938439.639625:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+166:17072:x1871643337365504:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:2.0:1784938439.639713:0:24202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938439.639741:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9a795 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766361d expref: 166 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.639758:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f23872e6900) 00010000:00010000:2.0:1784938439.639768:0:24202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938439.639789:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9aefe lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.639800:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9aefe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.639808:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9aefe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.639822:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217de00/0x7b044d4128f9af05 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x56569231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.639828:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217de00/0x7b044d4128f9af05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.639837:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217de00/0x7b044d4128f9af05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.639910:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ce00/0x7b044d4128f9af0c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.639916:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ce00/0x7b044d4128f9af0c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.639922:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ce00/0x7b044d4128f9af0c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784938439.640187:0:24202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].37, 64 off10560 00010000:00010000:2.0:1784938439.640236:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9af13 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.640245:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9af13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.640253:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9af13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.640259:0:24202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9af13 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.640265:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9af13 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.640271:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9af13 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.640284:0:24202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938439.640301:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ce00/0x7b044d4128f9af0c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.640306:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ce00/0x7b044d4128f9af0c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.640311:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ce00/0x7b044d4128f9af0c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.640317:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217ce00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938439.640321:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ce00/0x7b044d4128f9af0c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.640329:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ce00/0x7b044d4128f9af0c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.640338:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f248fb6bd00) 00010000:00010000:2.0:1784938439.640341:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784938439.640345:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ce00/0x7b044d4128f9af0c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.640351:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ce00/0x7b044d4128f9af0c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.640378:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9aefe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.640383:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9aefe lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.640389:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9aefe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.640397:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217c600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938439.640400:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9aefe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.640407:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9aefe lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.640413:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:2.0:1784938439.640416:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938439.640419:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9aefe lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.640425:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9aefe lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938439.640434:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e7855afa reply state 0000000060761a29 transno 8589934684 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217de00/0x7b044d4128f9af05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.640444:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217de00/0x7b044d4128f9af05 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.640450:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x56569231 (ffff9f24898dfb00) 00010000:00010000:2.0:1784938439.640452:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938439.640455:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938439.640526:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+167:17072:x1871643337365504:12345-192.168.202.54@tcp:36:rm.0 Request processed in 903us (1194us total) trans 8589934684 rc 0/0 00000100:00100000:2.0:1784938439.640533:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 225 00010000:00010000:1.0:1784938439.640610:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938439.640616:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9af13 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.640623:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217c800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938439.640626:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9af13 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.640632:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9af13 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.640641:0:19222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f248fb6bd00) 00010000:00010000:1.0:1784938439.640644:0:19222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784938439.640647:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9af13 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.640653:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9af13 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.640667:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938439.640669:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938439.640671:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938439.643376:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938439.643646:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337365760 00000100:00100000:1.0:1784938439.643657:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337365760 00000100:00100000:1.0:1784938439.643730:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 226 00000100:00100000:1.0:1784938439.643740:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+167:17072:x1871643337365760:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:1.0:1784938439.643805:0:24201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938439.643832:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c000/0x7b044d4128f9a7b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663624 expref: 167 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.643851:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff9f23872e6000) 00010000:00010000:1.0:1784938439.643862:0:24201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938439.643887:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9af1a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.643901:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9af1a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.643911:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9af1a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.643938:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02000/0x7b044d4128f9af21 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x712be7d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.643945:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02000/0x7b044d4128f9af21 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.643951:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02000/0x7b044d4128f9af21 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.644024:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9af28 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.644030:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9af28 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.644034:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9af28 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784938439.644292:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].38, 64 off10624 00010000:00010000:1.0:1784938439.644339:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9af2f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.644347:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9af2f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.644368:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9af2f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.645081:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9af2f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.645093:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9af2f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.645100:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9af2f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.645132:0:24201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938439.645177:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9af28 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.645184:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9af28 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.645191:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9af28 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.645197:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e03600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.645200:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9af28 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.645207:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9af28 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.645218:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938439.645221:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784938439.645226:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9af28 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.645232:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9af28 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.645251:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9af1a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.645258:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9af1a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.645263:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9af1a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.645268:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9af1a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.645272:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e02200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.645274:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9af1a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.645280:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9af1a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.645288:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.645290:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.645293:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9af1a lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.645300:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9af1a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938439.645309:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e3074b72 reply state 000000001992994b transno 8589934685 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02000/0x7b044d4128f9af21 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.645323:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02000/0x7b044d4128f9af21 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.645329:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x712be7d1 (ffff9f2381d78c00) 00010000:00010000:1.0:1784938439.645332:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938439.645334:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938439.645599:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938439.645608:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9af2f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.645614:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e02c00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938439.645618:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9af2f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.645626:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9af2f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.645636:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938439.645638:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938439.645641:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9af2f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.645646:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9af2f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.645662:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.645664:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.645666:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938439.645834:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+168:17072:x1871643337365760:12345-192.168.202.54@tcp:36:rm.0 Request processed in 2091us (2474us total) trans 8589934685 rc 0/0 00000100:00100000:1.0:1784938439.645843:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 226 00000100:00100000:3.0:1784938439.651013:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:3.0:1784938439.652488:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938439.652495:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039200/0x7b044d4128f9af4b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.652502:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382039200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938439.652505:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039200/0x7b044d4128f9af4b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.652531:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039200/0x7b044d4128f9af4b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.652540:0:19223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff9f248fb6c100) 00010000:00010000:3.0:1784938439.652542:0:19223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938439.652545:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039200/0x7b044d4128f9af4b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.652550:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039200/0x7b044d4128f9af4b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.652564:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.652566:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.652568:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938439.657038:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938439.657274:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337366272 00000100:00100000:1.0:1784938439.657285:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337366272 00000100:00100000:1.0:1784938439.657345:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 228 00000100:00100000:1.0:1784938439.657371:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d17ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+169:17072:x1871643337366272:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:1.0:1784938439.657456:0:24945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938439.657485:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00400/0x7b044d4128f9a80c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663632 expref: 169 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.657506:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff9f23872e6d00) 00010000:00010000:1.0:1784938439.657517:0:24945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938439.657539:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9af52 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.657552:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9af52 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.657562:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9af52 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.657582:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9af59 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x39c3d8fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.657588:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9af59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.657595:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9af59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.657676:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9af60 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.657687:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9af60 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.657693:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9af60 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784938439.657943:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].39, 64 off10688 00010000:00010000:1.0:1784938439.657992:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9af67 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.657999:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9af67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.658007:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9af67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.658014:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9af67 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.658020:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9af67 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.658026:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9af67 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.658054:0:24945:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938439.658072:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9af60 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.658078:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9af60 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.658084:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9af60 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.658089:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e02c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.658093:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9af60 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.658102:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9af60 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.658110:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff9f2381d78100) 00010000:00010000:1.0:1784938439.658112:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784938439.658116:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9af60 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.658122:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9af60 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.658176:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9af52 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.658186:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9af52 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.658191:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9af52 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.658195:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e02200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.658198:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9af52 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.658203:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9af52 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.658211:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.658213:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.658217:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9af52 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.658222:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9af52 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938439.658231:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000030d6823b reply state 0000000007416049 transno 8589934687 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9af59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.658241:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9af59 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.658248:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x39c3d8fe (ffff9f2381d78500) 00010000:00010000:1.0:1784938439.658250:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938439.658252:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938439.658327:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d17ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+170:17072:x1871643337366272:12345-192.168.202.54@tcp:36:rm.0 Request processed in 972us (1299us total) trans 8589934687 rc 0/0 00000100:00100000:1.0:1784938439.658336:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 228 00010000:00010000:2.0:1784938439.659962:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938439.659976:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9af67 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.659986:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e03a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938439.659990:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9af67 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.660000:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9af67 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.660016:0:19222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff9f2381d78100) 00010000:00010000:2.0:1784938439.660018:0:19222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784938439.660023:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9af67 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.660029:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9af67 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.660060:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938439.660062:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938439.660064:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938439.666621:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938439.666713:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337366528 00000100:00100000:2.0:1784938439.666724:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337366528 00000100:00100000:2.0:1784938439.666789:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 229 00000100:00100000:2.0:1784938439.666800:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+170:17072:x1871643337366528:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:2.0:1784938439.666867:0:24202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938439.666894:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9a828 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663639 expref: 170 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.666930:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f23872e6200) 00010000:00010000:2.0:1784938439.666943:0:24202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938439.666969:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9af6e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.666982:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9af6e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.666991:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9af6e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.667005:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ce00/0x7b044d4128f9af75 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x9ca112ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.667011:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ce00/0x7b044d4128f9af75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.667017:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ce00/0x7b044d4128f9af75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.667108:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d800/0x7b044d4128f9af7c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.667116:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d800/0x7b044d4128f9af7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.667122:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d800/0x7b044d4128f9af7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784938439.667525:0:24202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].38, 64 off10624 00010000:00010000:2.0:1784938439.667580:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d200/0x7b044d4128f9af83 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.667590:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d200/0x7b044d4128f9af83 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.667602:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d200/0x7b044d4128f9af83 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.667609:0:24202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d200/0x7b044d4128f9af83 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.667615:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d200/0x7b044d4128f9af83 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.667621:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d200/0x7b044d4128f9af83 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.667644:0:24202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938439.667662:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d800/0x7b044d4128f9af7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.667669:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d800/0x7b044d4128f9af7c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.667675:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d800/0x7b044d4128f9af7c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.667680:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217d800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938439.667684:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d800/0x7b044d4128f9af7c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.667691:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d800/0x7b044d4128f9af7c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.667700:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f248fb6b200) 00010000:00010000:2.0:1784938439.667703:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784938439.667707:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d800/0x7b044d4128f9af7c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.667712:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d800/0x7b044d4128f9af7c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.667727:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9af6e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.667732:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9af6e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.667737:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9af6e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.667741:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217c600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938439.667744:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9af6e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.667750:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9af6e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.667756:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:2.0:1784938439.667758:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938439.667761:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9af6e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.667766:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9af6e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938439.667775:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003004b079 reply state 00000000faa5a0b6 transno 8589934688 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ce00/0x7b044d4128f9af75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.667791:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ce00/0x7b044d4128f9af75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.667797:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x9ca112ae (ffff9f248fb6bb00) 00010000:00010000:2.0:1784938439.667799:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938439.667802:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938439.668500:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938439.668509:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d200/0x7b044d4128f9af83 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.668516:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217d200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938439.668520:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d200/0x7b044d4128f9af83 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.668526:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d200/0x7b044d4128f9af83 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.668536:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f248fb6b200) 00010000:00010000:3.0:1784938439.668539:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938439.668542:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d200/0x7b044d4128f9af83 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.668564:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d200/0x7b044d4128f9af83 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.668582:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.668584:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.668586:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938439.668627:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+171:17072:x1871643337366528:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1827us (2012us total) trans 8589934688 rc 0/0 00000100:00100000:2.0:1784938439.668637:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 229 00000100:00100000:3.0:1784938439.676653:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337366784 00000100:00100000:3.0:1784938439.676666:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337366784 00000100:00100000:3.0:1784938439.676779:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 230 00000100:00100000:3.0:1784938439.676792:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+171:17072:x1871643337366784:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:3.0:1784938439.676861:0:24201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938439.676890:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9a844 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663640 expref: 171 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.676909:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff9f23872e6e00) 00010000:00010000:3.0:1784938439.676934:0:24201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938439.676960:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00600/0x7b044d4128f9af8a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.676974:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00600/0x7b044d4128f9af8a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.676984:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00600/0x7b044d4128f9af8a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.676998:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01400/0x7b044d4128f9af91 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0xa9dd9870 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.677004:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01400/0x7b044d4128f9af91 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.677029:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01400/0x7b044d4128f9af91 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.677169:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9af98 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.677177:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9af98 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.677185:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9af98 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784938439.677470:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].39, 64 off10688 00010000:00010000:3.0:1784938439.677516:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9af9f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.677525:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9af9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.677533:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9af9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.677540:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9af9f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.677546:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9af9f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.677553:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9af9f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.677577:0:24201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938439.677606:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9af98 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.677612:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9af98 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.677619:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9af98 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.677625:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938439.677630:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9af98 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.677637:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9af98 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.677647:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff9f2485293300) 00010000:00010000:3.0:1784938439.677650:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784938439.677654:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9af98 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.677660:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9af98 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.677679:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00600/0x7b044d4128f9af8a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.677684:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00600/0x7b044d4128f9af8a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.677690:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00600/0x7b044d4128f9af8a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.677696:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00600/0x7b044d4128f9af8a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.677708:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938439.677711:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00600/0x7b044d4128f9af8a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.677718:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00600/0x7b044d4128f9af8a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.677727:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:3.0:1784938439.677729:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938439.677732:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00600/0x7b044d4128f9af8a lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.677738:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00600/0x7b044d4128f9af8a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938439.677748:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e55d2144 reply state 00000000520ddcbb transno 8589934689 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01400/0x7b044d4128f9af91 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.677759:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01400/0x7b044d4128f9af91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.677765:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xa9dd9870 (ffff9f2485293400) 00010000:00010000:3.0:1784938439.677768:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938439.677770:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938439.677870:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+172:17072:x1871643337366784:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1080us (1874us total) trans 8589934689 rc 0/0 00000100:00100000:3.0:1784938439.677878:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 230 00010000:00010000:2.0:1784938439.678427:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938439.678436:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9af9f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.678443:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e01200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938439.678447:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9af9f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.678453:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9af9f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.678462:0:19223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff9f2485293300) 00010000:00010000:2.0:1784938439.678465:0:19223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784938439.678468:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9af9f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.678473:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9af9f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.678491:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938439.678492:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938439.678495:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938439.684207:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:2.0:1784938439.688686:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938439.688693:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038e00/0x7b044d4128f9afbb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.688700:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382038e00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938439.688703:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038e00/0x7b044d4128f9afbb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.688710:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038e00/0x7b044d4128f9afbb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.688723:0:19222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff9f248fb6c100) 00010000:00010000:2.0:1784938439.688726:0:19222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784938439.688728:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038e00/0x7b044d4128f9afbb lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.688733:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038e00/0x7b044d4128f9afbb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.688749:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938439.688751:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938439.688753:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938439.695706:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+173:17072:x1871643337367040:12345-192.168.202.54@tcp:36:rm.0 Request processed in 8889us (11494us total) trans 8589934690 rc 0/0 00000100:00100000:1.0:1784938439.695720:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 231 00000100:00100000:1.0:1784938439.700013:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:2.0:1784938439.701528:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938439.701537:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038800/0x7b044d4128f9afd7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.701543:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382038800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938439.701547:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038800/0x7b044d4128f9afd7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.701553:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038800/0x7b044d4128f9afd7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.701564:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9f24975b2000) 00010000:00010000:2.0:1784938439.701566:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784938439.701570:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038800/0x7b044d4128f9afd7 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.701575:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038800/0x7b044d4128f9afd7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.701590:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938439.701592:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938439.701594:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938439.705696:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337367552 00000100:00100000:2.0:1784938439.705706:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337367552 00000100:00100000:2.0:1784938439.705757:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 233 00000100:00100000:2.0:1784938439.705767:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+174:17072:x1871643337367552:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:2.0:1784938439.705833:0:24202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938439.705866:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fdc00/0x7b044d4128f9a8b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663655 expref: 174 pid: 25714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.705885:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff9f2387231f00) 00010000:00010000:2.0:1784938439.705896:0:24202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938439.705929:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9afde lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.705942:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9afde lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.705951:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9afde lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.705969:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d800/0x7b044d4128f9afe5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x407c6222 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.705975:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d800/0x7b044d4128f9afe5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.705980:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d800/0x7b044d4128f9afe5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.706065:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d400/0x7b044d4128f9afec lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.706073:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d400/0x7b044d4128f9afec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.706079:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d400/0x7b044d4128f9afec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784938439.706632:0:24202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].40, 64 off10752 00000004:00080000:2.0:1784938439.706642:0:24202:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 705873495908ns, next at 706873492641ns, rc = 0 00010000:00010000:2.0:1784938439.706694:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c000/0x7b044d4128f9aff3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.706704:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c000/0x7b044d4128f9aff3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.706711:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c000/0x7b044d4128f9aff3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.706718:0:24202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c000/0x7b044d4128f9aff3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.706729:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c000/0x7b044d4128f9aff3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.706734:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c000/0x7b044d4128f9aff3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.706760:0:24202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938439.706777:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d400/0x7b044d4128f9afec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.706784:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d400/0x7b044d4128f9afec lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.706790:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d400/0x7b044d4128f9afec lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.706796:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217d400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938439.706799:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d400/0x7b044d4128f9afec lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.706806:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d400/0x7b044d4128f9afec lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.706815:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff9f248fb6b100) 00010000:00010000:2.0:1784938439.706817:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784938439.706827:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d400/0x7b044d4128f9afec lrc: 2/0,0 mode: --/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.706833:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d400/0x7b044d4128f9afec lrc: 0/0,0 mode: --/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.706856:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9afde lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.706863:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9afde lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.706870:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9afde lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.706875:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217c600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938439.706878:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9afde lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.706883:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9afde lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.706889:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:2.0:1784938439.706891:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938439.706894:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9afde lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.706900:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9afde lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938439.706908:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007b8df532 reply state 000000009ab189d7 transno 8589934692 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d800/0x7b044d4128f9afe5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.706918:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d800/0x7b044d4128f9afe5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938439.706924:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x407c6222 (ffff9f248fb6b600) 00010000:00010000:2.0:1784938439.706927:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938439.706930:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938439.707054:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+175:17072:x1871643337367552:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1286us (1440us total) trans 8589934692 rc 0/0 00000100:00100000:2.0:1784938439.707062:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 233 00010000:00010000:3.0:1784938439.707565:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938439.707573:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c000/0x7b044d4128f9aff3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.707602:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217c000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938439.707605:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c000/0x7b044d4128f9aff3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.707612:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c000/0x7b044d4128f9aff3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.707622:0:19223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff9f248fb6b100) 00010000:00010000:3.0:1784938439.707624:0:19223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938439.707627:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c000/0x7b044d4128f9aff3 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.707632:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c000/0x7b044d4128f9aff3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.707649:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.707651:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938439.707653:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938439.713763:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938439.714326:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337367680 00000100:00100000:3.0:1784938439.714338:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337367680 00000100:00100000:3.0:1784938439.714413:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 234 00000100:00100000:3.0:1784938439.714538:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+175:17072:x1871643337367680:12345-192.168.202.54@tcp:101:rm.0 00010000:00010000:3.0:1784938439.714566:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938439.714588:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00600/0x7b044d4128f9affa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476637dd expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.714656:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9b001 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.714692:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9b001 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.714704:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9b001 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.714720:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b008 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa1c75412 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.714727:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b008 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.714734:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b008 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.714808:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01000/0x7b044d4128f9b00f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.714816:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01000/0x7b044d4128f9b00f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.714823:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01000/0x7b044d4128f9b00f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938439.714856:0:24203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 4096 00000004:00200000:3.0:1784938439.714860:0:24203:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784938439.714878:0:24203:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01000/0x7b044d4128f9b00f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.714888:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9b001 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.714906:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9b001 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.714912:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9b001 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.714931:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938439.714935:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9b001 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.714943:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9b001 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.714956:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f24898dd400) 00010000:00010000:3.0:1784938439.714959:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938439.714964:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9b001 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.714971:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9b001 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.714984:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b008 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.714989:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b008 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.714995:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b008 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.715000:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938439.715011:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b008 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.715018:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b008 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.715026:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa1c75412 (ffff9f2485293100) 00010000:00010000:3.0:1784938439.715030:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938439.715033:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b008 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.715038:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b008 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.715078:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00600/0x7b044d4128f9affa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476637dd expref: 177 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.715093:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01000/0x7b044d4128f9b00f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476637dd expref: 176 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.715100:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:3.0:1784938439.715102:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784938439.715105:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e01000, rc 0) 00000100:00100000:3.0:1784938439.715227:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+176:17072:x1871643337367680:12345-192.168.202.54@tcp:101:rm.0 Request processed in 692us (1474us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938439.718891:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 234 00000100:00100000:2.0:1784938439.719670:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337367936 00000100:00100000:2.0:1784938439.719679:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337367936 00000100:00100000:2.0:1784938439.719770:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:2.0:1784938439.719780:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+176:17072:x1871643337367936:12345-192.168.202.54@tcp:35:rm.0 00000100:00100000:2.0:1784938439.720022:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+177:17072:x1871643337367936:12345-192.168.202.54@tcp:35:rm.0 Request processed in 243us (457us total) trans 8589934693 rc 0/0 00000100:00100000:2.0:1784938439.720030:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:3.0:1784938439.722592:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938439.722874:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337368192 00000100:00100000:1.0:1784938439.722885:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337368192 00000100:00100000:1.0:1784938439.722959:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 235 00000100:00100000:1.0:1784938439.722970:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+177:17072:x1871643337368192:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:1.0:1784938439.723029:0:24202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1784938439.723070:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01000/0x7b044d4128f9b00f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476637dd expref: 177 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.723094:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42ca00/0x7b044d4128f99c90 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476633d8 expref: 176 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.723105:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938439.723116:0:24202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938439.723629:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b016 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.723643:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b016 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.723655:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b016 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.723670:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9b01d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xa1c75412 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.723677:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9b01d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.723682:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9b01d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.723758:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9b024 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.723765:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9b024 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.723771:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9b024 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938439.724009:0:24202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1784938439.724029:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9b024 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.724037:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9b024 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.724045:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9b024 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.724051:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e02c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.724057:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9b024 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.724071:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9b024 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.724085:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f2381d78600) 00010000:00010000:1.0:1784938439.724088:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784938439.724093:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9b024 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.724099:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9b024 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.724121:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b016 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.724304:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b016 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.724310:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b016 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.724315:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e02600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.724318:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b016 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.724324:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b016 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.724333:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f24898dd400) 00010000:00010000:1.0:1784938439.724336:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.724339:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b016 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.724349:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b016 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938439.724368:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000097c35f17 reply state 000000005fed37c0 transno 8589934694 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9b01d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.724379:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9b01d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.724385:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa1c75412 (ffff9f2381d78a00) 00010000:00010000:1.0:1784938439.724387:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938439.724389:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938439.724740:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+177:17072:x1871643337368192:12345-192.168.202.54@tcp:36:rm.0 Request processed in 1769us (2155us total) trans 8589934694 rc 0/0 00000100:00100000:1.0:1784938439.724749:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 235 00000100:00100000:1.0:1784938439.729493:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938439.729586:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337368320 00000100:00100000:3.0:1784938439.729596:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337368320 00000100:00100000:3.0:1784938439.729705:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 236 00000100:00100000:3.0:1784938439.729735:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+177:17072:x1871643337368320:12345-192.168.202.54@tcp:101:rm.0 00010000:00010000:3.0:1784938439.729762:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938439.729783:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00600/0x7b044d4128f9b02b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476637e4 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.729849:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b032 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.729862:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b032 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.729872:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b032 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.729884:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9b039 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb51c27aa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.729890:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9b039 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb51c27aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.729896:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9b039 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb51c27aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.729982:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b040 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.729989:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b040 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.729995:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b040 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938439.730041:0:24201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784938439.730044:0:24201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784938439.730076:0:24201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b040 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.730088:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b032 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.730094:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b032 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.730099:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b032 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.730105:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b032 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.730111:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938439.730114:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b032 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.730121:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b032 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.730497:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f238dd4bd00) 00010000:00010000:3.0:1784938439.730500:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938439.730506:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b032 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.730512:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b032 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.730539:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9b039 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb51c27aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.730545:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9b039 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb51c27aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.730552:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9b039 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb51c27aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.730557:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938439.730559:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9b039 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb51c27aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.730565:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9b039 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb51c27aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.730573:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb51c27aa (ffff9f2485293100) 00010000:00010000:3.0:1784938439.730575:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938439.730578:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9b039 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb51c27aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.730584:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9b039 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb51c27aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.730617:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00600/0x7b044d4128f9b02b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476637e4 expref: 179 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.730631:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b040 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476637e4 expref: 178 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.730650:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f24898dd400) 00010000:00010000:3.0:1784938439.730653:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784938439.730655:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e01200, rc 0) 00000100:00100000:1.0:1784938439.731405:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+178:17072:x1871643337368320:12345-192.168.202.54@tcp:101:rm.0 Request processed in 1666us (1987us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938439.731415:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 236 00000100:00100000:2.0:1784938439.741876:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938439.746790:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938439.746993:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337368832 00000100:00100000:3.0:1784938439.747004:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337368832 00000100:00100000:3.0:1784938439.747077:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 237 00000100:00100000:3.0:1784938439.747090:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+179:17072:x1871643337368832:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:3.0:1784938439.747186:0:24945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1784938439.747213:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b040 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476637e4 expref: 179 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.747247:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558200/0x7b044d4128f9887e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947662f86 expref: 178 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.747260:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f24898dd400) 00010000:00010000:3.0:1784938439.747276:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f98790 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947662f32 expref: 177 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.747285:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f238dd4bd00) 00010000:00010000:3.0:1784938439.747291:0:24945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938439.747324:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01600/0x7b044d4128f9b047 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.747338:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01600/0x7b044d4128f9b047 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.747348:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01600/0x7b044d4128f9b047 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.747386:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00c00/0x7b044d4128f9b04e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb51c27aa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.747394:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00c00/0x7b044d4128f9b04e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb51c27aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.747401:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00c00/0x7b044d4128f9b04e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb51c27aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.747479:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b055 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.747487:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b055 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.747494:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b055 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938439.747730:0:24945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1784938439.747745:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b055 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.747752:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b055 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.747760:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b055 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.747766:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938439.747770:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b055 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.747789:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b055 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.747799:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f2485293600) 00010000:00010000:3.0:1784938439.747802:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784938439.747807:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b055 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.747812:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b055 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.747830:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01600/0x7b044d4128f9b047 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.747836:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01600/0x7b044d4128f9b047 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.747842:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01600/0x7b044d4128f9b047 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.747847:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e01600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938439.747851:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01600/0x7b044d4128f9b047 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.747857:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01600/0x7b044d4128f9b047 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.747864:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2485293000) 00010000:00010000:3.0:1784938439.747867:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938439.747870:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01600/0x7b044d4128f9b047 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.747885:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01600/0x7b044d4128f9b047 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938439.747897:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003bf73a7b reply state 000000006d5f176c transno 8589934696 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00c00/0x7b044d4128f9b04e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb51c27aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.747907:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00c00/0x7b044d4128f9b04e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb51c27aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938439.747913:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb51c27aa (ffff9f2485293200) 00010000:00010000:3.0:1784938439.747928:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938439.747930:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938439.748005:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+178:17072:x1871643337368832:12345-192.168.202.54@tcp:36:rm.0 Request processed in 918us (1223us total) trans 8589934696 rc 0/0 00000100:00100000:3.0:1784938439.748013:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 237 00000100:00100000:3.0:1784938439.776496:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938439.787237:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938439.787526:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337369088 00000100:00100000:1.0:1784938439.787538:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337369088 00000100:00100000:1.0:1784938439.787619:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 239 00000100:00100000:1.0:1784938439.787631:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+179:17080:x1871643337369088:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1784938439.787657:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.787683:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b06a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476637f2 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.787789:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9b071 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.787805:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9b071 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.787817:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9b071 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.787832:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9b078 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.787840:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9b078 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.787846:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9b078 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.787895:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9b071 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.787903:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9b071 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.787909:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9b071 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.787915:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e02c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.787920:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9b071 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.787932:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9b071 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.787944:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f24975b2000) 00010000:00010000:1.0:1784938439.787948:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.787953:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9b071 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.787959:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9b071 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.787972:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9b078 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.787978:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9b078 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.787984:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9b078 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.787990:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e02200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.787993:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9b078 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.787998:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9b078 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.788005:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf7e027e9 (ffff9f2381d78600) 00010000:00010000:1.0:1784938439.788007:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.788010:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9b078 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.788019:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9b078 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.788052:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b06a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476637f2 expref: 180 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.788062:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f24975b2000) 00010000:00010000:1.0:1784938439.788065:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.788069:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b06a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476637f2 expref: 180 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.788078:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e02600, rc 0) 00000100:00100000:1.0:1784938439.788688:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+179:17080:x1871643337369088:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 515us (928us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938439.788698:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 239 00000100:00100000:3.0:1784938439.815278:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938439.815466:0:24210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337369216 00000100:00100000:2.0:1784938439.815479:0:24210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337369216 00000100:00100000:2.0:1784938439.815547:0:24210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 1 00000100:00100000:2.0:1784938439.815559:0:24210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7ea6e988-18ba-4c98-b179-17995571b98b+179:17080:x1871643337369216:12345-192.168.202.54@tcp:700:lfs.0 00000100:00100000:2.0:1784938439.815660:0:24210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7ea6e988-18ba-4c98-b179-17995571b98b+179:17080:x1871643337369216:12345-192.168.202.54@tcp:700:lfs.0 Request processed in 103us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938439.815668:0:24210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 1 00000100:00100000:2.0:1784938439.835656:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938439.888326:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938439.888639:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337369600 00000100:00100000:1.0:1784938439.888650:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337369600 00000100:00100000:1.0:1784938439.888708:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 241 00000100:00100000:1.0:1784938439.888717:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+180:16924:x1871643337369600:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:1.0:1784938439.888741:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.888763:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9b094 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476637f9 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.888844:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9b09b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.888857:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9b09b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.888868:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9b09b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938439.888912:0:24202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784938439.888927:0:24202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938439.888963:0:24202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9b09b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.888987:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9b094 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476637f9 expref: 182 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.889004:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9b09b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476637f9 expref: 181 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.889012:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2381d78600) 00010000:00010000:1.0:1784938439.889015:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784938439.889019:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e02c00, rc 0) 00000100:00100000:1.0:1784938439.889084:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+181:16924:x1871643337369600:12345-192.168.202.54@tcp:101:bash.0 Request processed in 368us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938439.889091:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 241 00000100:00100000:1.0:1784938439.897867:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938439.898048:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337369728 00000100:00100000:2.0:1784938439.898069:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337369728 00000100:00100000:2.0:1784938439.898132:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 242 00000100:00100000:2.0:1784938439.898142:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+181:16924:x1871643337369728:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:2.0:1784938439.898195:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938439.898216:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d400/0x7b044d4128f9b0a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663800 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938439.911723:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938439.911824:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337369856 00000100:00100000:1.0:1784938439.911835:0:24212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337369856 00000100:00100000:1.0:1784938439.911894:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:1.0:1784938439.911905:0:24212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7ea6e988-18ba-4c98-b179-17995571b98b+182:16924:x1871643337369856:12345-192.168.202.54@tcp:900:bash.0 00000100:00100000:1.0:1784938439.912002:0:24212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7ea6e988-18ba-4c98-b179-17995571b98b+182:16924:x1871643337369856:12345-192.168.202.54@tcp:900:bash.0 Request processed in 98us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938439.912014:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:3.0:1784938439.916129:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938439.916461:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337369984 00000100:00100000:1.0:1784938439.916472:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337369984 00000100:00100000:1.0:1784938439.916534:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 243 00000100:00100000:1.0:1784938439.916544:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+182:16924:x1871643337369984:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:1.0:1784938439.916565:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.916597:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9b0be lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663807 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.916661:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9b0c5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.916679:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9b0c5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.916689:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9b0c5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.916705:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b0cc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0xf20aa046 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.916711:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b0cc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0xf20aa046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.916717:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b0cc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0xf20aa046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.916814:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42ca00/0x7b044d4128f9b0d3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.916825:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42ca00/0x7b044d4128f9b0d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.916831:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42ca00/0x7b044d4128f9b0d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938439.916863:0:24202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1784938439.916866:0:24202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938439.916891:0:24202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42ca00/0x7b044d4128f9b0d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.916904:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9b0c5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.916910:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9b0c5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.916928:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9b0c5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.916934:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e03a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.916937:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9b0c5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.916944:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9b0c5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.916958:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f248300a200) 00010000:00010000:1.0:1784938439.916962:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.916967:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9b0c5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.916976:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9b0c5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.916990:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b0cc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0xf20aa046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.916996:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b0cc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0xf20aa046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.917001:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b0cc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0xf20aa046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.917006:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e02600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.917009:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b0cc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0xf20aa046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.917014:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b0cc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0xf20aa046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.917020:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0xf20aa046 (ffff9f2381d78000) 00010000:00010000:1.0:1784938439.917023:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.917025:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b0cc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0xf20aa046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.917030:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b0cc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0xf20aa046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.917071:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9b0be lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663807 expref: 184 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.917090:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42ca00/0x7b044d4128f9b0d3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663807 expref: 183 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.917098:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0x0 (ffff9f2381d78100) 00010000:00010000:1.0:1784938439.917100:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784938439.917102:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d42ca00, rc 0) 00000100:00100000:1.0:1784938439.917210:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+183:16924:x1871643337369984:12345-192.168.202.54@tcp:101:bash.0 Request processed in 668us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938439.917218:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 243 00000100:00100000:2.0:1784938439.923806:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938439.977446:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337370496 00000100:00100000:1.0:1784938439.977456:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337370496 00000100:00100000:1.0:1784938439.977512:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 245 00000100:00100000:1.0:1784938439.977521:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+183:16924:x1871643337370496:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:1.0:1784938439.977541:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938439.977562:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9b0ef lrc: 2/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663815 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.977629:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b0f6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.977644:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b0f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.977654:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b0f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.977667:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9b0fd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x3:0x0].0x4649583 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.977675:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9b0fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x4649583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.977681:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9b0fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x4649583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.977720:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b0f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.977726:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b0f6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.977733:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b0f6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.977739:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e02600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.977743:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b0f6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.977752:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b0f6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.977763:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0x0 (ffff9f2381d78100) 00010000:00010000:1.0:1784938439.977779:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.977784:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b0f6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.977791:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b0f6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.977804:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9b0fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x4649583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.977811:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9b0fd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x4649583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.977817:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9b0fd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x4649583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.977822:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e03a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938439.977824:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9b0fd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x4649583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.977830:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9b0fd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x4649583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.977836:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0x4649583 (ffff9f2381d78000) 00010000:00010000:1.0:1784938439.977838:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938439.977840:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9b0fd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x3:0x0].0x4649583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.977845:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9b0fd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x3:0x0].0x4649583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.977873:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9b0ef lrc: 1/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663815 expref: 184 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.977882:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0x0 (ffff9f2381d78100) 00010000:00010000:1.0:1784938439.977884:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784938439.977888:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9b0ef lrc: 0/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663815 expref: 184 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938439.977901:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e02200, rc 0) 00000100:00100000:1.0:1784938439.977966:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+183:16924:x1871643337370496:12345-192.168.202.54@tcp:101:bash.0 Request processed in 446us (697us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938439.977973:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 245 00000100:00100000:3.0:1784938440.079848:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938440.081844:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337370624 00000100:00100000:1.0:1784938440.081860:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337370624 00000100:00100000:1.0:1784938440.081944:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 246 00000100:00100000:1.0:1784938440.081955:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+183:17091:x1871643337370624:12345-192.168.202.54@tcp:101:stat.0 00010000:00010000:1.0:1784938440.081976:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938440.081998:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9b104 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766381c expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.082061:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9b10b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.082074:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9b10b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.082086:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9b10b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.082097:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b112 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.082104:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b112 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.082111:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b112 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.082231:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b119 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.082240:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b119 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.082247:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b119 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938440.082281:0:24201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784938440.082284:0:24201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938440.082321:0:24201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b119 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.082334:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9b10b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.082341:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9b10b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.082347:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9b10b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.082364:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9b10b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.082369:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e03a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.082372:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9b10b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.082513:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9b10b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.082526:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2381d78600) 00010000:00010000:1.0:1784938440.082529:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.082534:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9b10b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.082541:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9b10b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.082554:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b112 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.082560:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b112 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.082566:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b112 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.082571:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e02600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.082573:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b112 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.082578:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b112 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.082584:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf7e027e9 (ffff9f2387231c00) 00010000:00010000:1.0:1784938440.082587:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.082589:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b112 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.082595:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b112 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.082622:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9b104 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766381c expref: 185 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.082635:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b119 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766381c expref: 184 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.082642:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1:0x0].0x0 (ffff9f2387231d00) 00010000:00010000:1.0:1784938440.082644:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784938440.082646:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238db38e00, rc 0) 00000100:00100000:1.0:1784938440.082708:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+184:17091:x1871643337370624:12345-192.168.202.54@tcp:101:stat.0 Request processed in 755us (2868us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938440.082715:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 246 00000100:00100000:2.0:1784938440.085954:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938440.087066:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337370752 00000100:00100000:1.0:1784938440.087078:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337370752 00000100:00100000:1.0:1784938440.087192:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 247 00000100:00100000:1.0:1784938440.087202:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+184:17091:x1871643337370752:12345-192.168.202.54@tcp:41:stat.0 00000004:00000024:1.0:1784938440.087273:0:24202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 626114560 avail 570490880 00000100:00100000:1.0:1784938440.087364:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+184:17091:x1871643337370752:12345-192.168.202.54@tcp:41:stat.0 Request processed in 163us (1421us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938440.087372:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 247 00000100:00100000:3.0:1784938440.269546:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337370880 00000100:00100000:3.0:1784938440.269557:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337370880 00000100:00100000:3.0:1784938440.269621:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 248 00000100:00100000:3.0:1784938440.269632:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+184:17095:x1871643337370880:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1784938440.269654:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938440.269678:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01600/0x7b044d4128f9b120 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663823 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.269766:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b127 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.269781:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b127 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.269805:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b127 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.269821:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b12e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.269830:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b12e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.269838:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b12e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.269877:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b127 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.269886:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b127 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.269893:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b127 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.269900:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938440.269905:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b127 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.270112:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b127 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.270405:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1:0x0].0x0 (ffff9f2387231d00) 00010000:00010000:3.0:1784938440.270409:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938440.270415:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b127 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.270422:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b127 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.270437:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b12e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.270500:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b12e lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.270509:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b12e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.270514:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e01200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938440.270516:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b12e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.270523:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b12e lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.270531:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1:0x0].0xa1c75412 (ffff9f2485293600) 00010000:00010000:3.0:1784938440.270534:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938440.270537:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b12e lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.270554:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b12e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.270592:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01600/0x7b044d4128f9b120 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663823 expref: 185 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.270604:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1:0x0].0x0 (ffff9f2387231d00) 00010000:00010000:3.0:1784938440.270606:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938440.270610:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01600/0x7b044d4128f9b120 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663823 expref: 185 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.270619:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e01600, rc 0) 00000100:00100000:3.0:1784938440.270698:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+184:17095:x1871643337370880:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1067us (1689us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938440.270708:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 248 00000100:00100000:1.0:1784938440.287488:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337371136 00000100:00100000:1.0:1784938440.287499:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337371136 00000100:00100000:1.0:1784938440.287560:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 249 00000100:00100000:1.0:1784938440.287570:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+184:17095:x1871643337371136:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1784938440.287592:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938440.287613:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b135 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766382a expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938440.287707:0:24202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1784938440.287820:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b135 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766382a expref: 186 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.287834:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2381d78600) 00010000:00010000:1.0:1784938440.287837:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784938440.287842:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b135 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766382a expref: 186 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.287856:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238db39600, rc 0) 00000100:00100000:1.0:1784938440.287922:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+185:17095:x1871643337371136:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 353us (663us total) trans 8589934698 rc 301/301 00000100:00100000:1.0:1784938440.287929:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 249 00000100:00100000:2.0:1784938440.296862:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938440.296960:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337371392 00000100:00100000:1.0:1784938440.296970:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337371392 00000100:00100000:1.0:1784938440.297032:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 250 00000100:00100000:1.0:1784938440.297042:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+185:17095:x1871643337371392:12345-192.168.202.54@tcp:36:lfs.0 00010000:00010000:1.0:1784938440.297105:0:24201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938440.297171:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b119 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766381c expref: 185 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.297192:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1:0x0].0x0 (ffff9f2387231d00) 00010000:00010000:1.0:1784938440.297198:0:24201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938440.297266:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b143 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.297281:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b143 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.297290:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b143 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.297307:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9b14a lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.297314:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9b14a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.297321:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9b14a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.297834:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b151 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.297845:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b151 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.297853:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b151 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938440.297867:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000792d8be6 reply state 00000000f078ca93 transno 8589934699 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b151 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.297879:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b151 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.297886:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938440.297889:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938440.297893:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784938440.297897:0:24201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1784938440.297905:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b143 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.297912:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b143 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.297919:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b143 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.297926:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b143 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.297932:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.297936:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b143 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.297944:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b143 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.297953:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1:0x0].0x0 (ffff9f2387231d00) 00010000:00010000:1.0:1784938440.297955:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.297959:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b143 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.297964:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b143 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938440.297975:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000792d8be6 reply state 00000000f078ca93 transno 8589934699 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9b14a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.297986:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9b14a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.297991:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1:0x0].0xa1c75412 (ffff9f2381d78000) 00010000:00010000:1.0:1784938440.297993:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938440.297995:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1784938440.298077:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+186:17095:x1871643337371392:12345-192.168.202.54@tcp:36:lfs.0 Request processed in 1036us (1224us total) trans 8589934699 rc 0/0 00000100:00100000:1.0:1784938440.298093:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 250 00000100:00100000:2.0:1784938440.302014:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337371648 00000100:00100000:2.0:1784938440.302025:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337371648 00000100:00100000:2.0:1784938440.302095:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:2.0:1784938440.302105:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24857f9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+186:17095:x1871643337371648:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:2.0:1784938440.302387:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24857f9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+187:17095:x1871643337371648:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 283us (637us total) trans 8589934700 rc 0/0 00000100:00100000:2.0:1784938440.302394:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:1.0:1784938440.355821:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337371776 00000100:00100000:1.0:1784938440.355832:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337371776 00000100:00100000:1.0:1784938440.355906:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 251 00000100:00100000:1.0:1784938440.355925:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+187:17096:x1871643337371776:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938440.355951:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938440.355972:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9b158 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663831 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.356063:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b15f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.356079:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b15f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.356102:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b15f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.356113:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b166 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.356129:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b166 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.356135:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b166 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.356254:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffc00/0x7b044d4128f9b16d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.356275:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffc00/0x7b044d4128f9b16d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.356283:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffc00/0x7b044d4128f9b16d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938440.356315:0:24202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784938440.356320:0:24202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938440.356365:0:24202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffc00/0x7b044d4128f9b16d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.356377:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b15f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.356384:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b15f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.356390:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b15f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.356396:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.356401:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b15f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.356408:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b15f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.356421:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2381d78600) 00010000:00010000:1.0:1784938440.356424:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.356428:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b15f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.356434:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b15f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.356903:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b166 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.356921:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b166 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.356927:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b166 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.356932:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db38e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.356934:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b166 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.356940:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b166 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.356950:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf7e027e9 (ffff9f2387231c00) 00010000:00010000:1.0:1784938440.356952:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.356955:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b166 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.356964:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b166 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.356999:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03a00/0x7b044d4128f9b158 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663831 expref: 189 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.357014:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffc00/0x7b044d4128f9b16d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663831 expref: 188 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.357021:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1:0x0].0x0 (ffff9f2387231d00) 00010000:00010000:1.0:1784938440.357023:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784938440.357025:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823ffc00, rc 0) 00000100:00100000:1.0:1784938440.357268:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+188:17096:x1871643337371776:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1352us (1571us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938440.357277:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 251 00000100:00100000:2.0:1784938440.376652:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938440.376759:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337371904 00000100:00100000:1.0:1784938440.376769:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337371904 00000100:00100000:1.0:1784938440.376840:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 252 00000100:00100000:1.0:1784938440.376850:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+188:17096:x1871643337371904:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938440.376879:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938440.376901:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b174 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663838 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.376965:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9b17b lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.376979:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9b17b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.376993:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9b17b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.377002:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b182 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.377009:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b182 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.377014:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b182 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.377081:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b189 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.377088:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b189 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.377095:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b189 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938440.377128:0:24201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0x2:0x0]: returning size 4096 00000004:00200000:1.0:1784938440.377132:0:24201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938440.377175:0:24201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b189 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.377188:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9b17b lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.377194:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9b17b lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.377206:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9b17b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.377212:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9b17b lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.377219:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823ff400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.377222:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9b17b lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.377230:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9b17b lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.377241:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1:0x0].0x0 (ffff9f2387231d00) 00010000:00010000:1.0:1784938440.377244:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.377249:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9b17b lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.377255:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9b17b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.377287:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b182 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.377294:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b182 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.377299:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b182 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.377303:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823ff000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.377306:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b182 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.377311:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b182 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.377318:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1:0x0].0xa1c75412 (ffff9f2381d78000) 00010000:00010000:1.0:1784938440.377320:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.377323:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b182 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.377328:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b182 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.377361:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b174 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663838 expref: 190 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.377374:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b189 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663838 expref: 189 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.377382:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938440.377384:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784938440.377386:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823ffa00, rc 0) 00000100:00100000:1.0:1784938440.377443:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+189:17096:x1871643337371904:12345-192.168.202.54@tcp:101:cp.0 Request processed in 595us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938440.377451:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 252 00000100:00100000:1.0:1784938440.396201:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337372032 00000100:00100000:1.0:1784938440.396212:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337372032 00000100:00100000:1.0:1784938440.396279:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 253 00000100:00100000:1.0:1784938440.396290:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+189:17096:x1871643337372032:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938440.396314:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938440.396337:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b190 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766383f expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.396437:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b197 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.396452:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b197 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.396462:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b197 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.396476:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9b19e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x45c0cf9c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.396482:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9b19e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.396487:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9b19e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.396524:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b197 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.396532:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b197 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.396538:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b197 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.396545:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823ff000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.396549:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b197 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.396557:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b197 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.396568:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938440.396572:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.396577:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b197 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.396583:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b197 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.396595:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9b19e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.396601:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9b19e lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.396606:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9b19e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.396611:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823ff400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.396613:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9b19e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.396619:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9b19e lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.396626:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x45c0cf9c (ffff9f2381d78900) 00010000:00010000:1.0:1784938440.396628:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.396631:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9b19e lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.396637:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9b19e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.396667:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b190 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766383f expref: 190 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.396678:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938440.396681:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.396685:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b190 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766383f expref: 190 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.396693:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823ffe00, rc 0) 00000100:00100000:1.0:1784938440.396756:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+189:17096:x1871643337372032:12345-192.168.202.54@tcp:101:cp.0 Request processed in 468us (777us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938440.396764:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 253 00000100:00100000:1.0:1784938440.408292:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337372288 00000100:00100000:1.0:1784938440.408302:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337372288 00000100:00100000:1.0:1784938440.408370:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 254 00000100:00100000:1.0:1784938440.408381:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+189:17096:x1871643337372288:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938440.408401:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938440.408405:0:24201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1784938440.408432:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b189 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663838 expref: 189 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.408453:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938440.408458:0:24201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938440.408473:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe600/0x7b044d4128f9b1a5 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663846 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.408567:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b1ac lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.408581:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b1ac lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.408591:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b1ac lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.408605:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fec00/0x7b044d4128f9b1b3 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x45c0cf9c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.408613:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fec00/0x7b044d4128f9b1b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.408619:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fec00/0x7b044d4128f9b1b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938440.408966:0:24201:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x29:0x0], count =25 00000004:00080000:1.0:1784938440.408973:0:24201:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x29:0x0]+25 in llog 00000004:00080000:1.0:1784938440.408992:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:1.0:1784938440.409120:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff200/0x7b044d4128f9b1ba lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.409129:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff200/0x7b044d4128f9b1ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.409138:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff200/0x7b044d4128f9b1ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.409197:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b1ac lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.409204:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b1ac lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.409211:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b1ac lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.409218:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b1ac lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.409224:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fea00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.409229:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b1ac lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.409236:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b1ac lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.409245:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938440.409248:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.409252:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b1ac lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.409258:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b1ac lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938440.409268:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a8f88717 reply state 0000000064ed0c15 transno 8589934701 ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fec00/0x7b044d4128f9b1b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.409279:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fec00/0x7b044d4128f9b1b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.409286:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x45c0cf9c (ffff9f2381d78700) 00010000:00010000:1.0:1784938440.409288:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938440.409291:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938440.409316:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe600/0x7b044d4128f9b1a5 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663846 expref: 191 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.409329:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff200/0x7b044d4128f9b1ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663846 expref: 190 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.409337:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x3:0x0].0x0 (ffff9f2381d78d00) 00010000:00010000:1.0:1784938440.409339:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938440.409341:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823ff200, rc 0) 00000100:00100000:1.0:1784938440.409410:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+191:17096:x1871643337372288:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1031us (1273us total) trans 8589934701 rc 0/0 00000100:00100000:1.0:1784938440.409418:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 254 00000100:00100000:2.0:1784938440.416898:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938440.417039:0:21152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337372416 00000100:00100000:1.0:1784938440.417059:0:21152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337372416 00000100:00100000:1.0:1784938440.417137:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 498 00000100:00100000:1.0:1784938440.417184:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+72:10958:x1871643337372416:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938440.417204:0:21152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938440.417226:0:21152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b902f147/0x7b044d4128f9b1c8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766384d expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938440.417252:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938440.417275:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=706s v=(0 0) 00010000:00010000:1.0:1784938440.417280:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938440.417290:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b902f147/0x7b044d4128f9b1c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766384d expref: 73 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.417309:0:21152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b902f147/0x7b044d4128f9b1c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766384d expref: 73 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.417321:0:21152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823ffe00, rc 0) 00000100:00100000:1.0:1784938440.417396:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+73:10958:x1871643337372416:12345-192.168.202.54@tcp:101:cp.0 Request processed in 249us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938440.417403:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 498 00010000:00010000:2.0:1784938440.430794:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938440.433056:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337372544 00000100:00100000:3.0:1784938440.433066:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337372544 00000100:00100000:3.0:1784938440.433141:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 499 00000100:00100000:3.0:1784938440.433187:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+73:17096:x1871643337372544:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938440.433206:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938440.433223:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093f69a35/0x7b044d4128f9b1cf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663854 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.433256:0:21151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b902f147/0x7b044d4128f9b1c8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766384d expref: 74 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.433285:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938440.433289:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938440.433295:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093f69a35/0x7b044d4128f9b1cf lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663854 expref: 74 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.433332:0:21151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b902f147/0x7b044d4128f9b1c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e94766384d expref: 74 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.433355:0:21151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b902f147/0x7b044d4128f9b1c8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766384d expref: 74 pid: 21152 timeout: 806 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938440.433373:0:21151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:21151:1871643350826496:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938440.433456:0:21151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238e8de240 going to sleep for 11 seconds 00000100:00100000:3.0:1784938440.436970:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938440.437072:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337372672 00000100:00100000:2.0:1784938440.437092:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337372672 00010000:00010000:2.0:1784938440.437132:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b902f147/0x7b044d4128f9b1c8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766384d expref: 75 pid: 21152 timeout: 806 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938440.437208:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 200 00000100:00100000:2.0:1784938440.437218:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+75:10959:x1871643337372672:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938440.437233:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938440.437255:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b902f147/0x7b044d4128f9b1c8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766384d expref: 75 pid: 21152 timeout: 806 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.437269:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b902f147/0x7b044d4128f9b1c8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766384d expref: 75 pid: 21152 timeout: 806 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.437294:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938440.437298:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938440.437307:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000093f69a35/0x7b044d4128f9b1cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663854 expref: 75 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.437318:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093f69a35/0x7b044d4128f9b1cf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663854 expref: 75 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.437391:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000093f69a35/0x7b044d4128f9b1cf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663854 expref: 75 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938440.437407:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350826624:192.168.202.54@tcp:105: 00000100:00100000:2.0:1784938440.437489:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b4068000 going to sleep for 11 seconds 00000100:00100000:3.0:1784938440.443679:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938440.446022:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350826624:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938440.446057:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938440.446101:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+73:10959:x1871643337372672:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 8885us (9140us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938440.446109:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 200 00000100:00100000:3.0:1784938440.469629:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938440.469890:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337373056 00000100:00100000:1.0:1784938440.469901:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337373056 00000100:00100000:1.0:1784938440.469970:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 255 00000100:00100000:1.0:1784938440.469980:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+192:17096:x1871643337373056:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938440.470005:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938440.470028:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9b1d6 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766385b expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.470112:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b1dd lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.470137:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b1dd lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.470180:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b1dd lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.470193:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b1e4 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.470200:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.470206:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.470282:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fee00/0x7b044d4128f9b1eb lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.470291:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fee00/0x7b044d4128f9b1eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.470297:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fee00/0x7b044d4128f9b1eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938440.470329:0:24202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0x2:0x0]: returning size 4096 00000004:00200000:1.0:1784938440.470333:0:24202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938440.470363:0:24202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fee00/0x7b044d4128f9b1eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.470375:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b1dd lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.470383:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b1dd lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.470388:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b1dd lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.470394:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823ff000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.470398:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b1dd lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.470405:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b1dd lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.470416:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1:0x0].0x0 (ffff9f2387231d00) 00010000:00010000:1.0:1784938440.470420:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.470426:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b1dd lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.470432:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b1dd lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.470444:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.470449:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b1e4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.470455:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b1e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.470460:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823ff800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.470463:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b1e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.470469:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b1e4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.470475:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1:0x0].0xa1c75412 (ffff9f2381d78000) 00010000:00010000:1.0:1784938440.470477:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.470480:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b1e4 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.470490:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b1e4 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.470513:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9b1d6 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766385b expref: 194 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.470526:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fee00/0x7b044d4128f9b1eb lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766385b expref: 193 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.470533:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938440.470535:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784938440.470538:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fee00, rc 0) 00000100:00100000:1.0:1784938440.470592:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+193:17096:x1871643337373056:12345-192.168.202.54@tcp:101:cp.0 Request processed in 614us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938440.470599:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 255 00000100:00100000:1.0:1784938440.478555:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337373184 00000100:00100000:1.0:1784938440.478566:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337373184 00000100:00100000:1.0:1784938440.478630:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 256 00000100:00100000:1.0:1784938440.478642:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+193:17096:x1871643337373184:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938440.478668:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938440.478690:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9b1f2 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663862 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.478760:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b1f9 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.478776:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b1f9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.478799:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b1f9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.478816:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b200 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x56569231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.478823:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b200 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.478830:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b200 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.478883:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b1f9 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.478891:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b1f9 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.478897:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b1f9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.478904:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b1f9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.478919:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823ff800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.478925:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b1f9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.478933:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b1f9 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.478946:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938440.478949:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.478953:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b1f9 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.478959:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b1f9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.478973:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b200 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.478979:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b200 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.478985:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b200 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.478990:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823ff000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.478993:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b200 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.478998:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b200 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.479004:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x56569231 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938440.479007:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.479009:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b200 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.479015:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b200 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.479044:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9b1f2 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663862 expref: 194 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.479054:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938440.479056:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.479059:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9b1f2 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663862 expref: 194 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.479067:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823ff400, rc 0) 00000100:00100000:1.0:1784938440.479129:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+193:17096:x1871643337373184:12345-192.168.202.54@tcp:101:cp.0 Request processed in 490us (677us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938440.479137:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 256 00000100:00100000:1.0:1784938440.487313:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337373312 00000100:00100000:1.0:1784938440.487323:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337373312 00000100:00100000:1.0:1784938440.487395:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 257 00000100:00100000:1.0:1784938440.487405:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+193:17096:x1871643337373312:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938440.487435:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938440.487467:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9b207 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663869 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.487531:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b20e lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.487547:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b20e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.487562:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b20e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.487577:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b215 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x56569231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.487585:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b215 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.487592:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b215 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.487644:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b20e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.487651:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b20e lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.487657:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b20e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.487662:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823ff000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.487666:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b20e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.487673:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b20e lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.487686:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938440.487689:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.487694:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b20e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.487699:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b20e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.487712:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b215 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.487719:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b215 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.487725:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b215 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.487730:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823ff800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.487733:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b215 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.487738:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b215 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.487745:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x56569231 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938440.487748:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.487751:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b215 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.487757:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b215 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.487793:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9b207 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663869 expref: 194 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.487805:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938440.487807:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.487810:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9b207 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663869 expref: 194 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.487824:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823ff400, rc 0) 00000100:00100000:1.0:1784938440.487891:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+193:17096:x1871643337373312:12345-192.168.202.54@tcp:101:cp.0 Request processed in 487us (770us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938440.487899:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 257 00000100:00100000:1.0:1784938440.492402:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337373568 00000100:00100000:1.0:1784938440.492412:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337373568 00000100:00100000:1.0:1784938440.492483:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 258 00000100:00100000:1.0:1784938440.492493:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+193:17096:x1871643337373568:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938440.492514:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938440.492535:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9b21c lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663870 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.492654:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b223 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.492673:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b223 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.492686:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b223 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.492699:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b22a lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x56569231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.492706:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b22a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.492712:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b22a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938440.493097:0:24201:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x2a:0x0], count =24 00000004:00080000:1.0:1784938440.493105:0:24201:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x2a:0x0]+24 in llog 00000004:00080000:1.0:1784938440.493115:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:1.0:1784938440.493321:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe200/0x7b044d4128f9b231 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.493331:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe200/0x7b044d4128f9b231 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.493338:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe200/0x7b044d4128f9b231 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.493381:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b223 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.493388:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b223 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.493394:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b223 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.493401:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b223 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.493407:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823ff800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.493412:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b223 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.493420:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b223 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.493436:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938440.493439:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.493444:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b223 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.493451:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b223 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938440.493465:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a6748161 reply state 00000000bd06ede5 transno 8589934703 ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b22a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.493476:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b22a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.493483:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x56569231 (ffff9f238dcb4a00) 00010000:00010000:1.0:1784938440.493485:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938440.493488:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938440.493517:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff400/0x7b044d4128f9b21c lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663870 expref: 196 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.493531:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe200/0x7b044d4128f9b231 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663870 expref: 195 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.493538:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4:0x0].0x0 (ffff9f248fb6e600) 00010000:00010000:1.0:1784938440.493540:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938440.493542:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fe200, rc 0) 00000100:00100000:1.0:1784938440.493599:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+196:17096:x1871643337373568:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1107us (1482us total) trans 8589934703 rc 0/0 00000100:00100000:1.0:1784938440.493606:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 258 00000100:00100000:1.0:1784938440.500066:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337373696 00000100:00100000:1.0:1784938440.500076:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337373696 00000100:00100000:1.0:1784938440.500141:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 500 00000100:00100000:1.0:1784938440.500173:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+73:10960:x1871643337373696:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938440.500190:0:25715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938440.500211:0:25715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000932b9d1a/0x7b044d4128f9b23f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663877 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938440.500234:0:25715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938440.500254:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=706s v=(0 0) 00010000:00010000:1.0:1784938440.500259:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938440.500268:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000932b9d1a/0x7b044d4128f9b23f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663877 expref: 74 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.500287:0:25715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000932b9d1a/0x7b044d4128f9b23f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663877 expref: 74 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.500302:0:25715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fe400, rc 0) 00000100:00100000:1.0:1784938440.500384:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+74:10960:x1871643337373696:12345-192.168.202.54@tcp:101:cp.0 Request processed in 212us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938440.500392:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 500 00000100:00100000:1.0:1784938440.524364:0:21152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337373824 00000100:00100000:1.0:1784938440.524380:0:21152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337373824 00000100:00100000:1.0:1784938440.524458:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 501 00000100:00100000:1.0:1784938440.524468:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381362850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+74:17096:x1871643337373824:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938440.524490:0:21152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938440.524514:0:21152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079f5821f/0x7b044d4128f9b246 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766387e expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.524548:0:21152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000932b9d1a/0x7b044d4128f9b23f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663877 expref: 75 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.524558:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938440.524563:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938440.524569:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079f5821f/0x7b044d4128f9b246 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766387e expref: 75 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.524607:0:21152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000932b9d1a/0x7b044d4128f9b23f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663877 expref: 75 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.524623:0:21152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000932b9d1a/0x7b044d4128f9b23f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663877 expref: 75 pid: 25715 timeout: 806 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938440.524637:0:21152:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388125180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:21152:1871643350826752:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938440.524814:0:21152:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24850230c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938440.532264:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337373952 00000100:00100000:2.0:1784938440.532275:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337373952 00010000:00010000:2.0:1784938440.532336:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000932b9d1a/0x7b044d4128f9b23f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663877 expref: 76 pid: 25715 timeout: 806 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938440.532402:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 201 00000100:00100000:2.0:1784938440.532413:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+76:10958:x1871643337373952:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938440.532433:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938440.532459:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000932b9d1a/0x7b044d4128f9b23f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663877 expref: 76 pid: 25715 timeout: 806 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.532474:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000932b9d1a/0x7b044d4128f9b23f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663877 expref: 76 pid: 25715 timeout: 806 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.532503:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938440.532507:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938440.532517:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000079f5821f/0x7b044d4128f9b246 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766387e expref: 76 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.532527:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079f5821f/0x7b044d4128f9b246 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766387e expref: 76 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.532566:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000079f5821f/0x7b044d4128f9b246 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766387e expref: 76 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938440.532582:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350826880:192.168.202.54@tcp:105: 00000100:00100000:2.0:1784938440.532676:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b4068000 going to sleep for 11 seconds 00010000:00010000:1.0:1784938440.533822:0:21152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000932b9d1a/0x7b044d4128f9b23f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663877 expref: 76 pid: 25715 timeout: 806 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938440.533844:0:21152:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388125180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:21152:1871643350826752:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938440.533882:0:21152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000079f5821f/0x7b044d4128f9b246 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766387e expref: 75 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.533900:0:21152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823ff400, rc 0) 00000100:00100000:1.0:1784938440.533972:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381362850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+75:17096:x1871643337373824:12345-192.168.202.54@tcp:101:cp.0 Request processed in 9506us (16028us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938440.533981:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 501 00000100:00100000:2.0:1784938440.540649:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350826880:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938440.540677:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938440.540751:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+74:10958:x1871643337373952:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 8339us (8932us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938440.540764:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 201 00000100:00100000:1.0:1784938440.547509:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337374208 00000100:00100000:1.0:1784938440.547527:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337374208 00000100:00100000:1.0:1784938440.547632:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:1.0:1784938440.547644:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+196:17096:x1871643337374208:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:1.0:1784938440.548005:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+197:17096:x1871643337374208:12345-192.168.202.54@tcp:35:cp.0 Request processed in 362us (7489us total) trans 8589934704 rc 0/0 00000100:00100000:1.0:1784938440.548013:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:1.0:1784938440.569196:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337374336 00000100:00100000:1.0:1784938440.569209:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337374336 00000100:00100000:1.0:1784938440.569271:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 259 00000100:00100000:1.0:1784938440.569281:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+197:17096:x1871643337374336:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938440.569313:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938440.569338:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe400/0x7b044d4128f9b24d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663885 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.569436:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b254 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.569451:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b254 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.569462:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b254 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.569487:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9b25b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xa6e7eec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.569494:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9b25b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.569500:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9b25b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.569541:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b254 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.569549:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b254 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.569554:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b254 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.569560:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823ff800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.569564:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b254 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.569572:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b254 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.569583:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938440.569587:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.569591:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b254 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.569597:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b254 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.569609:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9b25b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.569615:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9b25b lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.569621:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9b25b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.569625:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fe000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.569628:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9b25b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.569634:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9b25b lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.569640:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xa6e7eec (ffff9f23823e3800) 00010000:00010000:1.0:1784938440.569642:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.569645:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9b25b lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.569651:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9b25b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.569683:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe400/0x7b044d4128f9b24d lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663885 expref: 198 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.569694:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938440.569697:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.569701:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe400/0x7b044d4128f9b24d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663885 expref: 198 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.569711:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fe400, rc 0) 00000100:00100000:1.0:1784938440.569790:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+197:17096:x1871643337374336:12345-192.168.202.54@tcp:101:cp.0 Request processed in 509us (868us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938440.569797:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 259 00000100:00100000:3.0:1784938440.573048:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938440.573461:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337374464 00000100:00100000:1.0:1784938440.573471:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337374464 00000100:00100000:1.0:1784938440.573540:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 260 00000100:00100000:1.0:1784938440.573551:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+197:17096:x1871643337374464:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938440.573576:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938440.573601:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe800/0x7b044d4128f9b262 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766388c expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.573669:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b269 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.573684:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b269 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.573695:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b269 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.573709:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b270 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xa6e7eec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.573716:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b270 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.573721:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b270 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.573761:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b269 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.573769:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b269 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.573776:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b269 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.573783:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b269 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.573789:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823ff600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.573794:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b269 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.573801:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b269 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.573812:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938440.573816:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.573820:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b269 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.573826:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b269 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.573841:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b270 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.573848:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b270 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.575018:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b270 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.575024:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823ffa00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.575028:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b270 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.575035:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b270 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.575267:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xa6e7eec (ffff9f23823e3b00) 00010000:00010000:1.0:1784938440.575271:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.575275:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b270 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.575281:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b270 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.575407:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe800/0x7b044d4128f9b262 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766388c expref: 198 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.575417:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938440.575420:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.575423:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe800/0x7b044d4128f9b262 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766388c expref: 198 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.575434:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fe800, rc 0) 00000100:00100000:1.0:1784938440.575558:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+197:17096:x1871643337374464:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2008us (2527us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938440.575569:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 260 00000100:00100000:2.0:1784938440.603594:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938440.603726:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337374720 00000100:00100000:1.0:1784938440.603738:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337374720 00000100:00100000:1.0:1784938440.608247:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 261 00000100:00100000:1.0:1784938440.608276:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+197:17096:x1871643337374720:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938440.608575:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938440.608604:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217da00/0x7b044d4128f9b277 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663893 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.608727:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ca00/0x7b044d4128f9b27e lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.608743:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ca00/0x7b044d4128f9b27e lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.608754:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ca00/0x7b044d4128f9b27e lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.608768:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9b285 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0xa6e7eec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.608775:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9b285 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.608782:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9b285 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938440.609115:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x43:0x0], index 0: 0 00010000:00010000:2.0:1784938440.609284:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d200/0x7b044d4128f9b28c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.609307:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d200/0x7b044d4128f9b28c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.609315:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d200/0x7b044d4128f9b28c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.609372:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ca00/0x7b044d4128f9b27e lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.609380:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ca00/0x7b044d4128f9b27e lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.609387:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ca00/0x7b044d4128f9b27e lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.609392:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217ca00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938440.609396:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ca00/0x7b044d4128f9b27e lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.609404:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ca00/0x7b044d4128f9b27e lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.609415:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938440.609418:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938440.609423:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ca00/0x7b044d4128f9b27e lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.609429:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ca00/0x7b044d4128f9b27e lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938440.609441:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001c1f2223 reply state 00000000dae521e5 transno 8589934705 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9b285 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.609452:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9b285 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.609458:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xa6e7eec (ffff9f248fb6be00) 00010000:00010000:2.0:1784938440.609460:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938440.609462:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938440.609493:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217da00/0x7b044d4128f9b277 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663893 expref: 200 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.609506:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d200/0x7b044d4128f9b28c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663893 expref: 199 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.609514:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x5:0x0].0x0 (ffff9f248fb6b900) 00010000:00010000:2.0:1784938440.609516:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938440.609518:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217d200, rc 0) 00000100:00100000:2.0:1784938440.609597:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+200:17096:x1871643337374720:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1334us (6012us total) trans 8589934705 rc 0/0 00000100:00100000:2.0:1784938440.609606:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 261 00000100:00100000:1.0:1784938440.625403:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337374848 00000100:00100000:1.0:1784938440.625413:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337374848 00000100:00100000:1.0:1784938440.625476:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 502 00000100:00100000:1.0:1784938440.625485:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+73:10958:x1871643337374848:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938440.625503:0:25716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938440.625521:0:25716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000baaa6dd1/0x7b044d4128f9b29a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x43:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766389a expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938440.625545:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x43:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938440.625566:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x43:0x0].0x0 since=706s v=(0 0) 00010000:00010000:1.0:1784938440.625570:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938440.625579:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000baaa6dd1/0x7b044d4128f9b29a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766389a expref: 74 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.625597:0:25716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000baaa6dd1/0x7b044d4128f9b29a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766389a expref: 74 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.625609:0:25716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823ffa00, rc 0) 00000100:00100000:1.0:1784938440.628000:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+74:10958:x1871643337374848:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2507us (2725us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938440.628013:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 502 00000100:00100000:1.0:1784938440.635254:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938440.635498:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337374976 00000100:00100000:2.0:1784938440.635509:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337374976 00000100:00100000:2.0:1784938440.635576:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 503 00000100:00100000:2.0:1784938440.635586:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+74:17096:x1871643337374976:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938440.635605:0:25715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938440.635624:0:25715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6d2a71d/0x7b044d4128f9b2a1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x43:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476638a1 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.635655:0:25715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000baaa6dd1/0x7b044d4128f9b29a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766389a expref: 75 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.635666:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938440.635670:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938440.635675:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6d2a71d/0x7b044d4128f9b2a1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x43:0x0].0x0 rrc: 3 type: EXT [0->393215] (req 0->393215) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476638a1 expref: 75 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.635709:0:25715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000baaa6dd1/0x7b044d4128f9b29a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e94766389a expref: 75 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.635725:0:25715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000baaa6dd1/0x7b044d4128f9b29a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766389a expref: 75 pid: 25716 timeout: 806 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938440.635742:0:25715:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25715:1871643350827008:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938440.635841:0:25715:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b40686c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938440.638539:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:1.0:1784938440.639613:0:25715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000baaa6dd1/0x7b044d4128f9b29a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766389a expref: 76 pid: 25716 timeout: 806 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938440.639630:0:25715:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25715:1871643350827008:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938440.639657:0:25715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c6d2a71d/0x7b044d4128f9b2a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->393215) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476638a1 expref: 75 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.639667:0:25715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217ca00, rc 0) 00000100:00100000:1.0:1784938440.639709:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+75:17096:x1871643337374976:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4125us (4468us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938440.639717:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 503 00000100:00100000:3.0:1784938440.647180:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938440.647297:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337375360 00000100:00100000:1.0:1784938440.647312:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337375360 00000100:00100000:1.0:1784938440.647437:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 24 00000100:00100000:1.0:1784938440.647450:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+200:17096:x1871643337375360:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:1.0:1784938440.647781:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+201:17096:x1871643337375360:12345-192.168.202.54@tcp:35:cp.0 Request processed in 334us (690us total) trans 8589934706 rc 0/0 00000100:00100000:1.0:1784938440.647788:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 24 00000100:00100000:3.0:1784938440.651606:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938440.655648:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938440.655750:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337375616 00000100:00100000:1.0:1784938440.655760:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337375616 00000100:00100000:1.0:1784938440.655878:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 263 00000100:00100000:1.0:1784938440.655890:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+201:17096:x1871643337375616:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938440.655918:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938440.655943:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b2bd lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476638af expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.656004:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b2c4 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.656017:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b2c4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.656027:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b2c4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.656053:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe400/0x7b044d4128f9b2cb lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe6b34bd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.656059:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe400/0x7b044d4128f9b2cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.656064:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe400/0x7b044d4128f9b2cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.656099:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b2c4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.656104:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b2c4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.656110:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b2c4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.656115:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823ff600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.656119:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b2c4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.656135:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b2c4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.656177:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938440.656180:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.656185:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b2c4 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.656192:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b2c4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.656205:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe400/0x7b044d4128f9b2cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.656211:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe400/0x7b044d4128f9b2cb lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.656217:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe400/0x7b044d4128f9b2cb lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.656222:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fe400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.656225:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe400/0x7b044d4128f9b2cb lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.656231:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe400/0x7b044d4128f9b2cb lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.656238:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xe6b34bd0 (ffff9f23823e3400) 00010000:00010000:1.0:1784938440.656240:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.656242:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe400/0x7b044d4128f9b2cb lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.656248:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe400/0x7b044d4128f9b2cb lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.656276:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b2bd lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476638af expref: 202 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.656284:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938440.656287:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.656290:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b2bd lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476638af expref: 202 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.656298:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823ffa00, rc 0) 00000100:00100000:1.0:1784938440.656363:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+201:17096:x1871643337375616:12345-192.168.202.54@tcp:101:cp.0 Request processed in 475us (726us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938440.656371:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 263 00000100:00100000:2.0:1784938440.666904:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938440.676407:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938440.680363:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938440.683652:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938440.683725:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337376256 00000100:00100000:3.0:1784938440.683733:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337376256 00010000:00010000:3.0:1784938440.683783:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000023e541b7/0x7b044d4128f9b2f5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476638bd expref: 77 pid: 21629 timeout: 806 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938440.683824:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 203 00000100:00100000:3.0:1784938440.683833:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+77:10957:x1871643337376256:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938440.683847:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938440.683872:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000023e541b7/0x7b044d4128f9b2f5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476638bd expref: 77 pid: 21629 timeout: 806 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.683888:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000023e541b7/0x7b044d4128f9b2f5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476638bd expref: 77 pid: 21629 timeout: 806 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.683918:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938440.683923:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938440.683932:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000060abbce8/0x7b044d4128f9b2fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476638c4 expref: 77 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.683942:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060abbce8/0x7b044d4128f9b2fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476638c4 expref: 77 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.683978:0:19220:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000060abbce8/0x7b044d4128f9b2fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476638c4 expref: 77 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938440.683992:0:19220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68d8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:19220:1871643350827392:192.168.202.54@tcp:105: 00000100:00100000:3.0:1784938440.684085:0:19220:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238e8def00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938440.687547:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938440.687770:0:19220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68d8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:19220:1871643350827392:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938440.687795:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938440.687848:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+75:10957:x1871643337376256:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 4017us (4206us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938440.687857:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 203 00000100:00100000:2.0:1784938440.693190:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938440.695716:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938440.695798:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337376768 00000100:00100000:1.0:1784938440.695805:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337376768 00000100:00100000:1.0:1784938440.695854:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 266 00000100:00100000:1.0:1784938440.695861:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+205:17096:x1871643337376768:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938440.695877:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938440.695892:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b318 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476638d2 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.695937:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9b31f lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.695946:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9b31f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.695953:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9b31f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.695965:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b326 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x9ca112ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.695971:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b326 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.695977:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b326 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.696012:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9b31f lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.696019:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9b31f lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.696023:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9b31f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.696028:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9b31f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.696031:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fe000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.696034:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9b31f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.696084:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9b31f lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.696094:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938440.696097:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.696100:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9b31f lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.696105:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9b31f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.696113:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b326 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.696117:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b326 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.696120:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b326 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.696123:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823ff800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.696238:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b326 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.696242:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b326 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.696248:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x9ca112ae (ffff9f23823e3400) 00010000:00010000:1.0:1784938440.696249:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.696251:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b326 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.696255:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b326 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.696278:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b318 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476638d2 expref: 206 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.696284:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938440.696286:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.696288:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b318 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476638d2 expref: 206 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.696294:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823ff600, rc 0) 00000100:00100000:1.0:1784938440.696388:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+205:17096:x1871643337376768:12345-192.168.202.54@tcp:101:cp.0 Request processed in 523us (672us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938440.696396:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 266 00000100:00100000:3.0:1784938440.698410:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938440.698632:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337377024 00000100:00100000:1.0:1784938440.698641:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337377024 00000100:00100000:1.0:1784938440.698739:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 267 00000100:00100000:1.0:1784938440.698747:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d3aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+205:17096:x1871643337377024:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938440.698764:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938440.698779:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b32d lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476638d9 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.698871:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b334 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.698886:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b334 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.698894:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b334 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.698903:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe600/0x7b044d4128f9b33b lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x9ca112ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.698907:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe600/0x7b044d4128f9b33b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.698911:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe600/0x7b044d4128f9b33b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938440.699238:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x44:0x0], index 0: 0 00010000:00010000:1.0:1784938440.699358:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe400/0x7b044d4128f9b342 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.699364:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe400/0x7b044d4128f9b342 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.699369:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe400/0x7b044d4128f9b342 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.699395:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b334 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.699400:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b334 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.699405:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b334 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.699410:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fea00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.699413:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b334 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.699418:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b334 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.699427:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938440.699429:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.699432:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b334 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.699436:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b334 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938440.699445:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000812a0e6b reply state 00000000d7ba3c32 transno 8589934709 ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe600/0x7b044d4128f9b33b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.699455:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe600/0x7b044d4128f9b33b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.699458:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x9ca112ae (ffff9f23823e3d00) 00010000:00010000:1.0:1784938440.699460:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938440.699461:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938440.699484:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b32d lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476638d9 expref: 208 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.699495:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe400/0x7b044d4128f9b342 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476638d9 expref: 207 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.699506:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7:0x0].0x0 (ffff9f23823e3f00) 00010000:00010000:1.0:1784938440.699508:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938440.699510:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fe400, rc 0) 00000100:00100000:1.0:1784938440.699573:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d3aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+208:17096:x1871643337377024:12345-192.168.202.54@tcp:101:cp.0 Request processed in 827us (1173us total) trans 8589934709 rc 0/0 00000100:00100000:1.0:1784938440.699581:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 267 00000100:00100000:2.0:1784938440.701720:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938440.701776:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337377152 00000100:00100000:3.0:1784938440.701784:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337377152 00000100:00100000:3.0:1784938440.701827:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 506 00000100:00100000:3.0:1784938440.701837:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+74:10958:x1871643337377152:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938440.701855:0:21149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938440.701875:0:21149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a628baba/0x7b044d4128f9b350 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x44:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476638e0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938440.701898:0:21149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x44:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938440.701916:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x44:0x0].0x0 since=706s v=(0 0) 00010000:00010000:3.0:1784938440.701920:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x44:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938440.701930:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a628baba/0x7b044d4128f9b350 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476638e0 expref: 75 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.701949:0:21149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a628baba/0x7b044d4128f9b350 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476638e0 expref: 75 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.701963:0:21149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e00a00, rc 0) 00000100:00100000:3.0:1784938440.702027:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+75:10958:x1871643337377152:12345-192.168.202.54@tcp:101:cp.0 Request processed in 192us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938440.702032:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 506 00000100:00100000:3.0:1784938440.703826:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938440.706834:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938440.707250:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337377408 00000100:00100000:3.0:1784938440.707256:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337377408 00010000:00010000:3.0:1784938440.707279:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a628baba/0x7b044d4128f9b350 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476638e0 expref: 76 pid: 21149 timeout: 806 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938440.707329:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 204 00000100:00100000:3.0:1784938440.707339:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+76:10959:x1871643337377408:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938440.707364:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938440.707385:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a628baba/0x7b044d4128f9b350 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476638e0 expref: 76 pid: 21149 timeout: 806 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.707395:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a628baba/0x7b044d4128f9b350 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476638e0 expref: 76 pid: 21149 timeout: 806 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.707413:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a628baba/0x7b044d4128f9b350 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476638e0 expref: 76 pid: 21149 timeout: 806 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.707425:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x44:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938440.707429:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x44:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938440.707435:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000069cbea22/0x7b044d4128f9b357 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476638e7 expref: 75 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.707442:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069cbea22/0x7b044d4128f9b357 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476638e7 expref: 75 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.707469:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000069cbea22/0x7b044d4128f9b357 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476638e7 expref: 75 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938440.707479:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d3ad180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350827648:192.168.202.54@tcp:105: 00000100:00100000:3.0:1784938440.707528:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238e8de300 going to sleep for 11 seconds 00000100:00100000:2.0:1784938440.711507:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938440.711592:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337377664 00000100:00100000:1.0:1784938440.711601:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337377664 00000100:00100000:1.0:1784938440.711645:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 26 00000100:00100000:1.0:1784938440.711655:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+208:17096:x1871643337377664:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:1.0:1784938440.711936:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+209:17096:x1871643337377664:12345-192.168.202.54@tcp:35:cp.0 Request processed in 282us (436us total) trans 8589934710 rc 0/0 00000100:00100000:1.0:1784938440.711941:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 26 00000100:00100000:2.0:1784938440.714270:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938440.716355:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938440.720564:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938440.720761:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337378176 00000100:00100000:1.0:1784938440.720771:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337378176 00000100:00100000:1.0:1784938440.720879:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 270 00000100:00100000:1.0:1784938440.720891:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+209:17096:x1871643337378176:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938440.720916:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938440.720940:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b388 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476638fc expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.721059:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b38f lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.721074:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b38f lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.721085:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b38f lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.721100:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b396 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x9fe9a331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.721106:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b396 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.721113:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b396 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938440.721479:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x44:0x0], index 1: 0 00010000:00010000:1.0:1784938440.721607:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b39d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.721617:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b39d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.721625:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b39d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.721654:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b38f lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.721661:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b38f lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.721667:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b38f lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.721686:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b38f lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.721693:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fea00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.721698:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b38f lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.721704:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b38f lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.721716:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938440.721719:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.721724:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b38f lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.721730:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b38f lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938440.721743:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000099c2ebae reply state 00000000f46aa485 transno 8589934711 ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b396 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.721753:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b396 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.721758:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x9fe9a331 (ffff9f23823e3400) 00010000:00010000:1.0:1784938440.721760:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938440.721763:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938440.721788:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b388 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476638fc expref: 212 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.721802:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b39d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476638fc expref: 211 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.721814:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8:0x0].0x0 (ffff9f23823e3700) 00010000:00010000:1.0:1784938440.721817:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938440.721819:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823ff800, rc 0) 00000100:00100000:1.0:1784938440.721887:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+212:17096:x1871643337378176:12345-192.168.202.54@tcp:101:cp.0 Request processed in 998us (1333us total) trans 8589934711 rc 0/0 00000100:00100000:1.0:1784938440.721895:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 270 00000100:00100000:3.0:1784938440.727846:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938440.727997:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337378304 00000100:00100000:1.0:1784938440.728007:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337378304 00000100:00100000:1.0:1784938440.728108:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 508 00000100:00100000:1.0:1784938440.728118:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+75:10960:x1871643337378304:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938440.728137:0:25716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938440.728177:0:25716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b330581/0x7b044d4128f9b3ab lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x44:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663903 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938440.728202:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x44:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938440.728233:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x44:0x0].0x0 since=706s v=(0 0) 00010000:00010000:1.0:1784938440.728237:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x44:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938440.728247:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b330581/0x7b044d4128f9b3ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663903 expref: 76 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.728264:0:25716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002b330581/0x7b044d4128f9b3ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663903 expref: 76 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.728276:0:25716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fe000, rc 0) 00000100:00100000:1.0:1784938440.728336:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+76:10960:x1871643337378304:12345-192.168.202.54@tcp:101:cp.0 Request processed in 219us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938440.728343:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 508 00000100:00100000:3.0:1784938440.730332:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938440.730426:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337378432 00000100:00100000:1.0:1784938440.730434:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337378432 00000100:00100000:1.0:1784938440.730506:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 509 00000100:00100000:1.0:1784938440.730515:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+76:17096:x1871643337378432:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938440.730530:0:25715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938440.730545:0:25715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f355ae29/0x7b044d4128f9b3b2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x44:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766390a expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.730574:0:25715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002b330581/0x7b044d4128f9b3ab lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663903 expref: 77 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.730580:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x44:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938440.730582:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x44:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938440.730586:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f355ae29/0x7b044d4128f9b3b2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x44:0x0].0x0 rrc: 3 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766390a expref: 77 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.730609:0:25715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002b330581/0x7b044d4128f9b3ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663903 expref: 77 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.730619:0:25715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002b330581/0x7b044d4128f9b3ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663903 expref: 77 pid: 25716 timeout: 806 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938440.730629:0:25715:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388124000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25715:1871643350827776:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938440.730694:0:25715:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24973b8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938440.732994:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938440.733087:0:25715:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388124000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25715:1871643350827776:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938440.733117:0:25715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f355ae29/0x7b044d4128f9b3b2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x44:0x0].0x0 rrc: 3 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766390a expref: 78 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.733173:0:25715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fe800, rc 0) 00000100:00100000:1.0:1784938440.733301:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+78:17096:x1871643337378432:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2788us (2974us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938440.733309:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 509 00000100:00100000:2.0:1784938440.740600:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938440.746951:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938440.747186:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337378944 00000100:00100000:1.0:1784938440.747197:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337378944 00000100:00100000:1.0:1784938440.747253:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 271 00000100:00100000:1.0:1784938440.747263:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+213:17096:x1871643337378944:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938440.747288:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938440.747309:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b3b9 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663911 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.747385:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b3c0 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.747399:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b3c0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.747409:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b3c0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.747424:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b3c7 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x151c8ac3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.747431:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b3c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.747438:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b3c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.747475:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b3c0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.747482:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b3c0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.747488:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b3c0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.747494:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fea00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.747498:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b3c0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.747506:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b3c0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.747517:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938440.747521:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.747525:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b3c0 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.747531:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b3c0 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.747545:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b3c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.747551:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b3c7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.747558:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b3c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.747563:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823ffa00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.747566:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b3c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.747572:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b3c7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.747579:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x151c8ac3 (ffff9f23823e3c00) 00010000:00010000:1.0:1784938440.747582:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.747584:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b3c7 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.747590:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b3c7 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.747622:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b3b9 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663911 expref: 214 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.747633:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938440.747635:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.747639:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b3b9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663911 expref: 214 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.747648:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823ffe00, rc 0) 00000100:00100000:1.0:1784938440.747712:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+213:17096:x1871643337378944:12345-192.168.202.54@tcp:101:cp.0 Request processed in 451us (771us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938440.747724:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 271 00000100:00100000:2.0:1784938440.757045:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938440.757621:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 272 00000100:00100000:2.0:1784938440.757633:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+213:17096:x1871643337379072:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938440.757654:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938440.757673:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d600/0x7b044d4128f9b3ce lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663918 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.757741:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d400/0x7b044d4128f9b3d5 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.757753:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d400/0x7b044d4128f9b3d5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.757761:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d400/0x7b044d4128f9b3d5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.757770:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9b3dc lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x151c8ac3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.757774:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9b3dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.757778:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9b3dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.757811:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d400/0x7b044d4128f9b3d5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.757814:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d400/0x7b044d4128f9b3d5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.757818:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d400/0x7b044d4128f9b3d5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.757823:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217d400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938440.757827:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d400/0x7b044d4128f9b3d5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.757831:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d400/0x7b044d4128f9b3d5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.757838:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938440.757840:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938440.757843:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d400/0x7b044d4128f9b3d5 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.757847:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d400/0x7b044d4128f9b3d5 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.757855:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9b3dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.757858:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9b3dc lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.757862:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9b3dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.757865:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217c600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938440.757866:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9b3dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.757869:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9b3dc lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.757876:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x151c8ac3 (ffff9f248fb6b700) 00010000:00010000:2.0:1784938440.757877:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938440.757879:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9b3dc lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.757882:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9b3dc lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.757964:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d600/0x7b044d4128f9b3ce lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663918 expref: 214 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.757973:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938440.757974:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938440.757977:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d600/0x7b044d4128f9b3ce lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663918 expref: 214 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.757983:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217d600, rc 0) 00000100:00100000:2.0:1784938440.758041:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+213:17096:x1871643337379072:12345-192.168.202.54@tcp:101:cp.0 Request processed in 411us (1006us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938440.758112:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 272 00000100:00100000:3.0:1784938440.760239:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938440.760299:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337379328 00000100:00100000:1.0:1784938440.760306:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337379328 00000100:00100000:1.0:1784938440.760378:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 273 00000100:00100000:1.0:1784938440.760389:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23880a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+213:17096:x1871643337379328:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938440.760411:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938440.760432:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b3e3 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766391f expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.760549:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b3ea lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.760564:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b3ea lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.760573:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b3ea lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.760587:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b3f1 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x151c8ac3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.760594:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b3f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.760600:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b3f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938440.760883:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x45:0x0], index 0: 0 00010000:00010000:1.0:1784938440.761006:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9b3f8 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.761013:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9b3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.761018:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9b3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.761096:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b3ea lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.761102:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b3ea lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.761106:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b3ea lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.761110:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823ffa00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.761113:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b3ea lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.761119:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b3ea lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.761134:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938440.761137:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.761140:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b3ea lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.761162:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b3ea lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938440.761171:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008e72aa85 reply state 00000000f1d99f74 transno 8589934713 ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b3f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.761180:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b3f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.761184:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x151c8ac3 (ffff9f23823e3c00) 00010000:00010000:1.0:1784938440.761186:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938440.761187:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938440.761209:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b3e3 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766391f expref: 216 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.761218:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9b3f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766391f expref: 215 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.761222:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x9:0x0].0x0 (ffff9f23823e3e00) 00010000:00010000:1.0:1784938440.761224:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938440.761225:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fe000, rc 0) 00000100:00100000:1.0:1784938440.761278:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23880a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+216:17096:x1871643337379328:12345-192.168.202.54@tcp:101:cp.0 Request processed in 892us (1050us total) trans 8589934713 rc 0/0 00000100:00100000:1.0:1784938440.761286:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 273 00000100:00100000:3.0:1784938440.763468:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938440.763934:0:21152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337379456 00000100:00100000:1.0:1784938440.763944:0:21152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337379456 00000100:00100000:1.0:1784938440.763997:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 510 00000100:00100000:1.0:1784938440.764006:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23880a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+75:10957:x1871643337379456:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938440.764023:0:21152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938440.764170:0:21152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893bc602/0x7b044d4128f9b406 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663926 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938440.764197:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x45:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938440.764217:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x45:0x0].0x0 since=706s v=(0 0) 00010000:00010000:1.0:1784938440.764222:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x45:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938440.764231:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893bc602/0x7b044d4128f9b406 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663926 expref: 76 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.764249:0:21152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000893bc602/0x7b044d4128f9b406 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663926 expref: 76 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.764262:0:21152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e03a00, rc 0) 00000100:00100000:1.0:1784938440.764314:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23880a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+76:10957:x1871643337379456:12345-192.168.202.54@tcp:101:cp.0 Request processed in 308us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938440.764321:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 510 00000100:00100000:3.0:1784938440.766510:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938440.769557:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938440.773787:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938440.773848:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337379968 00000100:00100000:2.0:1784938440.773855:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337379968 00000100:00100000:2.0:1784938440.773906:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 28 00000100:00100000:2.0:1784938440.773926:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+216:17096:x1871643337379968:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:2.0:1784938440.774574:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+217:17096:x1871643337379968:12345-192.168.202.54@tcp:35:cp.0 Request processed in 647us (791us total) trans 8589934714 rc 0/0 00000100:00100000:2.0:1784938440.774583:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 28 00000100:00100000:3.0:1784938440.777712:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938440.777856:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337380096 00000100:00100000:1.0:1784938440.777867:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337380096 00000100:00100000:1.0:1784938440.777987:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 274 00000100:00100000:1.0:1784938440.777997:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+217:17096:x1871643337380096:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938440.778024:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938440.778053:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b414 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663934 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.778106:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b41b lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.778118:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b41b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.778134:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b41b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.778196:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b422 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x15c8a56e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.778204:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b422 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.778211:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b422 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.778247:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b41b lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.778254:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b41b lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.778261:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b41b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.778267:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b41b lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.778272:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db38e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.778276:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b41b lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.778284:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b41b lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.778295:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938440.778298:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.778303:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b41b lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.778309:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b41b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.778320:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b422 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.778325:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b422 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.778330:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b422 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.778334:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823ffe00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.778336:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b422 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.778341:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b422 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.778356:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x15c8a56e (ffff9f23823e3a00) 00010000:00010000:1.0:1784938440.778358:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.778361:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b422 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.778366:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b422 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.778396:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b414 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663934 expref: 218 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.778411:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938440.778413:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.778416:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b414 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663934 expref: 218 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.778425:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238db39600, rc 0) 00000100:00100000:1.0:1784938440.778481:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+217:17096:x1871643337380096:12345-192.168.202.54@tcp:101:cp.0 Request processed in 486us (774us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938440.778488:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 274 00000100:00100000:1.0:1784938440.780779:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938440.780880:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337380224 00000100:00100000:3.0:1784938440.780888:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337380224 00000100:00100000:3.0:1784938440.780938:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 275 00000100:00100000:3.0:1784938440.780945:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+217:17096:x1871643337380224:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938440.780962:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938440.780981:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b429 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766393b expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.781250:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b430 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.781263:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b430 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.781270:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b430 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.781283:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00600/0x7b044d4128f9b437 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x15c8a56e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.781305:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00600/0x7b044d4128f9b437 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.781312:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00600/0x7b044d4128f9b437 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.781363:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b430 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.781371:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b430 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.781378:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b430 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.781385:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938440.781389:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b430 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.781397:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b430 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.781409:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938440.781413:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938440.781418:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b430 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.781424:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b430 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.781437:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00600/0x7b044d4128f9b437 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.781450:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00600/0x7b044d4128f9b437 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.781454:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00600/0x7b044d4128f9b437 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.781458:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938440.781460:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00600/0x7b044d4128f9b437 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.781463:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00600/0x7b044d4128f9b437 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.781468:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x15c8a56e (ffff9f2485293e00) 00010000:00010000:3.0:1784938440.781469:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938440.781471:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00600/0x7b044d4128f9b437 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.781475:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00600/0x7b044d4128f9b437 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.781501:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b429 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766393b expref: 218 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.781511:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938440.781513:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938440.781517:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b429 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766393b expref: 218 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.781537:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e01200, rc 0) 00000100:00100000:3.0:1784938440.781628:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+217:17096:x1871643337380224:12345-192.168.202.54@tcp:101:cp.0 Request processed in 682us (857us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938440.781634:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 275 00000100:00100000:3.0:1784938440.784966:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337380480 00000100:00100000:3.0:1784938440.784976:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337380480 00000100:00100000:3.0:1784938440.785033:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 276 00000100:00100000:3.0:1784938440.785052:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+217:17096:x1871643337380480:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938440.785076:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938440.785099:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9b43e lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663942 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.785238:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b445 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.785254:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b445 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.785264:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b445 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.785279:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01800/0x7b044d4128f9b44c lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x15c8a56e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.785285:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01800/0x7b044d4128f9b44c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.785293:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01800/0x7b044d4128f9b44c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938440.785614:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x45:0x0], index 1: 0 00010000:00010000:3.0:1784938440.785762:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00400/0x7b044d4128f9b453 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.785772:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00400/0x7b044d4128f9b453 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.785780:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00400/0x7b044d4128f9b453 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.785811:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b445 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.785818:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b445 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.785825:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b445 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.785832:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938440.785836:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b445 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.785844:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b445 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.785856:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938440.785859:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938440.785864:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b445 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.785883:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b445 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938440.785897:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000044ada6be reply state 00000000be5dc625 transno 8589934715 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01800/0x7b044d4128f9b44c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.785909:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01800/0x7b044d4128f9b44c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.785917:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x15c8a56e (ffff9f2485293900) 00010000:00010000:3.0:1784938440.785919:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938440.785922:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938440.785950:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9b43e lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663942 expref: 220 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.785965:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00400/0x7b044d4128f9b453 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663942 expref: 219 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.785972:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa:0x0].0x0 (ffff9f2485293a00) 00010000:00010000:3.0:1784938440.785974:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938440.785977:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e00400, rc 0) 00000100:00100000:3.0:1784938440.786042:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+220:17096:x1871643337380480:12345-192.168.202.54@tcp:101:cp.0 Request processed in 992us (1169us total) trans 8589934715 rc 0/0 00000100:00100000:3.0:1784938440.786050:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 276 00000100:00100000:2.0:1784938440.789667:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938440.789748:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337380608 00000100:00100000:3.0:1784938440.789758:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337380608 00000100:00100000:3.0:1784938440.789879:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 512 00000100:00100000:3.0:1784938440.789890:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+76:10960:x1871643337380608:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938440.789935:0:21149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938440.789958:0:21149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9b461 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663949 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938440.789985:0:21149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x45:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938440.790007:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x45:0x0].0x0 since=706s v=(0 0) 00010000:00010000:3.0:1784938440.790012:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x45:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938440.790022:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9b461 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663949 expref: 77 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.790041:0:21149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9b461 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663949 expref: 77 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.790067:0:21149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e01200, rc 0) 00000100:00100000:3.0:1784938440.790135:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+77:10960:x1871643337380608:12345-192.168.202.54@tcp:101:cp.0 Request processed in 241us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938440.790176:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 512 00000100:00100000:1.0:1784938440.793310:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938440.793387:0:21152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337380736 00000100:00100000:3.0:1784938440.793397:0:21152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337380736 00000100:00100000:3.0:1784938440.793475:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 513 00000100:00100000:3.0:1784938440.793484:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+77:17096:x1871643337380736:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938440.793500:0:21152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938440.793519:0:21152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006680760a/0x7b044d4128f9b468 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663950 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.793551:0:21152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9b461 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663949 expref: 78 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.793575:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x45:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938440.793579:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x45:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938440.793583:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006680760a/0x7b044d4128f9b468 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663950 expref: 78 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.793612:0:21152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9b461 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663949 expref: 78 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.793623:0:21152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9b461 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663949 expref: 78 pid: 21149 timeout: 806 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938440.793634:0:21152:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:21152:1871643350828288:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938440.793710:0:21152:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238e8def00 going to sleep for 11 seconds 00000100:00100000:1.0:1784938440.795963:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337380864 00000100:00100000:1.0:1784938440.795970:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337380864 00000100:00100000:3.0:1784938440.795986:0:21152:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:21152:1871643350828288:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938440.796009:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9b461 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663949 expref: 79 pid: 21149 timeout: 806 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938440.796059:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 207 00000100:00100000:1.0:1784938440.796068:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+79:10958:x1871643337380864:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938440.796085:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938440.796109:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9b461 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663949 expref: 79 pid: 21149 timeout: 806 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.796122:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9b461 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663949 expref: 79 pid: 21149 timeout: 806 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.796257:0:21152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006680760a/0x7b044d4128f9b468 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 4 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663950 expref: 79 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.796267:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9b461 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663949 expref: 79 pid: 21149 timeout: 806 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.796272:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x45:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938440.796276:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x45:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938440.796285:0:21152:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006680760a/0x7b044d4128f9b468 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663950 expref: 78 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.796295:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006680760a/0x7b044d4128f9b468 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663950 expref: 78 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.796324:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938440.796354:0:21152:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006680760a/0x7b044d4128f9b468 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663950 expref: 78 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938440.796367:0:21152:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:21152:1871643350828416:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938440.796391:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+78:10958:x1871643337380864:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 325us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938440.796399:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 207 00000100:00100000:3.0:1784938440.796412:0:21152:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238e8def00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938440.798828:0:21152:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:21152:1871643350828416:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938440.798856:0:21152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e00600, rc 0) 00000100:00100000:3.0:1784938440.798966:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+77:17096:x1871643337380736:12345-192.168.202.54@tcp:101:cp.0 Request processed in 5482us (5663us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938440.798975:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 513 00000100:00100000:2.0:1784938440.801465:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938440.805450:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337381248 00000100:00100000:2.0:1784938440.805460:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337381248 00000100:00100000:2.0:1784938440.805589:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 277 00000100:00100000:2.0:1784938440.805601:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+221:17096:x1871643337381248:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938440.805626:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938440.805650:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217da00/0x7b044d4128f9b46f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663957 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.805714:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9b476 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.805728:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9b476 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.805737:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9b476 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.805752:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c000/0x7b044d4128f9b47d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe7eb4718 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.805759:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c000/0x7b044d4128f9b47d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.805765:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c000/0x7b044d4128f9b47d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.805806:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9b476 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.805812:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9b476 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.805819:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9b476 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.805824:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217cc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938440.805829:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9b476 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.805837:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9b476 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.805848:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938440.805851:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938440.805855:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9b476 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.805861:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9b476 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.805873:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c000/0x7b044d4128f9b47d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.805879:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c000/0x7b044d4128f9b47d lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.805885:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c000/0x7b044d4128f9b47d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.805890:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217c000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938440.805892:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c000/0x7b044d4128f9b47d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.805902:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c000/0x7b044d4128f9b47d lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.805909:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xe7eb4718 (ffff9f248fb6b700) 00010000:00010000:2.0:1784938440.805911:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938440.805914:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c000/0x7b044d4128f9b47d lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.805919:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c000/0x7b044d4128f9b47d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.805951:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217da00/0x7b044d4128f9b46f lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663957 expref: 222 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.805961:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938440.805963:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938440.805967:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217da00/0x7b044d4128f9b46f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663957 expref: 222 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.805976:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217da00, rc 0) 00000100:00100000:2.0:1784938440.806035:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+221:17096:x1871643337381248:12345-192.168.202.54@tcp:101:cp.0 Request processed in 437us (797us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938440.806051:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 277 00000100:00100000:2.0:1784938440.810015:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938440.811310:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337381376 00000100:00100000:1.0:1784938440.811324:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337381376 00000100:00100000:1.0:1784938440.811469:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 278 00000100:00100000:1.0:1784938440.811478:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+221:17096:x1871643337381376:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938440.811505:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938440.811526:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b484 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766395e expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.811579:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b48b lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.811590:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b48b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.811598:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b48b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.811608:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b492 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe7eb4718 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.811615:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b492 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.811619:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b492 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.811655:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b48b lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.811659:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b48b lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.811663:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b48b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.811668:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b48b lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.811673:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823ffe00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.811676:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b48b lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.811681:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b48b lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.811688:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938440.811690:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.811693:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b48b lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.811697:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b48b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.811707:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b492 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.811711:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b492 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.811714:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b492 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.811717:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.811718:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b492 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.811721:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b492 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.811725:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xe7eb4718 (ffff9f23823e3a00) 00010000:00010000:1.0:1784938440.811726:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.811727:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b492 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.811730:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b492 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.811751:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b484 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766395e expref: 222 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.811757:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938440.811758:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.811761:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b484 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766395e expref: 222 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.811766:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823ffa00, rc 0) 00000100:00100000:1.0:1784938440.811825:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+221:17096:x1871643337381376:12345-192.168.202.54@tcp:101:cp.0 Request processed in 349us (1823us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938440.811830:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 278 00000100:00100000:1.0:1784938440.815315:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938440.815475:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337381632 00000100:00100000:3.0:1784938440.815486:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337381632 00000100:00100000:3.0:1784938440.815648:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 279 00000100:00100000:3.0:1784938440.815658:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+221:17096:x1871643337381632:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938440.815680:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938440.815705:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9b499 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663965 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.815812:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b4a0 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.815828:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b4a0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.815841:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b4a0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.815874:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b4a7 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0xe7eb4718 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.815883:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b4a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.815890:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b4a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938440.816392:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x46:0x0], index 0: 0 00010000:00010000:3.0:1784938440.816535:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01c00/0x7b044d4128f9b4ae lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.816546:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01c00/0x7b044d4128f9b4ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.816554:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01c00/0x7b044d4128f9b4ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.816586:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b4a0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.816593:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b4a0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.816599:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b4a0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.816605:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938440.816609:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b4a0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.816631:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b4a0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.816644:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938440.816648:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938440.816652:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b4a0 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.816659:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b4a0 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938440.816672:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006d17d6f2 reply state 00000000d3aa7dde transno 8589934717 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b4a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.816685:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b4a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.816692:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xe7eb4718 (ffff9f2485293f00) 00010000:00010000:3.0:1784938440.816694:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938440.816697:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938440.816726:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9b499 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663965 expref: 224 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.816741:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01c00/0x7b044d4128f9b4ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663965 expref: 223 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.816749:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb:0x0].0x0 (ffff9f2485293000) 00010000:00010000:3.0:1784938440.816751:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938440.816754:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e01c00, rc 0) 00000100:00100000:3.0:1784938440.816825:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+224:17096:x1871643337381632:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1168us (1517us total) trans 8589934717 rc 0/0 00000100:00100000:3.0:1784938440.816833:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 279 00000100:00100000:1.0:1784938440.820872:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938440.821009:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337381760 00000100:00100000:2.0:1784938440.821017:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337381760 00000100:00100000:2.0:1784938440.821087:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 514 00000100:00100000:2.0:1784938440.821098:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+76:10957:x1871643337381760:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938440.821118:0:25716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938440.821312:0:25716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8714fdb/0x7b044d4128f9b4bc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x46:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766396c expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938440.821339:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x46:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938440.821371:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x46:0x0].0x0 since=706s v=(0 0) 00010000:00010000:2.0:1784938440.821376:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x46:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938440.821385:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8714fdb/0x7b044d4128f9b4bc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766396c expref: 77 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.821402:0:25716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b8714fdb/0x7b044d4128f9b4bc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766396c expref: 77 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.821413:0:25716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217da00, rc 0) 00000100:00100000:2.0:1784938440.821475:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+77:10957:x1871643337381760:12345-192.168.202.54@tcp:101:cp.0 Request processed in 379us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938440.821483:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 514 00000100:00100000:1.0:1784938440.824698:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938440.824861:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337381888 00000100:00100000:2.0:1784938440.824871:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337381888 00000100:00100000:2.0:1784938440.824940:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 515 00000100:00100000:2.0:1784938440.824950:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+77:17096:x1871643337381888:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938440.824968:0:25715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938440.824989:0:25715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033558f11/0x7b044d4128f9b4c3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663973 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.825021:0:25715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8714fdb/0x7b044d4128f9b4bc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766396c expref: 78 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.825031:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x46:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938440.825036:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x46:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938440.825041:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033558f11/0x7b044d4128f9b4c3 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663973 expref: 78 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.825088:0:25715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b8714fdb/0x7b044d4128f9b4bc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e94766396c expref: 78 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.825102:0:25715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b8714fdb/0x7b044d4128f9b4bc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766396c expref: 78 pid: 25716 timeout: 806 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938440.825119:0:25715:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25715:1871643350828544:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938440.825236:0:25715:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b4068900 going to sleep for 11 seconds 00000100:00100000:2.0:1784938440.827788:0:25715:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25715:1871643350828544:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938440.827826:0:25715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000033558f11/0x7b044d4128f9b4c3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663973 expref: 78 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.827848:0:25715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217c000, rc 0) 00000100:00100000:2.0:1784938440.827913:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+78:17096:x1871643337381888:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2957us (3218us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938440.827923:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 515 00000100:00100000:1.0:1784938440.830734:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938440.830870:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337382016 00000100:00100000:3.0:1784938440.830881:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337382016 00010000:00010000:3.0:1784938440.830932:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b8714fdb/0x7b044d4128f9b4bc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766396c expref: 78 pid: 25716 timeout: 806 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938440.830976:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 208 00000100:00100000:3.0:1784938440.830987:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+78:10959:x1871643337382016:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938440.831004:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938440.831027:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b8714fdb/0x7b044d4128f9b4bc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766396c expref: 78 pid: 25716 timeout: 806 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.831042:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b8714fdb/0x7b044d4128f9b4bc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766396c expref: 78 pid: 25716 timeout: 806 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.831068:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8714fdb/0x7b044d4128f9b4bc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766396c expref: 78 pid: 25716 timeout: 806 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.831087:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x46:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938440.831092:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x46:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938440.831102:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000033558f11/0x7b044d4128f9b4c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663973 expref: 77 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.831112:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033558f11/0x7b044d4128f9b4c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663973 expref: 77 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.831358:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000033558f11/0x7b044d4128f9b4c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663973 expref: 77 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938440.831374:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350828672:192.168.202.54@tcp:105: 00000100:00100000:3.0:1784938440.831487:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238e8de480 going to sleep for 11 seconds 00000100:00100000:1.0:1784938440.834310:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938440.834485:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337382272 00000100:00100000:2.0:1784938440.834494:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337382272 00000100:00100000:2.0:1784938440.834611:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 30 00000100:00100000:2.0:1784938440.834621:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+224:17096:x1871643337382272:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938440.834974:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350828672:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938440.834994:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938440.835033:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+225:17096:x1871643337382272:12345-192.168.202.54@tcp:35:cp.0 Request processed in 412us (730us total) trans 8589934718 rc 0/0 00000100:00100000:2.0:1784938440.835041:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 30 00000100:00100000:3.0:1784938440.835244:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+77:10959:x1871643337382016:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 4259us (4519us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938440.835253:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 208 00000100:00100000:1.0:1784938440.842282:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938440.842362:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337382400 00000100:00100000:3.0:1784938440.842372:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337382400 00000100:00100000:3.0:1784938440.842468:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 280 00000100:00100000:3.0:1784938440.842480:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+225:17096:x1871643337382400:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938440.842515:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938440.842538:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9b4ca lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766397a expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.842602:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b4d1 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.842617:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b4d1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.842629:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b4d1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.842662:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b4d8 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x48840fb6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.842671:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.842677:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.842714:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b4d1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.842721:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b4d1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.842728:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b4d1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.842735:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938440.842739:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b4d1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.842747:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b4d1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.842759:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938440.842762:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938440.842766:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b4d1 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.842773:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b4d1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.842795:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.842801:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b4d8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.842807:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b4d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.842815:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e01200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938440.842818:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b4d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.842825:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b4d8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.842833:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x48840fb6 (ffff9f2485293300) 00010000:00010000:3.0:1784938440.842835:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938440.842838:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b4d8 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.842844:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b4d8 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.842875:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9b4ca lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766397a expref: 226 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.842886:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938440.842889:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938440.842901:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00e00/0x7b044d4128f9b4ca lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766397a expref: 226 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.842923:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e00e00, rc 0) 00000100:00100000:3.0:1784938440.843004:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+225:17096:x1871643337382400:12345-192.168.202.54@tcp:101:cp.0 Request processed in 522us (724us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938440.843011:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 280 00000100:00100000:1.0:1784938440.850878:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938440.850987:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337382528 00000100:00100000:2.0:1784938440.850996:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337382528 00000100:00100000:2.0:1784938440.851063:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 281 00000100:00100000:2.0:1784938440.851073:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+225:17096:x1871643337382528:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938440.851095:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938440.851120:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d400/0x7b044d4128f9b4df lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663981 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.851231:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9b4e6 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.851243:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9b4e6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.851251:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9b4e6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.851260:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d600/0x7b044d4128f9b4ed lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x48840fb6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.851264:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d600/0x7b044d4128f9b4ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.851268:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d600/0x7b044d4128f9b4ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.851313:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9b4e6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.851321:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9b4e6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.851328:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9b4e6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.851333:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217c600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938440.851336:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9b4e6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.851342:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9b4e6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.851366:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938440.851369:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938440.851375:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9b4e6 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.851381:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c600/0x7b044d4128f9b4e6 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.851394:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d600/0x7b044d4128f9b4ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.851399:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d600/0x7b044d4128f9b4ed lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.851405:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d600/0x7b044d4128f9b4ed lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.851410:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217d600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938440.851412:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d600/0x7b044d4128f9b4ed lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.851418:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d600/0x7b044d4128f9b4ed lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.851424:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x48840fb6 (ffff9f248fb6b300) 00010000:00010000:2.0:1784938440.851427:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938440.851430:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d600/0x7b044d4128f9b4ed lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.851436:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d600/0x7b044d4128f9b4ed lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.851472:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d400/0x7b044d4128f9b4df lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663981 expref: 226 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.851483:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938440.851485:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938440.851493:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d400/0x7b044d4128f9b4df lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663981 expref: 226 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.851714:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217d400, rc 0) 00000100:00100000:2.0:1784938440.851823:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+225:17096:x1871643337382528:12345-192.168.202.54@tcp:101:cp.0 Request processed in 750us (954us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938440.851831:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 281 00000100:00100000:2.0:1784938440.854830:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938440.854897:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337382784 00000100:00100000:1.0:1784938440.854907:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337382784 00000100:00100000:1.0:1784938440.855201:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 282 00000100:00100000:1.0:1784938440.855215:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+225:17096:x1871643337382784:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938440.855236:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938440.855257:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b4f4 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663988 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.855483:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b4fb lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.855498:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b4fb lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.855510:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b4fb lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.855525:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b502 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x48840fb6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.855533:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b502 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.855540:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b502 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938440.855876:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x46:0x0], index 1: 0 00010000:00010000:1.0:1784938440.856411:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b509 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.856423:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b509 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.856431:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b509 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.856464:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b4fb lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.856471:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b4fb lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.856477:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b4fb lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.856484:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b4fb lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.856491:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.856496:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b4fb lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.856504:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b4fb lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.856516:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938440.856520:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.856524:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b4fb lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.856530:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b4fb lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938440.856543:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006e208787 reply state 00000000b4fb9fc5 transno 8589934719 ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b502 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.856552:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b502 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.856558:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x48840fb6 (ffff9f23823e3a00) 00010000:00010000:1.0:1784938440.856561:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938440.856563:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938440.857107:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b4f4 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663988 expref: 228 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.857433:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b509 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663988 expref: 227 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.857443:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xc:0x0].0x0 (ffff9f23823e3600) 00010000:00010000:1.0:1784938440.857446:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938440.857449:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823ffe00, rc 0) 00000100:00100000:1.0:1784938440.857538:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+228:17096:x1871643337382784:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2325us (2713us total) trans 8589934719 rc 0/0 00000100:00100000:1.0:1784938440.857547:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 282 00000100:00100000:1.0:1784938440.863411:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938440.875370:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938440.875726:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337383040 00000100:00100000:3.0:1784938440.875736:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337383040 00000100:00100000:3.0:1784938440.875807:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 517 00000100:00100000:3.0:1784938440.875818:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+78:17096:x1871643337383040:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938440.875838:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938440.875858:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a5e02e4/0x7b044d4128f9b51e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663996 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.875895:0:21151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4b1af9e/0x7b044d4128f9b517 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766398f expref: 79 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.875913:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x46:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938440.875918:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x46:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938440.875924:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a5e02e4/0x7b044d4128f9b51e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663996 expref: 79 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.875958:0:21151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e4b1af9e/0x7b044d4128f9b517 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e94766398f expref: 79 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.875973:0:21151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e4b1af9e/0x7b044d4128f9b517 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766398f expref: 79 pid: 21629 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938440.876005:0:21151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:21151:1871643350828800:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938440.876088:0:21151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238e8de240 going to sleep for 11 seconds 00000100:00100000:3.0:1784938440.879053:0:21151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:21151:1871643350828800:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938440.879105:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003a5e02e4/0x7b044d4128f9b51e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663996 expref: 79 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.879135:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e00e00, rc 0) 00000100:00100000:3.0:1784938440.879225:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+79:17096:x1871643337383040:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3408us (3867us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938440.879235:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 517 00000100:00100000:1.0:1784938440.882127:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938440.887001:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938440.893688:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938440.893780:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337383552 00000100:00100000:3.0:1784938440.893790:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337383552 00000100:00100000:3.0:1784938440.893860:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 283 00000100:00100000:3.0:1784938440.893870:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+229:17096:x1871643337383552:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938440.893896:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938440.894053:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b525 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766399d expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.894119:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b52c lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.894261:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b52c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.894273:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b52c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.894304:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01000/0x7b044d4128f9b533 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x48e4a31f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.894312:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01000/0x7b044d4128f9b533 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.894320:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01000/0x7b044d4128f9b533 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.894368:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b52c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.894448:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b52c lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.894455:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b52c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.894462:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938440.894467:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b52c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.894476:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b52c lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.894489:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938440.894493:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938440.894498:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b52c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.894505:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b52c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.894526:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01000/0x7b044d4128f9b533 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.894532:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01000/0x7b044d4128f9b533 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.894539:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01000/0x7b044d4128f9b533 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.894544:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e01000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938440.894547:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01000/0x7b044d4128f9b533 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.894553:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01000/0x7b044d4128f9b533 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.894561:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x48e4a31f (ffff9f2485293300) 00010000:00010000:3.0:1784938440.894563:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938440.894566:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01000/0x7b044d4128f9b533 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.894572:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01000/0x7b044d4128f9b533 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.894605:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b525 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766399d expref: 230 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.894616:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938440.894619:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938440.894629:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b525 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766399d expref: 230 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.894640:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e01200, rc 0) 00000100:00100000:3.0:1784938440.894758:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+229:17096:x1871643337383552:12345-192.168.202.54@tcp:101:cp.0 Request processed in 888us (1077us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938440.894767:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 283 00000100:00100000:2.0:1784938440.899228:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938440.899315:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337383680 00000100:00100000:3.0:1784938440.899325:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337383680 00000100:00100000:3.0:1784938440.899406:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 284 00000100:00100000:3.0:1784938440.899417:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+229:17096:x1871643337383680:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938440.899439:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938440.899463:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00800/0x7b044d4128f9b53a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476639a4 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.899531:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9b541 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.899545:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9b541 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.899558:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9b541 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.899573:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b548 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x48e4a31f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.899581:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b548 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.899587:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b548 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.899646:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9b541 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.899653:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9b541 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.899660:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9b541 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.899667:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d00a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938440.899672:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9b541 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.899679:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9b541 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.899692:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938440.899695:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938440.899701:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9b541 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.899708:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9b541 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.899721:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b548 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.899727:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b548 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.899733:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b548 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.899753:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d01800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938440.899757:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b548 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.899764:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b548 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.899772:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x48e4a31f (ffff9f2485293700) 00010000:00010000:3.0:1784938440.899774:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938440.899777:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b548 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.899784:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b548 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.899820:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00800/0x7b044d4128f9b53a lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476639a4 expref: 230 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.899831:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938440.899846:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938440.899851:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00800/0x7b044d4128f9b53a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476639a4 expref: 230 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.899861:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d00800, rc 0) 00000100:00100000:3.0:1784938440.900179:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+229:17096:x1871643337383680:12345-192.168.202.54@tcp:101:cp.0 Request processed in 762us (958us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938440.900189:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 284 00000100:00100000:1.0:1784938440.904189:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938440.904528:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337383936 00000100:00100000:3.0:1784938440.904552:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337383936 00000100:00100000:3.0:1784938440.904617:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 285 00000100:00100000:3.0:1784938440.904627:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+229:17096:x1871643337383936:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938440.904647:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938440.904669:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00400/0x7b044d4128f9b54f lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476639ab expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.904773:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b556 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.904789:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b556 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.904802:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b556 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.904818:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b55d lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x48e4a31f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.904825:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b55d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.904831:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b55d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938440.905368:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x47:0x0], index 0: 0 00010000:00010000:3.0:1784938440.905858:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01000/0x7b044d4128f9b564 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.905868:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01000/0x7b044d4128f9b564 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.905892:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01000/0x7b044d4128f9b564 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.906118:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b556 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.906138:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b556 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.906167:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b556 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.906174:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d00c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938440.906178:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b556 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.906185:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b556 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.906199:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938440.906202:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938440.906207:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b556 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.906213:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b556 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938440.906226:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ad2d6457 reply state 00000000e87baaa8 transno 8589934721 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b55d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.906237:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b55d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.906250:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x48e4a31f (ffff9f2485293300) 00010000:00010000:3.0:1784938440.906253:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938440.906255:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938440.906287:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00400/0x7b044d4128f9b54f lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476639ab expref: 232 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.906302:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01000/0x7b044d4128f9b564 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476639ab expref: 231 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.906310:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd:0x0].0x0 (ffff9f24898dd400) 00010000:00010000:3.0:1784938440.906313:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938440.906316:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e01000, rc 0) 00000100:00100000:3.0:1784938440.906600:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+232:17096:x1871643337383936:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1974us (2472us total) trans 8589934721 rc 0/0 00000100:00100000:3.0:1784938440.906608:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 285 00000100:00100000:2.0:1784938440.913673:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938440.918429:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938440.921870:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938440.921962:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337384320 00000100:00100000:3.0:1784938440.921971:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337384320 00010000:00010000:3.0:1784938440.922010:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e4b1af9e/0x7b044d4128f9b572 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476639b2 expref: 80 pid: 21149 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938440.922061:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 210 00000100:00100000:3.0:1784938440.922071:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+80:10959:x1871643337384320:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938440.922086:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938440.922108:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e4b1af9e/0x7b044d4128f9b572 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476639b2 expref: 80 pid: 21149 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.922189:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e4b1af9e/0x7b044d4128f9b572 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476639b2 expref: 80 pid: 21149 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.922216:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x47:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938440.922221:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x47:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938440.922229:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000893bc602/0x7b044d4128f9b579 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476639b9 expref: 80 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.922241:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893bc602/0x7b044d4128f9b579 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476639b9 expref: 80 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.922276:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000893bc602/0x7b044d4128f9b579 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476639b9 expref: 80 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938440.922291:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350829184:192.168.202.54@tcp:105: 00000100:00100000:3.0:1784938440.922391:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238e8dea80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938440.928044:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350829184:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938440.928071:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938440.928184:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+78:10959:x1871643337384320:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 6113us (6322us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938440.928197:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 210 00000100:00100000:2.0:1784938440.929726:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938440.929829:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337384576 00000100:00100000:1.0:1784938440.929839:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337384576 00000100:00100000:1.0:1784938440.929903:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 32 00000100:00100000:1.0:1784938440.929921:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+232:17096:x1871643337384576:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:1.0:1784938440.930247:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+233:17096:x1871643337384576:12345-192.168.202.54@tcp:35:cp.0 Request processed in 327us (527us total) trans 8589934722 rc 0/0 00000100:00100000:1.0:1784938440.930255:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 32 00000100:00100000:2.0:1784938440.935239:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938440.935449:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337384704 00000100:00100000:3.0:1784938440.935460:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337384704 00000100:00100000:3.0:1784938440.935585:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 286 00000100:00100000:3.0:1784938440.935607:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+233:17096:x1871643337384704:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938440.935637:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938440.935666:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b580 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476639c0 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.935743:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00400/0x7b044d4128f9b587 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.935761:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00400/0x7b044d4128f9b587 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.935774:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00400/0x7b044d4128f9b587 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.935791:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b58e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xbf79d746 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.935797:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b58e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.935803:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b58e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.935848:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00400/0x7b044d4128f9b587 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.935855:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00400/0x7b044d4128f9b587 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.935862:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00400/0x7b044d4128f9b587 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.935880:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d00400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938440.935885:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00400/0x7b044d4128f9b587 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.935892:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00400/0x7b044d4128f9b587 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.935918:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938440.935921:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938440.935926:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00400/0x7b044d4128f9b587 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.935933:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00400/0x7b044d4128f9b587 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.935949:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b58e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.935954:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b58e lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.935960:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b58e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.935965:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d00c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938440.935967:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b58e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.935974:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b58e lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.935992:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xbf79d746 (ffff9f2485293700) 00010000:00010000:3.0:1784938440.935995:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938440.935998:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b58e lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.936004:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b58e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.936047:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b580 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476639c0 expref: 234 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.936058:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938440.936061:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938440.936065:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b580 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476639c0 expref: 234 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.936075:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e00000, rc 0) 00000100:00100000:3.0:1784938440.936312:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+233:17096:x1871643337384704:12345-192.168.202.54@tcp:101:cp.0 Request processed in 706us (1084us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938440.936323:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 286 00000100:00100000:2.0:1784938440.939759:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938440.939840:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337384832 00000100:00100000:3.0:1784938440.939850:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337384832 00000100:00100000:3.0:1784938440.939909:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 287 00000100:00100000:3.0:1784938440.939930:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+233:17096:x1871643337384832:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938440.939952:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938440.939972:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00800/0x7b044d4128f9b595 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476639c7 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.940083:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b59c lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.940099:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b59c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.940111:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b59c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.940138:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9b5a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xbf79d746 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.940177:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9b5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.940186:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9b5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.940224:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b59c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.940232:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b59c lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.940238:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b59c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.940244:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d01800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938440.940249:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b59c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.940266:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b59c lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.940278:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938440.940281:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938440.940286:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b59c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.940292:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b59c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.940307:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9b5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.940313:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9b5a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.940319:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9b5a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.940324:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d00a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938440.940327:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9b5a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.940334:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9b5a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.940342:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xbf79d746 (ffff9f238dd49f00) 00010000:00010000:3.0:1784938440.940357:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938440.940360:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9b5a3 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.940656:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9b5a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.940691:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00800/0x7b044d4128f9b595 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476639c7 expref: 234 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.940702:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938440.940704:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938440.940708:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00800/0x7b044d4128f9b595 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476639c7 expref: 234 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938440.940717:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d00800, rc 0) 00000100:00100000:2.0:1784938440.940847:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+233:17096:x1871643337384832:12345-192.168.202.54@tcp:101:cp.0 Request processed in 928us (1097us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938440.940855:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 287 00000100:00100000:2.0:1784938440.945003:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938440.945198:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337385088 00000100:00100000:1.0:1784938440.945207:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337385088 00000100:00100000:1.0:1784938440.945266:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 288 00000100:00100000:1.0:1784938440.945276:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+233:17096:x1871643337385088:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938440.945298:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938440.945320:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b5aa lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476639ce expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.945717:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b5b1 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.945733:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b5b1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.945744:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b5b1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.945762:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4e00/0x7b044d4128f9b5b8 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0xbf79d746 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.945769:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4e00/0x7b044d4128f9b5b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.945775:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4e00/0x7b044d4128f9b5b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938440.946103:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x47:0x0], index 1: 0 00010000:00010000:1.0:1784938440.946290:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e5800/0x7b044d4128f9b5bf lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.946300:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e5800/0x7b044d4128f9b5bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.946307:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e5800/0x7b044d4128f9b5bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.946338:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b5b1 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.946358:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b5b1 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.946364:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b5b1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.946721:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b5b1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.946730:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938440.946734:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b5b1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.946741:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b5b1 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.946755:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938440.946758:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938440.946763:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b5b1 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.946771:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b5b1 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938440.946786:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f21df18a reply state 00000000fdcdfae4 transno 8589934723 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4e00/0x7b044d4128f9b5b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.946798:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4e00/0x7b044d4128f9b5b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.946806:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xbf79d746 (ffff9f23823e3000) 00010000:00010000:1.0:1784938440.946808:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938440.946811:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938440.946848:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b5aa lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476639ce expref: 236 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.946863:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e5800/0x7b044d4128f9b5bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476639ce expref: 235 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.946876:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xe:0x0].0x0 (ffff9f23823e3200) 00010000:00010000:1.0:1784938440.946879:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938440.946882:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c9e5800, rc 0) 00000100:00100000:1.0:1784938440.947021:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+236:17096:x1871643337385088:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1744us (2025us total) trans 8589934723 rc 0/0 00000100:00100000:1.0:1784938440.947029:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 288 00000100:00100000:3.0:1784938440.951008:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938440.951400:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337385216 00000100:00100000:2.0:1784938440.951410:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337385216 00000100:00100000:2.0:1784938440.951470:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 520 00000100:00100000:2.0:1784938440.951481:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+78:10960:x1871643337385216:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938440.951500:0:25716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938440.951523:0:25716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8714fdb/0x7b044d4128f9b5cd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x47:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476639d5 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938440.951546:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x47:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938440.951569:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x47:0x0].0x0 since=707s v=(0 0) 00010000:00010000:2.0:1784938440.951574:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x47:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938440.951584:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8714fdb/0x7b044d4128f9b5cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476639d5 expref: 79 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.951600:0:25716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b8714fdb/0x7b044d4128f9b5cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476639d5 expref: 79 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938440.951613:0:25716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217da00, rc 0) 00000100:00100000:2.0:1784938440.951675:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+79:10960:x1871643337385216:12345-192.168.202.54@tcp:101:cp.0 Request processed in 197us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938440.951683:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 520 00000100:00100000:2.0:1784938440.964214:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938440.973025:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938440.973195:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337385472 00000100:00100000:1.0:1784938440.973205:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337385472 00010000:00010000:1.0:1784938440.973249:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b8714fdb/0x7b044d4128f9b5cd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476639d5 expref: 80 pid: 25716 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938440.973296:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 211 00000100:00100000:1.0:1784938440.973305:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+80:10957:x1871643337385472:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938440.973320:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938440.973356:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b8714fdb/0x7b044d4128f9b5cd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476639d5 expref: 80 pid: 25716 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.973379:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b8714fdb/0x7b044d4128f9b5cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476639d5 expref: 80 pid: 25716 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.973403:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8714fdb/0x7b044d4128f9b5cd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476639d5 expref: 80 pid: 25716 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.973420:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x47:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938440.973425:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x47:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938440.973433:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4b1af9e/0x7b044d4128f9b5d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476639dc expref: 79 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.973443:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4b1af9e/0x7b044d4128f9b5d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476639dc expref: 79 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938440.973482:0:19220:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e4b1af9e/0x7b044d4128f9b5d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476639dc expref: 79 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938440.973496:0:19220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2381d2b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:19220:1871643350829440:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938440.973579:0:19220:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24831b40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938440.980341:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938440.980501:0:19220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2381d2b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:19220:1871643350829440:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938440.980523:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938440.980575:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+79:10957:x1871643337385472:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 7271us (7560us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938440.980585:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 211 00000100:00100000:2.0:1784938440.990287:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938440.995136:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.000422:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.000486:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337386240 00000100:00100000:1.0:1784938441.000496:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337386240 00000100:00100000:1.0:1784938441.000577:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 291 00000100:00100000:1.0:1784938441.000588:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+237:17096:x1871643337386240:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938441.000610:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938441.000633:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e5000/0x7b044d4128f9b605 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476639f1 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784938441.000644:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784938441.000736:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4800/0x7b044d4128f9b60c lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.000767:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4800/0x7b044d4128f9b60c lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.000779:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4800/0x7b044d4128f9b60c lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.000820:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4400/0x7b044d4128f9b613 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0xb34b709f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.000826:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4400/0x7b044d4128f9b613 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.000831:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4400/0x7b044d4128f9b613 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938441.001108:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x48:0x0], index 0: 0 00010000:00010000:1.0:1784938441.001258:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b61a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.001267:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b61a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.001274:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b61a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.001300:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4800/0x7b044d4128f9b60c lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.001304:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4800/0x7b044d4128f9b60c lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.001309:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4800/0x7b044d4128f9b60c lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.001314:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9e4800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.001317:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4800/0x7b044d4128f9b60c lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.001322:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4800/0x7b044d4128f9b60c lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.001330:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.001332:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.001335:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4800/0x7b044d4128f9b60c lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.001339:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4800/0x7b044d4128f9b60c lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938441.001360:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000db4a5413 reply state 00000000f3954af7 transno 8589934725 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4400/0x7b044d4128f9b613 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.001695:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4400/0x7b044d4128f9b613 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.001702:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xb34b709f (ffff9f23823e2000) 00010000:00010000:1.0:1784938441.001704:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938441.001706:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938441.001735:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e5000/0x7b044d4128f9b605 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476639f1 expref: 240 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.001796:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b61a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476639f1 expref: 239 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.001809:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xf:0x0].0x0 (ffff9f23823e2200) 00010000:00010000:1.0:1784938441.001811:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938441.001814:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238db38e00, rc 0) 00000100:00100000:1.0:1784938441.001953:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+240:17096:x1871643337386240:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1367us (1541us total) trans 8589934725 rc 0/0 00000100:00100000:1.0:1784938441.001963:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 291 00000100:00100000:2.0:1784938441.009530:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.009618:0:21152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337386368 00000100:00100000:3.0:1784938441.009629:0:21152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337386368 00000100:00100000:3.0:1784938441.009711:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 522 00000100:00100000:3.0:1784938441.009722:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f228e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+78:10957:x1871643337386368:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938441.009744:0:21152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938441.009767:0:21152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a53361ef/0x7b044d4128f9b628 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x48:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476639f8 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938441.009794:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x48:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938441.009816:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x48:0x0].0x0 since=707s v=(0 0) 00010000:00010000:3.0:1784938441.009821:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x48:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938441.009848:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a53361ef/0x7b044d4128f9b628 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476639f8 expref: 79 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.009867:0:21152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a53361ef/0x7b044d4128f9b628 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476639f8 expref: 79 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.009881:0:21152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fdc00, rc 0) 00000100:00080000:2.0:1784938441.010111:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938441.010352:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f228e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+79:10957:x1871643337386368:12345-192.168.202.54@tcp:101:cp.0 Request processed in 621us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938441.010361:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 522 00000100:00100000:3.0:1784938441.014207:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.014559:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337386496 00000100:00100000:2.0:1784938441.014569:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337386496 00000100:00100000:2.0:1784938441.014630:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 523 00000100:00100000:2.0:1784938441.014640:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+79:17096:x1871643337386496:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938441.014659:0:25716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938441.014678:0:25716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022e2f3b3/0x7b044d4128f9b62f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x48:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476639ff expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.014713:0:25716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a53361ef/0x7b044d4128f9b628 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476639f8 expref: 80 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.014722:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x48:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938441.014727:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x48:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938441.014731:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022e2f3b3/0x7b044d4128f9b62f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x48:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476639ff expref: 80 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.014781:0:25716:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a53361ef/0x7b044d4128f9b628 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e9476639f8 expref: 80 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.014794:0:25716:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a53361ef/0x7b044d4128f9b628 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476639f8 expref: 80 pid: 21152 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938441.014807:0:25716:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25716:1871643350829568:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938441.014898:0:25716:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b4068300 going to sleep for 11 seconds 00000100:00100000:2.0:1784938441.018457:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.018606:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337386624 00000100:00100000:3.0:1784938441.018615:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337386624 00010000:00010000:3.0:1784938441.018657:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a53361ef/0x7b044d4128f9b628 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476639f8 expref: 81 pid: 21152 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938441.018707:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 212 00000100:00100000:3.0:1784938441.018716:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f228700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+81:10959:x1871643337386624:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938441.018732:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938441.018754:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a53361ef/0x7b044d4128f9b628 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476639f8 expref: 81 pid: 21152 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.018769:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a53361ef/0x7b044d4128f9b628 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476639f8 expref: 81 pid: 21152 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.018794:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x48:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938441.018813:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x48:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938441.018822:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000022e2f3b3/0x7b044d4128f9b62f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476639ff expref: 81 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.018832:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022e2f3b3/0x7b044d4128f9b62f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476639ff expref: 81 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.018871:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000022e2f3b3/0x7b044d4128f9b62f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476639ff expref: 81 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938441.018887:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350829696:192.168.202.54@tcp:105: 00000100:00100000:3.0:1784938441.018974:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238e8de480 going to sleep for 11 seconds 00010000:00010000:1.0:1784938441.019318:0:25716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a53361ef/0x7b044d4128f9b628 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476639f8 expref: 81 pid: 21152 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938441.019335:0:25716:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25716:1871643350829568:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938441.019379:0:25716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000022e2f3b3/0x7b044d4128f9b62f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476639ff expref: 80 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.019391:0:25716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217d400, rc 0) 00000100:00100000:1.0:1784938441.019422:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+80:17096:x1871643337386496:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4783us (5226us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938441.019429:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 523 00000100:00100000:3.0:1784938441.027524:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350829696:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938441.027551:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938441.027615:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f228700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+79:10959:x1871643337386624:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 8898us (9166us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938441.027626:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 212 00000100:00100000:2.0:1784938441.030211:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.034719:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.034826:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337387008 00000100:00100000:1.0:1784938441.034837:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337387008 00000100:00100000:1.0:1784938441.034915:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 292 00000100:00100000:1.0:1784938441.034924:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+241:17096:x1871643337387008:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938441.034949:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938441.034976:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b636 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663a06 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.035060:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e5000/0x7b044d4128f9b63d lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.035077:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e5000/0x7b044d4128f9b63d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.035089:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e5000/0x7b044d4128f9b63d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.035107:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4800/0x7b044d4128f9b644 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x9b815f19 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.035115:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4800/0x7b044d4128f9b644 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.035122:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4800/0x7b044d4128f9b644 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.035201:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e5000/0x7b044d4128f9b63d lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.035208:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e5000/0x7b044d4128f9b63d lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.035215:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e5000/0x7b044d4128f9b63d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.035221:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e5000/0x7b044d4128f9b63d lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.035228:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9e5000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.035233:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e5000/0x7b044d4128f9b63d lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.035241:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e5000/0x7b044d4128f9b63d lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.035253:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.035257:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.035261:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e5000/0x7b044d4128f9b63d lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.035268:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e5000/0x7b044d4128f9b63d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.035283:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4800/0x7b044d4128f9b644 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.035289:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4800/0x7b044d4128f9b644 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.035294:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4800/0x7b044d4128f9b644 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.035299:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9e4800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.035301:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4800/0x7b044d4128f9b644 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.035306:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4800/0x7b044d4128f9b644 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.035314:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x9b815f19 (ffff9f23823e2800) 00010000:00010000:1.0:1784938441.035316:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.035319:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4800/0x7b044d4128f9b644 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.035324:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4800/0x7b044d4128f9b644 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.035485:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b636 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a06 expref: 242 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.035498:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.035501:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.035505:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b636 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a06 expref: 242 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.035516:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238db39600, rc 0) 00000100:00100000:1.0:1784938441.035688:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+241:17096:x1871643337387008:12345-192.168.202.54@tcp:101:cp.0 Request processed in 764us (979us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938441.035696:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 292 00000100:00100000:1.0:1784938441.039053:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.039141:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337387136 00000100:00100000:3.0:1784938441.039175:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337387136 00000100:00100000:3.0:1784938441.039229:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 293 00000100:00100000:3.0:1784938441.039239:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+241:17096:x1871643337387136:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938441.039258:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938441.039279:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9b64b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663a0d expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.039353:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9b652 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.039397:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9b652 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.039411:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9b652 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.039426:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fce00/0x7b044d4128f9b659 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x9b815f19 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.039434:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fce00/0x7b044d4128f9b659 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.039439:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fce00/0x7b044d4128f9b659 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.039480:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9b652 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.039487:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9b652 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.039493:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9b652 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.039499:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fd600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938441.039503:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9b652 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.039510:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9b652 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.039521:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938441.039530:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.039535:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9b652 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.039541:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9b652 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.039555:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fce00/0x7b044d4128f9b659 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.039561:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fce00/0x7b044d4128f9b659 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.039567:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fce00/0x7b044d4128f9b659 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.039572:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fce00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938441.039575:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fce00/0x7b044d4128f9b659 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.039580:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fce00/0x7b044d4128f9b659 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.039588:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x9b815f19 (ffff9f238dd49300) 00010000:00010000:3.0:1784938441.039590:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.039593:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fce00/0x7b044d4128f9b659 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.039599:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fce00/0x7b044d4128f9b659 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.039632:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9b64b lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a0d expref: 242 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.039650:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938441.039653:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.039658:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9b64b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a0d expref: 242 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.039667:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fc800, rc 0) 00000100:00100000:3.0:1784938441.039725:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+241:17096:x1871643337387136:12345-192.168.202.54@tcp:101:cp.0 Request processed in 487us (693us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938441.039733:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 293 00000100:00100000:2.0:1784938441.043298:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.049114:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.049530:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337387520 00000100:00100000:1.0:1784938441.049540:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337387520 00000100:00100000:1.0:1784938441.049634:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 524 00000100:00100000:1.0:1784938441.049644:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+79:10959:x1871643337387520:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938441.049662:0:25715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938441.049680:0:25715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0f08a3c/0x7b044d4128f9b683 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x48:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663a1b expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938441.049705:0:25715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x48:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938441.049724:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x48:0x0].0x0 since=707s v=(0 0) 00010000:00010000:1.0:1784938441.049729:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x48:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938441.049738:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0f08a3c/0x7b044d4128f9b683 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a1b expref: 80 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.049755:0:25715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a0f08a3c/0x7b044d4128f9b683 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a1b expref: 80 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.049767:0:25715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c9e4800, rc 0) 00000100:00100000:1.0:1784938441.049827:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+80:10959:x1871643337387520:12345-192.168.202.54@tcp:101:cp.0 Request processed in 184us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938441.049834:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 524 00000100:00100000:3.0:1784938441.052511:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.052767:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337387648 00000100:00100000:1.0:1784938441.052776:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337387648 00000100:00100000:1.0:1784938441.052832:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 525 00000100:00100000:1.0:1784938441.052843:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+80:17096:x1871643337387648:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938441.052860:0:21629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938441.052879:0:21629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bcdde69f/0x7b044d4128f9b68a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x48:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663a22 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.052921:0:21629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0f08a3c/0x7b044d4128f9b683 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a1b expref: 81 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.052930:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x48:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938441.052934:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x48:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938441.052940:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcdde69f/0x7b044d4128f9b68a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x48:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a22 expref: 81 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.052977:0:21629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a0f08a3c/0x7b044d4128f9b683 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663a1b expref: 81 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.052992:0:21629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a0f08a3c/0x7b044d4128f9b683 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663a1b expref: 81 pid: 25715 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938441.053007:0:21629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2381d2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:21629:1871643350829824:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938441.053285:0:21629:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24831b4540 going to sleep for 11 seconds 00000100:00100000:3.0:1784938441.055886:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00080000:2.0:1784938441.062387:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784938441.063524:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.063615:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337388032 00000100:00100000:2.0:1784938441.063625:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337388032 00000100:00100000:2.0:1784938441.063684:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 35 00000100:00100000:2.0:1784938441.063694:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+244:17096:x1871643337388032:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:2.0:1784938441.064008:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+245:17096:x1871643337388032:12345-192.168.202.54@tcp:35:cp.0 Request processed in 314us (488us total) trans 8589934728 rc 0/0 00000100:00100000:2.0:1784938441.064016:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 35 00000100:00100000:3.0:1784938441.067812:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.072191:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.072386:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337388288 00000100:00100000:1.0:1784938441.072396:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337388288 00000100:00100000:1.0:1784938441.072452:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 296 00000100:00100000:1.0:1784938441.072461:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+245:17096:x1871643337388288:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938441.072481:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938441.072503:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b6a6 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663a30 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.072565:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9b6ad lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.072577:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9b6ad lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.072587:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9b6ad lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.072603:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dac00/0x7b044d4128f9b6b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe9fa0db8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.072610:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dac00/0x7b044d4128f9b6b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.072616:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dac00/0x7b044d4128f9b6b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.072653:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9b6ad lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.072659:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9b6ad lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.072665:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9b6ad lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.072670:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9b6ad lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.072675:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5db400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.072679:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9b6ad lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.072686:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9b6ad lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.072696:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.072699:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.072703:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9b6ad lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.072709:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9b6ad lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.072721:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dac00/0x7b044d4128f9b6b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.072726:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dac00/0x7b044d4128f9b6b4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.072731:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dac00/0x7b044d4128f9b6b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.072734:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5dac00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.072736:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dac00/0x7b044d4128f9b6b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.072741:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dac00/0x7b044d4128f9b6b4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.072746:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xe9fa0db8 (ffff9f23823e2400) 00010000:00010000:1.0:1784938441.072749:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.072751:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dac00/0x7b044d4128f9b6b4 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.072757:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dac00/0x7b044d4128f9b6b4 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.072788:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b6a6 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a30 expref: 246 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.072804:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.072806:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.072810:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b6a6 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a30 expref: 246 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.072819:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238db39600, rc 0) 00000100:00100000:1.0:1784938441.072875:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+245:17096:x1871643337388288:12345-192.168.202.54@tcp:101:cp.0 Request processed in 414us (692us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938441.072882:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 296 00000100:00100000:3.0:1784938441.076419:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.082923:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.086901:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.087017:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337388800 00000100:00100000:2.0:1784938441.087026:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337388800 00000100:00100000:2.0:1784938441.087090:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 527 00000100:00100000:2.0:1784938441.087099:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+80:17096:x1871643337388800:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938441.087118:0:25715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938441.087137:0:25715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000337df334/0x7b044d4128f9b6e5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x49:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663a45 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.087192:0:25715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005890b19b/0x7b044d4128f9b6de lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a3e expref: 81 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.087201:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x49:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938441.087206:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x49:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938441.087211:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000337df334/0x7b044d4128f9b6e5 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x49:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a45 expref: 81 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.087241:0:25715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005890b19b/0x7b044d4128f9b6de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663a3e expref: 81 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.087264:0:25715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005890b19b/0x7b044d4128f9b6de lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663a3e expref: 81 pid: 21151 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938441.087279:0:25715:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25715:1871643350830080:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938441.087735:0:25715:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b4068300 going to sleep for 11 seconds 00000100:00100000:3.0:1784938441.090819:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.090926:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337388928 00000100:00100000:1.0:1784938441.090935:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337388928 00010000:00010000:1.0:1784938441.090974:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005890b19b/0x7b044d4128f9b6de lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663a3e expref: 82 pid: 21151 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938441.091018:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 214 00000100:00100000:1.0:1784938441.091028:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+82:10960:x1871643337388928:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938441.091053:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938441.091077:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005890b19b/0x7b044d4128f9b6de lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663a3e expref: 82 pid: 21151 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.091092:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005890b19b/0x7b044d4128f9b6de lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663a3e expref: 82 pid: 21151 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.091117:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x49:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938441.091122:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x49:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938441.091167:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000337df334/0x7b044d4128f9b6e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a45 expref: 82 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.091179:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000337df334/0x7b044d4128f9b6e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a45 expref: 82 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.091220:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000337df334/0x7b044d4128f9b6e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a45 expref: 82 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938441.091234:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2381d2b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350830208:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938441.091305:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24831b4e40 going to sleep for 11 seconds 00010000:00010000:2.0:1784938441.091696:0:25715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005890b19b/0x7b044d4128f9b6de lrc: 0/0,0 mode: --/PR res: [0x280000401:0x49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663a3e expref: 82 pid: 21151 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938441.091715:0:25715:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25715:1871643350830080:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938441.091748:0:25715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000337df334/0x7b044d4128f9b6e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663a45 expref: 81 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.091760:0:25715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217d600, rc 0) 00000100:00100000:2.0:1784938441.091793:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+81:17096:x1871643337388800:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4695us (4900us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938441.091802:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 527 00000100:00100000:1.0:1784938441.101418:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.101548:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337389184 00000100:00100000:2.0:1784938441.101558:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337389184 00000100:00100000:2.0:1784938441.101618:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 36 00000100:00100000:2.0:1784938441.101628:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+248:17096:x1871643337389184:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:2.0:1784938441.101924:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+249:17096:x1871643337389184:12345-192.168.202.54@tcp:35:cp.0 Request processed in 296us (515us total) trans 8589934730 rc 0/0 00000100:00100000:2.0:1784938441.101931:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 36 00000100:00100000:3.0:1784938441.105390:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.105625:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337389312 00000100:00100000:1.0:1784938441.105636:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337389312 00000100:00100000:1.0:1784938441.105696:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 298 00000100:00100000:1.0:1784938441.105707:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+249:17096:x1871643337389312:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938441.105730:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938441.105750:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dac00/0x7b044d4128f9b6ec lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663a4c expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.105842:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9b6f3 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.105858:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9b6f3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.105869:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9b6f3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.105883:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9b6fa lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xc025ca7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.105890:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9b6fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.105897:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9b6fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.105948:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9b6f3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.105955:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9b6f3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.105961:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9b6f3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.105968:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9b6f3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.105974:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5db400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.105978:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9b6f3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.105984:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9b6f3 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.105995:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.105998:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.106004:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9b6f3 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.106010:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9b6f3 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.106024:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9b6fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.106029:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9b6fa lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.106034:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9b6fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.106039:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5db200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.106041:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9b6fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.106047:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9b6fa lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.106053:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xc025ca7 (ffff9f23823e2400) 00010000:00010000:1.0:1784938441.106056:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.106059:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9b6fa lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.106065:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9b6fa lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.106098:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dac00/0x7b044d4128f9b6ec lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a4c expref: 250 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.106114:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.106116:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.106120:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dac00/0x7b044d4128f9b6ec lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a4c expref: 250 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.106130:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d5dac00, rc 0) 00000100:00100000:1.0:1784938441.106225:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+249:17096:x1871643337389312:12345-192.168.202.54@tcp:101:cp.0 Request processed in 520us (853us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938441.106233:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 298 00000100:00100000:3.0:1784938441.110884:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.110978:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337389440 00000100:00100000:1.0:1784938441.110988:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337389440 00000100:00100000:1.0:1784938441.111059:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 299 00000100:00100000:1.0:1784938441.111070:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+249:17096:x1871643337389440:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938441.111092:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938441.111114:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dae00/0x7b044d4128f9b701 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663a53 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.111221:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b708 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.111237:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b708 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.111248:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b708 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.111262:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b70f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xc025ca7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.111270:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b70f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.111276:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b70f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.111313:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b708 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.111320:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b708 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.111326:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b708 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.111334:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.111338:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b708 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.111357:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b708 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.111497:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.111502:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.111508:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b708 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.111514:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b708 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.111528:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b70f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.111535:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b70f lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.111541:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b70f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.111547:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f7000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.111550:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b70f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.111556:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b70f lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.111565:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xc025ca7 (ffff9f23823e2d00) 00010000:00010000:1.0:1784938441.111568:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.111571:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b70f lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.111577:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b70f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.111618:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dae00/0x7b044d4128f9b701 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a53 expref: 250 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.111630:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.111632:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.111636:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dae00/0x7b044d4128f9b701 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a53 expref: 250 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.111652:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d5dae00, rc 0) 00000100:00100000:1.0:1784938441.111713:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+249:17096:x1871643337389440:12345-192.168.202.54@tcp:101:cp.0 Request processed in 644us (840us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938441.111720:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 299 00000100:00100000:3.0:1784938441.114843:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.114936:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337389696 00000100:00100000:1.0:1784938441.114948:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337389696 00000100:00100000:1.0:1784938441.115008:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 300 00000100:00100000:1.0:1784938441.115018:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+249:17096:x1871643337389696:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938441.115049:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938441.115073:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dac00/0x7b044d4128f9b716 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663a5a expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.115228:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9b71d lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.115244:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9b71d lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.115257:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9b71d lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.115272:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9b724 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0xc025ca7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.115280:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9b724 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.115286:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9b724 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938441.115610:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x49:0x0], index 1: 0 00010000:00010000:1.0:1784938441.115753:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031200/0x7b044d4128f9b72b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.115763:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031200/0x7b044d4128f9b72b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.115771:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031200/0x7b044d4128f9b72b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.115802:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9b71d lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.115809:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9b71d lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.115814:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9b71d lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.115820:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9b71d lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.115826:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5db200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.115830:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9b71d lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.115836:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9b71d lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.115848:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.115851:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.115856:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9b71d lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.115863:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9b71d lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938441.115879:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000554e660 reply state 000000006cf7dd49 transno 8589934731 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9b724 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.115890:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9b724 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.115897:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xc025ca7 (ffff9f23823e2400) 00010000:00010000:1.0:1784938441.115899:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938441.115901:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938441.115930:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dac00/0x7b044d4128f9b716 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a5a expref: 252 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.115945:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031200/0x7b044d4128f9b72b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a5a expref: 251 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.115951:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x12:0x0].0x0 (ffff9f23823e2f00) 00010000:00010000:1.0:1784938441.115954:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938441.115956:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2480031200, rc 0) 00000100:00100000:1.0:1784938441.116466:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+252:17096:x1871643337389696:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1446us (1630us total) trans 8589934731 rc 0/0 00000100:00100000:1.0:1784938441.116475:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 300 00000100:00100000:2.0:1784938441.120802:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.121567:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+81:10959:x1871643337389824:12345-192.168.202.54@tcp:101:cp.0 Request processed in 555us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938441.121575:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 528 00000100:00100000:2.0:1784938441.124586:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.124658:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337389952 00000100:00100000:1.0:1784938441.124667:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337389952 00000100:00100000:1.0:1784938441.124728:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 529 00000100:00100000:1.0:1784938441.124739:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f229500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+81:17096:x1871643337389952:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938441.124759:0:25716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938441.124778:0:25716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce195e5a/0x7b044d4128f9b740 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x49:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663a68 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.124816:0:25716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005890b19b/0x7b044d4128f9b739 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a61 expref: 82 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.124826:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x49:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938441.124830:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x49:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938441.124835:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce195e5a/0x7b044d4128f9b740 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x49:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a68 expref: 82 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.124875:0:25716:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005890b19b/0x7b044d4128f9b739 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663a61 expref: 82 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.124890:0:25716:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005890b19b/0x7b044d4128f9b739 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663a61 expref: 82 pid: 21149 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938441.124905:0:25716:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2381d2bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25716:1871643350830336:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938441.124994:0:25716:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2489c66180 going to sleep for 11 seconds 00000100:00100000:1.0:1784938441.128779:0:25716:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2381d2bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25716:1871643350830336:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938441.128822:0:25716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ce195e5a/0x7b044d4128f9b740 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x49:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663a68 expref: 82 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.128845:0:25716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2480030000, rc 0) 00000100:00100000:1.0:1784938441.128916:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f229500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+82:17096:x1871643337389952:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4178us (4337us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938441.128926:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 529 00000100:00100000:3.0:1784938441.129192:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.129522:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337390080 00000100:00100000:1.0:1784938441.129531:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337390080 00010000:00010000:1.0:1784938441.129566:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005890b19b/0x7b044d4128f9b739 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663a61 expref: 82 pid: 21149 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938441.129595:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 215 00000100:00100000:1.0:1784938441.129603:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+82:10958:x1871643337390080:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938441.129618:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938441.129641:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005890b19b/0x7b044d4128f9b739 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663a61 expref: 82 pid: 21149 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.129653:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005890b19b/0x7b044d4128f9b739 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663a61 expref: 82 pid: 21149 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.129677:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005890b19b/0x7b044d4128f9b739 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663a61 expref: 82 pid: 21149 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.129693:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x49:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938441.129697:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x49:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938441.129707:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce195e5a/0x7b044d4128f9b740 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663a68 expref: 81 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.129717:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce195e5a/0x7b044d4128f9b740 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663a68 expref: 81 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.129747:0:19220:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ce195e5a/0x7b044d4128f9b740 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663a68 expref: 81 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938441.129761:0:19220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2381d2bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:19220:1871643350830464:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938441.129829:0:19220:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2489c66180 going to sleep for 11 seconds 00000100:00100000:1.0:1784938441.133384:0:19220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2381d2bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:19220:1871643350830464:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938441.133410:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938441.133469:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+81:10958:x1871643337390080:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3866us (4277us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938441.133480:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 215 00000100:00100000:2.0:1784938441.136263:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.144265:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.144385:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337390464 00000100:00100000:1.0:1784938441.144396:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337390464 00000100:00100000:1.0:1784938441.144446:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 301 00000100:00100000:1.0:1784938441.144457:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+253:17096:x1871643337390464:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938441.144480:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938441.144501:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b747 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663a6f expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.144566:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031400/0x7b044d4128f9b74e lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.144581:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031400/0x7b044d4128f9b74e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.144592:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031400/0x7b044d4128f9b74e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.144607:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dac00/0x7b044d4128f9b755 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xecc4f14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.144613:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dac00/0x7b044d4128f9b755 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.144620:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dac00/0x7b044d4128f9b755 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.144655:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031400/0x7b044d4128f9b74e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.144662:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031400/0x7b044d4128f9b74e lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.144668:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031400/0x7b044d4128f9b74e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.144675:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2480031400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.144679:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031400/0x7b044d4128f9b74e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.144687:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031400/0x7b044d4128f9b74e lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.144697:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.144700:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.144705:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031400/0x7b044d4128f9b74e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.144710:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031400/0x7b044d4128f9b74e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.144726:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dac00/0x7b044d4128f9b755 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.144731:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dac00/0x7b044d4128f9b755 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.144736:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dac00/0x7b044d4128f9b755 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.144741:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5dac00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.144743:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dac00/0x7b044d4128f9b755 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.144749:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dac00/0x7b044d4128f9b755 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.144755:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xecc4f14 (ffff9f23823e2d00) 00010000:00010000:1.0:1784938441.144758:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.144761:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dac00/0x7b044d4128f9b755 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.144766:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dac00/0x7b044d4128f9b755 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.144797:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b747 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a6f expref: 254 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.144805:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.144807:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.144811:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b747 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a6f expref: 254 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.144819:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2480030800, rc 0) 00000100:00100000:1.0:1784938441.144885:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+253:17096:x1871643337390464:12345-192.168.202.54@tcp:101:cp.0 Request processed in 431us (631us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938441.144892:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 301 00000100:00100000:3.0:1784938441.147492:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.147578:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337390592 00000100:00100000:1.0:1784938441.147590:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337390592 00000100:00100000:1.0:1784938441.147653:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 302 00000100:00100000:1.0:1784938441.147662:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+253:17096:x1871643337390592:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938441.147680:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938441.147699:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9b75c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663a76 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.147763:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dae00/0x7b044d4128f9b763 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.147777:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dae00/0x7b044d4128f9b763 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.147788:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dae00/0x7b044d4128f9b763 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.147804:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b76a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xecc4f14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.147811:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b76a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.147817:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b76a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.147855:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dae00/0x7b044d4128f9b763 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.147862:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dae00/0x7b044d4128f9b763 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.147869:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dae00/0x7b044d4128f9b763 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.147875:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dae00/0x7b044d4128f9b763 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.147881:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5dae00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.147885:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dae00/0x7b044d4128f9b763 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.147892:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dae00/0x7b044d4128f9b763 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.147916:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.147920:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.147924:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dae00/0x7b044d4128f9b763 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.147930:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dae00/0x7b044d4128f9b763 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.147945:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b76a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.147951:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b76a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.147957:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b76a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.147962:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f7000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.147965:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b76a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.147970:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b76a lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.147977:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xecc4f14 (ffff9f23823e2700) 00010000:00010000:1.0:1784938441.147980:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.147982:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b76a lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.147988:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b76a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.148016:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9b75c lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a76 expref: 254 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.148026:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.148028:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.148032:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db200/0x7b044d4128f9b75c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a76 expref: 254 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.148041:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d5db200, rc 0) 00000100:00100000:1.0:1784938441.148106:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+253:17096:x1871643337390592:12345-192.168.202.54@tcp:101:cp.0 Request processed in 446us (626us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938441.148116:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 302 00000100:00100000:2.0:1784938441.150969:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.151060:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337390848 00000100:00100000:1.0:1784938441.151070:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337390848 00000100:00100000:1.0:1784938441.151199:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 303 00000100:00100000:1.0:1784938441.151210:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+253:17096:x1871643337390848:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938441.151231:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938441.151253:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dac00/0x7b044d4128f9b771 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663a7d expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.151370:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b778 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.151386:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b778 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.151397:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b778 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.151410:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031400/0x7b044d4128f9b77f lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0xecc4f14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.151417:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031400/0x7b044d4128f9b77f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.151424:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031400/0x7b044d4128f9b77f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938441.151731:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4a:0x0], index 0: 0 00010000:00010000:1.0:1784938441.151864:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b786 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.151874:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b786 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.151882:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b786 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.151914:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b778 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.151921:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b778 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.151927:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b778 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.151933:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2480030800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.151938:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b778 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.151945:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b778 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.151956:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.151959:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.151963:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b778 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.151969:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b778 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938441.151981:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000de8ae347 reply state 00000000aca8845e transno 8589934733 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031400/0x7b044d4128f9b77f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.151991:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031400/0x7b044d4128f9b77f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.151996:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xecc4f14 (ffff9f23823e2d00) 00010000:00010000:1.0:1784938441.151998:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938441.152000:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938441.152029:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dac00/0x7b044d4128f9b771 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a7d expref: 256 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.152043:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b786 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a7d expref: 255 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.152049:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x13:0x0].0x0 (ffff9f23823e2300) 00010000:00010000:1.0:1784938441.152051:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938441.152054:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238db39600, rc 0) 00000100:00100000:1.0:1784938441.152127:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+256:17096:x1871643337390848:12345-192.168.202.54@tcp:101:cp.0 Request processed in 918us (1167us total) trans 8589934733 rc 0/0 00000100:00100000:1.0:1784938441.152134:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 303 00000100:00100000:2.0:1784938441.156112:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.161055:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.161141:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337391104 00000100:00100000:1.0:1784938441.161176:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337391104 00000100:00100000:1.0:1784938441.161221:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 531 00000100:00100000:1.0:1784938441.161228:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+81:17096:x1871643337391104:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938441.161246:0:21629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938441.161260:0:21629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018157374/0x7b044d4128f9b79b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663a8b expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.161284:0:21629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008b50e285/0x7b044d4128f9b794 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a84 expref: 82 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.161291:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938441.161294:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938441.161297:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018157374/0x7b044d4128f9b79b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a8b expref: 82 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.161323:0:21629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008b50e285/0x7b044d4128f9b794 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663a84 expref: 82 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.161332:0:21629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008b50e285/0x7b044d4128f9b794 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663a84 expref: 82 pid: 21152 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938441.161355:0:21629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2381d2bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:21629:1871643350830592:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938441.161590:0:21629:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248a7b1900 going to sleep for 11 seconds 00000100:00100000:1.0:1784938441.163674:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.163719:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337391232 00000100:00100000:3.0:1784938441.163729:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337391232 00010000:00010000:3.0:1784938441.163852:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008b50e285/0x7b044d4128f9b794 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663a84 expref: 83 pid: 21152 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938441.163889:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 216 00000100:00100000:3.0:1784938441.163896:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248a949c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+83:10960:x1871643337391232:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938441.163909:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938441.163931:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008b50e285/0x7b044d4128f9b794 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663a84 expref: 82 pid: 21152 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.163944:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008b50e285/0x7b044d4128f9b794 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663a84 expref: 82 pid: 21152 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.163968:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b50e285/0x7b044d4128f9b794 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663a84 expref: 82 pid: 21152 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.163983:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938441.163987:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938441.163996:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000018157374/0x7b044d4128f9b79b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663a8b expref: 81 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.164006:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018157374/0x7b044d4128f9b79b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663a8b expref: 81 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.164092:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000018157374/0x7b044d4128f9b79b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663a8b expref: 81 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938441.164705:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350830720:192.168.202.54@tcp:105: 00000100:00100000:3.0:1784938441.164877:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238e8de480 going to sleep for 11 seconds 00000100:00100000:3.0:1784938441.166402:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350830720:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938441.166422:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938441.166470:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248a949c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+81:10960:x1871643337391232:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 2573us (2804us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938441.166482:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 216 00000100:00100000:2.0:1784938441.168017:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.168117:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337391488 00000100:00100000:1.0:1784938441.168138:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337391488 00000100:00100000:1.0:1784938441.168338:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 38 00000100:00100000:1.0:1784938441.168357:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+256:17096:x1871643337391488:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:1.0:1784938441.168641:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+257:17096:x1871643337391488:12345-192.168.202.54@tcp:35:cp.0 Request processed in 283us (628us total) trans 8589934734 rc 0/0 00000100:00100000:1.0:1784938441.168648:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 38 00000100:00100000:2.0:1784938441.171986:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.172390:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337391616 00000100:00100000:1.0:1784938441.172399:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337391616 00000100:00100000:1.0:1784938441.172501:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 304 00000100:00100000:1.0:1784938441.172512:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+257:17096:x1871643337391616:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938441.172537:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938441.172559:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9b7a2 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663a92 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.172621:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b7a9 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.172636:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b7a9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.172646:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b7a9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.172661:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b7b0 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x712be7d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.172668:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.172674:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.172713:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b7a9 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.172720:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b7a9 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.172726:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b7a9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.172736:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b7a9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.172742:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2480030800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.172746:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b7a9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.172753:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b7a9 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.172764:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.172767:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.172772:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b7a9 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.172778:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b7a9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.172790:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.172796:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b7b0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.172801:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b7b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.172806:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f7000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.172808:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b7b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.172817:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b7b0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.172823:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x712be7d1 (ffff9f23823e2700) 00010000:00010000:1.0:1784938441.172825:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.172828:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b7b0 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.172833:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b7b0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.172866:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9b7a2 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a92 expref: 258 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.172875:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.172878:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.172881:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9b7a2 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a92 expref: 258 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.172890:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d27c800, rc 0) 00000100:00100000:1.0:1784938441.173026:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+257:17096:x1871643337391616:12345-192.168.202.54@tcp:101:cp.0 Request processed in 515us (1112us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938441.173034:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 304 00000100:00100000:2.0:1784938441.175635:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.175867:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337391744 00000100:00100000:3.0:1784938441.175876:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337391744 00000100:00100000:3.0:1784938441.175982:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 305 00000100:00100000:3.0:1784938441.175992:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+257:17096:x1871643337391744:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938441.176013:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938441.176043:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9b7b7 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663a99 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.176114:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9b7be lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.176138:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9b7be lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.176179:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9b7be lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.176194:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fce00/0x7b044d4128f9b7c5 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x712be7d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.176216:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fce00/0x7b044d4128f9b7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.176223:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fce00/0x7b044d4128f9b7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.176267:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9b7be lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.176275:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9b7be lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.176282:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9b7be lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.176289:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fc800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938441.176294:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9b7be lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.176301:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9b7be lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.176313:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938441.176317:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.176322:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9b7be lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.176328:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9b7be lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.176350:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fce00/0x7b044d4128f9b7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.176363:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fce00/0x7b044d4128f9b7c5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.176370:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fce00/0x7b044d4128f9b7c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.176376:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fce00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938441.176379:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fce00/0x7b044d4128f9b7c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.176386:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fce00/0x7b044d4128f9b7c5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.176394:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x712be7d1 (ffff9f238dd49300) 00010000:00010000:3.0:1784938441.176398:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.176400:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fce00/0x7b044d4128f9b7c5 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.176406:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fce00/0x7b044d4128f9b7c5 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.176438:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9b7b7 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a99 expref: 258 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.176449:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938441.176451:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.176455:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9b7b7 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a99 expref: 258 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.176477:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fcc00, rc 0) 00000100:00100000:3.0:1784938441.176528:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+257:17096:x1871643337391744:12345-192.168.202.54@tcp:101:cp.0 Request processed in 537us (904us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938441.176536:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 305 00000100:00100000:2.0:1784938441.179394:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.179510:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337392000 00000100:00100000:3.0:1784938441.179520:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337392000 00000100:00100000:3.0:1784938441.179583:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 306 00000100:00100000:3.0:1784938441.179593:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+257:17096:x1871643337392000:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938441.179616:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938441.179641:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9b7cc lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663aa0 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.179739:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fdc00/0x7b044d4128f9b7d3 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.179752:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fdc00/0x7b044d4128f9b7d3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.179764:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fdc00/0x7b044d4128f9b7d3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.179779:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b7da lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x712be7d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.179786:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b7da lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.179793:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b7da lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938441.180117:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4a:0x0], index 1: 0 00010000:00010000:3.0:1784938441.180297:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00800/0x7b044d4128f9b7e1 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.180308:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00800/0x7b044d4128f9b7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.180316:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00800/0x7b044d4128f9b7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.180360:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fdc00/0x7b044d4128f9b7d3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.180368:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fdc00/0x7b044d4128f9b7d3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.180376:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fdc00/0x7b044d4128f9b7d3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.180383:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fdc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938441.180387:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fdc00/0x7b044d4128f9b7d3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.180395:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fdc00/0x7b044d4128f9b7d3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.180407:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938441.180410:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.180415:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fdc00/0x7b044d4128f9b7d3 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.180434:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fdc00/0x7b044d4128f9b7d3 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938441.180449:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a4366b66 reply state 000000000f07f5e4 transno 8589934735 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b7da lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.180460:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b7da lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.180466:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x712be7d1 (ffff9f238dd49900) 00010000:00010000:3.0:1784938441.180469:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938441.180471:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938441.180499:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9b7cc lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663aa0 expref: 260 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.180514:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00800/0x7b044d4128f9b7e1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663aa0 expref: 259 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.180520:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x14:0x0].0x0 (ffff9f238dd49c00) 00010000:00010000:3.0:1784938441.180522:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938441.180525:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d00800, rc 0) 00000100:00100000:3.0:1784938441.180592:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+260:17096:x1871643337392000:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1000us (1209us total) trans 8589934735 rc 0/0 00000100:00100000:3.0:1784938441.180600:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 306 00000100:00100000:2.0:1784938441.184740:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.188499:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.192646:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.193111:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337392384 00000100:00100000:1.0:1784938441.193118:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337392384 00010000:00010000:1.0:1784938441.193462:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008b50e285/0x7b044d4128f9b7ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663aa7 expref: 83 pid: 21151 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938441.193505:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 217 00000100:00100000:1.0:1784938441.193514:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f181880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+83:10957:x1871643337392384:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938441.193527:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938441.193550:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008b50e285/0x7b044d4128f9b7ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663aa7 expref: 83 pid: 21151 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.193562:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008b50e285/0x7b044d4128f9b7ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663aa7 expref: 83 pid: 21151 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.193583:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b50e285/0x7b044d4128f9b7ef lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663aa7 expref: 83 pid: 21151 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.193598:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938441.193602:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938441.193610:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005890b19b/0x7b044d4128f9b7f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663aae expref: 82 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.193620:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005890b19b/0x7b044d4128f9b7f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663aae expref: 82 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.193655:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005890b19b/0x7b044d4128f9b7f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663aae expref: 82 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938441.193668:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2381d2ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350830976:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938441.193721:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248a7b1240 going to sleep for 11 seconds 00000100:00100000:2.0:1784938441.199644:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337392640 00000100:00100000:2.0:1784938441.199655:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337392640 00000100:00100000:2.0:1784938441.199720:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 39 00000100:00100000:2.0:1784938441.199729:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24857fa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+260:17096:x1871643337392640:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:2.0:1784938441.200280:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24857fa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+261:17096:x1871643337392640:12345-192.168.202.54@tcp:35:cp.0 Request processed in 550us (714us total) trans 8589934736 rc 0/0 00000100:00100000:2.0:1784938441.200288:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 39 00000100:00100000:1.0:1784938441.200407:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2381d2ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350830976:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938441.200427:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938441.200451:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f181880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+82:10957:x1871643337392384:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 6938us (7816us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938441.200460:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 217 00000100:00100000:2.0:1784938441.204563:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.204637:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337392768 00000100:00100000:1.0:1784938441.204648:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337392768 00000100:00100000:1.0:1784938441.204709:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 307 00000100:00100000:1.0:1784938441.204721:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+261:17096:x1871643337392768:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938441.204750:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938441.204776:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b7fd lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663ab5 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.204851:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9b804 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.204866:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9b804 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.204877:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9b804 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.204893:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b80b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x4ee593e6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.204900:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b80b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.204930:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b80b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.204975:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9b804 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.204982:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9b804 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.204988:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9b804 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.204994:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9b804 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.205000:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27c800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.205004:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9b804 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.205011:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9b804 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.205023:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.205026:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.205030:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9b804 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.205048:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9b804 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.205062:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b80b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.205069:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b80b lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.205074:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b80b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.205078:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2480030800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.205081:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b80b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.205087:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b80b lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.205095:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x4ee593e6 (ffff9f23823e2700) 00010000:00010000:1.0:1784938441.205097:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.205100:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b80b lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.205106:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b80b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.205139:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b7fd lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ab5 expref: 262 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.205190:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.205192:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.205196:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b7fd lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ab5 expref: 262 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.205210:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c9f7000, rc 0) 00000100:00100000:1.0:1784938441.205267:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+261:17096:x1871643337392768:12345-192.168.202.54@tcp:101:cp.0 Request processed in 547us (714us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938441.205274:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 307 00000100:00100000:2.0:1784938441.211922:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.212011:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337392896 00000100:00100000:3.0:1784938441.212021:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337392896 00000100:00100000:3.0:1784938441.212090:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 308 00000100:00100000:3.0:1784938441.212101:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+261:17096:x1871643337392896:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938441.212138:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938441.212197:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9b812 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663abc expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.212265:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b819 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.212281:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b819 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.212294:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b819 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.212310:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b820 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x4ee593e6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.212318:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b820 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.212325:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b820 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.212380:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b819 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.212388:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b819 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.212395:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b819 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.212400:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d01800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938441.212412:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b819 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.212420:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b819 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.212432:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938441.212436:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.212440:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b819 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.212447:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b819 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.212462:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b820 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.212469:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b820 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.212476:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b820 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.212482:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d00c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938441.212486:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b820 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.212493:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b820 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.212500:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x4ee593e6 (ffff9f238dd49300) 00010000:00010000:3.0:1784938441.212503:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.212513:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b820 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.212519:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b820 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.212554:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9b812 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663abc expref: 262 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.212566:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938441.212568:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.212573:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9b812 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663abc expref: 262 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.212583:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d00a00, rc 0) 00000100:00100000:3.0:1784938441.212647:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+261:17096:x1871643337392896:12345-192.168.202.54@tcp:101:cp.0 Request processed in 547us (733us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938441.212655:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 308 00000100:00100000:2.0:1784938441.215837:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.215933:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337393152 00000100:00100000:1.0:1784938441.215944:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337393152 00000100:00100000:1.0:1784938441.216012:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 309 00000100:00100000:1.0:1784938441.216022:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+261:17096:x1871643337393152:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938441.216057:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938441.216083:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b827 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663ac3 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.216259:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b82e lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.216276:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b82e lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.216286:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b82e lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.216299:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9b835 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x4ee593e6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.216306:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9b835 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.216313:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9b835 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938441.216603:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4b:0x0], index 0: 0 00010000:00010000:1.0:1784938441.216733:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dac00/0x7b044d4128f9b83c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.216742:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dac00/0x7b044d4128f9b83c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.216749:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dac00/0x7b044d4128f9b83c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.216780:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b82e lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.216787:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b82e lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.216793:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b82e lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.216800:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b82e lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.216805:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f7000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.216810:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b82e lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.216816:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b82e lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.216828:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.216831:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.216835:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b82e lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.216840:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b82e lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938441.216854:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000059477648 reply state 00000000e06e0c53 transno 8589934737 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9b835 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.216864:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9b835 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.216870:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x4ee593e6 (ffff9f23823e2700) 00010000:00010000:1.0:1784938441.216873:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938441.216875:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938441.216901:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b827 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ac3 expref: 264 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.216915:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dac00/0x7b044d4128f9b83c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ac3 expref: 263 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.216922:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x15:0x0].0x0 (ffff9f23823e2900) 00010000:00010000:1.0:1784938441.216925:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938441.216927:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d5dac00, rc 0) 00000100:00100000:1.0:1784938441.216983:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+264:17096:x1871643337393152:12345-192.168.202.54@tcp:101:cp.0 Request processed in 962us (1158us total) trans 8589934737 rc 0/0 00000100:00100000:1.0:1784938441.216991:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 309 00000100:00100000:2.0:1784938441.220414:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.220488:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337393280 00000100:00100000:3.0:1784938441.220497:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337393280 00000100:00100000:3.0:1784938441.220544:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 534 00000100:00100000:3.0:1784938441.220554:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+81:10957:x1871643337393280:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938441.220573:0:21149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938441.220592:0:21149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084f9b11e/0x7b044d4128f9b84a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663aca expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938441.220617:0:21149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938441.220639:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4b:0x0].0x0 since=707s v=(0 0) 00010000:00010000:3.0:1784938441.220659:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938441.220669:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084f9b11e/0x7b044d4128f9b84a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663aca expref: 82 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.220686:0:21149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000084f9b11e/0x7b044d4128f9b84a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663aca expref: 82 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.220699:0:21149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d00400, rc 0) 00000100:00100000:3.0:1784938441.220762:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+82:10957:x1871643337393280:12345-192.168.202.54@tcp:101:cp.0 Request processed in 209us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938441.220770:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 534 00000100:00100000:2.0:1784938441.224385:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.224462:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337393408 00000100:00100000:1.0:1784938441.224473:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337393408 00000100:00100000:1.0:1784938441.224524:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 535 00000100:00100000:1.0:1784938441.224533:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+82:17096:x1871643337393408:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938441.224553:0:25716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938441.224572:0:25716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8c084d2/0x7b044d4128f9b851 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663ad1 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.224605:0:25716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000084f9b11e/0x7b044d4128f9b84a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663aca expref: 83 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.224614:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938441.224618:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938441.224624:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8c084d2/0x7b044d4128f9b851 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ad1 expref: 83 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.224657:0:25716:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000084f9b11e/0x7b044d4128f9b84a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663aca expref: 83 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.224671:0:25716:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000084f9b11e/0x7b044d4128f9b84a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663aca expref: 83 pid: 21149 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938441.224687:0:25716:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2381d2ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25716:1871643350831104:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938441.224777:0:25716:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248a7b1900 going to sleep for 11 seconds 00000100:00100000:2.0:1784938441.227808:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:1.0:1784938441.230169:0:25716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084f9b11e/0x7b044d4128f9b84a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663aca expref: 84 pid: 21149 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938441.230193:0:25716:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2381d2ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25716:1871643350831104:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938441.230220:0:25716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f8c084d2/0x7b044d4128f9b851 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663ad1 expref: 83 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.230235:0:25716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d5db200, rc 0) 00000100:00100000:1.0:1784938441.230297:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+83:17096:x1871643337393408:12345-192.168.202.54@tcp:101:cp.0 Request processed in 5765us (5923us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938441.230305:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 535 00000100:00100000:2.0:1784938441.234320:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.238532:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.238780:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337393920 00000100:00100000:3.0:1784938441.238791:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337393920 00000100:00100000:3.0:1784938441.238854:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 310 00000100:00100000:3.0:1784938441.238864:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+265:17096:x1871643337393920:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938441.238887:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938441.238917:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9b858 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663ad8 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.238983:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b85f lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.238998:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b85f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.239010:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b85f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.239024:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b866 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xf0a46efb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.239047:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b866 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.239055:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b866 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.239101:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b85f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.239110:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b85f lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.239117:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b85f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.239123:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d00c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938441.239127:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b85f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.239134:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b85f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.239174:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938441.239181:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.239185:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b85f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.239190:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b85f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.239200:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b866 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.239209:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b866 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.239214:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b866 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.239220:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d01800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938441.239223:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b866 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.239229:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b866 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.239238:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xf0a46efb (ffff9f238dd49300) 00010000:00010000:3.0:1784938441.239241:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.239244:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b866 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.239249:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b866 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.239284:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9b858 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ad8 expref: 266 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.239294:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938441.239296:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.239300:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9b858 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ad8 expref: 266 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.239321:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d00a00, rc 0) 00000100:00100000:3.0:1784938441.239644:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+265:17096:x1871643337393920:12345-192.168.202.54@tcp:101:cp.0 Request processed in 778us (1118us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938441.239652:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 310 00000100:00100000:2.0:1784938441.242878:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.243520:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337394048 00000100:00100000:1.0:1784938441.243531:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337394048 00000100:00100000:1.0:1784938441.243598:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 311 00000100:00100000:1.0:1784938441.243609:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+265:17096:x1871643337394048:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938441.243631:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938441.243654:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b86d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663adf expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.243719:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b874 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.243734:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b874 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.243745:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b874 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.243760:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9b87b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xf0a46efb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.243767:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9b87b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.243779:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9b87b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.243827:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b874 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.243835:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b874 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.243842:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b874 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.243849:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b874 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.243855:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f7000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.243859:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b874 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.243868:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b874 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.243880:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.243884:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.243888:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b874 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.243895:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9b874 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.243921:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9b87b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.243929:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9b87b lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.243935:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9b87b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.243940:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.243942:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9b87b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.243949:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9b87b lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.243957:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xf0a46efb (ffff9f23823e2c00) 00010000:00010000:1.0:1784938441.243959:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.243962:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9b87b lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.243968:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9b87b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.244006:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b86d lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663adf expref: 266 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.244017:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.244019:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.244023:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9b86d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663adf expref: 266 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.244503:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2480030800, rc 0) 00000100:00100000:1.0:1784938441.244573:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+265:17096:x1871643337394048:12345-192.168.202.54@tcp:101:cp.0 Request processed in 966us (1707us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938441.244580:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 311 00000100:00100000:2.0:1784938441.247878:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.248203:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337394304 00000100:00100000:3.0:1784938441.248215:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337394304 00000100:00100000:3.0:1784938441.248385:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 312 00000100:00100000:3.0:1784938441.248396:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+265:17096:x1871643337394304:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938441.248417:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938441.248441:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9b882 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663ae6 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.248555:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b889 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.248572:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b889 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.248585:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b889 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.248598:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b890 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0xf0a46efb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.248604:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b890 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.248610:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b890 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938441.248928:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4b:0x0], index 1: 0 00010000:00010000:3.0:1784938441.249401:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00400/0x7b044d4128f9b897 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.249413:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00400/0x7b044d4128f9b897 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.249423:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00400/0x7b044d4128f9b897 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.249458:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b889 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.249465:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b889 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.249472:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b889 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.249479:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d01800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938441.249483:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b889 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.249492:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b889 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.249504:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938441.249507:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.249511:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b889 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.249530:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b889 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938441.249543:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006753bfc3 reply state 0000000068e38d8f transno 8589934739 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b890 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.249555:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b890 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.249562:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xf0a46efb (ffff9f238dd49300) 00010000:00010000:3.0:1784938441.249565:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938441.249568:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938441.249602:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9b882 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ae6 expref: 268 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.249619:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00400/0x7b044d4128f9b897 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ae6 expref: 267 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.249627:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x16:0x0].0x0 (ffff9f238dd49100) 00010000:00010000:3.0:1784938441.249629:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938441.249632:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d00400, rc 0) 00000100:00100000:3.0:1784938441.249712:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+268:17096:x1871643337394304:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1317us (1842us total) trans 8589934739 rc 0/0 00000100:00100000:3.0:1784938441.249722:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 312 00000100:00100000:2.0:1784938441.253675:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.253880:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337394432 00000100:00100000:1.0:1784938441.253890:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337394432 00000100:00100000:1.0:1784938441.254138:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 536 00000100:00100000:1.0:1784938441.254190:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+82:10959:x1871643337394432:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938441.254207:0:25715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938441.254227:0:25715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077b8fdcf/0x7b044d4128f9b8a5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663aed expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938441.254265:0:25715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938441.254291:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4b:0x0].0x0 since=707s v=(0 0) 00010000:00010000:1.0:1784938441.254296:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938441.254306:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077b8fdcf/0x7b044d4128f9b8a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663aed expref: 83 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.254323:0:25715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000077b8fdcf/0x7b044d4128f9b8a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663aed expref: 83 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.254336:0:25715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b34a00, rc 0) 00000100:00100000:1.0:1784938441.254404:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+83:10959:x1871643337394432:12345-192.168.202.54@tcp:101:cp.0 Request processed in 219us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938441.254415:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 536 00000100:00100000:2.0:1784938441.258003:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.258085:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337394560 00000100:00100000:3.0:1784938441.258096:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337394560 00000100:00100000:3.0:1784938441.258188:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 537 00000100:00100000:3.0:1784938441.258198:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+83:17096:x1871643337394560:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938441.258231:0:21149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938441.258262:0:21149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000317a9dcc/0x7b044d4128f9b8ac lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663af4 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.258296:0:21149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000077b8fdcf/0x7b044d4128f9b8a5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663aed expref: 84 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.258306:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938441.258310:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938441.258315:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000317a9dcc/0x7b044d4128f9b8ac lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663af4 expref: 84 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.258359:0:21149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000077b8fdcf/0x7b044d4128f9b8a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663aed expref: 84 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.258373:0:21149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000077b8fdcf/0x7b044d4128f9b8a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663aed expref: 84 pid: 25715 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938441.258388:0:21149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:21149:1871643350831360:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938441.258463:0:21149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238e8de900 going to sleep for 11 seconds 00000100:00100000:3.0:1784938441.262224:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.262438:0:21149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:21149:1871643350831360:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938441.262471:0:21149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000317a9dcc/0x7b044d4128f9b8ac lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663af4 expref: 84 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.262494:0:21149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d5dae00, rc 0) 00000100:00100000:2.0:1784938441.262559:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+84:17096:x1871643337394560:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4362us (4565us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938441.262569:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 537 00000100:00100000:2.0:1784938441.262858:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337394688 00000100:00100000:2.0:1784938441.262865:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337394688 00010000:00010000:2.0:1784938441.262899:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000077b8fdcf/0x7b044d4128f9b8a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663aed expref: 84 pid: 25715 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938441.262940:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 219 00000100:00100000:2.0:1784938441.262950:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+84:10957:x1871643337394688:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938441.262966:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938441.262990:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000077b8fdcf/0x7b044d4128f9b8a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663aed expref: 84 pid: 25715 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.263006:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000077b8fdcf/0x7b044d4128f9b8a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663aed expref: 84 pid: 25715 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.263031:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077b8fdcf/0x7b044d4128f9b8a5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663aed expref: 84 pid: 25715 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.263045:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938441.263050:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938441.263059:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000317a9dcc/0x7b044d4128f9b8ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663af4 expref: 83 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.263070:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000317a9dcc/0x7b044d4128f9b8ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663af4 expref: 83 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.263108:0:19220:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000317a9dcc/0x7b044d4128f9b8ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663af4 expref: 83 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938441.263122:0:19220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f182d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:19220:1871643350831488:192.168.202.54@tcp:105: 00000100:00100000:2.0:1784938441.263329:0:19220:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b4068300 going to sleep for 11 seconds 00000100:00100000:2.0:1784938441.271318:0:19220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f182d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:19220:1871643350831488:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938441.271359:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938441.271422:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+83:10957:x1871643337394688:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 8473us (9208us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938441.271435:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 219 00000100:00100000:3.0:1784938441.271512:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337394944 00000100:00100000:3.0:1784938441.271520:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337394944 00000100:00100000:3.0:1784938441.271565:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 41 00000100:00100000:3.0:1784938441.271576:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+268:17096:x1871643337394944:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938441.271845:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+269:17096:x1871643337394944:12345-192.168.202.54@tcp:35:cp.0 Request processed in 270us (655us total) trans 8589934740 rc 0/0 00000100:00100000:3.0:1784938441.271895:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 41 00000100:00100000:3.0:1784938441.276180:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.276384:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337395072 00000100:00100000:1.0:1784938441.276394:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337395072 00000100:00100000:1.0:1784938441.276502:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 313 00000100:00100000:1.0:1784938441.276512:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+269:17096:x1871643337395072:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938441.276538:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938441.276557:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9b8b3 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663afb expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.276619:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34c00/0x7b044d4128f9b8ba lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.276634:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34c00/0x7b044d4128f9b8ba lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.276646:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34c00/0x7b044d4128f9b8ba lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.276660:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9b8c1 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x267dbf88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.276667:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9b8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.276673:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9b8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.276714:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34c00/0x7b044d4128f9b8ba lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.276722:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34c00/0x7b044d4128f9b8ba lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.276726:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34c00/0x7b044d4128f9b8ba lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.276729:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34c00/0x7b044d4128f9b8ba lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.276733:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b34c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.276736:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34c00/0x7b044d4128f9b8ba lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.276741:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34c00/0x7b044d4128f9b8ba lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.276750:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.276753:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.276757:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34c00/0x7b044d4128f9b8ba lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.276764:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34c00/0x7b044d4128f9b8ba lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.276779:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9b8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.276785:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9b8c1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.276791:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9b8c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.276796:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b34200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.276799:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9b8c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.276804:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9b8c1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.276811:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x267dbf88 (ffff9f23823e2c00) 00010000:00010000:1.0:1784938441.276813:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.276815:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9b8c1 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.276821:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9b8c1 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.276853:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9b8b3 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663afb expref: 270 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.276863:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.276865:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.276868:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9b8b3 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663afb expref: 270 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.276874:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b35800, rc 0) 00000100:00100000:1.0:1784938441.276938:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+269:17096:x1871643337395072:12345-192.168.202.54@tcp:101:cp.0 Request processed in 429us (803us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938441.276943:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 313 00000100:00100000:3.0:1784938441.279241:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.283677:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.290363:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337395584 00000100:00100000:3.0:1784938441.290376:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337395584 00000100:00100000:3.0:1784938441.290454:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 538 00000100:00100000:3.0:1784938441.290466:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+82:10958:x1871643337395584:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938441.290492:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938441.290519:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa59b5dc/0x7b044d4128f9b900 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663b10 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938441.290548:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938441.290572:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4c:0x0].0x0 since=707s v=(0 0) 00010000:00010000:3.0:1784938441.290577:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938441.290588:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa59b5dc/0x7b044d4128f9b900 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b10 expref: 83 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.290606:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa59b5dc/0x7b044d4128f9b900 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b10 expref: 83 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.290620:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fd600, rc 0) 00000100:00100000:3.0:1784938441.290688:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+83:10958:x1871643337395584:12345-192.168.202.54@tcp:101:cp.0 Request processed in 224us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938441.290695:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 538 00000100:00100000:3.0:1784938441.296678:0:21152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337395712 00000100:00100000:3.0:1784938441.296689:0:21152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337395712 00000100:00100000:3.0:1784938441.296751:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 539 00000100:00100000:3.0:1784938441.296762:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+83:17096:x1871643337395712:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938441.296784:0:21152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938441.296805:0:21152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a53361ef/0x7b044d4128f9b907 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663b17 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.296853:0:21152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa59b5dc/0x7b044d4128f9b900 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b10 expref: 84 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.296863:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938441.296868:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938441.296874:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a53361ef/0x7b044d4128f9b907 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b17 expref: 84 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.296923:0:21152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fa59b5dc/0x7b044d4128f9b900 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663b10 expref: 84 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.296938:0:21152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fa59b5dc/0x7b044d4128f9b900 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663b10 expref: 84 pid: 21151 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938441.296952:0:21152:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:21152:1871643350831616:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938441.297032:0:21152:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238e8deb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938441.302851:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.303220:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337395840 00000100:00100000:1.0:1784938441.303229:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337395840 00010000:00010000:1.0:1784938441.303266:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fa59b5dc/0x7b044d4128f9b900 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663b10 expref: 84 pid: 21151 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938441.303304:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 220 00000100:00100000:1.0:1784938441.303313:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+84:10960:x1871643337395840:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938441.303328:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938441.303366:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fa59b5dc/0x7b044d4128f9b900 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663b10 expref: 84 pid: 21151 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.303379:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fa59b5dc/0x7b044d4128f9b900 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663b10 expref: 84 pid: 21151 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.303405:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa59b5dc/0x7b044d4128f9b900 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663b10 expref: 84 pid: 21151 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.303419:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938441.303423:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938441.303432:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a53361ef/0x7b044d4128f9b907 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663b17 expref: 83 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.303443:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a53361ef/0x7b044d4128f9b907 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663b17 expref: 83 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.303475:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a53361ef/0x7b044d4128f9b907 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663b17 expref: 83 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938441.303494:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2381d2bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350831744:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938441.303543:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248a7b1900 going to sleep for 11 seconds 00000100:00100000:1.0:1784938441.312544:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.312702:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2381d2bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350831744:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938441.312746:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938441.312815:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+83:10960:x1871643337395840:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 9501us (9985us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938441.312826:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 220 00000100:00100000:3.0:1784938441.317126:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.321599:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.327518:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:0.0:1784938441.327977:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039a00/0x7b044d4128f9b946 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0xd946e4d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.327985:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039a00/0x7b044d4128f9b946 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.327992:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039a00/0x7b044d4128f9b946 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938441.328454:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4c:0x0], index 1: 0 00010000:00010000:0.0:1784938441.328608:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039000/0x7b044d4128f9b94d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.328618:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039000/0x7b044d4128f9b94d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.328625:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039000/0x7b044d4128f9b94d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.328660:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9b93f lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.328668:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9b93f lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.328675:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9b93f lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.328681:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db7b000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938441.328686:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9b93f lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.328694:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9b93f lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.328712:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938441.328715:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938441.328720:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9b93f lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.328726:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9b93f lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938441.328738:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000574a4cd3 reply state 00000000595780f9 transno 8589934743 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039a00/0x7b044d4128f9b946 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.328749:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039a00/0x7b044d4128f9b946 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.328756:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xd946e4d2 (ffff9f24898dc700) 00010000:00010000:0.0:1784938441.328758:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938441.328760:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938441.328789:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ac00/0x7b044d4128f9b938 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b2c expref: 276 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.328805:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039000/0x7b044d4128f9b94d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b2c expref: 275 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.328812:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9f24898dc400) 00010000:00010000:0.0:1784938441.328815:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938441.328817:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382039000, rc 0) 00000100:00100000:0.0:1784938441.329017:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+276:17096:x1871643337396608:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1272us (1507us total) trans 8589934743 rc 0/0 00000100:00100000:0.0:1784938441.329026:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 318 00000100:00100000:0.0:1784938441.334530:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.334623:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337396736 00000100:00100000:2.0:1784938441.334632:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337396736 00000100:00100000:2.0:1784938441.334721:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 540 00000100:00100000:2.0:1784938441.334730:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+83:10959:x1871643337396736:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938441.334759:0:21149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938441.334787:0:21149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8714fdb/0x7b044d4128f9b95b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663b33 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938441.334812:0:21149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938441.334833:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4c:0x0].0x0 since=707s v=(0 0) 00010000:00010000:2.0:1784938441.334837:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938441.334846:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8714fdb/0x7b044d4128f9b95b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b33 expref: 84 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.334869:0:21149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b8714fdb/0x7b044d4128f9b95b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b33 expref: 84 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.334883:0:21149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217da00, rc 0) 00000100:00100000:2.0:1784938441.334945:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+84:10959:x1871643337396736:12345-192.168.202.54@tcp:101:cp.0 Request processed in 216us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938441.334952:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 540 00000100:00100000:3.0:1784938441.338280:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.339989:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337396864 00000100:00100000:1.0:1784938441.340005:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337396864 00000100:00100000:1.0:1784938441.340259:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 541 00000100:00100000:1.0:1784938441.340268:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+84:17096:x1871643337396864:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938441.340288:0:25715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938441.340307:0:25715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9e05033/0x7b044d4128f9b962 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663b3a expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.340338:0:25715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b8714fdb/0x7b044d4128f9b95b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b33 expref: 85 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.340360:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938441.340365:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938441.340371:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9e05033/0x7b044d4128f9b962 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b3a expref: 85 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.340404:0:25715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b8714fdb/0x7b044d4128f9b95b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663b33 expref: 85 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.340418:0:25715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b8714fdb/0x7b044d4128f9b95b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663b33 expref: 85 pid: 21149 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938441.340433:0:25715:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2381d29500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25715:1871643350831872:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938441.340516:0:25715:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248a7b1900 going to sleep for 11 seconds 00000100:00100000:3.0:1784938441.343657:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.343703:0:25715:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2381d29500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25715:1871643350831872:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938441.343780:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337396992 00000100:00100000:2.0:1784938441.343787:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337396992 00010000:00010000:2.0:1784938441.343830:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b8714fdb/0x7b044d4128f9b95b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663b33 expref: 86 pid: 21149 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938441.343877:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 221 00000100:00100000:2.0:1784938441.343888:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+86:10958:x1871643337396992:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938441.343915:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938441.343940:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b8714fdb/0x7b044d4128f9b95b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663b33 expref: 86 pid: 21149 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.343954:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b8714fdb/0x7b044d4128f9b95b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663b33 expref: 86 pid: 21149 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.343975:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8714fdb/0x7b044d4128f9b95b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663b33 expref: 86 pid: 21149 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.343998:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938441.344002:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938441.344010:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9e05033/0x7b044d4128f9b962 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b3a expref: 85 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.344019:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9e05033/0x7b044d4128f9b962 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b3a expref: 85 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.344066:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f9e05033/0x7b044d4128f9b962 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b3a expref: 85 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938441.344080:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f183480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350832000:192.168.202.54@tcp:105: 00000100:00100000:2.0:1784938441.344697:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b4068300 going to sleep for 11 seconds 00010000:00010000:1.0:1784938441.345504:0:25715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f9e05033/0x7b044d4128f9b962 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663b3a expref: 85 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.345521:0:25715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b35c00, rc 0) 00000100:00100000:1.0:1784938441.345575:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+85:17096:x1871643337396864:12345-192.168.202.54@tcp:101:cp.0 Request processed in 5307us (7302us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938441.345584:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 541 00000100:00100000:1.0:1784938441.346123:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f183480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350832000:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938441.346168:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938441.346200:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+84:10958:x1871643337396992:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 2314us (2554us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938441.346209:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 221 00000100:00100000:3.0:1784938441.350576:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.351476:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337397248 00000100:00100000:1.0:1784938441.351490:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337397248 00000100:00100000:1.0:1784938441.351604:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 43 00000100:00100000:1.0:1784938441.351615:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+276:17096:x1871643337397248:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:1.0:1784938441.353184:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+277:17096:x1871643337397248:12345-192.168.202.54@tcp:35:cp.0 Request processed in 1564us (2612us total) trans 8589934744 rc 0/0 00000100:00100000:1.0:1784938441.353196:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 43 00000100:00100000:2.0:1784938441.366666:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938441.366812:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337397376 00000100:00100000:0.0:1784938441.366824:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337397376 00000100:00100000:0.0:1784938441.366912:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 319 00000100:00100000:0.0:1784938441.366923:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+277:17096:x1871643337397376:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938441.366948:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938441.366969:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9b969 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663b41 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.367049:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ac00/0x7b044d4128f9b970 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.367065:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ac00/0x7b044d4128f9b970 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.367077:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ac00/0x7b044d4128f9b970 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.367092:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9b977 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x7584afcd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.367100:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9b977 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.367107:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9b977 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.367380:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ac00/0x7b044d4128f9b970 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.367389:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ac00/0x7b044d4128f9b970 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.367397:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ac00/0x7b044d4128f9b970 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.367403:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db7ac00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938441.367407:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ac00/0x7b044d4128f9b970 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.367416:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ac00/0x7b044d4128f9b970 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.367430:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938441.367434:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938441.367438:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ac00/0x7b044d4128f9b970 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.367445:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ac00/0x7b044d4128f9b970 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.367457:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9b977 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.367464:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9b977 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.367470:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9b977 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.367475:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db7be00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938441.367478:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9b977 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.367489:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9b977 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.367496:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x7584afcd (ffff9f24898dc900) 00010000:00010000:0.0:1784938441.367499:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938441.367502:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9b977 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.367508:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9b977 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.367544:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9b969 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b41 expref: 278 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.367555:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938441.367558:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938441.367561:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9b969 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b41 expref: 278 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.367571:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238db7b000, rc 0) 00000100:00100000:0.0:1784938441.367641:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+277:17096:x1871643337397376:12345-192.168.202.54@tcp:101:cp.0 Request processed in 719us (988us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938441.367648:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 319 00000100:00100000:0.0:1784938441.377101:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.377200:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337397504 00000100:00100000:3.0:1784938441.377211:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337397504 00000100:00100000:3.0:1784938441.377274:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 320 00000100:00100000:3.0:1784938441.377284:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+277:17096:x1871643337397504:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938441.377304:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938441.377324:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fce00/0x7b044d4128f9b97e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663b48 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.377395:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9b985 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.377411:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9b985 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.377423:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9b985 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.377437:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9b98c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x7584afcd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.377445:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9b98c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.377466:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9b98c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.377502:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9b985 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.377509:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9b985 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.377517:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9b985 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.377523:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fcc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938441.377528:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9b985 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.377535:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9b985 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.377546:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938441.377549:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.377554:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9b985 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.377560:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9b985 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.377571:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9b98c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.377578:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9b98c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.377589:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9b98c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.377594:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fc800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938441.377597:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9b98c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.377603:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9b98c lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.377611:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x7584afcd (ffff9f238dd49000) 00010000:00010000:3.0:1784938441.377613:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.377616:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9b98c lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.377622:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9b98c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.377652:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fce00/0x7b044d4128f9b97e lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b48 expref: 278 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.377662:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938441.377665:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.377668:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fce00/0x7b044d4128f9b97e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b48 expref: 278 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.377677:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fce00, rc 0) 00000100:00100000:3.0:1784938441.377738:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+277:17096:x1871643337397504:12345-192.168.202.54@tcp:101:cp.0 Request processed in 456us (647us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938441.377753:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 320 00000100:00100000:3.0:1784938441.381634:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938441.381831:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337397760 00000100:00100000:0.0:1784938441.381842:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337397760 00000100:00100000:0.0:1784938441.381943:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 321 00000100:00100000:0.0:1784938441.381954:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+277:17096:x1871643337397760:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938441.381982:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938441.382007:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9b993 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663b4f expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.382128:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9b99a lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.382453:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9b99a lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.382468:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9b99a lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.382486:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ac00/0x7b044d4128f9b9a1 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x7584afcd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.382493:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ac00/0x7b044d4128f9b9a1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.382500:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ac00/0x7b044d4128f9b9a1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938441.382800:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4d:0x0], index 0: 0 00010000:00010000:0.0:1784938441.382950:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28a00/0x7b044d4128f9b9a8 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.382960:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28a00/0x7b044d4128f9b9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.382967:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28a00/0x7b044d4128f9b9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.383010:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9b99a lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.383018:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9b99a lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.383023:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9b99a lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.383029:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db7be00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938441.383033:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9b99a lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.383040:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9b99a lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.383054:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938441.383057:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938441.383061:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9b99a lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.383067:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9b99a lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938441.383080:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000088f700e9 reply state 00000000bf98ad5c transno 8589934745 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ac00/0x7b044d4128f9b9a1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.383090:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ac00/0x7b044d4128f9b9a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.383097:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x7584afcd (ffff9f24898dc900) 00010000:00010000:0.0:1784938441.383099:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938441.383102:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938441.383131:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9b993 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b4f expref: 280 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.384020:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28a00/0x7b044d4128f9b9a8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b4f expref: 279 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.384032:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x19:0x0].0x0 (ffff9f24898dca00) 00010000:00010000:0.0:1784938441.384034:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938441.384038:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24c5b28a00, rc 0) 00000100:00100000:0.0:1784938441.384999:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+280:17096:x1871643337397760:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2190us (2519us total) trans 8589934745 rc 0/0 00000100:00100000:0.0:1784938441.385015:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 321 00000100:00100000:3.0:1784938441.388026:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.388081:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337397888 00000100:00100000:3.0:1784938441.388092:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337397888 00000100:00100000:3.0:1784938441.388192:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 542 00000100:00100000:3.0:1784938441.388203:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+83:10958:x1871643337397888:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938441.388226:0:21629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938441.388249:0:21629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa59b5dc/0x7b044d4128f9b9b6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663b56 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938441.388275:0:21629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938441.388295:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4d:0x0].0x0 since=707s v=(0 0) 00010000:00010000:3.0:1784938441.388299:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938441.388309:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa59b5dc/0x7b044d4128f9b9b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b56 expref: 84 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.388326:0:21629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa59b5dc/0x7b044d4128f9b9b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b56 expref: 84 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.388350:0:21629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fd600, rc 0) 00000100:00100000:3.0:1784938441.388404:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+84:10958:x1871643337397888:12345-192.168.202.54@tcp:101:cp.0 Request processed in 202us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938441.388412:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 542 00000100:00100000:3.0:1784938441.396060:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.396441:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337398016 00000100:00100000:2.0:1784938441.396452:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337398016 00000100:00100000:2.0:1784938441.396513:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 543 00000100:00100000:2.0:1784938441.396523:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+84:17096:x1871643337398016:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938441.396543:0:21149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938441.396562:0:21149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051a08011/0x7b044d4128f9b9bd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663b5d expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.396597:0:21149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa59b5dc/0x7b044d4128f9b9b6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b56 expref: 85 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.396611:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938441.396615:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938441.396620:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051a08011/0x7b044d4128f9b9bd lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b5d expref: 85 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.396654:0:21149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fa59b5dc/0x7b044d4128f9b9b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663b56 expref: 85 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.396668:0:21149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fa59b5dc/0x7b044d4128f9b9b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663b56 expref: 85 pid: 21629 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938441.396682:0:21149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f228000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:21149:1871643350832128:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938441.396771:0:21149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b40686c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938441.400533:0:21149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f228000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:21149:1871643350832128:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938441.400576:0:21149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000051a08011/0x7b044d4128f9b9bd lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663b5d expref: 85 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.400599:0:21149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217c600, rc 0) 00000100:00100000:2.0:1784938441.400674:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+85:17096:x1871643337398016:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4151us (4632us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938441.400683:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 543 00000100:00100000:2.0:1784938441.403592:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938441.403703:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337398144 00000100:00100000:0.0:1784938441.403715:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337398144 00010000:00010000:0.0:1784938441.403760:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fa59b5dc/0x7b044d4128f9b9b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663b56 expref: 85 pid: 21629 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938441.403808:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 222 00000100:00100000:0.0:1784938441.403828:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f228000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+85:10960:x1871643337398144:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938441.403844:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938441.403864:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fa59b5dc/0x7b044d4128f9b9b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663b56 expref: 85 pid: 21629 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.403879:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fa59b5dc/0x7b044d4128f9b9b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663b56 expref: 85 pid: 21629 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.403919:0:22955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa59b5dc/0x7b044d4128f9b9b6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663b56 expref: 85 pid: 21629 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.403938:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938441.403943:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938441.403951:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000051a08011/0x7b044d4128f9b9bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663b5d expref: 84 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.403961:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051a08011/0x7b044d4128f9b9bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663b5d expref: 84 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.403999:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000051a08011/0x7b044d4128f9b9bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663b5d expref: 84 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938441.404014:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd55f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350832256:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938441.404118:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b6a64e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784938441.407542:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd55f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350832256:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938441.407570:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938441.407629:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f228000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+84:10960:x1871643337398144:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3803us (4048us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938441.407642:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 222 00000100:00100000:1.0:1784938441.411067:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.411191:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337398400 00000100:00100000:3.0:1784938441.411201:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337398400 00000100:00100000:3.0:1784938441.411250:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 44 00000100:00100000:3.0:1784938441.411259:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+280:17096:x1871643337398400:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938441.411570:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+281:17096:x1871643337398400:12345-192.168.202.54@tcp:35:cp.0 Request processed in 311us (511us total) trans 8589934746 rc 0/0 00000100:00100000:3.0:1784938441.411579:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 44 00000100:00100000:2.0:1784938441.415115:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.415737:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337398528 00000100:00100000:3.0:1784938441.415748:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337398528 00000100:00100000:3.0:1784938441.415860:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 322 00000100:00100000:3.0:1784938441.415871:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+281:17096:x1871643337398528:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938441.415896:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938441.415929:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9b9c4 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663b64 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.416019:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b9cb lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.416047:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b9cb lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.416059:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b9cb lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.416076:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9b9d2 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xf4c8ca43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.416083:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9b9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.416102:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9b9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.416374:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b9cb lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.416382:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b9cb lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.416388:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b9cb lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.416394:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d01800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938441.416398:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b9cb lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.416405:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b9cb lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.416418:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938441.416422:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.416427:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b9cb lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.416433:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9b9cb lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.416447:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9b9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.416454:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9b9d2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.416467:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9b9d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.416473:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fd600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938441.416477:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9b9d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.416484:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9b9d2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.416492:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xf4c8ca43 (ffff9f238dd49000) 00010000:00010000:3.0:1784938441.416495:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.416498:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9b9d2 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.416504:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9b9d2 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.416537:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9b9c4 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b64 expref: 282 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.416548:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938441.416550:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.416554:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9b9c4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b64 expref: 282 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.416564:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d00a00, rc 0) 00000100:00100000:3.0:1784938441.416635:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+281:17096:x1871643337398528:12345-192.168.202.54@tcp:101:cp.0 Request processed in 765us (1531us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938441.416651:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 322 00000100:00100000:1.0:1784938441.419786:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938441.419888:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337398656 00000100:00100000:0.0:1784938441.419898:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337398656 00000100:00100000:0.0:1784938441.419976:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 323 00000100:00100000:0.0:1784938441.419987:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+281:17096:x1871643337398656:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938441.420008:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938441.420031:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9b9d9 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663b6b expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.420108:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9b9e0 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.420130:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9b9e0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.420141:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9b9e0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.420201:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238b600/0x7b044d4128f9b9e7 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xf4c8ca43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.420208:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238b600/0x7b044d4128f9b9e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.420216:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238b600/0x7b044d4128f9b9e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.420254:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9b9e0 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.420262:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9b9e0 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.420269:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9b9e0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.420279:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9b9e0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.420285:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db7be00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938441.420291:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9b9e0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.420299:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9b9e0 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.420309:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938441.420312:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938441.420317:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9b9e0 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.420323:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9b9e0 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.420337:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238b600/0x7b044d4128f9b9e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.420356:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238b600/0x7b044d4128f9b9e7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.420361:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238b600/0x7b044d4128f9b9e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.420366:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238238b600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938441.420368:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238b600/0x7b044d4128f9b9e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.420379:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238b600/0x7b044d4128f9b9e7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.420386:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xf4c8ca43 (ffff9f24898dcd00) 00010000:00010000:0.0:1784938441.420388:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938441.420391:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238b600/0x7b044d4128f9b9e7 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.420396:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238b600/0x7b044d4128f9b9e7 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.420427:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9b9d9 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b6b expref: 282 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.420438:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938441.420441:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938441.420444:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9b9d9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b6b expref: 282 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.420453:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238db7b000, rc 0) 00000100:00100000:0.0:1784938441.420518:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+281:17096:x1871643337398656:12345-192.168.202.54@tcp:101:cp.0 Request processed in 533us (745us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938441.420527:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 323 00000100:00100000:1.0:1784938441.424102:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938441.424395:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337398912 00000100:00100000:0.0:1784938441.424404:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337398912 00000100:00100000:0.0:1784938441.424462:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 324 00000100:00100000:0.0:1784938441.424473:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+281:17096:x1871643337398912:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938441.424498:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938441.424518:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9b9ee lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663b72 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.424620:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9b9f5 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.424634:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9b9f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.424645:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9b9f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.424658:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379c000/0x7b044d4128f9b9fc lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0xf4c8ca43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.424665:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379c000/0x7b044d4128f9b9fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.424671:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379c000/0x7b044d4128f9b9fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938441.424976:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4d:0x0], index 1: 0 00010000:00010000:0.0:1784938441.425107:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379d600/0x7b044d4128f9ba03 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.425117:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379d600/0x7b044d4128f9ba03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.425658:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379d600/0x7b044d4128f9ba03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.425847:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9b9f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.425855:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9b9f5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.425861:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9b9f5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.425867:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b379ca00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938441.425871:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9b9f5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.425878:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9b9f5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.425891:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938441.425894:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938441.425910:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9b9f5 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.425916:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9b9f5 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938441.425931:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fa7b2af0 reply state 00000000faf8b931 transno 8589934747 ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379c000/0x7b044d4128f9b9fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.425942:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379c000/0x7b044d4128f9b9fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.425949:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xf4c8ca43 (ffff9f24898dcc00) 00010000:00010000:2.0:1784938441.425952:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938441.425955:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938441.425989:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9b9ee lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b72 expref: 284 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.426005:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379d600/0x7b044d4128f9ba03 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b72 expref: 283 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.426013:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1a:0x0].0x0 (ffff9f24898dc600) 00010000:00010000:2.0:1784938441.426015:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938441.426018:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b379d600, rc 0) 00000100:00100000:2.0:1784938441.426103:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+284:17096:x1871643337398912:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1631us (2010us total) trans 8589934747 rc 0/0 00000100:00100000:2.0:1784938441.426113:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 324 00000100:00100000:3.0:1784938441.432578:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938441.432682:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337399040 00000100:00100000:0.0:1784938441.432693:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337399040 00000100:00100000:0.0:1784938441.432784:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 544 00000100:00100000:0.0:1784938441.432796:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+84:10960:x1871643337399040:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938441.432816:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938441.432838:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000993f7fed/0x7b044d4128f9ba11 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663b79 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938441.432865:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938441.432887:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4d:0x0].0x0 since=707s v=(0 0) 00010000:00010000:0.0:1784938441.432891:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938441.432911:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000993f7fed/0x7b044d4128f9ba11 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b79 expref: 85 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.432929:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000993f7fed/0x7b044d4128f9ba11 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b79 expref: 85 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.432943:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b379dc00, rc 0) 00000100:00100000:0.0:1784938441.433007:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+85:10960:x1871643337399040:12345-192.168.202.54@tcp:101:cp.0 Request processed in 211us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938441.433014:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 544 00000100:00100000:1.0:1784938441.436891:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.436992:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337399168 00000100:00100000:3.0:1784938441.437003:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337399168 00000100:00100000:3.0:1784938441.437073:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 545 00000100:00100000:3.0:1784938441.437084:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+85:17096:x1871643337399168:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938441.437105:0:21629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938441.437136:0:21629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000548150d6/0x7b044d4128f9ba18 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663b80 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.437212:0:21629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000993f7fed/0x7b044d4128f9ba11 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b79 expref: 86 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.437223:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938441.437228:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938441.437234:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000548150d6/0x7b044d4128f9ba18 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b80 expref: 86 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.437270:0:21629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000993f7fed/0x7b044d4128f9ba11 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663b79 expref: 86 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.437287:0:21629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000993f7fed/0x7b044d4128f9ba11 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663b79 expref: 86 pid: 21151 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938441.437302:0:21629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:21629:1871643350832384:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938441.437434:0:21629:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238e8dec00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938441.441579:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.441848:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337399296 00000100:00100000:3.0:1784938441.441858:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337399296 00010000:00010000:3.0:1784938441.441911:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000993f7fed/0x7b044d4128f9ba11 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663b79 expref: 87 pid: 21151 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938441.441995:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 223 00000100:00100000:3.0:1784938441.442005:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248a94b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+87:10957:x1871643337399296:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938441.442023:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938441.442054:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000993f7fed/0x7b044d4128f9ba11 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663b79 expref: 87 pid: 21151 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.442068:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000993f7fed/0x7b044d4128f9ba11 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663b79 expref: 87 pid: 21151 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.442093:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938441.442098:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938441.442107:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000548150d6/0x7b044d4128f9ba18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b80 expref: 87 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.442117:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000548150d6/0x7b044d4128f9ba18 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b80 expref: 87 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.442528:0:19220:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000548150d6/0x7b044d4128f9ba18 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b80 expref: 87 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938441.442568:0:19220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:19220:1871643350832512:192.168.202.54@tcp:105: 00000100:00100000:3.0:1784938441.442661:0:19220:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238e8de300 going to sleep for 11 seconds 00000100:00100000:3.0:1784938441.445101:0:19220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:19220:1871643350832512:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938441.445137:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938441.445221:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248a94b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+87:10957:x1871643337399296:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3216us (3650us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938441.445232:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 223 00010000:00010000:0.0:1784938441.446390:0:21629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000993f7fed/0x7b044d4128f9ba11 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663b79 expref: 86 pid: 21151 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938441.446413:0:21629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:21629:1871643350832384:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938441.446440:0:21629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000548150d6/0x7b044d4128f9ba18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663b80 expref: 85 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.446457:0:21629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fce00, rc 0) 00000100:00100000:1.0:1784938441.446603:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+85:17096:x1871643337399168:12345-192.168.202.54@tcp:101:cp.0 Request processed in 9519us (9723us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938441.446612:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 545 00010000:00010000:2.0:1784938441.448482:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938441.450199:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.450362:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337399552 00000100:00100000:1.0:1784938441.450373:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337399552 00000100:00100000:1.0:1784938441.450436:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 45 00000100:00100000:1.0:1784938441.450447:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24857f8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+284:17096:x1871643337399552:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:1.0:1784938441.450738:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24857f8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+285:17096:x1871643337399552:12345-192.168.202.54@tcp:35:cp.0 Request processed in 292us (548us total) trans 8589934748 rc 0/0 00000100:00100000:1.0:1784938441.450745:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 45 00000100:00100000:2.0:1784938441.455333:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938441.455418:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337399680 00000100:00100000:0.0:1784938441.455428:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337399680 00000100:00100000:0.0:1784938441.455477:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 325 00000100:00100000:0.0:1784938441.455486:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+285:17096:x1871643337399680:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938441.455509:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938441.455530:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379dc00/0x7b044d4128f9ba1f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663b87 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.455616:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9ba26 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.455632:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9ba26 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.455643:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9ba26 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.455657:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9ba2d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x130bf32a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.455663:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9ba2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.455670:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9ba2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.455712:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9ba26 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.455720:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9ba26 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.455726:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9ba26 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.455732:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9ba26 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.455738:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b379ca00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938441.455742:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9ba26 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.455749:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9ba26 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.455760:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938441.455763:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938441.455767:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9ba26 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.455773:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9ba26 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.455786:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9ba2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.455792:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9ba2d lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.455799:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9ba2d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.455804:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238238a000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938441.455807:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9ba2d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.455813:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9ba2d lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.455818:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x130bf32a (ffff9f24898dce00) 00010000:00010000:0.0:1784938441.455820:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938441.455823:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9ba2d lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.455828:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9ba2d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.455860:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379dc00/0x7b044d4128f9ba1f lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b87 expref: 286 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.455870:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938441.455871:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938441.455875:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379dc00/0x7b044d4128f9ba1f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b87 expref: 286 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.455885:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b379dc00, rc 0) 00000100:00100000:0.0:1784938441.456043:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+285:17096:x1871643337399680:12345-192.168.202.54@tcp:101:cp.0 Request processed in 556us (914us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938441.456054:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 325 00000100:00100000:2.0:1784938441.459729:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.459822:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337399808 00000100:00100000:3.0:1784938441.459834:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337399808 00000100:00100000:3.0:1784938441.459897:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 326 00000100:00100000:3.0:1784938441.459908:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+285:17096:x1871643337399808:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938441.459932:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938441.459959:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9ba34 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663b8e expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.460045:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9ba3b lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.460061:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9ba3b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.460073:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9ba3b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.460089:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9ba42 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x130bf32a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.460120:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9ba42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.460141:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9ba42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.460521:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9ba3b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.460528:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9ba3b lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.460534:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9ba3b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.460540:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fc800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938441.460544:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9ba3b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.460554:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9ba3b lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.460567:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938441.460571:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.460576:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9ba3b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.460582:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9ba3b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.460595:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9ba42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.460609:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9ba42 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.460615:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9ba42 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.460621:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fcc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938441.460625:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9ba42 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.460632:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9ba42 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.460641:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x130bf32a (ffff9f238dd49000) 00010000:00010000:3.0:1784938441.460644:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.460648:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9ba42 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.460655:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9ba42 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.460693:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9ba34 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b8e expref: 286 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.460704:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938441.460707:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.460710:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9ba34 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b8e expref: 286 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.460733:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fd600, rc 0) 00000100:00100000:3.0:1784938441.460811:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+285:17096:x1871643337399808:12345-192.168.202.54@tcp:101:cp.0 Request processed in 904us (1090us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938441.460819:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 326 00000100:00100000:3.0:1784938441.464360:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.464499:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337400064 00000100:00100000:2.0:1784938441.464510:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337400064 00000100:00100000:2.0:1784938441.464579:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 327 00000100:00100000:2.0:1784938441.464589:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+285:17096:x1871643337400064:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938441.464613:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938441.464638:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217da00/0x7b044d4128f9ba49 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663b95 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.464744:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9ba50 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.464760:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9ba50 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.464772:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9ba50 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.464787:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394c00/0x7b044d4128f9ba57 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x130bf32a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.464794:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394c00/0x7b044d4128f9ba57 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.464802:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394c00/0x7b044d4128f9ba57 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938441.465353:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4e:0x0], index 0: 0 00010000:00010000:2.0:1784938441.465508:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394e00/0x7b044d4128f9ba5e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.465519:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394e00/0x7b044d4128f9ba5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.465527:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394e00/0x7b044d4128f9ba5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.465558:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9ba50 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.465565:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9ba50 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.465572:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9ba50 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.465578:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217cc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938441.465583:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9ba50 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.465591:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9ba50 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.465602:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938441.465605:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938441.465609:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9ba50 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.465615:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9ba50 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938441.465628:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004386deb3 reply state 0000000081e769ef transno 8589934749 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394c00/0x7b044d4128f9ba57 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.465639:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394c00/0x7b044d4128f9ba57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.465644:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x130bf32a (ffff9f248fb6bd00) 00010000:00010000:2.0:1784938441.465647:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938441.465649:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938441.465680:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217da00/0x7b044d4128f9ba49 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b95 expref: 288 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.465694:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394e00/0x7b044d4128f9ba5e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b95 expref: 287 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.465701:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1b:0x0].0x0 (ffff9f248fb6c100) 00010000:00010000:2.0:1784938441.465704:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938441.465707:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382394e00, rc 0) 00000100:00100000:2.0:1784938441.465777:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+288:17096:x1871643337400064:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1190us (1437us total) trans 8589934749 rc 0/0 00000100:00100000:2.0:1784938441.465786:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 327 00000100:00100000:1.0:1784938441.470139:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938441.470480:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337400192 00000100:00100000:0.0:1784938441.470491:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337400192 00000100:00100000:0.0:1784938441.470547:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 546 00000100:00100000:0.0:1784938441.470557:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+84:10958:x1871643337400192:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938441.470578:0:25716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938441.470601:0:25716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a08444a1/0x7b044d4128f9ba6c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663b9c expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938441.470625:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938441.470645:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4e:0x0].0x0 since=707s v=(0 0) 00010000:00010000:0.0:1784938441.470649:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938441.470658:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a08444a1/0x7b044d4128f9ba6c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b9c expref: 85 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.470674:0:25716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a08444a1/0x7b044d4128f9ba6c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b9c expref: 85 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.470688:0:25716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238238a000, rc 0) 00000100:00100000:0.0:1784938441.470753:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+85:10958:x1871643337400192:12345-192.168.202.54@tcp:101:cp.0 Request processed in 197us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938441.470760:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 546 00000100:00100000:3.0:1784938441.474704:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938441.474924:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337400320 00000100:00100000:0.0:1784938441.474934:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337400320 00000100:00100000:0.0:1784938441.474998:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 547 00000100:00100000:0.0:1784938441.475007:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+85:17096:x1871643337400320:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938441.475026:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938441.475056:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087694d84/0x7b044d4128f9ba73 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663ba3 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.475087:0:21151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a08444a1/0x7b044d4128f9ba6c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b9c expref: 86 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.475096:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938441.475100:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938441.475105:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087694d84/0x7b044d4128f9ba73 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ba3 expref: 86 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.475138:0:21151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a08444a1/0x7b044d4128f9ba6c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663b9c expref: 86 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.475376:0:21151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a08444a1/0x7b044d4128f9ba6c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663b9c expref: 86 pid: 25716 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938441.475391:0:21151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd55f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:21151:1871643350832640:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938441.475476:0:21151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b6a64780 going to sleep for 11 seconds 00000100:00100000:3.0:1784938441.479012:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938441.479427:0:21151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd55f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:21151:1871643350832640:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938441.479463:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000087694d84/0x7b044d4128f9ba73 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663ba3 expref: 86 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.479486:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238238b600, rc 0) 00000100:00100000:0.0:1784938441.479554:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+86:17096:x1871643337400320:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4548us (4862us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938441.479564:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 547 00000100:00100000:1.0:1784938441.481099:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337400448 00000100:00100000:1.0:1784938441.481111:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337400448 00010000:00010000:1.0:1784938441.481377:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a08444a1/0x7b044d4128f9ba6c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663b9c expref: 86 pid: 25716 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938441.481473:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 224 00000100:00100000:1.0:1784938441.481482:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+86:10960:x1871643337400448:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938441.481498:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938441.481520:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a08444a1/0x7b044d4128f9ba6c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663b9c expref: 86 pid: 25716 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.481533:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a08444a1/0x7b044d4128f9ba6c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663b9c expref: 86 pid: 25716 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.481560:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a08444a1/0x7b044d4128f9ba6c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663b9c expref: 86 pid: 25716 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.481577:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938441.481582:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938441.481590:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087694d84/0x7b044d4128f9ba73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663ba3 expref: 85 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.481601:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087694d84/0x7b044d4128f9ba73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663ba3 expref: 85 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.481643:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000087694d84/0x7b044d4128f9ba73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663ba3 expref: 85 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938441.481656:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd5a5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350832768:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938441.481749:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24831b4540 going to sleep for 11 seconds 00000100:00100000:3.0:1784938441.485750:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.485845:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd5a5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350832768:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938441.485871:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938441.485940:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+85:10960:x1871643337400448:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 4457us (6936us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938441.485949:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 224 00000100:00100000:0.0:1784938441.486080:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337400704 00000100:00100000:0.0:1784938441.486088:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337400704 00000100:00100000:0.0:1784938441.486140:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 46 00000100:00100000:0.0:1784938441.486182:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+288:17096:x1871643337400704:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:0.0:1784938441.486465:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+289:17096:x1871643337400704:12345-192.168.202.54@tcp:35:cp.0 Request processed in 292us (726us total) trans 8589934750 rc 0/0 00000100:00100000:0.0:1784938441.486472:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 46 00000100:00100000:2.0:1784938441.490954:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.491400:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337400832 00000100:00100000:3.0:1784938441.491411:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337400832 00000100:00100000:3.0:1784938441.491471:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 328 00000100:00100000:3.0:1784938441.491481:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+289:17096:x1871643337400832:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938441.491508:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938441.491530:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9ba7a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663baa expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.491601:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9ba81 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.491616:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9ba81 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.491629:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9ba81 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.491643:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9ba88 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe00215d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.491666:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9ba88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.491674:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9ba88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.491713:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9ba81 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.491720:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9ba81 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.491726:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9ba81 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.491732:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d01800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938441.491736:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9ba81 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.491743:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9ba81 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.491755:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938441.491758:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.491763:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9ba81 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.491769:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9ba81 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.491782:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9ba88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.491795:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9ba88 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.491801:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9ba88 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.491806:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fd600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938441.491809:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9ba88 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.491814:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9ba88 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.491822:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xe00215d9 (ffff9f238dd49000) 00010000:00010000:3.0:1784938441.491824:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.491827:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9ba88 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.491833:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9ba88 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.491864:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9ba7a lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663baa expref: 290 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.491873:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938441.491875:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.491879:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9ba7a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663baa expref: 290 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.491899:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d00a00, rc 0) 00000100:00100000:3.0:1784938441.491968:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+289:17096:x1871643337400832:12345-192.168.202.54@tcp:101:cp.0 Request processed in 488us (1023us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938441.491976:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 328 00000100:00100000:3.0:1784938441.495556:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.495662:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337400960 00000100:00100000:2.0:1784938441.495671:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337400960 00000100:00100000:2.0:1784938441.495737:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 329 00000100:00100000:2.0:1784938441.495747:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+289:17096:x1871643337400960:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938441.495767:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938441.495787:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395e00/0x7b044d4128f9ba8f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663bb1 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.495851:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9ba96 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.495866:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9ba96 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.495877:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9ba96 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.495892:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395600/0x7b044d4128f9ba9d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe00215d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.495910:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395600/0x7b044d4128f9ba9d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.495917:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395600/0x7b044d4128f9ba9d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.495961:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9ba96 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.495968:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9ba96 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.495974:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9ba96 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.495979:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938441.495983:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9ba96 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.495990:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9ba96 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.496001:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938441.496004:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938441.496008:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9ba96 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.496014:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9ba96 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.496029:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395600/0x7b044d4128f9ba9d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.496035:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395600/0x7b044d4128f9ba9d lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.496041:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395600/0x7b044d4128f9ba9d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.496046:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382395600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938441.496049:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395600/0x7b044d4128f9ba9d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.496055:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395600/0x7b044d4128f9ba9d lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.496062:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xe00215d9 (ffff9f23872e6e00) 00010000:00010000:2.0:1784938441.496064:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938441.496067:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395600/0x7b044d4128f9ba9d lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.496072:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395600/0x7b044d4128f9ba9d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.496105:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395e00/0x7b044d4128f9ba8f lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663bb1 expref: 290 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.496114:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938441.496116:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938441.496119:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395e00/0x7b044d4128f9ba8f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663bb1 expref: 290 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.496296:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382395e00, rc 0) 00000100:00100000:2.0:1784938441.496372:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+289:17096:x1871643337400960:12345-192.168.202.54@tcp:101:cp.0 Request processed in 626us (825us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938441.496380:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 329 00000100:00100000:0.0:1784938441.499684:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.499925:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337401216 00000100:00100000:3.0:1784938441.499936:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337401216 00000100:00100000:3.0:1784938441.500002:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 330 00000100:00100000:3.0:1784938441.500013:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+289:17096:x1871643337401216:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938441.500045:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938441.500070:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9baa4 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663bb8 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.500231:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9baab lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.500247:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9baab lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.500258:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9baab lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.500273:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9bab2 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0xe00215d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.500280:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9bab2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.500308:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9bab2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938441.500649:0:24203:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4e:0x0], index 1: 0 00010000:00010000:3.0:1784938441.500779:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9bab9 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.500788:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9bab9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.500796:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9bab9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.500826:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9baab lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.500833:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9baab lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.500840:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9baab lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.500846:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fd600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938441.500850:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9baab lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.500858:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9baab lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.500872:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938441.500875:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.500890:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9baab lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.500897:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9baab lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938441.500912:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b1977437 reply state 00000000236da8c1 transno 8589934751 ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9bab2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.500925:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9bab2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.500931:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xe00215d9 (ffff9f238dd49000) 00010000:00010000:3.0:1784938441.500934:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938441.500936:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938441.500965:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9baa4 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663bb8 expref: 292 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.500980:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9bab9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663bb8 expref: 291 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.500988:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1c:0x0].0x0 (ffff9f238dd49b00) 00010000:00010000:3.0:1784938441.500991:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938441.500993:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d00a00, rc 0) 00000100:00100000:3.0:1784938441.501072:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+292:17096:x1871643337401216:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1060us (1399us total) trans 8589934751 rc 0/0 00000100:00100000:3.0:1784938441.501082:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 330 00000100:00100000:3.0:1784938441.506378:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938441.506559:0:21152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337401344 00000100:00100000:0.0:1784938441.506570:0:21152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337401344 00000100:00100000:0.0:1784938441.506628:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 548 00000100:00100000:0.0:1784938441.506638:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381361c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+85:10960:x1871643337401344:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938441.506662:0:21152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938441.506691:0:21152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a08444a1/0x7b044d4128f9bac7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663bbf expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938441.506728:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938441.506762:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4e:0x0].0x0 since=707s v=(0 0) 00010000:00010000:0.0:1784938441.506768:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938441.506780:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a08444a1/0x7b044d4128f9bac7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663bbf expref: 86 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.506799:0:21152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a08444a1/0x7b044d4128f9bac7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663bbf expref: 86 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.506814:0:21152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238238a000, rc 0) 00000100:00100000:0.0:1784938441.506885:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381361c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+86:10960:x1871643337401344:12345-192.168.202.54@tcp:101:cp.0 Request processed in 248us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938441.506893:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 548 00000100:00100000:0.0:1784938441.519515:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.519685:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337401472 00000100:00100000:2.0:1784938441.519696:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337401472 00000100:00100000:2.0:1784938441.519763:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 549 00000100:00100000:2.0:1784938441.519775:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+86:17096:x1871643337401472:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938441.519795:0:25716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938441.519815:0:25716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c6719e5/0x7b044d4128f9bace lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663bc6 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.519861:0:25716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a08444a1/0x7b044d4128f9bac7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663bbf expref: 87 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.519871:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938441.519875:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938441.519881:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c6719e5/0x7b044d4128f9bace lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->57343] (req 0->57343) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663bc6 expref: 87 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.519927:0:25716:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a08444a1/0x7b044d4128f9bac7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663bbf expref: 87 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.519941:0:25716:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a08444a1/0x7b044d4128f9bac7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663bbf expref: 87 pid: 21152 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938441.519955:0:25716:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f19aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25716:1871643350832896:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938441.520042:0:25716:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b4068300 going to sleep for 11 seconds 00000100:00100000:0.0:1784938441.527513:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.527692:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337401600 00000100:00100000:1.0:1784938441.527701:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337401600 00010000:00010000:1.0:1784938441.527738:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a08444a1/0x7b044d4128f9bac7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663bbf expref: 88 pid: 21152 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938441.527775:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 225 00000100:00100000:1.0:1784938441.527783:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+88:10957:x1871643337401600:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938441.527798:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938441.527819:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a08444a1/0x7b044d4128f9bac7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663bbf expref: 88 pid: 21152 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.527843:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a08444a1/0x7b044d4128f9bac7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663bbf expref: 88 pid: 21152 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.527869:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938441.527874:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938441.527883:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c6719e5/0x7b044d4128f9bace lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663bc6 expref: 88 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.527893:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c6719e5/0x7b044d4128f9bace lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663bc6 expref: 88 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.527934:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002c6719e5/0x7b044d4128f9bace lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663bc6 expref: 88 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938441.527948:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd5a5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350833024:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938441.528026:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24831b4540 going to sleep for 11 seconds 00010000:00010000:2.0:1784938441.529547:0:25716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a08444a1/0x7b044d4128f9bac7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663bbf expref: 88 pid: 21152 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938441.529574:0:25716:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f19aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25716:1871643350832896:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938441.529603:0:25716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c6719e5/0x7b044d4128f9bace lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663bc6 expref: 87 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.529615:0:25716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382395e00, rc 0) 00000100:00100000:2.0:1784938441.529675:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+87:17096:x1871643337401472:12345-192.168.202.54@tcp:101:cp.0 Request processed in 9902us (10169us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938441.529682:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 549 00000100:00100000:1.0:1784938441.532866:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd5a5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350833024:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938441.532891:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938441.532951:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+86:10957:x1871643337401600:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 5167us (5447us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938441.532961:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 225 00000100:00100000:3.0:1784938441.537310:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.537472:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337401856 00000100:00100000:2.0:1784938441.537482:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337401856 00000100:00100000:2.0:1784938441.537543:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00100000:2.0:1784938441.537553:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+292:17096:x1871643337401856:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:2.0:1784938441.537864:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+293:17096:x1871643337401856:12345-192.168.202.54@tcp:35:cp.0 Request processed in 311us (562us total) trans 8589934752 rc 0/0 00000100:00100000:2.0:1784938441.537872:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00100000:0.0:1784938441.559233:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.559719:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337401984 00000100:00100000:2.0:1784938441.559730:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337401984 00000100:00100000:2.0:1784938441.559793:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 331 00000100:00100000:2.0:1784938441.559803:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+293:17096:x1871643337401984:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938441.559837:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938441.559857:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395600/0x7b044d4128f9bad5 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663bcd expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.559927:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9badc lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.559944:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9badc lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.559954:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9badc lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.559966:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bae3 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x868dff87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.559972:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bae3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.559978:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bae3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.560016:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9badc lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.560024:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9badc lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.560030:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9badc lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.560037:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938441.560041:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9badc lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.560048:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9badc lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.560060:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938441.560064:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938441.560069:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9badc lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.560076:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394600/0x7b044d4128f9badc lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.560088:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bae3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.560095:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bae3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.560101:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bae3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.560106:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938441.560108:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bae3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.560115:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bae3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.560122:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x868dff87 (ffff9f23872e6e00) 00010000:00010000:2.0:1784938441.560136:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938441.560586:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bae3 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.560595:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bae3 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.560632:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395600/0x7b044d4128f9bad5 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663bcd expref: 294 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.560643:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938441.560645:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938441.560649:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395600/0x7b044d4128f9bad5 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663bcd expref: 294 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.560660:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382395600, rc 0) 00000100:00100000:2.0:1784938441.560726:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+293:17096:x1871643337401984:12345-192.168.202.54@tcp:101:cp.0 Request processed in 923us (1503us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938441.560734:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 331 00000100:00100000:3.0:1784938441.573418:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938441.574121:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337402112 00000100:00100000:0.0:1784938441.574179:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337402112 00000100:00100000:0.0:1784938441.574236:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 332 00000100:00100000:0.0:1784938441.574243:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+293:17096:x1871643337402112:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938441.574264:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938441.574282:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379dc00/0x7b044d4128f9baea lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663bd4 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.574334:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9baf1 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.574359:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9baf1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.574370:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9baf1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.574386:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9baf8 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x868dff87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.574396:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9baf8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.574402:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9baf8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.574441:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9baf1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.574454:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9baf1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.574460:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9baf1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.574465:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b379ca00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938441.574470:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9baf1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.574477:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9baf1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.574490:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938441.574494:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938441.574499:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9baf1 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.574505:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9baf1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.574516:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9baf8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.574523:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9baf8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.574528:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9baf8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.574532:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db7b000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938441.574535:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9baf8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.574540:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9baf8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.574547:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x868dff87 (ffff9f24898dc300) 00010000:00010000:0.0:1784938441.574550:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938441.574553:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9baf8 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.574558:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9baf8 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.574596:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379dc00/0x7b044d4128f9baea lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663bd4 expref: 294 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.574606:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938441.574608:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938441.574612:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379dc00/0x7b044d4128f9baea lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663bd4 expref: 294 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.574626:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b379dc00, rc 0) 00000100:00100000:0.0:1784938441.574693:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+293:17096:x1871643337402112:12345-192.168.202.54@tcp:101:cp.0 Request processed in 449us (1287us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938441.574700:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 332 00000100:00100000:3.0:1784938441.580259:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.580748:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337402368 00000100:00100000:1.0:1784938441.580759:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337402368 00000100:00100000:0.0:1784938441.580897:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 333 00000100:00100000:0.0:1784938441.580918:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+293:17096:x1871643337402368:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938441.580941:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938441.580964:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9baff lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663bdb expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.581093:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625f400/0x7b044d4128f9bb06 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.581109:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625f400/0x7b044d4128f9bb06 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.581119:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625f400/0x7b044d4128f9bb06 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.581133:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625fa00/0x7b044d4128f9bb0d lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x868dff87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.581142:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625fa00/0x7b044d4128f9bb0d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.581197:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625fa00/0x7b044d4128f9bb0d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938441.581543:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4f:0x0], index 0: 0 00010000:00010000:0.0:1784938441.581692:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625f800/0x7b044d4128f9bb14 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.581701:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625f800/0x7b044d4128f9bb14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.581710:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625f800/0x7b044d4128f9bb14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.581749:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625f400/0x7b044d4128f9bb06 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.581756:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625f400/0x7b044d4128f9bb06 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.581763:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625f400/0x7b044d4128f9bb06 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.581769:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c625f400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938441.581773:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625f400/0x7b044d4128f9bb06 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.581781:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625f400/0x7b044d4128f9bb06 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.581793:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938441.581797:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938441.581801:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625f400/0x7b044d4128f9bb06 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.581811:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625f400/0x7b044d4128f9bb06 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938441.583540:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dc6f7dc3 reply state 0000000065eadf8e transno 8589934753 ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625fa00/0x7b044d4128f9bb0d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.583565:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625fa00/0x7b044d4128f9bb0d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.583573:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x868dff87 (ffff9f24898dc800) 00010000:00010000:0.0:1784938441.583576:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938441.583579:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938441.583631:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9baff lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663bdb expref: 296 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.583653:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625f800/0x7b044d4128f9bb14 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663bdb expref: 295 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.583660:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1d:0x0].0x0 (ffff9f2487e3af00) 00010000:00010000:0.0:1784938441.583662:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938441.583665:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24c625f800, rc 0) 00000100:00100000:0.0:1784938441.583741:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+296:17096:x1871643337402368:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2825us (3491us total) trans 8589934753 rc 0/0 00000100:00100000:0.0:1784938441.583749:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 333 00000100:00100000:1.0:1784938441.590118:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.592467:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337402496 00000100:00100000:2.0:1784938441.592480:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337402496 00000100:00100000:2.0:1784938441.592554:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 550 00000100:00100000:2.0:1784938441.592565:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+85:10958:x1871643337402496:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938441.592585:0:25715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938441.592606:0:25715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c5c832f/0x7b044d4128f9bb22 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663be2 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938441.592633:0:25715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938441.592654:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4f:0x0].0x0 since=707s v=(0 0) 00010000:00010000:2.0:1784938441.592658:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938441.592669:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c5c832f/0x7b044d4128f9bb22 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663be2 expref: 86 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.592686:0:25715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007c5c832f/0x7b044d4128f9bb22 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663be2 expref: 86 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.592705:0:25715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382395600, rc 0) 00000100:00100000:2.0:1784938441.592771:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+86:10958:x1871643337402496:12345-192.168.202.54@tcp:101:cp.0 Request processed in 206us (2661us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938441.592780:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 550 00000100:00100000:3.0:1784938441.596745:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938441.596856:0:21152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337402624 00000100:00100000:0.0:1784938441.596866:0:21152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337402624 00000100:00100000:0.0:1784938441.596986:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 551 00000100:00100000:0.0:1784938441.596994:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+86:17096:x1871643337402624:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938441.597010:0:21152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938441.597026:0:21152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e6c75cd/0x7b044d4128f9bb29 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663be9 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.597062:0:21152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007c5c832f/0x7b044d4128f9bb22 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663be2 expref: 87 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.597069:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938441.597071:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938441.597075:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e6c75cd/0x7b044d4128f9bb29 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4f:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663be9 expref: 87 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.597099:0:21152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007c5c832f/0x7b044d4128f9bb22 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663be2 expref: 87 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.597109:0:21152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007c5c832f/0x7b044d4128f9bb22 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663be2 expref: 87 pid: 25715 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938441.597119:0:21152:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd55c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:21152:1871643350833152:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938441.597227:0:21152:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b6a64c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938441.599896:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.600061:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337402752 00000100:00100000:2.0:1784938441.600070:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337402752 00010000:00010000:2.0:1784938441.600113:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007c5c832f/0x7b044d4128f9bb22 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663be2 expref: 88 pid: 25715 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938441.600194:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 226 00000100:00100000:2.0:1784938441.600204:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+88:10960:x1871643337402752:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938441.600219:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938441.600242:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007c5c832f/0x7b044d4128f9bb22 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663be2 expref: 88 pid: 25715 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.600253:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007c5c832f/0x7b044d4128f9bb22 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663be2 expref: 88 pid: 25715 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.600273:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938441.600276:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938441.600282:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006e6c75cd/0x7b044d4128f9bb29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663be9 expref: 88 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.600288:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e6c75cd/0x7b044d4128f9bb29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663be9 expref: 88 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.600317:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006e6c75cd/0x7b044d4128f9bb29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663be9 expref: 88 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938441.600326:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f19aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350833280:192.168.202.54@tcp:105: 00000100:00100000:2.0:1784938441.600408:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2488a4c000 going to sleep for 11 seconds 00010000:00010000:0.0:1784938441.601218:0:21152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c5c832f/0x7b044d4128f9bb22 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663be2 expref: 88 pid: 25715 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938441.601236:0:21152:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd55c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:21152:1871643350833152:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938441.601263:0:21152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006e6c75cd/0x7b044d4128f9bb29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663be9 expref: 87 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.601275:0:21152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24c625f400, rc 0) 00000100:00100000:0.0:1784938441.601321:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+87:17096:x1871643337402624:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4327us (4583us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938441.601329:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 551 00000100:00100000:3.0:1784938441.604261:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.604500:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337403008 00000100:00100000:1.0:1784938441.604509:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337403008 00000100:00100000:2.0:1784938441.604536:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f19aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350833280:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938441.604565:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938441.604606:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 48 00000100:00100000:2.0:1784938441.604610:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+86:10960:x1871643337402752:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 4408us (4722us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938441.604615:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+296:17096:x1871643337403008:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:2.0:1784938441.604620:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 226 00000100:00100000:1.0:1784938441.604876:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+297:17096:x1871643337403008:12345-192.168.202.54@tcp:35:cp.0 Request processed in 262us (626us total) trans 8589934754 rc 0/0 00000100:00100000:1.0:1784938441.604881:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 48 00000100:00100000:3.0:1784938441.607592:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938441.607640:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337403136 00000100:00100000:0.0:1784938441.607650:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337403136 00000100:00100000:0.0:1784938441.607715:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 334 00000100:00100000:0.0:1784938441.607726:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+297:17096:x1871643337403136:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938441.607749:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938441.607771:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625fc00/0x7b044d4128f9bb30 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663bf0 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.607830:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9bb37 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.607843:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9bb37 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.607854:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9bb37 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.607867:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9bb3e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x39c3d8fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.607875:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9bb3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.607881:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9bb3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.607921:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9bb37 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.607928:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9bb37 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.607934:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9bb37 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.607941:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db7be00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938441.607945:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9bb37 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.607953:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9bb37 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.607962:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938441.607964:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938441.607968:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9bb37 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.607973:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7be00/0x7b044d4128f9bb37 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.607981:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9bb3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.607984:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9bb3e lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.607987:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9bb3e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.607991:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db7b000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938441.607993:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9bb3e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.607996:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9bb3e lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.607999:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x39c3d8fe (ffff9f2487e3ac00) 00010000:00010000:0.0:1784938441.608001:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938441.608002:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9bb3e lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.608005:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7b000/0x7b044d4128f9bb3e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.608028:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625fc00/0x7b044d4128f9bb30 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663bf0 expref: 298 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.608035:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938441.608037:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938441.608040:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625fc00/0x7b044d4128f9bb30 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663bf0 expref: 298 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.608049:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24c625fc00, rc 0) 00000100:00100000:0.0:1784938441.608104:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+297:17096:x1871643337403136:12345-192.168.202.54@tcp:101:cp.0 Request processed in 379us (516us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938441.608111:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 334 00000100:00100000:3.0:1784938441.609864:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.610386:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337403264 00000100:00100000:1.0:1784938441.610395:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337403264 00000100:00100000:1.0:1784938441.610444:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 335 00000100:00100000:1.0:1784938441.610453:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+297:17096:x1871643337403264:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938441.610472:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938441.610493:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9bb45 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663bf7 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.610550:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bb4c lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.610564:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bb4c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.610580:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bb4c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.610595:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9bb53 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x39c3d8fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.610602:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9bb53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.610608:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9bb53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.610646:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bb4c lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.610652:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bb4c lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.610659:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bb4c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.610667:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bb4c lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.610672:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.610676:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bb4c lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.610685:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bb4c lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.610696:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.610700:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.610704:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bb4c lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.610710:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bb4c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.610723:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9bb53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.610730:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9bb53 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.610735:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9bb53 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.610740:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.610743:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9bb53 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.610750:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9bb53 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.610757:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x39c3d8fe (ffff9f23823e2c00) 00010000:00010000:1.0:1784938441.610759:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.610762:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9bb53 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.610768:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9bb53 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.610798:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9bb45 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663bf7 expref: 298 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.610808:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.610810:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.610814:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9bb45 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663bf7 expref: 298 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.610992:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b34000, rc 0) 00000100:00100000:1.0:1784938441.611244:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+297:17096:x1871643337403264:12345-192.168.202.54@tcp:101:cp.0 Request processed in 790us (1386us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938441.611252:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 335 00000100:00100000:3.0:1784938441.615806:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938441.617913:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337403520 00000100:00100000:0.0:1784938441.617927:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337403520 00000100:00100000:0.0:1784938441.618008:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 336 00000100:00100000:0.0:1784938441.618017:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+297:17096:x1871643337403520:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938441.618040:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938441.618064:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379dc00/0x7b044d4128f9bb5a lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663bfe expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.618202:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9bb61 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.618218:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9bb61 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.618229:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9bb61 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.618243:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7400/0x7b044d4128f9bb68 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x39c3d8fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.618250:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7400/0x7b044d4128f9bb68 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.618256:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7400/0x7b044d4128f9bb68 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938441.620086:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4f:0x0], index 1: 0 00010000:00010000:0.0:1784938441.620303:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6800/0x7b044d4128f9bb6f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.620319:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6800/0x7b044d4128f9bb6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.620333:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6800/0x7b044d4128f9bb6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.620383:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9bb61 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.620390:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9bb61 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.620397:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9bb61 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.620402:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b379ca00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938441.620407:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9bb61 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.620414:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9bb61 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.620425:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938441.620428:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938441.620432:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9bb61 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.620438:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9bb61 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938441.620451:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000015a467c0 reply state 00000000b1516cd6 transno 8589934755 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7400/0x7b044d4128f9bb68 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.620462:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7400/0x7b044d4128f9bb68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.620468:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x39c3d8fe (ffff9f2487e3a400) 00010000:00010000:0.0:1784938441.620516:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938441.620519:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938441.620552:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379dc00/0x7b044d4128f9bb5a lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663bfe expref: 300 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.620567:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6800/0x7b044d4128f9bb6f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663bfe expref: 299 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.620574:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1e:0x0].0x0 (ffff9f2487e3a900) 00010000:00010000:0.0:1784938441.620577:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938441.620579:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a6800, rc 0) 00000100:00100000:0.0:1784938441.620647:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+300:17096:x1871643337403520:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2632us (4851us total) trans 8589934755 rc 0/0 00000100:00100000:0.0:1784938441.620655:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 336 00000100:00100000:3.0:1784938441.624653:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.627169:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337403648 00000100:00100000:2.0:1784938441.627185:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337403648 00000100:00100000:2.0:1784938441.627265:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 552 00000100:00100000:2.0:1784938441.627276:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+86:10960:x1871643337403648:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938441.627294:0:21149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938441.627315:0:21149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4b367e8/0x7b044d4128f9bb7d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663c05 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938441.627353:0:21149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938441.627380:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4f:0x0].0x0 since=707s v=(0 0) 00010000:00010000:2.0:1784938441.627386:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938441.627397:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4b367e8/0x7b044d4128f9bb7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c05 expref: 87 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.627421:0:21149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c4b367e8/0x7b044d4128f9bb7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c05 expref: 87 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.627436:0:21149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382394a00, rc 0) 00000100:00100000:2.0:1784938441.627507:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+87:10960:x1871643337403648:12345-192.168.202.54@tcp:101:cp.0 Request processed in 233us (2862us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938441.627516:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 552 00000100:00100000:0.0:1784938441.631493:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.631595:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337403776 00000100:00100000:2.0:1784938441.631605:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337403776 00000100:00100000:2.0:1784938441.631695:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 553 00000100:00100000:2.0:1784938441.631706:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+87:17096:x1871643337403776:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938441.631726:0:25715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938441.631749:0:25715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0b73105/0x7b044d4128f9bb84 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663c0c expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.631781:0:25715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4b367e8/0x7b044d4128f9bb7d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c05 expref: 88 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.631791:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938441.631795:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938441.631801:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0b73105/0x7b044d4128f9bb84 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4f:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c0c expref: 88 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.631850:0:25715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c4b367e8/0x7b044d4128f9bb7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663c05 expref: 88 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.631866:0:25715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c4b367e8/0x7b044d4128f9bb7d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663c05 expref: 88 pid: 21149 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938441.631882:0:25715:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f19aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25715:1871643350833408:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938441.632125:0:25715:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2488a4c000 going to sleep for 11 seconds 00000100:00100000:2.0:1784938441.634922:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.635102:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337403904 00000100:00100000:3.0:1784938441.635111:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337403904 00010000:00010000:3.0:1784938441.635188:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c4b367e8/0x7b044d4128f9bb7d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663c05 expref: 89 pid: 21149 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938441.635223:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 227 00000100:00100000:3.0:1784938441.635233:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f199c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+89:10958:x1871643337403904:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938441.635249:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938441.635271:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c4b367e8/0x7b044d4128f9bb7d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663c05 expref: 89 pid: 21149 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.635286:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c4b367e8/0x7b044d4128f9bb7d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663c05 expref: 89 pid: 21149 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.635310:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938441.635315:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938441.635324:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0b73105/0x7b044d4128f9bb84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c0c expref: 89 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.635374:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0b73105/0x7b044d4128f9bb84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c0c expref: 89 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.635419:0:19220:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e0b73105/0x7b044d4128f9bb84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c0c expref: 89 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938441.635435:0:19220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f183b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:19220:1871643350833536:192.168.202.54@tcp:105: 00000100:00100000:3.0:1784938441.635517:0:19220:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238e8de0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938441.638219:0:19220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f183b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:19220:1871643350833536:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938441.638246:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938441.638293:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f199c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+89:10958:x1871643337403904:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3061us (3379us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938441.638304:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 227 00010000:00010000:1.0:1784938441.641186:0:25715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4b367e8/0x7b044d4128f9bb7d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663c05 expref: 88 pid: 21149 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938441.641217:0:25715:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f19aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25715:1871643350833408:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938441.641255:0:25715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e0b73105/0x7b044d4128f9bb84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663c0c expref: 87 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.641271:0:25715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382394600, rc 0) 00000100:00100000:1.0:1784938441.641358:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+87:17096:x1871643337403776:12345-192.168.202.54@tcp:101:cp.0 Request processed in 9653us (9873us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938441.641367:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 553 00000100:00100000:3.0:1784938441.647963:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938441.648115:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337404160 00000100:00100000:0.0:1784938441.648124:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337404160 00000100:00100000:0.0:1784938441.648211:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:0.0:1784938441.648221:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+300:17096:x1871643337404160:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:0.0:1784938441.648532:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+301:17096:x1871643337404160:12345-192.168.202.54@tcp:35:cp.0 Request processed in 312us (578us total) trans 8589934756 rc 0/0 00000100:00100000:0.0:1784938441.648540:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:3.0:1784938441.657839:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.657951:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337404288 00000100:00100000:1.0:1784938441.657961:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337404288 00000100:00100000:1.0:1784938441.658020:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 337 00000100:00100000:1.0:1784938441.658028:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+301:17096:x1871643337404288:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938441.658061:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938441.658081:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9bb8b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663c13 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.658179:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9bb92 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.658193:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9bb92 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.658203:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9bb92 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.658217:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bb99 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x5b30f298 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.658224:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bb99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.658229:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bb99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.658267:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9bb92 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.658272:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9bb92 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.658278:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9bb92 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.658284:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9bb92 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.658290:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.658294:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9bb92 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.658300:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9bb92 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.658310:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.658313:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.658317:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9bb92 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.658322:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9bb92 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.658335:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bb99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.658350:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bb99 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.658355:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bb99 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.658360:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.658362:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bb99 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.658367:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bb99 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.658378:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x5b30f298 (ffff9f23823e2c00) 00010000:00010000:1.0:1784938441.658381:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.658383:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bb99 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.658389:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bb99 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.658419:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9bb8b lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c13 expref: 302 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.658429:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.658431:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.658435:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9bb8b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c13 expref: 302 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.658446:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b34000, rc 0) 00000100:00100000:1.0:1784938441.658506:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+301:17096:x1871643337404288:12345-192.168.202.54@tcp:101:cp.0 Request processed in 478us (688us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938441.658512:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 337 00000100:00100000:3.0:1784938441.664590:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.666213:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337404416 00000100:00100000:2.0:1784938441.666225:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337404416 00000100:00100000:2.0:1784938441.666289:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 338 00000100:00100000:2.0:1784938441.666298:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+301:17096:x1871643337404416:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938441.666318:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938441.666348:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395600/0x7b044d4128f9bba0 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663c1a expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.666408:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9bba7 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.666421:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9bba7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.666435:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9bba7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.666449:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bbae lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x5b30f298 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.666455:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bbae lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.666461:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bbae lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.666495:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9bba7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.666501:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9bba7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.666507:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9bba7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.666512:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938441.666516:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9bba7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.666523:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9bba7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.666534:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938441.666536:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938441.666540:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9bba7 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.666547:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9bba7 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.666559:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bbae lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.666564:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bbae lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.666569:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bbae lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.666573:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938441.666576:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bbae lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.666580:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bbae lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.666586:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x5b30f298 (ffff9f23872e6000) 00010000:00010000:2.0:1784938441.666587:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938441.666589:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bbae lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.666594:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bbae lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.666621:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395600/0x7b044d4128f9bba0 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c1a expref: 302 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.666634:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938441.666636:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938441.666639:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395600/0x7b044d4128f9bba0 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c1a expref: 302 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.666647:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382395600, rc 0) 00000100:00100000:2.0:1784938441.667113:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+301:17096:x1871643337404416:12345-192.168.202.54@tcp:101:cp.0 Request processed in 814us (2530us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938441.667120:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 338 00000100:00100000:3.0:1784938441.680496:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.680608:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337404672 00000100:00100000:1.0:1784938441.680618:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337404672 00000100:00100000:1.0:1784938441.680677:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 339 00000100:00100000:1.0:1784938441.680687:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+301:17096:x1871643337404672:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938441.680708:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938441.680730:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9bbb5 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663c21 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.681081:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bbbc lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.681097:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bbbc lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.681110:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bbbc lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.681124:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9bbc3 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x5b30f298 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.681131:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9bbc3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.681137:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9bbc3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938441.681464:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x50:0x0], index 0: 0 00010000:00010000:1.0:1784938441.681609:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34e00/0x7b044d4128f9bbca lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.681618:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34e00/0x7b044d4128f9bbca lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.681626:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34e00/0x7b044d4128f9bbca lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.681660:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bbbc lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.681672:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bbbc lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.681678:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bbbc lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.681684:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bbbc lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.681688:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.681691:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bbbc lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.681696:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bbbc lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.681706:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.681708:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.681712:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bbbc lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.681717:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bbbc lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938441.681727:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f0e0b0fb reply state 00000000b088cb07 transno 8589934757 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9bbc3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.681735:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9bbc3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.681739:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x5b30f298 (ffff9f23823e2c00) 00010000:00010000:1.0:1784938441.681741:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938441.681743:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938441.683527:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9bbb5 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c21 expref: 304 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.683554:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34e00/0x7b044d4128f9bbca lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c21 expref: 303 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.683563:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1f:0x0].0x0 (ffff9f23823e2100) 00010000:00010000:1.0:1784938441.683566:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938441.683570:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b34e00, rc 0) 00000100:00100000:1.0:1784938441.683653:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+304:17096:x1871643337404672:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2967us (3168us total) trans 8589934757 rc 0/0 00000100:00100000:1.0:1784938441.683662:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 339 00000100:00100000:3.0:1784938441.688435:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.688522:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337404800 00000100:00100000:1.0:1784938441.688533:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337404800 00000100:00100000:1.0:1784938441.688597:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 554 00000100:00100000:1.0:1784938441.688607:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+86:10958:x1871643337404800:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938441.688625:0:21629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938441.688644:0:21629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027f9ef8c/0x7b044d4128f9bbd8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x50:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663c28 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938441.688667:0:21629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x50:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938441.688685:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x50:0x0].0x0 since=707s v=(0 0) 00010000:00010000:1.0:1784938441.688690:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x50:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938441.688698:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027f9ef8c/0x7b044d4128f9bbd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c28 expref: 87 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.688719:0:21629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027f9ef8c/0x7b044d4128f9bbd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c28 expref: 87 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.688732:0:21629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b35e00, rc 0) 00000100:00100000:1.0:1784938441.689137:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+87:10958:x1871643337404800:12345-192.168.202.54@tcp:101:cp.0 Request processed in 529us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938441.689176:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 554 00000100:00100000:3.0:1784938441.692783:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.693685:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337404928 00000100:00100000:2.0:1784938441.693697:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337404928 00000100:00100000:2.0:1784938441.693765:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 555 00000100:00100000:2.0:1784938441.693775:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+87:17096:x1871643337404928:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938441.693793:0:21149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938441.693812:0:21149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c5c832f/0x7b044d4128f9bbdf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x50:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663c2f expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.693845:0:21149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027f9ef8c/0x7b044d4128f9bbd8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c28 expref: 88 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.693855:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x50:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938441.693859:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x50:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938441.693863:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c5c832f/0x7b044d4128f9bbdf lrc: 4/0,0 mode: --/PW res: [0x280000401:0x50:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c2f expref: 88 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.693901:0:21149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000027f9ef8c/0x7b044d4128f9bbd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663c28 expref: 88 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.693916:0:21149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000027f9ef8c/0x7b044d4128f9bbd8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663c28 expref: 88 pid: 21629 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938441.693930:0:21149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f199880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:21149:1871643350833664:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938441.694010:0:21149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2488a4c540 going to sleep for 11 seconds 00000100:00100000:3.0:1784938441.697646:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.697773:0:21149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f199880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:21149:1871643350833664:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938441.697778:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337405056 00000100:00100000:1.0:1784938441.697785:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337405056 00010000:00010000:2.0:1784938441.697806:0:21149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007c5c832f/0x7b044d4128f9bbdf lrc: 3/0,0 mode: --/PW res: [0x280000401:0x50:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663c2f expref: 89 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.697825:0:21149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382395600, rc 0) 00010000:00010000:1.0:1784938441.697828:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000027f9ef8c/0x7b044d4128f9bbd8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x50:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663c28 expref: 89 pid: 21629 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938441.697869:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 228 00000100:00100000:1.0:1784938441.697878:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+89:10960:x1871643337405056:12345-192.168.202.54@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1784938441.697880:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+89:17096:x1871643337404928:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4107us (5108us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938441.697886:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 555 00010000:00010000:1.0:1784938441.697890:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938441.697919:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000027f9ef8c/0x7b044d4128f9bbd8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x50:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663c28 expref: 88 pid: 21629 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.697932:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000027f9ef8c/0x7b044d4128f9bbd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x50:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663c28 expref: 88 pid: 21629 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.697955:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027f9ef8c/0x7b044d4128f9bbd8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x50:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663c28 expref: 88 pid: 21629 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.697974:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x50:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938441.697979:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x50:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938441.697988:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007c5c832f/0x7b044d4128f9bbdf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663c2f expref: 87 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.697997:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c5c832f/0x7b044d4128f9bbdf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663c2f expref: 87 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.698039:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007c5c832f/0x7b044d4128f9bbdf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663c2f expref: 87 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938441.698054:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd5a5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350833792:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938441.698239:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2487fb1900 going to sleep for 11 seconds 00000100:00100000:3.0:1784938441.701940:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.702063:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd5a5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350833792:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938441.702093:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938441.702173:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+87:10960:x1871643337405056:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 4297us (4537us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938441.702184:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 228 00000100:00100000:2.0:1784938441.704635:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337405312 00000100:00100000:2.0:1784938441.704650:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337405312 00000100:00100000:2.0:1784938441.704717:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 50 00000100:00100000:2.0:1784938441.704727:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+304:17096:x1871643337405312:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:2.0:1784938441.705445:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+305:17096:x1871643337405312:12345-192.168.202.54@tcp:35:cp.0 Request processed in 717us (3512us total) trans 8589934758 rc 0/0 00000100:00100000:2.0:1784938441.705455:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 50 00000100:00100000:3.0:1784938441.710217:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938441.710400:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337405440 00000100:00100000:0.0:1784938441.710410:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337405440 00000100:00100000:0.0:1784938441.710577:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 340 00000100:00100000:0.0:1784938441.710589:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+305:17096:x1871643337405440:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938441.710619:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938441.710644:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9bbe6 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663c36 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.710714:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9bbed lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.710729:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9bbed lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.710740:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9bbed lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.710755:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6600/0x7b044d4128f9bbf4 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x2893e4db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.710762:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6600/0x7b044d4128f9bbf4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.710768:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6600/0x7b044d4128f9bbf4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.710805:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9bbed lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.710812:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9bbed lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.710818:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9bbed lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.710842:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a6000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938441.710847:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9bbed lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.710855:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9bbed lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.710867:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938441.710870:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938441.710875:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9bbed lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.710880:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9bbed lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.710892:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6600/0x7b044d4128f9bbf4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.710907:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6600/0x7b044d4128f9bbf4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.710913:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6600/0x7b044d4128f9bbf4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.710918:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a6600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938441.710921:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6600/0x7b044d4128f9bbf4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.710926:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6600/0x7b044d4128f9bbf4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.710937:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x2893e4db (ffff9f2487e3ac00) 00010000:00010000:0.0:1784938441.710939:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938441.710941:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6600/0x7b044d4128f9bbf4 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.710946:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6600/0x7b044d4128f9bbf4 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.710975:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9bbe6 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c36 expref: 306 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.710984:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938441.710986:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938441.710990:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9bbe6 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c36 expref: 306 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.710998:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a6400, rc 0) 00000100:00100000:0.0:1784938441.711073:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+305:17096:x1871643337405440:12345-192.168.202.54@tcp:101:cp.0 Request processed in 485us (864us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938441.711079:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 340 00000100:00100000:3.0:1784938441.714455:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.718258:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337405568 00000100:00100000:2.0:1784938441.718273:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337405568 00000100:00100000:2.0:1784938441.718352:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 341 00000100:00100000:2.0:1784938441.718364:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+305:17096:x1871643337405568:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938441.718387:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938441.718411:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bbfb lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663c3d expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.718494:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9bc02 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.718508:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9bc02 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.718520:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9bc02 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.718659:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9bc09 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x2893e4db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.718668:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9bc09 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.718675:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9bc09 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.718715:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9bc02 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.718722:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9bc02 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.718732:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9bc02 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.718738:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938441.718742:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9bc02 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.718749:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9bc02 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.718760:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938441.718763:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938441.718769:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9bc02 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.718775:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9bc02 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.718816:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9bc09 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.718823:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9bc09 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.718829:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9bc09 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.718834:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238238a000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938441.718837:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9bc09 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.718846:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9bc09 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.718854:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x2893e4db (ffff9f23872e6000) 00010000:00010000:2.0:1784938441.718857:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938441.718860:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9bc09 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.718866:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9bc09 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.718904:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bbfb lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c3d expref: 306 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.718913:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938441.718916:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938441.718919:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bbfb lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c3d expref: 306 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.718928:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382394a00, rc 0) 00000100:00100000:2.0:1784938441.718997:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+305:17096:x1871643337405568:12345-192.168.202.54@tcp:101:cp.0 Request processed in 635us (4550us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938441.719004:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 341 00000100:00100000:3.0:1784938441.722321:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938441.722494:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337405824 00000100:00100000:0.0:1784938441.722506:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337405824 00000100:00100000:0.0:1784938441.722564:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 342 00000100:00100000:0.0:1784938441.722573:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+305:17096:x1871643337405824:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938441.722595:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938441.722616:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7200/0x7b044d4128f9bc10 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663c44 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.722724:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7000/0x7b044d4128f9bc17 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.722740:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7000/0x7b044d4128f9bc17 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.722751:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7000/0x7b044d4128f9bc17 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.722765:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9bc1e lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x2893e4db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.722772:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9bc1e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.722779:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9bc1e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938441.723076:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x50:0x0], index 1: 0 00010000:00010000:0.0:1784938441.723273:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7800/0x7b044d4128f9bc25 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.723283:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7800/0x7b044d4128f9bc25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.723292:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7800/0x7b044d4128f9bc25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.723327:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7000/0x7b044d4128f9bc17 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.723354:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7000/0x7b044d4128f9bc17 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.723361:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7000/0x7b044d4128f9bc17 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.723368:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7000/0x7b044d4128f9bc17 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.723375:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a7000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938441.723379:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7000/0x7b044d4128f9bc17 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.723387:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7000/0x7b044d4128f9bc17 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.723399:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938441.723402:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938441.723407:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7000/0x7b044d4128f9bc17 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.723413:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7000/0x7b044d4128f9bc17 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938441.723428:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f05cde8e reply state 000000000183f688 transno 8589934759 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9bc1e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.723439:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9bc1e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.723446:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x2893e4db (ffff9f2487e3a100) 00010000:00010000:0.0:1784938441.723449:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938441.723452:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938441.723480:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7200/0x7b044d4128f9bc10 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c44 expref: 308 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.723496:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7800/0x7b044d4128f9bc25 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c44 expref: 307 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.723504:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x20:0x0].0x0 (ffff9f2487e3a300) 00010000:00010000:0.0:1784938441.723506:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938441.723509:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a7800, rc 0) 00000100:00100000:0.0:1784938441.723579:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+308:17096:x1871643337405824:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1007us (1268us total) trans 8589934759 rc 0/0 00000100:00100000:0.0:1784938441.723588:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 342 00000100:00100000:3.0:1784938441.730947:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938441.731123:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337405952 00000100:00100000:0.0:1784938441.731133:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337405952 00000100:00100000:0.0:1784938441.731224:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 556 00000100:00100000:0.0:1784938441.731235:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+87:10959:x1871643337405952:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938441.731254:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938441.731275:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e022c2b/0x7b044d4128f9bc33 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x50:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663c4b expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938441.731302:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x50:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938441.731328:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x50:0x0].0x0 since=707s v=(0 0) 00010000:00010000:0.0:1784938441.731334:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x50:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938441.731380:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e022c2b/0x7b044d4128f9bc33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c4b expref: 88 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.731403:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005e022c2b/0x7b044d4128f9bc33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c4b expref: 88 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.731416:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a6400, rc 0) 00000100:00100000:0.0:1784938441.731476:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+88:10959:x1871643337405952:12345-192.168.202.54@tcp:101:cp.0 Request processed in 243us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938441.731484:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 556 00000100:00100000:3.0:1784938441.735612:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938441.735700:0:21152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337406080 00000100:00100000:0.0:1784938441.735712:0:21152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337406080 00000100:00100000:0.0:1784938441.735779:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 557 00000100:00100000:0.0:1784938441.735789:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+88:17096:x1871643337406080:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938441.735809:0:21152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938441.735838:0:21152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc854c8a/0x7b044d4128f9bc3a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x50:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663c52 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.735873:0:21152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005e022c2b/0x7b044d4128f9bc33 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c4b expref: 89 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.735883:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x50:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938441.735888:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x50:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938441.735894:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc854c8a/0x7b044d4128f9bc3a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x50:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c52 expref: 89 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.735938:0:21152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005e022c2b/0x7b044d4128f9bc33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663c4b expref: 89 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.735953:0:21152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005e022c2b/0x7b044d4128f9bc33 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663c4b expref: 89 pid: 21151 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938441.735967:0:21152:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd55ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:21152:1871643350833920:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938441.736053:0:21152:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b6a64540 going to sleep for 11 seconds 00000100:00100000:3.0:1784938441.739504:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938441.739650:0:21152:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd55ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:21152:1871643350833920:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938441.739685:0:21152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fc854c8a/0x7b044d4128f9bc3a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x50:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663c52 expref: 89 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.739707:0:21152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a7200, rc 0) 00000100:00100000:0.0:1784938441.739830:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+89:17096:x1871643337406080:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4032us (4218us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938441.739839:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 557 00000100:00100000:2.0:1784938441.740680:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337406208 00000100:00100000:2.0:1784938441.740690:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337406208 00010000:00010000:2.0:1784938441.740733:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005e022c2b/0x7b044d4128f9bc33 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663c4b expref: 89 pid: 21151 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938441.740774:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 229 00000100:00100000:2.0:1784938441.740784:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+89:10958:x1871643337406208:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938441.740802:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938441.740836:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005e022c2b/0x7b044d4128f9bc33 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x50:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663c4b expref: 89 pid: 21151 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.740849:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005e022c2b/0x7b044d4128f9bc33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x50:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663c4b expref: 89 pid: 21151 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.740872:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e022c2b/0x7b044d4128f9bc33 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x50:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663c4b expref: 89 pid: 21151 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.740888:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x50:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938441.740893:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x50:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938441.740912:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc854c8a/0x7b044d4128f9bc3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663c52 expref: 88 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.740922:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc854c8a/0x7b044d4128f9bc3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663c52 expref: 88 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.740959:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fc854c8a/0x7b044d4128f9bc3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663c52 expref: 88 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938441.740973:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f199880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350834048:192.168.202.54@tcp:105: 00000100:00100000:2.0:1784938441.741546:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2488a4ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938441.746630:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.746715:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337406464 00000100:00100000:1.0:1784938441.746726:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337406464 00000100:00100000:1.0:1784938441.746830:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00100000:1.0:1784938441.746841:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24857fa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+308:17096:x1871643337406464:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:1.0:1784938441.747304:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24857fa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+309:17096:x1871643337406464:12345-192.168.202.54@tcp:35:cp.0 Request processed in 463us (684us total) trans 8589934760 rc 0/0 00000100:00100000:1.0:1784938441.747315:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00100000:2.0:1784938441.747446:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f199880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350834048:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938441.747469:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938441.747493:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+88:10958:x1871643337406208:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 6711us (8000us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938441.747501:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 229 00000100:00100000:1.0:1784938441.752495:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938441.752597:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337406592 00000100:00100000:0.0:1784938441.752607:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337406592 00000100:00100000:0.0:1784938441.752672:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 343 00000100:00100000:0.0:1784938441.752682:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+309:17096:x1871643337406592:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938441.752707:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938441.752730:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6600/0x7b044d4128f9bc41 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663c59 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.752796:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9bc48 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.752815:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9bc48 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.752837:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9bc48 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.752852:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7c00/0x7b044d4128f9bc4f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x49aa722d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.752859:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7c00/0x7b044d4128f9bc4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.752867:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7c00/0x7b044d4128f9bc4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.752912:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9bc48 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.752920:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9bc48 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.752927:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9bc48 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.752933:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a6000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938441.752937:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9bc48 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.752945:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9bc48 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.752957:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938441.752960:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938441.752965:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9bc48 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.752971:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9bc48 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.752985:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7c00/0x7b044d4128f9bc4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.752991:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7c00/0x7b044d4128f9bc4f lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.752997:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7c00/0x7b044d4128f9bc4f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.753002:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a7c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938441.753005:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7c00/0x7b044d4128f9bc4f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.753010:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7c00/0x7b044d4128f9bc4f lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.753017:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x49aa722d (ffff9f2487e3a200) 00010000:00010000:0.0:1784938441.753020:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938441.753023:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7c00/0x7b044d4128f9bc4f lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.753029:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7c00/0x7b044d4128f9bc4f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.753063:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6600/0x7b044d4128f9bc41 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c59 expref: 310 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.753074:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938441.753076:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938441.753080:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6600/0x7b044d4128f9bc41 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c59 expref: 310 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.753089:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a6600, rc 0) 00000100:00100000:0.0:1784938441.753434:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+309:17096:x1871643337406592:12345-192.168.202.54@tcp:101:cp.0 Request processed in 752us (948us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938441.753442:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 343 00000100:00100000:0.0:1784938441.756872:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.757075:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337406720 00000100:00100000:3.0:1784938441.757086:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337406720 00000100:00100000:3.0:1784938441.757199:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 344 00000100:00100000:3.0:1784938441.757210:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238c937850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+309:17096:x1871643337406720:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938441.757232:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938441.757251:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9bc56 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663c60 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.757313:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bc5d lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.757326:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bc5d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.757350:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bc5d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.757366:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9bc64 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x49aa722d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.757373:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9bc64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.757381:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9bc64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.757421:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bc5d lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.757428:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bc5d lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.757435:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bc5d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.757453:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bc5d lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.757459:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fcc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938441.757464:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bc5d lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.757472:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bc5d lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.757483:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938441.757487:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.757491:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bc5d lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.757498:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bc5d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.757509:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9bc64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.757516:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9bc64 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.757523:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9bc64 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.757528:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d01800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938441.757530:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9bc64 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.757545:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9bc64 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.757552:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x49aa722d (ffff9f238dd49400) 00010000:00010000:3.0:1784938441.757554:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.757557:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9bc64 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.757562:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9bc64 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.757592:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9bc56 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c60 expref: 310 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.757601:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938441.757603:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.757606:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9bc56 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c60 expref: 310 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.757614:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fd600, rc 0) 00000100:00100000:3.0:1784938441.757671:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238c937850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+309:17096:x1871643337406720:12345-192.168.202.54@tcp:101:cp.0 Request processed in 464us (810us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938441.757679:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 344 00000100:00100000:1.0:1784938441.762372:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.762483:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337406976 00000100:00100000:2.0:1784938441.762493:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337406976 00000100:00100000:2.0:1784938441.762557:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 345 00000100:00100000:2.0:1784938441.762569:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+309:17096:x1871643337406976:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938441.762590:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938441.762613:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9bc6b lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663c67 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.762719:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bc72 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.762734:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bc72 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.762744:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bc72 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.762759:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9bc79 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x49aa722d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.762766:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9bc79 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.762777:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9bc79 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938441.763142:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x51:0x0], index 0: 0 00010000:00010000:2.0:1784938441.763312:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217da00/0x7b044d4128f9bc80 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.763322:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217da00/0x7b044d4128f9bc80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.763330:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217da00/0x7b044d4128f9bc80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.763377:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bc72 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.763384:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bc72 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.763391:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bc72 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.763397:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938441.763401:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bc72 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.763408:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bc72 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.763419:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938441.763422:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938441.763427:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bc72 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.763432:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bc72 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938441.763445:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008f000d5c reply state 0000000069f696f7 transno 8589934761 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9bc79 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.763456:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9bc79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.763462:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x49aa722d (ffff9f23872e6000) 00010000:00010000:2.0:1784938441.763464:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938441.763466:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938441.763491:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9bc6b lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c67 expref: 312 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.763504:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217da00/0x7b044d4128f9bc80 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c67 expref: 311 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.763512:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x21:0x0].0x0 (ffff9f23872e6900) 00010000:00010000:2.0:1784938441.763514:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938441.763516:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217da00, rc 0) 00000100:00100000:2.0:1784938441.763585:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+312:17096:x1871643337406976:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1018us (1223us total) trans 8589934761 rc 0/0 00000100:00100000:2.0:1784938441.763592:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 345 00000100:00100000:2.0:1784938441.770191:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.770433:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337407104 00000100:00100000:1.0:1784938441.770445:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337407104 00000100:00100000:1.0:1784938441.770510:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 558 00000100:00100000:1.0:1784938441.770520:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f199880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+87:10958:x1871643337407104:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938441.770540:0:25716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938441.770583:0:25716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000918d0904/0x7b044d4128f9bc8e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663c6e expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938441.770609:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x51:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938441.770628:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x51:0x0].0x0 since=707s v=(0 0) 00010000:00010000:1.0:1784938441.770632:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x51:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938441.770641:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000918d0904/0x7b044d4128f9bc8e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c6e expref: 88 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.770657:0:25716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000918d0904/0x7b044d4128f9bc8e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c6e expref: 88 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.770670:0:25716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b34600, rc 0) 00000100:00100000:1.0:1784938441.770728:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f199880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+88:10958:x1871643337407104:12345-192.168.202.54@tcp:101:cp.0 Request processed in 210us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938441.770734:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 558 00000100:00100000:1.0:1784938441.775392:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938441.775562:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337407232 00000100:00100000:0.0:1784938441.775575:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337407232 00000100:00100000:0.0:1784938441.775640:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 559 00000100:00100000:0.0:1784938441.775650:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+88:17096:x1871643337407232:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938441.775669:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938441.775700:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e757f76/0x7b044d4128f9bc95 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663c75 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.775734:0:21151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000918d0904/0x7b044d4128f9bc8e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c6e expref: 89 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.775743:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x51:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938441.775748:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x51:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938441.775753:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e757f76/0x7b044d4128f9bc95 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c75 expref: 89 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.775798:0:21151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000918d0904/0x7b044d4128f9bc8e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663c6e expref: 89 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.775812:0:21151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000918d0904/0x7b044d4128f9bc8e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663c6e expref: 89 pid: 25716 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938441.775827:0:21151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd55ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:21151:1871643350834176:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938441.775925:0:21151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b6a649c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938441.779222:0:21151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd55ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:21151:1871643350834176:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938441.779263:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002e757f76/0x7b044d4128f9bc95 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663c75 expref: 89 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.779285:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a6600, rc 0) 00000100:00100000:0.0:1784938441.779356:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+89:17096:x1871643337407232:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3707us (3976us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938441.779366:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 559 00000100:00100000:3.0:1784938441.781861:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938441.782193:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337407360 00000100:00100000:0.0:1784938441.782203:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337407360 00010000:00010000:0.0:1784938441.782244:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000918d0904/0x7b044d4128f9bc8e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663c6e expref: 89 pid: 25716 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938441.782278:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 230 00000100:00100000:0.0:1784938441.782286:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2485cecc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+89:10959:x1871643337407360:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938441.782304:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938441.782328:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000918d0904/0x7b044d4128f9bc8e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663c6e expref: 89 pid: 25716 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.782353:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000918d0904/0x7b044d4128f9bc8e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663c6e expref: 89 pid: 25716 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.782374:0:22955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000918d0904/0x7b044d4128f9bc8e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663c6e expref: 89 pid: 25716 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.782392:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x51:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938441.782396:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x51:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938441.782404:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002e757f76/0x7b044d4128f9bc95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663c75 expref: 88 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.782413:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e757f76/0x7b044d4128f9bc95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663c75 expref: 88 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.782447:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002e757f76/0x7b044d4128f9bc95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663c75 expref: 88 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938441.782461:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd55ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350834304:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938441.782540:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b6a649c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938441.786656:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd55ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350834304:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938441.786683:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938441.786782:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2485cecc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+88:10959:x1871643337407360:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 4495us (4930us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938441.786793:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 230 00000100:00100000:3.0:1784938441.790562:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.790709:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337407616 00000100:00100000:2.0:1784938441.790719:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337407616 00000100:00100000:2.0:1784938441.790809:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 52 00000100:00100000:2.0:1784938441.790829:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+312:17096:x1871643337407616:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:2.0:1784938441.791095:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+313:17096:x1871643337407616:12345-192.168.202.54@tcp:35:cp.0 Request processed in 278us (543us total) trans 8589934762 rc 0/0 00000100:00100000:2.0:1784938441.791101:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 52 00000100:00100000:2.0:1784938441.795907:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.796019:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337407744 00000100:00100000:3.0:1784938441.796029:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337407744 00000100:00100000:3.0:1784938441.796122:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 346 00000100:00100000:3.0:1784938441.796177:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+313:17096:x1871643337407744:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938441.796199:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938441.796219:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9bc9c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663c7c expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.796270:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9bca3 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.796283:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9bca3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.796292:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9bca3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.796304:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9bcaa lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x4c7a76ee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.796308:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9bcaa lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.796313:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9bcaa lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.796362:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9bca3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.796367:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9bca3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.796370:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9bca3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.796382:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9bca3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.796386:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c7000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938441.796389:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9bca3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.796394:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9bca3 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.796403:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938441.796405:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.796409:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9bca3 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.796414:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9bca3 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.796423:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9bcaa lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.796426:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9bcaa lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.796430:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9bcaa lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.796433:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c6a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938441.796435:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9bcaa lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.796444:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9bcaa lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.796449:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x4c7a76ee (ffff9f238dd49400) 00010000:00010000:3.0:1784938441.796451:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.796452:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9bcaa lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.796455:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9bcaa lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.796481:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9bc9c lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c7c expref: 314 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.796487:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938441.796489:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.796491:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9bc9c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c7c expref: 314 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.796497:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c6600, rc 0) 00000100:00100000:3.0:1784938441.796541:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+313:17096:x1871643337407744:12345-192.168.202.54@tcp:101:cp.0 Request processed in 367us (647us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938441.796546:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 346 00000100:00100000:1.0:1784938441.798661:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.798801:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337407872 00000100:00100000:2.0:1784938441.798809:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337407872 00000100:00100000:2.0:1784938441.798921:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 347 00000100:00100000:2.0:1784938441.798930:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+313:17096:x1871643337407872:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938441.798948:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938441.798969:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9bcb1 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663c83 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.799022:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9bcb8 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.799079:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9bcb8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.799088:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9bcb8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.799102:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bcbf lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x4c7a76ee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.799107:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bcbf lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.799111:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bcbf lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.799252:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9bcb8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.799258:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9bcb8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.799262:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9bcb8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.799265:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238238a000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938441.799269:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9bcb8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.799274:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9bcb8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.799282:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938441.799284:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938441.799288:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9bcb8 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.799292:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9bcb8 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.799300:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bcbf lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.799303:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bcbf lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.799307:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bcbf lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.799311:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938441.799313:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bcbf lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.799316:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bcbf lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.799319:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x4c7a76ee (ffff9f248fb6aa00) 00010000:00010000:2.0:1784938441.799320:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938441.799322:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bcbf lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.799325:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bcbf lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.799367:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9bcb1 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c83 expref: 314 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.799380:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938441.799382:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938441.799385:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9bcb1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c83 expref: 314 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.799395:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217cc00, rc 0) 00000100:00100000:2.0:1784938441.799489:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+313:17096:x1871643337407872:12345-192.168.202.54@tcp:101:cp.0 Request processed in 560us (835us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938441.799495:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 347 00000100:00100000:0.0:1784938441.801644:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.801760:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337408128 00000100:00100000:1.0:1784938441.801769:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337408128 00000100:00100000:1.0:1784938441.801951:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 348 00000100:00100000:1.0:1784938441.801962:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+313:17096:x1871643337408128:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938441.801983:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938441.802004:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9bcc6 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663c8a expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.802109:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9bccd lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.802121:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9bccd lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.802142:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9bccd lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.802187:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9bcd4 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x4c7a76ee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.802192:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9bcd4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.802197:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9bcd4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938441.802526:0:24203:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x51:0x0], index 1: 0 00010000:00010000:1.0:1784938441.802645:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34600/0x7b044d4128f9bcdb lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.802654:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34600/0x7b044d4128f9bcdb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.802659:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34600/0x7b044d4128f9bcdb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.802784:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9bccd lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.802793:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9bccd lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.802800:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9bccd lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.802806:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b34a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.802810:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9bccd lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.802818:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9bccd lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.802888:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.802890:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.802894:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9bccd lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.802899:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9bccd lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938441.802915:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f460ac09 reply state 0000000015cc33d4 transno 8589934763 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9bcd4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.802926:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9bcd4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.802932:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x4c7a76ee (ffff9f23823e1f00) 00010000:00010000:1.0:1784938441.802935:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938441.802937:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938441.802966:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9bcc6 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c8a expref: 316 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.802977:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34600/0x7b044d4128f9bcdb lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c8a expref: 315 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.802982:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x22:0x0].0x0 (ffff9f23823e1700) 00010000:00010000:1.0:1784938441.802984:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938441.802985:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b34600, rc 0) 00000100:00100000:1.0:1784938441.803043:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+316:17096:x1871643337408128:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1084us (1406us total) trans 8589934763 rc 0/0 00000100:00100000:1.0:1784938441.803050:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 348 00000100:00100000:1.0:1784938441.805455:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.805538:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337408256 00000100:00100000:3.0:1784938441.805546:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337408256 00000100:00100000:3.0:1784938441.805619:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 560 00000100:00100000:3.0:1784938441.805627:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+88:10959:x1871643337408256:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938441.805659:0:21629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938441.805686:0:21629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063ef4b0e/0x7b044d4128f9bce9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663c91 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938441.805710:0:21629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x51:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938441.805727:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x51:0x0].0x0 since=707s v=(0 0) 00010000:00010000:3.0:1784938441.805731:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x51:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938441.805737:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063ef4b0e/0x7b044d4128f9bce9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c91 expref: 89 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.805764:0:21629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000063ef4b0e/0x7b044d4128f9bce9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c91 expref: 89 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.805778:0:21629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c6600, rc 0) 00000100:00100000:3.0:1784938441.805857:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+89:10959:x1871643337408256:12345-192.168.202.54@tcp:101:cp.0 Request processed in 229us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938441.805865:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 560 00000100:00100000:1.0:1784938441.807674:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938441.807901:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337408384 00000100:00100000:0.0:1784938441.807910:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337408384 00000100:00100000:0.0:1784938441.807965:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 561 00000100:00100000:0.0:1784938441.807973:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+89:17096:x1871643337408384:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938441.807988:0:25716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938441.808003:0:25716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090940899/0x7b044d4128f9bcf0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663c98 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.808028:0:25716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000063ef4b0e/0x7b044d4128f9bce9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c91 expref: 90 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.808036:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x51:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938441.808040:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x51:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938441.808045:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090940899/0x7b044d4128f9bcf0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c98 expref: 90 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.808080:0:25716:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000063ef4b0e/0x7b044d4128f9bce9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663c91 expref: 90 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.808092:0:25716:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000063ef4b0e/0x7b044d4128f9bce9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663c91 expref: 90 pid: 21629 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938441.808102:0:25716:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd55ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25716:1871643350834432:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938441.808399:0:25716:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b6a64540 going to sleep for 11 seconds 00000100:00100000:2.0:1784938441.810050:0:25716:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd55ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25716:1871643350834432:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938441.810090:0:25716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000090940899/0x7b044d4128f9bcf0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663c98 expref: 90 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.810111:0:25716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a6c00, rc 0) 00000100:00100000:2.0:1784938441.810202:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+90:17096:x1871643337408384:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2229us (2533us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938441.810212:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 561 00000100:00100000:1.0:1784938441.811315:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938441.811415:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337408512 00000100:00100000:0.0:1784938441.811422:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337408512 00010000:00010000:0.0:1784938441.811452:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000063ef4b0e/0x7b044d4128f9bce9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663c91 expref: 90 pid: 21629 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938441.811481:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 231 00000100:00100000:0.0:1784938441.811490:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+90:10957:x1871643337408512:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938441.811505:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938441.811525:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000063ef4b0e/0x7b044d4128f9bce9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663c91 expref: 90 pid: 21629 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.811534:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000063ef4b0e/0x7b044d4128f9bce9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663c91 expref: 90 pid: 21629 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.811552:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063ef4b0e/0x7b044d4128f9bce9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663c91 expref: 90 pid: 21629 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.811562:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x51:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938441.811565:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x51:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938441.811571:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000090940899/0x7b044d4128f9bcf0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663c98 expref: 89 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.811577:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090940899/0x7b044d4128f9bcf0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663c98 expref: 89 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.811603:0:19220:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000090940899/0x7b044d4128f9bcf0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663c98 expref: 89 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938441.811613:0:19220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd55dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:19220:1871643350834560:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938441.811742:0:19220:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b6a64c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938441.813406:0:19220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd55dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:19220:1871643350834560:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938441.813424:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938441.813462:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+89:10957:x1871643337408512:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 1974us (2152us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938441.813471:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 231 00000100:00100000:1.0:1784938441.815367:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.815484:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337408768 00000100:00100000:2.0:1784938441.815493:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337408768 00000100:00100000:2.0:1784938441.815589:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 53 00000100:00100000:2.0:1784938441.815598:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+316:17096:x1871643337408768:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:2.0:1784938441.815869:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+317:17096:x1871643337408768:12345-192.168.202.54@tcp:35:cp.0 Request processed in 272us (509us total) trans 8589934764 rc 0/0 00000100:00100000:2.0:1784938441.815877:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 53 00000100:00100000:1.0:1784938441.821936:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.822011:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337408896 00000100:00100000:3.0:1784938441.822019:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337408896 00000100:00100000:3.0:1784938441.822073:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 349 00000100:00100000:3.0:1784938441.822084:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+317:17096:x1871643337408896:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938441.822109:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938441.822128:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9bcf7 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663c9f expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.822322:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9bcfe lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.822361:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9bcfe lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.822378:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9bcfe lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.822396:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9bd05 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x610aa076 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.822404:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9bd05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.822411:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9bd05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.822449:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9bcfe lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.822454:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9bcfe lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.822458:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9bcfe lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.822462:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c7000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938441.822465:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9bcfe lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.822469:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9bcfe lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.822477:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938441.822490:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.822494:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9bcfe lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.822499:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9bcfe lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.822508:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9bd05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.822512:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9bd05 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.822516:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9bd05 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.822519:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c6600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938441.822521:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9bd05 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.822524:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9bd05 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.822527:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x610aa076 (ffff9f2485293700) 00010000:00010000:3.0:1784938441.822529:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.822530:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9bd05 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.822533:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9bd05 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.822557:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9bcf7 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c9f expref: 318 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.822569:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938441.822572:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.822575:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9bcf7 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c9f expref: 318 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.822585:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c6a00, rc 0) 00000100:00100000:3.0:1784938441.822672:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+317:17096:x1871643337408896:12345-192.168.202.54@tcp:101:cp.0 Request processed in 590us (746us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938441.822678:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 349 00000100:00100000:1.0:1784938441.824390:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.824476:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337409024 00000100:00100000:3.0:1784938441.824484:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337409024 00000100:00100000:3.0:1784938441.824567:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 350 00000100:00100000:3.0:1784938441.824577:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+317:17096:x1871643337409024:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938441.824599:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938441.824620:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9bd0c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663ca6 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.824686:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9bd13 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.824701:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9bd13 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.824712:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9bd13 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.824725:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bd1a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x610aa076 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.824746:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bd1a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.824753:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bd1a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.824791:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9bd13 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.824798:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9bd13 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.824804:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9bd13 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.824811:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9bd13 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.824817:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fd600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938441.824821:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9bd13 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.824828:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9bd13 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.824840:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938441.824843:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.824848:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9bd13 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.824855:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9bd13 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.824874:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bd1a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.824880:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bd1a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.824886:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bd1a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.824890:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fcc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938441.824893:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bd1a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.824898:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bd1a lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.824905:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x610aa076 (ffff9f238dd4a200) 00010000:00010000:3.0:1784938441.824907:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.824910:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bd1a lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.824915:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bd1a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.824945:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9bd0c lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ca6 expref: 318 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.824954:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938441.824956:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.824966:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9bd0c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ca6 expref: 318 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.824976:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d01800, rc 0) 00000100:00100000:3.0:1784938441.825037:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+317:17096:x1871643337409024:12345-192.168.202.54@tcp:101:cp.0 Request processed in 462us (653us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938441.825045:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 350 00000100:00100000:1.0:1784938441.827367:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.827468:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337409280 00000100:00100000:2.0:1784938441.827476:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337409280 00000100:00100000:2.0:1784938441.827522:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 351 00000100:00100000:2.0:1784938441.827529:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+317:17096:x1871643337409280:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938441.827544:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938441.827562:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bd21 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663cad expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.827656:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9bd28 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.827668:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9bd28 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.827677:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9bd28 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.827686:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9bd2f lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x610aa076 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.827690:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9bd2f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.827694:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9bd2f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938441.827969:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x52:0x0], index 0: 0 00010000:00010000:2.0:1784938441.828079:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3ce00/0x7b044d4128f9bd36 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.828088:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3ce00/0x7b044d4128f9bd36 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.828095:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3ce00/0x7b044d4128f9bd36 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938441.828332:0:24224:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd55dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:24224:1871643350834688:192.168.202.154@tcp:5:osp-pre-0-0.0 00000100:00100000:0.0:1784938441.828412:0:24224:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b6a64c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784938441.828675:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938441.828745:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350834688 00000100:00100000:0.0:1784938441.828750:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350834688 00000100:00100000:0.0:1784938441.828808:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 562 00000100:00100000:0.0:1784938441.828817:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:24224:x1871643350834688:12345-192.168.202.154@tcp:5:osp-pre-0-0.0 00002000:00080000:0.0:1784938441.828853:0:25715:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x280000401 at 98 00000100:00080000:1.0:1784938441.829522:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1784938441.829827:0:25715:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x280000401 at 106 00000001:00080000:0.0:1784938441.830259:0:25715:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967401 00002000:00080000:0.0:1784938441.830275:0:25715:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x280000401 at 114 00000001:00080000:0.0:1784938441.830648:0:25715:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00002000:00080000:0.0:1784938441.830665:0:25715:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x280000401 at 122 00000001:00080000:0.0:1784938441.831038:0:25715:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000100:00100000:0.0:1784938441.831135:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:24224:x1871643350834688:12345-192.168.202.154@tcp:5:osp-pre-0-0.0 Request processed in 2316us (2456us total) trans 4294967404 rc 0/0 00000100:00100000:0.0:1784938441.831165:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 562 00000020:00080000:0.0:1784938441.831171:0:25715:0:(tgt_main.c:784:tgt_ses_key_exit()) total 4 transactions per RPC 00010000:00010000:2.0:1784938441.831383:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9bd28 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.831396:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9bd28 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.831404:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9bd28 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.831411:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217cc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938441.831417:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9bd28 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.831427:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9bd28 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.831448:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938441.831452:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938441.831458:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9bd28 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.831465:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9bd28 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938441.831478:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001a865eda reply state 00000000109deb30 transno 8589934765 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9bd2f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.831491:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9bd2f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.831498:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x610aa076 (ffff9f248fb6aa00) 00010000:00010000:2.0:1784938441.831500:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938441.831502:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938441.831550:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9bd21 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663cad expref: 320 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.831566:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3ce00/0x7b044d4128f9bd36 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663cad expref: 319 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.831574:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x23:0x0].0x0 (ffff9f248fb6a500) 00010000:00010000:2.0:1784938441.831576:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938441.831579:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d3ce00, rc 0) 00000100:00100000:2.0:1784938441.831624:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+320:17096:x1871643337409280:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4095us (4265us total) trans 8589934765 rc 0/0 00000100:00100000:2.0:1784938441.831632:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 351 00000100:00100000:2.0:1784938441.832939:0:24224:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd55dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:24224:1871643350834688:192.168.202.154@tcp:5:osp-pre-0-0.0 00000004:00080000:2.0:1784938441.832958:0:24224:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x52:0x0]-[0x280000401:0x81:0x0] 00000100:00100000:1.0:1784938441.845732:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938441.845792:0:21152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337409408 00000100:00100000:0.0:1784938441.845803:0:21152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337409408 00000100:00100000:0.0:1784938441.845866:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 563 00000100:00100000:0.0:1784938441.845877:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+88:10957:x1871643337409408:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938441.845897:0:21152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938441.845977:0:21152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003d010a8/0x7b044d4128f9bd44 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663cb4 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938441.846005:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x52:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938441.846027:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x52:0x0].0x0 since=708s v=(0 0) 00010000:00010000:0.0:1784938441.846044:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x52:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938441.846055:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003d010a8/0x7b044d4128f9bd44 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663cb4 expref: 89 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.846074:0:21152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000003d010a8/0x7b044d4128f9bd44 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663cb4 expref: 89 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.846088:0:21152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a7600, rc 0) 00000100:00100000:0.0:1784938441.846182:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+89:10957:x1871643337409408:12345-192.168.202.54@tcp:101:cp.0 Request processed in 307us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938441.846188:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 563 00000100:00100000:0.0:1784938441.851246:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.851532:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337409536 00000100:00100000:2.0:1784938441.851541:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337409536 00000100:00100000:2.0:1784938441.851603:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 564 00000100:00100000:2.0:1784938441.851613:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+89:17096:x1871643337409536:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938441.851635:0:21149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938441.851660:0:21149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049aad0c1/0x7b044d4128f9bd4b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663cbb expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.851700:0:21149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000003d010a8/0x7b044d4128f9bd44 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663cb4 expref: 90 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.851710:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x52:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938441.851715:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x52:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938441.851720:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049aad0c1/0x7b044d4128f9bd4b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663cbb expref: 90 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.851776:0:21149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000003d010a8/0x7b044d4128f9bd44 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663cb4 expref: 90 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.851792:0:21149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000003d010a8/0x7b044d4128f9bd44 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663cb4 expref: 90 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938441.851812:0:21149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f198a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:21149:1871643350834816:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938441.851917:0:21149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2482cd3000 going to sleep for 11 seconds 00000100:00100000:2.0:1784938441.864374:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.864942:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337409664 00000100:00100000:1.0:1784938441.864954:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337409664 00010000:00010000:1.0:1784938441.864997:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000003d010a8/0x7b044d4128f9bd44 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663cb4 expref: 91 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938441.865052:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 232 00000100:00100000:1.0:1784938441.865062:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f199f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+91:10960:x1871643337409664:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938441.865078:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938441.865103:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000003d010a8/0x7b044d4128f9bd44 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663cb4 expref: 91 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.865119:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000003d010a8/0x7b044d4128f9bd44 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663cb4 expref: 91 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.865425:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x52:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938441.865429:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x52:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938441.865439:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000049aad0c1/0x7b044d4128f9bd4b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663cbb expref: 91 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.865451:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049aad0c1/0x7b044d4128f9bd4b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663cbb expref: 91 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.865490:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000049aad0c1/0x7b044d4128f9bd4b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663cbb expref: 91 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938441.865506:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd5a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350834944:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938441.865589:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2487fb16c0 going to sleep for 11 seconds 00010000:00010000:3.0:1784938441.867692:0:21149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003d010a8/0x7b044d4128f9bd44 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663cb4 expref: 91 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938441.867719:0:21149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f198a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:21149:1871643350834816:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938441.867751:0:21149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000049aad0c1/0x7b044d4128f9bd4b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663cbb expref: 90 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.867768:0:21149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d3c000, rc 0) 00000100:00100000:3.0:1784938441.867832:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+90:17096:x1871643337409536:12345-192.168.202.54@tcp:101:cp.0 Request processed in 16220us (16604us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938441.867840:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 564 00000100:00100000:1.0:1784938441.868876:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd5a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350834944:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938441.868909:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938441.869034:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f199f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+89:10960:x1871643337409664:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3965us (4662us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938441.869046:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 232 00000100:00100000:2.0:1784938441.881020:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.881124:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337409920 00000100:00100000:1.0:1784938441.881133:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337409920 00000100:00100000:1.0:1784938441.881213:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 54 00000100:00100000:1.0:1784938441.881224:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f19a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+320:17096:x1871643337409920:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:1.0:1784938441.881672:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f19a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+321:17096:x1871643337409920:12345-192.168.202.54@tcp:35:cp.0 Request processed in 448us (658us total) trans 8589934766 rc 0/0 00000100:00100000:1.0:1784938441.881682:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 54 00000100:00100000:2.0:1784938441.889692:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.890356:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337410048 00000100:00100000:1.0:1784938441.890368:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337410048 00000100:00100000:1.0:1784938441.890494:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 352 00000100:00100000:1.0:1784938441.890507:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f19bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+321:17096:x1871643337410048:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938441.890533:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938441.890559:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9bd52 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663cc2 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.890635:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9bd59 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.890653:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9bd59 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.890673:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9bd59 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.890690:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bd60 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x72a71b3d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.890697:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bd60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.890704:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bd60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.890761:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9bd59 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.890769:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9bd59 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.890776:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9bd59 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.890782:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b34000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.890787:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9bd59 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.890795:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9bd59 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.890807:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.890810:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.890816:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9bd59 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.890822:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9bd59 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.890850:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bd60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.890858:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bd60 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.890865:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bd60 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.890870:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.890873:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bd60 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.890879:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bd60 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.890887:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x72a71b3d (ffff9f23823e1300) 00010000:00010000:1.0:1784938441.890890:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.890894:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bd60 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.890912:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bd60 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.890946:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9bd52 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663cc2 expref: 322 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.890962:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.890964:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.890969:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9bd52 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663cc2 expref: 322 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.890979:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b34a00, rc 0) 00000100:00100000:1.0:1784938441.891065:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f19bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+321:17096:x1871643337410048:12345-192.168.202.54@tcp:101:cp.0 Request processed in 560us (1385us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938441.891072:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 352 00000100:00100000:2.0:1784938441.894861:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.894982:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337410176 00000100:00100000:3.0:1784938441.894991:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337410176 00000100:00100000:3.0:1784938441.895052:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 353 00000100:00100000:3.0:1784938441.895061:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+321:17096:x1871643337410176:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938441.895082:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938441.895139:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34c00/0x7b044d4128f9bd67 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663cc9 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.895233:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9bd6e lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.895248:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9bd6e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.895258:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9bd6e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.895273:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35e00/0x7b044d4128f9bd75 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x72a71b3d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.895280:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35e00/0x7b044d4128f9bd75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.895287:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35e00/0x7b044d4128f9bd75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.895327:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9bd6e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.895353:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9bd6e lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.895360:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9bd6e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.895367:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.895372:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9bd6e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.895379:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9bd6e lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.895391:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.895394:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.895398:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9bd6e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.895403:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9bd6e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.895415:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35e00/0x7b044d4128f9bd75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.895420:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35e00/0x7b044d4128f9bd75 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.895426:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35e00/0x7b044d4128f9bd75 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.895431:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.895433:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35e00/0x7b044d4128f9bd75 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.895439:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35e00/0x7b044d4128f9bd75 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.895446:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x72a71b3d (ffff9f23823e1900) 00010000:00010000:1.0:1784938441.895448:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.895451:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35e00/0x7b044d4128f9bd75 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.895457:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35e00/0x7b044d4128f9bd75 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.895489:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34c00/0x7b044d4128f9bd67 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663cc9 expref: 322 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.895500:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.895502:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.895505:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34c00/0x7b044d4128f9bd67 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663cc9 expref: 322 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.895516:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b34c00, rc 0) 00000100:00100000:1.0:1784938441.895582:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+321:17096:x1871643337410176:12345-192.168.202.54@tcp:101:cp.0 Request processed in 522us (730us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938441.895589:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 353 00000100:00100000:2.0:1784938441.898959:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.899056:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337410432 00000100:00100000:3.0:1784938441.899067:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337410432 00000100:00100000:3.0:1784938441.899187:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 354 00000100:00100000:3.0:1784938441.899198:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+321:17096:x1871643337410432:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938441.899232:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938441.899259:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bd7c lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663cd0 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.899385:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9bd83 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.899402:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9bd83 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.899414:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9bd83 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.899431:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9bd8a lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x72a71b3d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.899438:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9bd8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.899445:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9bd8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938441.899765:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x52:0x0], index 1: 0 00010000:00010000:3.0:1784938441.899900:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9bd91 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.899910:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9bd91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.899918:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9bd91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.899963:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9bd83 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.899970:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9bd83 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.899976:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9bd83 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.899983:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9bd83 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.899989:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fd600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938441.899994:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9bd83 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.900001:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9bd83 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.900012:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938441.900016:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938441.900020:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9bd83 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.900027:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9bd83 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938441.900040:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000542fa9e reply state 0000000044015997 transno 8589934767 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9bd8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.900051:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9bd8a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.900063:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x72a71b3d (ffff9f238dd4a200) 00010000:00010000:3.0:1784938441.900065:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938441.900068:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938441.900099:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bd7c lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663cd0 expref: 324 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.900114:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9bd91 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663cd0 expref: 323 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.900121:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x24:0x0].0x0 (ffff9f238dd4a800) 00010000:00010000:3.0:1784938441.900123:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938441.900126:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c6a00, rc 0) 00000100:00100000:3.0:1784938441.900227:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+324:17096:x1871643337410432:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1031us (1277us total) trans 8589934767 rc 0/0 00000100:00100000:3.0:1784938441.900236:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 354 00000100:00100000:0.0:1784938441.900506:0:24226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd55df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:24226:1871643350835072:192.168.202.154@tcp:5:osp-pre-1-0.0 00000100:00100000:0.0:1784938441.900574:0:24226:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b6a64c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938441.900891:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938441.902658:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350835072 00000100:00100000:3.0:1784938441.902671:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350835072 00000100:00100000:3.0:1784938441.902784:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 565 00000100:00100000:3.0:1784938441.902800:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f19a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:24226:x1871643350835072:12345-192.168.202.154@tcp:5:osp-pre-1-0.0 00002000:00080000:3.0:1784938441.902847:0:21151:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x2c0000401 at 98 00002000:00080000:3.0:1784938441.903605:0:21151:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x2c0000401 at 106 00000100:00080000:1.0:1784938441.903837:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1784938441.904365:0:21151:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967401 00002000:00080000:3.0:1784938441.904386:0:21151:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x2c0000401 at 114 00000001:00080000:3.0:1784938441.905329:0:21151:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00002000:00080000:3.0:1784938441.905362:0:21151:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x2c0000401 at 122 00000001:00080000:3.0:1784938441.905661:0:21151:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000100:00100000:3.0:1784938441.905831:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f19a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:24226:x1871643350835072:12345-192.168.202.154@tcp:5:osp-pre-1-0.0 Request processed in 3026us (4932us total) trans 4294967404 rc 0/0 00000100:00100000:3.0:1784938441.905849:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 565 00000020:00080000:3.0:1784938441.905855:0:21151:0:(tgt_main.c:784:tgt_ses_key_exit()) total 4 transactions per RPC 00000100:00100000:3.0:1784938441.906768:0:24226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd55df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:24226:1871643350835072:192.168.202.154@tcp:5:osp-pre-1-0.0 00000004:00080000:3.0:1784938441.906786:0:24226:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x52:0x0]-[0x2c0000401:0x81:0x0] 00000100:00100000:0.0:1784938441.909915:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.910068:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337410560 00000100:00100000:3.0:1784938441.910079:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337410560 00000100:00100000:3.0:1784938441.910139:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 566 00000100:00100000:2.0:1784938441.910329:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+89:10960:x1871643337410560:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938441.910365:0:21629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938441.910392:0:21629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066704ef9/0x7b044d4128f9bd9f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663cd7 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938441.910425:0:21629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x52:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938441.910451:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x52:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1784938441.910457:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x52:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938441.910469:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066704ef9/0x7b044d4128f9bd9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663cd7 expref: 90 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.910492:0:21629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000066704ef9/0x7b044d4128f9bd9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663cd7 expref: 90 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.910509:0:21629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d3ca00, rc 0) 00000100:00100000:2.0:1784938441.910583:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+90:10960:x1871643337410560:12345-192.168.202.54@tcp:101:cp.0 Request processed in 298us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938441.910591:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 566 00000100:00100000:0.0:1784938441.916331:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.916435:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337410688 00000100:00100000:1.0:1784938441.916445:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337410688 00000100:00100000:1.0:1784938441.916496:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 567 00000100:00100000:1.0:1784938441.916505:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+90:17096:x1871643337410688:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938441.916522:0:25716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938441.916539:0:25716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a00afcf/0x7b044d4128f9bda6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663cde expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.916569:0:25716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000066704ef9/0x7b044d4128f9bd9f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663cd7 expref: 91 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.916578:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x52:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938441.916583:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x52:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938441.916588:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a00afcf/0x7b044d4128f9bda6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663cde expref: 91 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.916618:0:25716:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000066704ef9/0x7b044d4128f9bd9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663cd7 expref: 91 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.916632:0:25716:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000066704ef9/0x7b044d4128f9bd9f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663cd7 expref: 91 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938441.916646:0:25716:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd5a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25716:1871643350835200:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938441.916721:0:25716:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2487fb1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784938441.921401:0:25716:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd5a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25716:1871643350835200:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938441.921443:0:25716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000a00afcf/0x7b044d4128f9bda6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663cde expref: 91 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.921461:0:25716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b34c00, rc 0) 00000100:00100000:1.0:1784938441.921514:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+91:17096:x1871643337410688:12345-192.168.202.54@tcp:101:cp.0 Request processed in 5010us (5193us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938441.921520:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 567 00000100:00100000:0.0:1784938441.922707:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.923113:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337410816 00000100:00100000:2.0:1784938441.923122:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337410816 00010000:00010000:2.0:1784938441.923245:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000066704ef9/0x7b044d4128f9bd9f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663cd7 expref: 91 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938441.923278:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 233 00000100:00100000:2.0:1784938441.923286:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+91:10958:x1871643337410816:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938441.923300:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938441.923320:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000066704ef9/0x7b044d4128f9bd9f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663cd7 expref: 91 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.923333:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000066704ef9/0x7b044d4128f9bd9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663cd7 expref: 91 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.923376:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066704ef9/0x7b044d4128f9bd9f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663cd7 expref: 91 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.923392:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x52:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938441.923397:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x52:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938441.923405:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000a00afcf/0x7b044d4128f9bda6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663cde expref: 90 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.923416:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a00afcf/0x7b044d4128f9bda6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663cde expref: 90 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.923459:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000a00afcf/0x7b044d4128f9bda6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663cde expref: 90 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938441.923475:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f198700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350835328:192.168.202.54@tcp:105: 00000100:00100000:2.0:1784938441.923548:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2482cd3000 going to sleep for 11 seconds 00000100:00100000:0.0:1784938441.926861:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.926966:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337411072 00000100:00100000:1.0:1784938441.926975:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337411072 00000100:00100000:1.0:1784938441.927032:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 55 00000100:00100000:1.0:1784938441.927052:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+324:17096:x1871643337411072:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:1.0:1784938441.927373:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+325:17096:x1871643337411072:12345-192.168.202.54@tcp:35:cp.0 Request processed in 331us (520us total) trans 8589934768 rc 0/0 00000100:00100000:1.0:1784938441.927381:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 55 00000100:00100000:2.0:1784938441.930072:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f198700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350835328:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938441.930100:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938441.930229:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+90:10958:x1871643337410816:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 6943us (7524us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938441.930240:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 233 00000100:00100000:0.0:1784938441.931092:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.931883:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337411200 00000100:00100000:2.0:1784938441.931892:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337411200 00000100:00100000:2.0:1784938441.932077:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 355 00000100:00100000:2.0:1784938441.932087:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+325:17096:x1871643337411200:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938441.932110:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938441.932288:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9bdad lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663ce5 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.932362:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3ca00/0x7b044d4128f9bdb4 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.932377:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3ca00/0x7b044d4128f9bdb4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.932388:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3ca00/0x7b044d4128f9bdb4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.932402:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9bdbb lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xa9dd9870 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.932408:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9bdbb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.932414:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9bdbb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.932451:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3ca00/0x7b044d4128f9bdb4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.932458:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3ca00/0x7b044d4128f9bdb4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.932464:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3ca00/0x7b044d4128f9bdb4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.932469:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3ca00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938441.932473:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3ca00/0x7b044d4128f9bdb4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.932481:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3ca00/0x7b044d4128f9bdb4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.932492:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938441.932495:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938441.932499:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3ca00/0x7b044d4128f9bdb4 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.932505:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3ca00/0x7b044d4128f9bdb4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.932516:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9bdbb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.932522:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9bdbb lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.932527:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9bdbb lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.932531:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3d000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938441.932534:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9bdbb lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.932540:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9bdbb lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.932547:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xa9dd9870 (ffff9f248fb6af00) 00010000:00010000:2.0:1784938441.932549:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938441.932552:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9bdbb lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.932557:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9bdbb lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.932589:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9bdad lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ce5 expref: 326 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.932598:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938441.932601:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938441.932605:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9bdad lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ce5 expref: 326 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.932612:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d3da00, rc 0) 00000100:00100000:2.0:1784938441.932670:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+325:17096:x1871643337411200:12345-192.168.202.54@tcp:101:cp.0 Request processed in 585us (1580us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938441.932677:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 355 00000100:00100000:3.0:1784938441.936264:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.936768:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337411328 00000100:00100000:1.0:1784938441.936779:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337411328 00000100:00100000:1.0:1784938441.936845:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 356 00000100:00100000:1.0:1784938441.936854:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+325:17096:x1871643337411328:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938441.936874:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938441.936907:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35e00/0x7b044d4128f9bdc2 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663cec expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.936983:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9bdc9 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.936998:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9bdc9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.937010:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9bdc9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.937025:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9bdd0 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xa9dd9870 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.937096:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9bdd0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.937103:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9bdd0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.937218:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9bdc9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.937227:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9bdc9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.937234:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9bdc9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.937240:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.937244:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9bdc9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.937250:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9bdc9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.937262:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.937265:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.937270:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9bdc9 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.937276:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9bdc9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.937290:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9bdd0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.937297:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9bdd0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.937303:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9bdd0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.937308:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b34a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.937311:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9bdd0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.937316:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9bdd0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.937323:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xa9dd9870 (ffff9f23823e1900) 00010000:00010000:1.0:1784938441.937326:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.937328:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9bdd0 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.937345:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9bdd0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.937378:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35e00/0x7b044d4128f9bdc2 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663cec expref: 326 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.937388:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.937390:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.937395:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35e00/0x7b044d4128f9bdc2 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663cec expref: 326 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.937404:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b35e00, rc 0) 00000100:00100000:1.0:1784938441.937459:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+325:17096:x1871643337411328:12345-192.168.202.54@tcp:101:cp.0 Request processed in 607us (1206us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938441.937466:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 356 00000100:00100000:3.0:1784938441.940447:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.940612:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337411584 00000100:00100000:1.0:1784938441.940624:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337411584 00000100:00100000:1.0:1784938441.940693:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 357 00000100:00100000:1.0:1784938441.940703:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+325:17096:x1871643337411584:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938441.940723:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938441.940747:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9bdd7 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663cf3 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.940853:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bdde lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.940868:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bdde lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.940879:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bdde lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.940894:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9bde5 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0xa9dd9870 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.940901:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9bde5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.940907:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9bde5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938441.941387:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x53:0x0], index 0: 0 00010000:00010000:1.0:1784938441.941519:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9bdec lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.941528:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9bdec lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.941535:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9bdec lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.941565:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bdde lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.941572:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bdde lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.941578:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bdde lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.941584:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938441.941588:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bdde lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.941596:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bdde lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.941606:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938441.941609:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938441.941614:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bdde lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.941624:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35400/0x7b044d4128f9bdde lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938441.941637:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000064083997 reply state 000000000d481eda transno 8589934769 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9bde5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.941647:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9bde5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.941653:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xa9dd9870 (ffff9f23823e1300) 00010000:00010000:1.0:1784938441.941656:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938441.941659:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938441.941687:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9bdd7 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663cf3 expref: 328 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.941704:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9bdec lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663cf3 expref: 327 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938441.941711:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x25:0x0].0x0 (ffff9f23823e1c00) 00010000:00010000:1.0:1784938441.941713:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938441.941715:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c9f7000, rc 0) 00000100:00100000:1.0:1784938441.941781:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+328:17096:x1871643337411584:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1079us (1342us total) trans 8589934769 rc 0/0 00000100:00100000:1.0:1784938441.941788:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 357 00000100:00100000:2.0:1784938441.944965:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.945054:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337411712 00000100:00100000:3.0:1784938441.945065:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337411712 00000100:00100000:3.0:1784938441.945142:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 568 00000100:00100000:3.0:1784938441.945190:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f198700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+89:10958:x1871643337411712:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938441.945210:0:25715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938441.945230:0:25715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063ef4b0e/0x7b044d4128f9bdfa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663cfa expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938441.945259:0:25715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x53:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938441.945280:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x53:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1784938441.945285:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x53:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938441.945295:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063ef4b0e/0x7b044d4128f9bdfa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663cfa expref: 90 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.945314:0:25715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000063ef4b0e/0x7b044d4128f9bdfa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663cfa expref: 90 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.945365:0:25715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c6600, rc 0) 00000100:00100000:3.0:1784938441.945424:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f198700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+90:10958:x1871643337411712:12345-192.168.202.54@tcp:101:cp.0 Request processed in 236us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938441.945431:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 568 00000100:00100000:2.0:1784938441.948728:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938441.948978:0:21152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337411840 00000100:00100000:0.0:1784938441.948988:0:21152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337411840 00000100:00100000:0.0:1784938441.949047:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 569 00000100:00100000:0.0:1784938441.949057:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+90:17096:x1871643337411840:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938441.949075:0:21152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938441.949093:0:21152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d8bba03/0x7b044d4128f9be01 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663d01 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.949123:0:21152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000063ef4b0e/0x7b044d4128f9bdfa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663cfa expref: 91 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.949131:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x53:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938441.949136:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x53:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938441.949140:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d8bba03/0x7b044d4128f9be01 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d01 expref: 91 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.949205:0:21152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000063ef4b0e/0x7b044d4128f9bdfa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663cfa expref: 91 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.949219:0:21152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000063ef4b0e/0x7b044d4128f9bdfa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663cfa expref: 91 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938441.949233:0:21152:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd55ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:21152:1871643350835456:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938441.949318:0:21152:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b6a64c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938441.951754:0:21152:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd55ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:21152:1871643350835456:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938441.951791:0:21152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001d8bba03/0x7b044d4128f9be01 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663d01 expref: 91 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.951811:0:21152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a7c00, rc 0) 00000100:00100000:0.0:1784938441.951866:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+91:17096:x1871643337411840:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2811us (3150us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938441.951874:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 569 00000100:00100000:3.0:1784938441.953067:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938441.953256:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337411968 00000100:00100000:0.0:1784938441.953264:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337411968 00010000:00010000:0.0:1784938441.953302:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000063ef4b0e/0x7b044d4128f9bdfa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663cfa expref: 91 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938441.953350:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 234 00000100:00100000:0.0:1784938441.953359:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+91:10960:x1871643337411968:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938441.953374:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938441.953398:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000063ef4b0e/0x7b044d4128f9bdfa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663cfa expref: 91 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.953411:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000063ef4b0e/0x7b044d4128f9bdfa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663cfa expref: 91 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.953434:0:22955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063ef4b0e/0x7b044d4128f9bdfa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663cfa expref: 91 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.953454:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x53:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938441.953458:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x53:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938441.953467:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001d8bba03/0x7b044d4128f9be01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663d01 expref: 90 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.953478:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d8bba03/0x7b044d4128f9be01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663d01 expref: 90 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.953514:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001d8bba03/0x7b044d4128f9be01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663d01 expref: 90 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938441.953527:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd55ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350835584:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938441.953604:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b6a64c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938441.956473:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd55ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350835584:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938441.956501:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938441.956557:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+90:10960:x1871643337411968:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3198us (3495us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938441.956569:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 234 00000100:00100000:2.0:1784938441.960565:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.960819:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337412224 00000100:00100000:1.0:1784938441.960831:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337412224 00000100:00100000:1.0:1784938441.960937:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 56 00000100:00100000:1.0:1784938441.960948:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f19b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+328:17096:x1871643337412224:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:1.0:1784938441.961294:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f19b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+329:17096:x1871643337412224:12345-192.168.202.54@tcp:35:cp.0 Request processed in 347us (740us total) trans 8589934770 rc 0/0 00000100:00100000:1.0:1784938441.961301:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 56 00000100:00100000:3.0:1784938441.964075:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.964250:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337412352 00000100:00100000:2.0:1784938441.964260:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337412352 00000100:00100000:2.0:1784938441.964321:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 358 00000100:00100000:2.0:1784938441.964331:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+329:17096:x1871643337412352:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938441.964367:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938441.964390:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3ca00/0x7b044d4128f9be08 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663d08 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.964456:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9be0f lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.964473:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9be0f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.964484:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9be0f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.964498:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9be16 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x839e9634 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.964510:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9be16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.964516:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9be16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.964551:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9be0f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.964557:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9be0f lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.964563:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9be0f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.964569:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3d600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938441.964573:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9be0f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.964581:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9be0f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.964593:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938441.964596:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938441.964600:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9be0f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.964606:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9be0f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.964618:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9be16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.964624:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9be16 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.964629:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9be16 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.964634:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3d000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938441.964636:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9be16 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.964641:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9be16 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.964647:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x839e9634 (ffff9f248fb6af00) 00010000:00010000:2.0:1784938441.964649:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938441.964651:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9be16 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.964656:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9be16 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.964690:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3ca00/0x7b044d4128f9be08 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d08 expref: 330 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.964699:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938441.964701:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938441.964704:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3ca00/0x7b044d4128f9be08 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d08 expref: 330 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.964718:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d3ca00, rc 0) 00000100:00100000:2.0:1784938441.964780:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+329:17096:x1871643337412352:12345-192.168.202.54@tcp:101:cp.0 Request processed in 451us (714us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938441.964787:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 358 00000100:00100000:3.0:1784938441.967985:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938441.968109:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337412480 00000100:00100000:0.0:1784938441.968120:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337412480 00000100:00100000:0.0:1784938441.968219:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 359 00000100:00100000:0.0:1784938441.968228:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+329:17096:x1871643337412480:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938441.968256:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938441.968278:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7000/0x7b044d4128f9be1d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663d0f expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.968363:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9be24 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.968378:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9be24 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.968390:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9be24 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.968407:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9be2b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x839e9634 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.968414:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9be2b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.968420:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9be2b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.968478:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9be24 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.968485:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9be24 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.968492:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9be24 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.968498:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a6400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938441.968502:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9be24 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.968515:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9be24 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.968527:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938441.968530:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938441.968535:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9be24 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.968541:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9be24 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.968556:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9be2b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.968561:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9be2b lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.968568:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9be2b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.968572:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a6000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938441.968574:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9be2b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.968580:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9be2b lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.968586:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x839e9634 (ffff9f2487e3ae00) 00010000:00010000:0.0:1784938441.968588:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938441.968591:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9be2b lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.968600:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9be2b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.968627:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7000/0x7b044d4128f9be1d lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d0f expref: 330 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.968635:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938441.968638:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938441.968641:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7000/0x7b044d4128f9be1d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d0f expref: 330 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938441.968650:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a7000, rc 0) 00000100:00100000:0.0:1784938441.968709:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+329:17096:x1871643337412480:12345-192.168.202.54@tcp:101:cp.0 Request processed in 482us (735us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938441.968717:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 359 00000100:00100000:3.0:1784938441.972296:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.972534:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337412736 00000100:00100000:2.0:1784938441.972544:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337412736 00000100:00100000:2.0:1784938441.972600:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 360 00000100:00100000:2.0:1784938441.972610:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+329:17096:x1871643337412736:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938441.972634:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938441.972663:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d400/0x7b044d4128f9be32 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663d16 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.972791:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9be39 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.972808:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9be39 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.972819:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9be39 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.972834:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9be40 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x839e9634 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.972841:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9be40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.972848:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9be40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938441.973204:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x53:0x0], index 1: 0 00010000:00010000:2.0:1784938441.973369:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9be47 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.973379:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9be47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.973387:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9be47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.973420:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9be39 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.973427:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9be39 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.973434:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9be39 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.973439:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3da00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938441.973443:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9be39 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.973450:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9be39 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.973462:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938441.973465:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938441.973469:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9be39 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.973480:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9be39 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938441.973494:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dee85eb4 reply state 0000000006ed9510 transno 8589934771 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9be40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.973505:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9be40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.973511:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x839e9634 (ffff9f248fb6a400) 00010000:00010000:2.0:1784938441.973514:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938441.973516:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938441.973546:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d400/0x7b044d4128f9be32 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d16 expref: 332 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.973561:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9be47 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d16 expref: 331 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.973569:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x26:0x0].0x0 (ffff9f23823dc600) 00010000:00010000:2.0:1784938441.973571:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938441.973573:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217cc00, rc 0) 00000100:00100000:2.0:1784938441.973642:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+332:17096:x1871643337412736:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1033us (1355us total) trans 8589934771 rc 0/0 00000100:00100000:2.0:1784938441.973651:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 360 00000100:00100000:2.0:1784938441.979248:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938441.979449:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337412864 00000100:00100000:3.0:1784938441.979458:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337412864 00000100:00100000:3.0:1784938441.979573:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 570 00000100:00100000:3.0:1784938441.979586:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f19ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+90:10960:x1871643337412864:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938441.979608:0:21149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938441.979630:0:21149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000705500be/0x7b044d4128f9be55 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663d1d expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938441.979656:0:21149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x53:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938441.979676:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x53:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1784938441.979681:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x53:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938441.979692:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000705500be/0x7b044d4128f9be55 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d1d expref: 91 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.979710:0:21149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000705500be/0x7b044d4128f9be55 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d1d expref: 91 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.979745:0:21149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c7000, rc 0) 00000100:00100000:3.0:1784938441.979809:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f19ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+91:10960:x1871643337412864:12345-192.168.202.54@tcp:101:cp.0 Request processed in 226us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938441.979817:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 570 00000100:00100000:3.0:1784938441.983637:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.983731:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337412992 00000100:00100000:2.0:1784938441.983740:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337412992 00000100:00100000:2.0:1784938441.983807:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 571 00000100:00100000:2.0:1784938441.983817:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+91:17096:x1871643337412992:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938441.983834:0:25715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938441.983850:0:25715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9ba2df7/0x7b044d4128f9be5c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663d24 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.983879:0:25715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000705500be/0x7b044d4128f9be55 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d1d expref: 92 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.983888:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x53:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938441.983892:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x53:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938441.983897:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9ba2df7/0x7b044d4128f9be5c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d24 expref: 92 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.983939:0:25715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000705500be/0x7b044d4128f9be55 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663d1d expref: 92 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.983952:0:25715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000705500be/0x7b044d4128f9be55 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663d1d expref: 92 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938441.983966:0:25715:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f19b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25715:1871643350835712:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938441.984065:0:25715:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f249d709780 going to sleep for 11 seconds 00000100:00100000:3.0:1784938441.988214:0:25715:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f19b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25715:1871643350835712:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938441.988250:0:25715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b9ba2df7/0x7b044d4128f9be5c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663d24 expref: 92 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938441.988269:0:25715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d3d400, rc 0) 00000100:00100000:3.0:1784938441.988344:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+92:17096:x1871643337412992:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4518us (4707us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938441.988353:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 571 00000100:00100000:0.0:1784938441.989813:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938441.989908:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337413120 00000100:00100000:2.0:1784938441.989916:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337413120 00010000:00010000:2.0:1784938441.989953:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000705500be/0x7b044d4128f9be55 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663d1d expref: 92 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938441.990066:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 235 00000100:00100000:2.0:1784938441.990076:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+92:10957:x1871643337413120:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938441.990090:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938441.990112:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000705500be/0x7b044d4128f9be55 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663d1d expref: 92 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.990125:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000705500be/0x7b044d4128f9be55 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663d1d expref: 92 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.990299:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000705500be/0x7b044d4128f9be55 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663d1d expref: 92 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.990317:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x53:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938441.990321:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x53:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938441.990330:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b9ba2df7/0x7b044d4128f9be5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663d24 expref: 91 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.990351:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9ba2df7/0x7b044d4128f9be5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663d24 expref: 91 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938441.990387:0:19220:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b9ba2df7/0x7b044d4128f9be5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663d24 expref: 91 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938441.990402:0:19220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f19b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:19220:1871643350835840:192.168.202.54@tcp:105: 00000100:00100000:2.0:1784938441.990535:0:19220:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f249d709780 going to sleep for 11 seconds 00000100:00100000:0.0:1784938441.995384:0:19220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f19b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:19220:1871643350835840:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938441.995414:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938441.995479:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+91:10957:x1871643337413120:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 5403us (5670us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938441.995492:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 235 00000100:00100000:3.0:1784938441.998252:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938441.998663:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337413376 00000100:00100000:1.0:1784938441.998674:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337413376 00000100:00100000:1.0:1784938441.998730:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 57 00000100:00100000:1.0:1784938441.998740:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24857f9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+332:17096:x1871643337413376:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:1.0:1784938441.999306:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24857f9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+333:17096:x1871643337413376:12345-192.168.202.54@tcp:35:cp.0 Request processed in 566us (1060us total) trans 8589934772 rc 0/0 00000100:00100000:1.0:1784938441.999315:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 57 00000100:00100000:2.0:1784938442.002547:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.002653:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337413504 00000100:00100000:0.0:1784938442.002663:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337413504 00000100:00100000:0.0:1784938442.002730:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 361 00000100:00100000:0.0:1784938442.002742:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f19a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+333:17096:x1871643337413504:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938442.002767:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938442.002790:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9be63 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663d2b expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.002854:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9be6a lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.002869:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9be6a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.002880:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9be6a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.002895:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9be71 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x9e90f16b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.002913:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9be71 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.002921:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9be71 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.002962:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9be6a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.002970:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9be6a lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.002976:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9be6a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.002983:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a6400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938442.002987:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9be6a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.003000:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9be6a lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.003012:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938442.003016:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.003020:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9be6a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.003026:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9be6a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.003040:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9be71 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.003046:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9be71 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.003053:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9be71 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.003058:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a6200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938442.003061:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9be71 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.003067:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9be71 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.003074:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x9e90f16b (ffff9f2487e3ae00) 00010000:00010000:0.0:1784938442.003076:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.003079:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9be71 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.003088:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9be71 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.003120:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9be63 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d2b expref: 334 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.003188:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938442.003191:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.003196:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9be63 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d2b expref: 334 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.003206:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a6000, rc 0) 00000100:00100000:0.0:1784938442.003261:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f19a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+333:17096:x1871643337413504:12345-192.168.202.54@tcp:101:cp.0 Request processed in 522us (724us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938442.003267:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 361 00000100:00100000:3.0:1784938442.008628:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938442.008735:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337413632 00000100:00100000:2.0:1784938442.008745:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337413632 00000100:00100000:2.0:1784938442.008805:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 362 00000100:00100000:2.0:1784938442.008815:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+333:17096:x1871643337413632:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938442.008835:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938442.008857:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9be78 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663d32 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.008938:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9be7f lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.008952:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9be7f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.008962:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9be7f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.008977:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9be86 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x9e90f16b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.008984:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9be86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.008990:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9be86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.009030:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9be7f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.009052:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9be7f lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.009058:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9be7f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.009064:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3d000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938442.009067:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9be7f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.009074:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9be7f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.009085:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938442.009088:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.009092:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9be7f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.009097:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9be7f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.009109:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9be86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.009115:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9be86 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.009120:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9be86 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.009135:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3da00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938442.009139:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9be86 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.009190:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9be86 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.009199:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x9e90f16b (ffff9f23823dc000) 00010000:00010000:2.0:1784938442.009202:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.009205:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9be86 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.009210:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9be86 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.009244:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9be78 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d32 expref: 334 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.009256:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938442.009258:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.009262:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9be78 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d32 expref: 334 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.009272:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d3d600, rc 0) 00000100:00100000:2.0:1784938442.009352:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+333:17096:x1871643337413632:12345-192.168.202.54@tcp:101:cp.0 Request processed in 539us (734us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938442.009360:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 362 00000100:00100000:2.0:1784938442.012238:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.012371:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337413888 00000100:00100000:0.0:1784938442.012382:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337413888 00000100:00100000:0.0:1784938442.012447:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 363 00000100:00100000:0.0:1784938442.012457:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f19b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+333:17096:x1871643337413888:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938442.012478:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938442.012499:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9be8d lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663d39 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.012603:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9be94 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.012617:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9be94 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.012629:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9be94 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.012643:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9be9b lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x9e90f16b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.012650:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9be9b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.012656:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9be9b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938442.012983:0:24203:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x54:0x0], index 0: 0 00010000:00010000:0.0:1784938442.013369:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7e00/0x7b044d4128f9bea2 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.013380:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7e00/0x7b044d4128f9bea2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.013389:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7e00/0x7b044d4128f9bea2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.013426:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9be94 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.013433:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9be94 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.013439:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9be94 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.013445:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a6200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938442.013450:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9be94 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.013457:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9be94 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.013469:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938442.013472:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.013477:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9be94 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.013484:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9be94 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938442.013497:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b665c6d9 reply state 000000004a1a4bd4 transno 8589934773 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9be9b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.013508:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9be9b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.013513:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x9e90f16b (ffff9f2487e3ae00) 00010000:00010000:0.0:1784938442.013516:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938442.013519:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938442.013550:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9be8d lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d39 expref: 336 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.013564:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7e00/0x7b044d4128f9bea2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d39 expref: 335 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.013571:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x27:0x0].0x0 (ffff9f2487e3a600) 00010000:00010000:0.0:1784938442.013573:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938442.013576:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a7e00, rc 0) 00000100:00100000:0.0:1784938442.013647:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f19b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+336:17096:x1871643337413888:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1191us (1417us total) trans 8589934773 rc 0/0 00000100:00100000:0.0:1784938442.013654:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 363 00000100:00100000:3.0:1784938442.021255:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938442.021450:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337414016 00000100:00100000:2.0:1784938442.021461:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337414016 00000100:00100000:2.0:1784938442.021528:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 572 00000100:00100000:2.0:1784938442.021540:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+90:10958:x1871643337414016:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938442.021558:0:21629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938442.021578:0:21629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024cec4ff/0x7b044d4128f9beb0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663d40 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938442.021602:0:21629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x54:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938442.021623:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x54:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1784938442.021628:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x54:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.021639:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024cec4ff/0x7b044d4128f9beb0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d40 expref: 91 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.021656:0:21629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024cec4ff/0x7b044d4128f9beb0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d40 expref: 91 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.021670:0:21629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d3d600, rc 0) 00000100:00100000:2.0:1784938442.021733:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+91:10958:x1871643337414016:12345-192.168.202.54@tcp:101:cp.0 Request processed in 195us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938442.021741:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 572 00000100:00100000:2.0:1784938442.024502:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.024579:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337414144 00000100:00100000:1.0:1784938442.024588:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337414144 00000100:00100000:1.0:1784938442.024650:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 573 00000100:00100000:1.0:1784938442.024660:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f19b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+91:17096:x1871643337414144:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938442.024676:0:25716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938442.024693:0:25716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000016c25f1/0x7b044d4128f9beb7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663d47 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.024722:0:25716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024cec4ff/0x7b044d4128f9beb0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d40 expref: 92 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.024732:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x54:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.024737:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x54:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.024742:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000016c25f1/0x7b044d4128f9beb7 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d47 expref: 92 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.024783:0:25716:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000024cec4ff/0x7b044d4128f9beb0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663d40 expref: 92 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.024798:0:25716:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000024cec4ff/0x7b044d4128f9beb0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663d40 expref: 92 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.024811:0:25716:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd5a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25716:1871643350835968:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938442.024893:0:25716:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2488a4cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938442.027397:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.027545:0:25716:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd5a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25716:1871643350835968:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938442.027585:0:25716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000016c25f1/0x7b044d4128f9beb7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663d47 expref: 92 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.027611:0:25716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f20b000, rc 0) 00000100:00100000:1.0:1784938442.027671:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f19b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+92:17096:x1871643337414144:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3012us (3180us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.027679:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 573 00000100:00100000:2.0:1784938442.028502:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337414272 00000100:00100000:2.0:1784938442.028511:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337414272 00010000:00010000:2.0:1784938442.028550:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000024cec4ff/0x7b044d4128f9beb0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663d40 expref: 92 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.028656:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 236 00000100:00100000:2.0:1784938442.028665:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+92:10959:x1871643337414272:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938442.028679:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938442.028699:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000024cec4ff/0x7b044d4128f9beb0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663d40 expref: 92 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.028712:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000024cec4ff/0x7b044d4128f9beb0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663d40 expref: 92 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.028734:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cec4ff/0x7b044d4128f9beb0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663d40 expref: 92 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.028751:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x54:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.028755:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x54:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.028763:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000016c25f1/0x7b044d4128f9beb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663d47 expref: 91 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.028774:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000016c25f1/0x7b044d4128f9beb7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663d47 expref: 91 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.028809:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000016c25f1/0x7b044d4128f9beb7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663d47 expref: 91 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.028824:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f19b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350836096:192.168.202.54@tcp:105: 00000100:00100000:2.0:1784938442.028890:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f249d709780 going to sleep for 11 seconds 00000100:00100000:2.0:1784938442.032213:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f19b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350836096:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938442.032240:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938442.032301:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+91:10959:x1871643337414272:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3636us (4911us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938442.032312:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 236 00000100:00100000:3.0:1784938442.033408:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.033492:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337414528 00000100:00100000:1.0:1784938442.033499:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337414528 00000100:00100000:1.0:1784938442.033556:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 58 00000100:00100000:1.0:1784938442.033564:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+336:17096:x1871643337414528:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:1.0:1784938442.033826:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+337:17096:x1871643337414528:12345-192.168.202.54@tcp:35:cp.0 Request processed in 263us (423us total) trans 8589934774 rc 0/0 00000100:00100000:1.0:1784938442.033834:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 58 00000100:00100000:3.0:1784938442.037512:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.037658:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337414656 00000100:00100000:1.0:1784938442.037670:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337414656 00000100:00100000:1.0:1784938442.037734:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 364 00000100:00100000:1.0:1784938442.037744:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+337:17096:x1871643337414656:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938442.037770:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938442.037793:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a200/0x7b044d4128f9bebe lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663d4e expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.037858:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a000/0x7b044d4128f9bec5 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.037872:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a000/0x7b044d4128f9bec5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.037883:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a000/0x7b044d4128f9bec5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.037908:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a400/0x7b044d4128f9becc lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x10fe8da8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.037916:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a400/0x7b044d4128f9becc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.037923:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a400/0x7b044d4128f9becc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.037962:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a000/0x7b044d4128f9bec5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.037970:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a000/0x7b044d4128f9bec5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.037981:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a000/0x7b044d4128f9bec5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.037987:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f20a000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938442.037992:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a000/0x7b044d4128f9bec5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.037999:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a000/0x7b044d4128f9bec5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.038011:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938442.038015:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938442.038019:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a000/0x7b044d4128f9bec5 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.038025:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a000/0x7b044d4128f9bec5 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.038041:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a400/0x7b044d4128f9becc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.038048:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a400/0x7b044d4128f9becc lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.038054:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a400/0x7b044d4128f9becc lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.038059:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f20a400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938442.038062:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a400/0x7b044d4128f9becc lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.038073:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a400/0x7b044d4128f9becc lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.038081:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x10fe8da8 (ffff9f23823e1900) 00010000:00010000:1.0:1784938442.038083:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938442.038086:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a400/0x7b044d4128f9becc lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.038092:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a400/0x7b044d4128f9becc lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.038278:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a200/0x7b044d4128f9bebe lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d4e expref: 338 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.038290:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938442.038293:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938442.038297:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a200/0x7b044d4128f9bebe lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d4e expref: 338 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.038307:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f20a200, rc 0) 00000100:00100000:1.0:1784938442.038381:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+337:17096:x1871643337414656:12345-192.168.202.54@tcp:101:cp.0 Request processed in 638us (877us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938442.038389:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 364 00000100:00100000:3.0:1784938442.041488:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.041586:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337414784 00000100:00100000:0.0:1784938442.041595:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337414784 00000100:00100000:0.0:1784938442.041652:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 365 00000100:00100000:0.0:1784938442.041662:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+337:17096:x1871643337414784:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938442.041683:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938442.041703:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9bed3 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663d55 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.041759:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9beda lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.041773:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9beda lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.041784:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9beda lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.041797:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9bee1 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x10fe8da8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.041804:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9bee1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.041811:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9bee1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.041849:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9beda lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.041857:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9beda lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.041863:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9beda lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.041869:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a6200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938442.041872:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9beda lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.041880:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9beda lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.041892:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938442.041906:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.041912:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9beda lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.041917:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9beda lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.041931:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9bee1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.041936:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9bee1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.041942:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9bee1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.041947:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a7a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938442.041950:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9bee1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.041956:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9bee1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.041962:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x10fe8da8 (ffff9f2487e3a500) 00010000:00010000:0.0:1784938442.041965:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.041967:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9bee1 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.041973:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9bee1 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.042003:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9bed3 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d55 expref: 338 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.042013:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938442.042015:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.042018:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9bed3 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d55 expref: 338 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.042027:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a6000, rc 0) 00000100:00100000:0.0:1784938442.042087:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+337:17096:x1871643337414784:12345-192.168.202.54@tcp:101:cp.0 Request processed in 426us (608us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938442.042094:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 365 00000100:00100000:1.0:1784938442.044981:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938442.045171:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337415040 00000100:00100000:2.0:1784938442.045181:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337415040 00000100:00100000:2.0:1784938442.045230:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 366 00000100:00100000:2.0:1784938442.045239:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+337:17096:x1871643337415040:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938442.045257:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938442.045277:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9bee8 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663d5c expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.045389:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9beef lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.045402:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9beef lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.045413:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9beef lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.045428:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9bef6 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x10fe8da8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.045435:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9bef6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.045442:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9bef6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938442.045716:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x54:0x0], index 1: 0 00010000:00010000:2.0:1784938442.045842:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3ca00/0x7b044d4128f9befd lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.045851:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3ca00/0x7b044d4128f9befd lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.045858:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3ca00/0x7b044d4128f9befd lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.045888:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9beef lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.045908:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9beef lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.045916:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9beef lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.045922:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3d000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938442.045927:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9beef lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.045935:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9beef lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.045947:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938442.045950:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.045954:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9beef lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.045960:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9beef lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938442.045972:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000039bf6796 reply state 000000002946c0b5 transno 8589934775 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9bef6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.045983:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9bef6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.045990:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x10fe8da8 (ffff9f23823dc800) 00010000:00010000:2.0:1784938442.045992:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938442.045995:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938442.046023:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9bee8 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d5c expref: 340 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.046322:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3ca00/0x7b044d4128f9befd lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d5c expref: 339 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.046330:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x28:0x0].0x0 (ffff9f23823dcb00) 00010000:00010000:2.0:1784938442.046343:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938442.046346:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d3ca00, rc 0) 00000100:00100000:2.0:1784938442.046409:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+340:17096:x1871643337415040:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1171us (1436us total) trans 8589934775 rc 0/0 00000100:00100000:2.0:1784938442.046418:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 366 00000100:00100000:2.0:1784938442.050182:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.050462:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337415168 00000100:00100000:3.0:1784938442.050472:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337415168 00000100:00100000:3.0:1784938442.050535:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 574 00000100:00100000:3.0:1784938442.050545:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f19b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+91:10960:x1871643337415168:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.050579:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.050601:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063ef4b0e/0x7b044d4128f9bf0b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663d63 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938442.050627:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x54:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938442.050648:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x54:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1784938442.050653:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x54:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.050663:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063ef4b0e/0x7b044d4128f9bf0b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d63 expref: 92 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.050681:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000063ef4b0e/0x7b044d4128f9bf0b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d63 expref: 92 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.050694:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c6600, rc 0) 00000100:00100000:3.0:1784938442.050756:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f19b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+92:10960:x1871643337415168:12345-192.168.202.54@tcp:101:cp.0 Request processed in 212us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938442.050765:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 574 00000100:00100000:0.0:1784938442.053686:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938442.053756:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337415296 00000100:00100000:2.0:1784938442.053767:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337415296 00000100:00100000:2.0:1784938442.053824:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 575 00000100:00100000:2.0:1784938442.053834:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+92:17096:x1871643337415296:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938442.053852:0:21629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938442.053874:0:21629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004766fa96/0x7b044d4128f9bf12 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663d6a expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.053922:0:21629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000063ef4b0e/0x7b044d4128f9bf0b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d63 expref: 93 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.053932:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x54:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.053936:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x54:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.053941:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004766fa96/0x7b044d4128f9bf12 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d6a expref: 93 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.053973:0:21629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000063ef4b0e/0x7b044d4128f9bf0b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663d63 expref: 93 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.053987:0:21629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000063ef4b0e/0x7b044d4128f9bf0b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663d63 expref: 93 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.054000:0:21629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f198a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:21629:1871643350836224:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938442.054089:0:21629:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b1557c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938442.057796:0:21629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f198a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:21629:1871643350836224:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938442.057838:0:21629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004766fa96/0x7b044d4128f9bf12 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663d6a expref: 93 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.057863:0:21629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b4056600, rc 0) 00000100:00100000:2.0:1784938442.057938:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+93:17096:x1871643337415296:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4105us (4261us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938442.057946:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 575 00000100:00100000:3.0:1784938442.060251:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.060354:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337415424 00000100:00100000:1.0:1784938442.060365:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337415424 00010000:00010000:1.0:1784938442.060407:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000063ef4b0e/0x7b044d4128f9bf0b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663d63 expref: 93 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.060446:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 237 00000100:00100000:1.0:1784938442.060456:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2485ced850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+93:10958:x1871643337415424:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.060473:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.060495:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000063ef4b0e/0x7b044d4128f9bf0b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663d63 expref: 93 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.060508:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000063ef4b0e/0x7b044d4128f9bf0b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663d63 expref: 93 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.060530:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063ef4b0e/0x7b044d4128f9bf0b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663d63 expref: 93 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.060548:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x54:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.060552:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x54:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.060560:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004766fa96/0x7b044d4128f9bf12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663d6a expref: 92 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.060571:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004766fa96/0x7b044d4128f9bf12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663d6a expref: 92 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.060607:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004766fa96/0x7b044d4128f9bf12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663d6a expref: 92 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.060622:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd5a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350836352:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938442.060710:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2488a4c540 going to sleep for 11 seconds 00000100:00100000:1.0:1784938442.063884:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd5a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350836352:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938442.063924:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938442.063981:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2485ced850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+92:10958:x1871643337415424:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3526us (3737us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.063991:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 237 00000100:00100000:3.0:1784938442.066545:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.066634:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337415680 00000100:00100000:1.0:1784938442.066644:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337415680 00000100:00100000:1.0:1784938442.066705:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 59 00000100:00100000:1.0:1784938442.066715:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+340:17096:x1871643337415680:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:1.0:1784938442.067020:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+341:17096:x1871643337415680:12345-192.168.202.54@tcp:35:cp.0 Request processed in 305us (484us total) trans 8589934776 rc 0/0 00000100:00100000:1.0:1784938442.067028:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 59 00000100:00100000:3.0:1784938442.070808:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.070919:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337415808 00000100:00100000:0.0:1784938442.070930:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337415808 00000100:00100000:0.0:1784938442.070992:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 367 00000100:00100000:0.0:1784938442.071002:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+341:17096:x1871643337415808:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938442.071037:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938442.071058:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9bf19 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663d71 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.071191:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6e00/0x7b044d4128f9bf20 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.071206:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6e00/0x7b044d4128f9bf20 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.071217:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6e00/0x7b044d4128f9bf20 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.071234:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9bf27 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x6b7bd7c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.071240:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9bf27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.071245:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9bf27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.071285:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6e00/0x7b044d4128f9bf20 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.071291:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6e00/0x7b044d4128f9bf20 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.071298:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6e00/0x7b044d4128f9bf20 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.071308:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a6e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938442.071312:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6e00/0x7b044d4128f9bf20 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.071318:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6e00/0x7b044d4128f9bf20 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.071328:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938442.071331:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.071346:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6e00/0x7b044d4128f9bf20 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.071352:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6e00/0x7b044d4128f9bf20 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.071365:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9bf27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.071370:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9bf27 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.071375:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9bf27 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.071378:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a7a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938442.071381:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9bf27 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.071385:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9bf27 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.071395:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x6b7bd7c (ffff9f2487e3a500) 00010000:00010000:0.0:1784938442.071397:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.071400:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9bf27 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.071404:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9bf27 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.071431:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9bf19 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d71 expref: 342 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.071440:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938442.071442:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.071446:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9bf19 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d71 expref: 342 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.071454:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a6200, rc 0) 00000100:00100000:0.0:1784938442.071507:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+341:17096:x1871643337415808:12345-192.168.202.54@tcp:101:cp.0 Request processed in 507us (711us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938442.071514:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 367 00000100:00100000:0.0:1784938442.074198:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938442.074278:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337415936 00000100:00100000:2.0:1784938442.074287:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337415936 00000100:00100000:2.0:1784938442.074347:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 368 00000100:00100000:2.0:1784938442.074357:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+341:17096:x1871643337415936:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938442.074375:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938442.074394:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9bf2e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663d78 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.074454:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9bf35 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.074466:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9bf35 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.074476:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9bf35 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.074488:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9bf3c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x6b7bd7c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.074495:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9bf3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.074502:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9bf3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.074535:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9bf35 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.074542:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9bf35 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.074553:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9bf35 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.074559:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3d600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938442.074563:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9bf35 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.074570:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9bf35 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.074582:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938442.074585:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.074589:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9bf35 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.074595:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9bf35 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.074607:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9bf3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.074614:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9bf3c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.074619:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9bf3c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.074624:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3d000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938442.074627:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9bf3c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.074637:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9bf3c lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.074643:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x6b7bd7c (ffff9f23823dc400) 00010000:00010000:2.0:1784938442.074646:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.074648:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9bf3c lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.074653:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9bf3c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.074682:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9bf2e lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d78 expref: 342 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.074691:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938442.074693:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.074696:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9bf2e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d78 expref: 342 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.074704:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b4057e00, rc 0) 00000100:00100000:2.0:1784938442.074766:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+341:17096:x1871643337415936:12345-192.168.202.54@tcp:101:cp.0 Request processed in 411us (576us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938442.074773:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 368 00000100:00100000:1.0:1784938442.080920:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.081068:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337416192 00000100:00100000:3.0:1784938442.081079:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337416192 00000100:00100000:3.0:1784938442.081183:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 369 00000100:00100000:3.0:1784938442.081194:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+341:17096:x1871643337416192:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.081216:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.081241:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9bf43 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663d7f expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.081392:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9bf4a lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.081408:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9bf4a lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.081421:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9bf4a lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.081437:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bf51 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x6b7bd7c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.081443:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bf51 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.081450:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bf51 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938442.081772:0:24203:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x55:0x0], index 0: 0 00010000:00010000:3.0:1784938442.081940:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9bf58 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.081951:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9bf58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.081960:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9bf58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.081995:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9bf4a lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.082015:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9bf4a lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.082023:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9bf4a lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.082029:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c6600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.082034:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9bf4a lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.082042:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9bf4a lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.082056:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938442.082060:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.082066:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9bf4a lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.082072:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9bf4a lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938442.082088:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000039ebf0ee reply state 000000006c16dda5 transno 8589934777 ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bf51 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.082101:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bf51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.082108:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x6b7bd7c (ffff9f238dd4a900) 00010000:00010000:3.0:1784938442.082111:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938442.082113:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938442.082142:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7000/0x7b044d4128f9bf43 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d7f expref: 344 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.082196:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9bf58 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d7f expref: 343 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.082204:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x29:0x0].0x0 (ffff9f238dd4ac00) 00010000:00010000:3.0:1784938442.082207:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938442.082210:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fd600, rc 0) 00000100:00100000:3.0:1784938442.082280:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+344:17096:x1871643337416192:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1087us (1382us total) trans 8589934777 rc 0/0 00000100:00100000:3.0:1784938442.082290:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 369 00000100:00100000:0.0:1784938442.087621:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.087694:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337416320 00000100:00100000:3.0:1784938442.087703:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337416320 00000100:00100000:3.0:1784938442.087760:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 576 00000100:00100000:3.0:1784938442.087771:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+91:10958:x1871643337416320:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.087791:0:21149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.087813:0:21149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000529d4596/0x7b044d4128f9bf66 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663d86 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938442.087838:0:21149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x55:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938442.087858:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x55:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1784938442.087863:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x55:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.087872:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000529d4596/0x7b044d4128f9bf66 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d86 expref: 92 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.087889:0:21149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000529d4596/0x7b044d4128f9bf66 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d86 expref: 92 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.087937:0:21149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c95c800, rc 0) 00000100:00100000:3.0:1784938442.088007:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+92:10958:x1871643337416320:12345-192.168.202.54@tcp:101:cp.0 Request processed in 238us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938442.088015:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 576 00000100:00100000:2.0:1784938442.094022:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.094419:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337416448 00000100:00100000:3.0:1784938442.094429:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337416448 00000100:00100000:3.0:1784938442.094483:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 577 00000100:00100000:3.0:1784938442.094494:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f198a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+92:17096:x1871643337416448:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.094514:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.094535:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000705500be/0x7b044d4128f9bf6d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663d8d expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.094569:0:21151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000529d4596/0x7b044d4128f9bf66 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d86 expref: 93 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.094578:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x55:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.094583:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x55:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.094588:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000705500be/0x7b044d4128f9bf6d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d8d expref: 93 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.094621:0:21151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000529d4596/0x7b044d4128f9bf66 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663d86 expref: 93 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.094635:0:21151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000529d4596/0x7b044d4128f9bf66 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663d86 expref: 93 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.094669:0:21151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:21151:1871643350836480:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938442.094759:0:21151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2488d266c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938442.098191:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.098466:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337416576 00000100:00100000:0.0:1784938442.098477:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337416576 00010000:00010000:0.0:1784938442.098517:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000529d4596/0x7b044d4128f9bf66 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663d86 expref: 94 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.098559:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 238 00000100:00100000:0.0:1784938442.098569:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f199c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+94:10960:x1871643337416576:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938442.098584:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938442.098606:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000529d4596/0x7b044d4128f9bf66 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663d86 expref: 94 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.098619:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000529d4596/0x7b044d4128f9bf66 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663d86 expref: 94 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.098644:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x55:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.098648:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x55:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.098656:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000705500be/0x7b044d4128f9bf6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d8d expref: 94 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.098666:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000705500be/0x7b044d4128f9bf6d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d8d expref: 94 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.098726:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000705500be/0x7b044d4128f9bf6d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d8d expref: 94 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.098741:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd55ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350836608:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938442.098836:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238e8de0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1784938442.099489:0:21151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000529d4596/0x7b044d4128f9bf66 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663d86 expref: 94 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.099507:0:21151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:21151:1871643350836480:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938442.099532:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000705500be/0x7b044d4128f9bf6d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663d8d expref: 93 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.099545:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c7000, rc 0) 00000100:00100000:3.0:1784938442.099593:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f198a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+93:17096:x1871643337416448:12345-192.168.202.54@tcp:101:cp.0 Request processed in 5101us (5582us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938442.099602:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 577 00000100:00100000:2.0:1784938442.104644:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.104709:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337416832 00000100:00100000:3.0:1784938442.104718:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337416832 00000100:00100000:3.0:1784938442.104780:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 60 00000100:00100000:3.0:1784938442.104790:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+344:17096:x1871643337416832:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938442.105102:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+345:17096:x1871643337416832:12345-192.168.202.54@tcp:35:cp.0 Request processed in 312us (466us total) trans 8589934778 rc 0/0 00000100:00100000:3.0:1784938442.105110:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 60 00000100:00100000:0.0:1784938442.105378:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd55ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350836608:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938442.105402:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938442.105426:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f199c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+92:10960:x1871643337416576:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 6859us (7283us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.105438:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 238 00000100:00100000:0.0:1784938442.109393:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938442.109505:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337416960 00000100:00100000:2.0:1784938442.109515:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337416960 00000100:00100000:2.0:1784938442.109577:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 370 00000100:00100000:2.0:1784938442.109587:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+345:17096:x1871643337416960:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938442.109615:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938442.109641:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8b800/0x7b044d4128f9bf74 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663d94 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.109702:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8a800/0x7b044d4128f9bf7b lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.109717:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8a800/0x7b044d4128f9bf7b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.109729:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8a800/0x7b044d4128f9bf7b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.109743:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8aa00/0x7b044d4128f9bf82 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x37dcc2d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.109750:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8aa00/0x7b044d4128f9bf82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.109758:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8aa00/0x7b044d4128f9bf82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.109800:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8a800/0x7b044d4128f9bf7b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.109807:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8a800/0x7b044d4128f9bf7b lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.109813:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8a800/0x7b044d4128f9bf7b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.109824:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b6b8a800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938442.109828:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8a800/0x7b044d4128f9bf7b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.109836:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8a800/0x7b044d4128f9bf7b lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.109848:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938442.109851:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.109856:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8a800/0x7b044d4128f9bf7b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.109862:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8a800/0x7b044d4128f9bf7b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.109876:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8aa00/0x7b044d4128f9bf82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.109882:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8aa00/0x7b044d4128f9bf82 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.109888:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8aa00/0x7b044d4128f9bf82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.109893:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b6b8aa00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938442.109905:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8aa00/0x7b044d4128f9bf82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.109912:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8aa00/0x7b044d4128f9bf82 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.109923:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x37dcc2d3 (ffff9f23823dc400) 00010000:00010000:2.0:1784938442.109926:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.109928:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8aa00/0x7b044d4128f9bf82 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.109934:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8aa00/0x7b044d4128f9bf82 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.109970:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8b800/0x7b044d4128f9bf74 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d94 expref: 346 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.109981:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938442.109983:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.109987:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8b800/0x7b044d4128f9bf74 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d94 expref: 346 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.109997:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b6b8b800, rc 0) 00000100:00100000:2.0:1784938442.110235:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+345:17096:x1871643337416960:12345-192.168.202.54@tcp:101:cp.0 Request processed in 648us (851us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938442.110242:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 370 00000100:00100000:2.0:1784938442.112523:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.112573:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337417088 00000100:00100000:3.0:1784938442.112583:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337417088 00000100:00100000:3.0:1784938442.112637:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 371 00000100:00100000:3.0:1784938442.112665:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f19aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+345:17096:x1871643337417088:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.112688:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.112708:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9bf89 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663d9b expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.113408:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9bf90 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.113424:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9bf90 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.113436:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9bf90 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.113451:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9bf97 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x37dcc2d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.113456:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9bf97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.113462:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9bf97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.113496:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9bf90 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.113501:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9bf90 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.113506:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9bf90 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.113520:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c95c800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.113524:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9bf90 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.113531:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9bf90 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.113541:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938442.113543:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.113546:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9bf90 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.113551:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9bf90 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.113562:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9bf97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.113566:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9bf97 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.113571:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9bf97 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.113574:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17ac00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.113575:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9bf97 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.113578:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9bf97 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.113589:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x37dcc2d3 (ffff9f238dd4a100) 00010000:00010000:3.0:1784938442.113591:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.113593:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9bf97 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.113596:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9bf97 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.113628:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9bf89 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d9b expref: 346 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.113635:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938442.113637:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.113639:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9bf89 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d9b expref: 346 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.113645:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c6600, rc 0) 00000100:00100000:3.0:1784938442.113750:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f19aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+345:17096:x1871643337417088:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1088us (1233us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938442.113760:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 371 00000100:00100000:1.0:1784938442.115761:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938442.115935:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337417344 00000100:00100000:2.0:1784938442.115946:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337417344 00000100:00100000:2.0:1784938442.116046:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 372 00000100:00100000:2.0:1784938442.116057:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+345:17096:x1871643337417344:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938442.116076:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938442.116094:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9bf9e lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663da2 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.116209:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8b800/0x7b044d4128f9bfa5 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.116220:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8b800/0x7b044d4128f9bfa5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.116228:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8b800/0x7b044d4128f9bfa5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.116236:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8aa00/0x7b044d4128f9bfac lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x37dcc2d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.116240:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8aa00/0x7b044d4128f9bfac lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.116244:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8aa00/0x7b044d4128f9bfac lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938442.116520:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x55:0x0], index 1: 0 00010000:00010000:2.0:1784938442.116619:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8a800/0x7b044d4128f9bfb3 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.116625:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8a800/0x7b044d4128f9bfb3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.116630:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8a800/0x7b044d4128f9bfb3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.116652:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8b800/0x7b044d4128f9bfa5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.116660:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8b800/0x7b044d4128f9bfa5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.116664:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8b800/0x7b044d4128f9bfa5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.116668:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b6b8b800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938442.116671:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8b800/0x7b044d4128f9bfa5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.116675:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8b800/0x7b044d4128f9bfa5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.116682:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938442.116684:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.116687:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8b800/0x7b044d4128f9bfa5 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.116691:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8b800/0x7b044d4128f9bfa5 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938442.116698:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000896ce5c4 reply state 000000007ab14320 transno 8589934779 ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8aa00/0x7b044d4128f9bfac lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.116705:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8aa00/0x7b044d4128f9bfac lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.116709:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x37dcc2d3 (ffff9f23823dc400) 00010000:00010000:2.0:1784938442.116710:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938442.116711:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938442.116731:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9bf9e lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663da2 expref: 348 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.116740:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8a800/0x7b044d4128f9bfb3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663da2 expref: 347 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.116746:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2a:0x0].0x0 (ffff9f23823dcd00) 00010000:00010000:2.0:1784938442.116748:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938442.116751:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b6b8a800, rc 0) 00000100:00100000:2.0:1784938442.116895:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+348:17096:x1871643337417344:12345-192.168.202.54@tcp:101:cp.0 Request processed in 839us (1141us total) trans 8589934779 rc 0/0 00000100:00100000:2.0:1784938442.116903:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 372 00000100:00100000:0.0:1784938442.118985:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.119026:0:21152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337417472 00000100:00100000:3.0:1784938442.119041:0:21152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337417472 00000100:00100000:3.0:1784938442.119086:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 578 00000100:00100000:3.0:1784938442.119095:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+92:10959:x1871643337417472:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.119117:0:21152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.119137:0:21152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c08077c/0x7b044d4128f9bfc1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663da9 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938442.119205:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x55:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938442.119224:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x55:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1784938442.119229:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x55:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.119240:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c08077c/0x7b044d4128f9bfc1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663da9 expref: 93 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.119257:0:21152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009c08077c/0x7b044d4128f9bfc1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663da9 expref: 93 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.119268:0:21152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3ec00, rc 0) 00000100:00100000:3.0:1784938442.119313:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+93:10959:x1871643337417472:12345-192.168.202.54@tcp:101:cp.0 Request processed in 218us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938442.119320:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 578 00000100:00100000:1.0:1784938442.122860:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.122960:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337417600 00000100:00100000:3.0:1784938442.122970:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337417600 00000100:00100000:3.0:1784938442.123261:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 579 00000100:00100000:3.0:1784938442.123272:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+93:17096:x1871643337417600:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.123294:0:21149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.123314:0:21149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d3e07c9/0x7b044d4128f9bfc8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663db0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.123358:0:21149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009c08077c/0x7b044d4128f9bfc1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663da9 expref: 94 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.123396:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x55:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.123401:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x55:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.123408:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d3e07c9/0x7b044d4128f9bfc8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->114687] (req 0->114687) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663db0 expref: 94 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.123446:0:21149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009c08077c/0x7b044d4128f9bfc1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663da9 expref: 94 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.123461:0:21149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009c08077c/0x7b044d4128f9bfc1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663da9 expref: 94 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.123477:0:21149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:21149:1871643350836736:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938442.123550:0:21149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2488d26d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938442.133239:0:21149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:21149:1871643350836736:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938442.133248:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:3.0:1784938442.133278:0:21149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005d3e07c9/0x7b044d4128f9bfc8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->114687] (req 0->114687) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663db0 expref: 94 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.133300:0:21149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3e200, rc 0) 00000100:00100000:3.0:1784938442.133400:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+94:17096:x1871643337417600:12345-192.168.202.54@tcp:101:cp.0 Request processed in 10130us (10550us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938442.133410:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 579 00000100:00100000:2.0:1784938442.133791:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337417728 00000100:00100000:2.0:1784938442.133799:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337417728 00010000:00010000:2.0:1784938442.133839:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009c08077c/0x7b044d4128f9bfc1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663da9 expref: 94 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.133884:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 239 00000100:00100000:2.0:1784938442.133902:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+94:10958:x1871643337417728:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938442.133917:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938442.133940:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009c08077c/0x7b044d4128f9bfc1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663da9 expref: 94 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.133950:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009c08077c/0x7b044d4128f9bfc1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663da9 expref: 94 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.133971:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c08077c/0x7b044d4128f9bfc1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663da9 expref: 94 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.133983:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x55:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.133986:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x55:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.133992:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005d3e07c9/0x7b044d4128f9bfc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663db0 expref: 93 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.133999:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d3e07c9/0x7b044d4128f9bfc8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663db0 expref: 93 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.134051:0:19220:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005d3e07c9/0x7b044d4128f9bfc8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663db0 expref: 93 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.134065:0:19220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f199f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:19220:1871643350836864:192.168.202.54@tcp:105: 00000100:00100000:2.0:1784938442.134126:0:19220:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24917d6900 going to sleep for 11 seconds 00000100:00100000:0.0:1784938442.140617:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.140716:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337417984 00000100:00100000:1.0:1784938442.140728:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337417984 00000100:00100000:1.0:1784938442.140790:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 61 00000100:00100000:1.0:1784938442.140799:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+348:17096:x1871643337417984:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:1.0:1784938442.141101:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+349:17096:x1871643337417984:12345-192.168.202.54@tcp:35:cp.0 Request processed in 302us (498us total) trans 8589934780 rc 0/0 00000100:00100000:1.0:1784938442.141109:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 61 00000100:00100000:2.0:1784938442.142440:0:19220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f199f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:19220:1871643350836864:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938442.142467:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938442.142510:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+93:10958:x1871643337417728:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 8618us (9262us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938442.142521:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 239 00000100:00100000:0.0:1784938442.146446:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.146559:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337418112 00000100:00100000:1.0:1784938442.146568:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337418112 00000100:00100000:1.0:1784938442.146632:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 373 00000100:00100000:1.0:1784938442.146642:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+349:17096:x1871643337418112:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938442.146669:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938442.146690:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20be00/0x7b044d4128f9bfcf lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663db7 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.146757:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a600/0x7b044d4128f9bfd6 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.146772:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a600/0x7b044d4128f9bfd6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.146784:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a600/0x7b044d4128f9bfd6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.146797:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20ac00/0x7b044d4128f9bfdd lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xa4bfea24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.146805:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20ac00/0x7b044d4128f9bfdd lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.146812:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20ac00/0x7b044d4128f9bfdd lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.146851:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a600/0x7b044d4128f9bfd6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.146859:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a600/0x7b044d4128f9bfd6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.146866:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a600/0x7b044d4128f9bfd6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.146876:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a600/0x7b044d4128f9bfd6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.146882:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f20a600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938442.146886:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a600/0x7b044d4128f9bfd6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.146894:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a600/0x7b044d4128f9bfd6 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.146921:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938442.146924:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938442.146930:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a600/0x7b044d4128f9bfd6 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.146936:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a600/0x7b044d4128f9bfd6 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.146951:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20ac00/0x7b044d4128f9bfdd lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.146958:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20ac00/0x7b044d4128f9bfdd lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.146964:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20ac00/0x7b044d4128f9bfdd lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.146969:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f20ac00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938442.146972:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20ac00/0x7b044d4128f9bfdd lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.146981:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20ac00/0x7b044d4128f9bfdd lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.146989:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xa4bfea24 (ffff9f23823e1900) 00010000:00010000:1.0:1784938442.146992:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938442.146994:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20ac00/0x7b044d4128f9bfdd lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.147000:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20ac00/0x7b044d4128f9bfdd lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.147044:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20be00/0x7b044d4128f9bfcf lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663db7 expref: 350 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.147055:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938442.147058:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938442.147062:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20be00/0x7b044d4128f9bfcf lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663db7 expref: 350 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.147072:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f20be00, rc 0) 00000100:00100000:1.0:1784938442.147483:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+349:17096:x1871643337418112:12345-192.168.202.54@tcp:101:cp.0 Request processed in 840us (1048us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938442.147492:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 373 00000100:00100000:0.0:1784938442.150781:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.150882:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337418240 00000100:00100000:3.0:1784938442.150950:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337418240 00000100:00100000:3.0:1784938442.151059:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 374 00000100:00100000:3.0:1784938442.151088:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+349:17096:x1871643337418240:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.151111:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.151166:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f400/0x7b044d4128f9bfe4 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663dbe expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.151229:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9bfeb lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.151243:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9bfeb lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.151254:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9bfeb lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.151267:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9bff2 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xa4bfea24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.151274:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9bff2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.151280:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9bff2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.151314:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9bfeb lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.151320:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9bfeb lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.151326:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9bfeb lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.151355:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3f200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.151360:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9bfeb lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.151367:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9bfeb lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.151380:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938442.151383:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.151388:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9bfeb lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.151394:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9bfeb lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.151405:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9bff2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.151411:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9bff2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.151416:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9bff2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.151422:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3e600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.151425:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9bff2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.151430:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9bff2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.151445:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xa4bfea24 (ffff9f238dd4a100) 00010000:00010000:3.0:1784938442.151448:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.151450:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9bff2 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.151457:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9bff2 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.151488:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f400/0x7b044d4128f9bfe4 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663dbe expref: 350 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.151497:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938442.151499:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.151502:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f400/0x7b044d4128f9bfe4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663dbe expref: 350 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.151513:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3f400, rc 0) 00000100:00100000:3.0:1784938442.151657:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+349:17096:x1871643337418240:12345-192.168.202.54@tcp:101:cp.0 Request processed in 571us (884us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938442.151665:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 374 00000100:00100000:0.0:1784938442.158700:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.159001:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337418496 00000100:00100000:3.0:1784938442.159013:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337418496 00000100:00100000:3.0:1784938442.159281:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 375 00000100:00100000:3.0:1784938442.159293:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+349:17096:x1871643337418496:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.159316:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.159350:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3fa00/0x7b044d4128f9bff9 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663dc5 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.159615:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9c000 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.159632:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9c000 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.159642:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9c000 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.159658:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9c007 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0xa4bfea24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.159666:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9c007 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.159673:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9c007 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938442.160348:0:24203:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x56:0x0], index 0: 0 00010000:00010000:3.0:1784938442.160580:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9c00e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.160594:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9c00e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.160603:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9c00e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.160634:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9c000 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.160656:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9c000 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.160663:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9c000 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.160669:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3f000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.160673:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9c000 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.160681:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9c000 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.160694:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938442.160697:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.160702:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9c000 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.160708:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9c000 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938442.160723:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003cf6bd8e reply state 0000000088fb192e transno 8589934781 ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9c007 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.160734:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9c007 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.160741:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xa4bfea24 (ffff9f238dd4a000) 00010000:00010000:3.0:1784938442.160744:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938442.160747:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938442.160778:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3fa00/0x7b044d4128f9bff9 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663dc5 expref: 352 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.160799:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9c00e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663dc5 expref: 351 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.160808:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2b:0x0].0x0 (ffff9f2485293700) 00010000:00010000:3.0:1784938442.160810:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938442.160813:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c6600, rc 0) 00000100:00100000:3.0:1784938442.160966:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+352:17096:x1871643337418496:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1674us (2277us total) trans 8589934781 rc 0/0 00000100:00100000:3.0:1784938442.160976:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 375 00000100:00100000:0.0:1784938442.165298:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.165445:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337418624 00000100:00100000:3.0:1784938442.165455:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337418624 00000100:00100000:3.0:1784938442.165513:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 580 00000100:00100000:3.0:1784938442.165523:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+92:10958:x1871643337418624:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.165544:0:25715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.165568:0:25715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004078d00f/0x7b044d4128f9c01c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663dcc expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938442.165594:0:25715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x56:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938442.165616:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x56:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1784938442.165621:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x56:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.165630:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004078d00f/0x7b044d4128f9c01c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663dcc expref: 93 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.165648:0:25715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004078d00f/0x7b044d4128f9c01c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663dcc expref: 93 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.165680:0:25715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17ac00, rc 0) 00000100:00100000:3.0:1784938442.165741:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+93:10958:x1871643337418624:12345-192.168.202.54@tcp:101:cp.0 Request processed in 220us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938442.165748:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 580 00000100:00100000:0.0:1784938442.169272:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938442.169485:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337418752 00000100:00100000:2.0:1784938442.169494:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337418752 00000100:00100000:2.0:1784938442.169549:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 581 00000100:00100000:2.0:1784938442.169559:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+93:17096:x1871643337418752:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938442.169579:0:21629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938442.169600:0:21629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049f8ae0e/0x7b044d4128f9c023 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663dd3 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.169638:0:21629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004078d00f/0x7b044d4128f9c01c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663dcc expref: 94 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.169649:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x56:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.169654:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x56:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.169660:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049f8ae0e/0x7b044d4128f9c023 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->36863] (req 0->36863) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663dd3 expref: 94 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.169697:0:21629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004078d00f/0x7b044d4128f9c01c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663dcc expref: 94 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.169713:0:21629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004078d00f/0x7b044d4128f9c01c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663dcc expref: 94 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.169731:0:21629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f199f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:21629:1871643350836992:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938442.169818:0:21629:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24917d6900 going to sleep for 11 seconds 00000100:00100000:2.0:1784938442.173434:0:21629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f199f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:21629:1871643350836992:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938442.173477:0:21629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000049f8ae0e/0x7b044d4128f9c023 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->36863] (req 0->36863) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663dd3 expref: 94 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.173499:0:21629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b6b8b800, rc 0) 00000100:00100000:2.0:1784938442.173560:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+94:17096:x1871643337418752:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4003us (4297us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938442.173568:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 581 00000100:00100000:0.0:1784938442.175233:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938442.175306:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337418880 00000100:00100000:2.0:1784938442.175313:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337418880 00010000:00010000:2.0:1784938442.175358:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004078d00f/0x7b044d4128f9c01c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663dcc expref: 94 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.175406:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 240 00000100:00100000:2.0:1784938442.175415:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+94:10959:x1871643337418880:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938442.175430:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938442.175452:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004078d00f/0x7b044d4128f9c01c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663dcc expref: 94 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.175464:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004078d00f/0x7b044d4128f9c01c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663dcc expref: 94 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.175488:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004078d00f/0x7b044d4128f9c01c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663dcc expref: 94 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.175505:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x56:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.175509:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x56:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.175518:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000049f8ae0e/0x7b044d4128f9c023 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663dd3 expref: 93 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.175528:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049f8ae0e/0x7b044d4128f9c023 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663dd3 expref: 93 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.175561:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000049f8ae0e/0x7b044d4128f9c023 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663dd3 expref: 93 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.175575:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f199f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350837120:192.168.202.54@tcp:105: 00000100:00100000:2.0:1784938442.175649:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24917d6900 going to sleep for 11 seconds 00000100:00100000:0.0:1784938442.182249:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938442.182358:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f199f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350837120:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938442.182394:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938442.182451:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+93:10959:x1871643337418880:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 7036us (7222us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938442.182462:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 240 00000100:00100000:1.0:1784938442.182619:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337419136 00000100:00100000:1.0:1784938442.182625:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337419136 00000100:00100000:1.0:1784938442.182678:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 62 00000100:00100000:1.0:1784938442.182686:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+352:17096:x1871643337419136:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:1.0:1784938442.182947:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+353:17096:x1871643337419136:12345-192.168.202.54@tcp:35:cp.0 Request processed in 261us (708us total) trans 8589934782 rc 0/0 00000100:00100000:1.0:1784938442.182955:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 62 00000100:00100000:1.0:1784938442.198665:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938442.198753:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337419264 00000100:00100000:2.0:1784938442.198761:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337419264 00000100:00100000:2.0:1784938442.198815:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 376 00000100:00100000:2.0:1784938442.198826:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+353:17096:x1871643337419264:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938442.198852:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938442.198874:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9c02a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663dda expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.198943:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9c031 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.198959:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9c031 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.198971:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9c031 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.198983:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9c038 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xc2bba7e5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.198991:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9c038 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.198994:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9c038 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.199029:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9c031 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.199035:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9c031 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.199041:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9c031 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.199047:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3d000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938442.199051:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9c031 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.199059:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9c031 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.199069:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938442.199073:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.199077:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9c031 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.199083:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9c031 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.199096:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9c038 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.199102:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9c038 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.199107:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9c038 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.199111:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3d600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938442.199114:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9c038 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.199119:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9c038 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.199125:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xc2bba7e5 (ffff9f23823dcf00) 00010000:00010000:2.0:1784938442.199128:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.199130:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9c038 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.199136:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9c038 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.199231:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9c02a lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663dda expref: 354 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.199241:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938442.199243:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.199247:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9c02a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663dda expref: 354 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.199260:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b4057e00, rc 0) 00000100:00100000:2.0:1784938442.199311:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+353:17096:x1871643337419264:12345-192.168.202.54@tcp:101:cp.0 Request processed in 486us (653us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938442.199319:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 376 00000100:00100000:0.0:1784938442.203638:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.203701:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337419392 00000100:00100000:1.0:1784938442.203709:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337419392 00000100:00100000:1.0:1784938442.203761:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 377 00000100:00100000:1.0:1784938442.203773:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+353:17096:x1871643337419392:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938442.203807:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938442.203827:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a600/0x7b044d4128f9c03f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663de1 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.203889:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20aa00/0x7b044d4128f9c046 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.203901:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20aa00/0x7b044d4128f9c046 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.203913:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20aa00/0x7b044d4128f9c046 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.203927:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20bc00/0x7b044d4128f9c04d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xc2bba7e5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.203935:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20bc00/0x7b044d4128f9c04d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.203941:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20bc00/0x7b044d4128f9c04d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.203987:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20aa00/0x7b044d4128f9c046 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.203993:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20aa00/0x7b044d4128f9c046 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.203997:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20aa00/0x7b044d4128f9c046 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.204001:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20aa00/0x7b044d4128f9c046 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.204005:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f20aa00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938442.204007:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20aa00/0x7b044d4128f9c046 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.204013:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20aa00/0x7b044d4128f9c046 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.204024:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938442.204026:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938442.204030:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20aa00/0x7b044d4128f9c046 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.204036:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20aa00/0x7b044d4128f9c046 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.204047:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20bc00/0x7b044d4128f9c04d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.204054:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20bc00/0x7b044d4128f9c04d lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.204060:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20bc00/0x7b044d4128f9c04d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.204065:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f20bc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938442.204067:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20bc00/0x7b044d4128f9c04d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.204073:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20bc00/0x7b044d4128f9c04d lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.204079:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xc2bba7e5 (ffff9f23823e1900) 00010000:00010000:1.0:1784938442.204082:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938442.204084:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20bc00/0x7b044d4128f9c04d lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.204090:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20bc00/0x7b044d4128f9c04d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.204120:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a600/0x7b044d4128f9c03f lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663de1 expref: 354 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.204130:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938442.204133:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938442.204137:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a600/0x7b044d4128f9c03f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663de1 expref: 354 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.204187:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f20a600, rc 0) 00000100:00100000:1.0:1784938442.204230:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+353:17096:x1871643337419392:12345-192.168.202.54@tcp:101:cp.0 Request processed in 461us (601us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938442.204237:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 377 00000100:00100000:0.0:1784938442.213516:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.213640:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337419648 00000100:00100000:3.0:1784938442.213650:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337419648 00000100:00100000:3.0:1784938442.213745:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 378 00000100:00100000:3.0:1784938442.213757:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+353:17096:x1871643337419648:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.213779:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.213816:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9c054 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663de8 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.213940:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3fa00/0x7b044d4128f9c05b lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.213956:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3fa00/0x7b044d4128f9c05b lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.213967:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3fa00/0x7b044d4128f9c05b lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.214008:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9c062 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0xc2bba7e5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.214016:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9c062 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.214024:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9c062 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938442.214410:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x56:0x0], index 1: 0 00010000:00010000:3.0:1784938442.214551:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f400/0x7b044d4128f9c069 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.214561:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f400/0x7b044d4128f9c069 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.214569:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f400/0x7b044d4128f9c069 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.214603:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3fa00/0x7b044d4128f9c05b lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.214610:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3fa00/0x7b044d4128f9c05b lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.214618:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3fa00/0x7b044d4128f9c05b lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.214624:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3fa00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.214629:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3fa00/0x7b044d4128f9c05b lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.214637:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3fa00/0x7b044d4128f9c05b lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.214649:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938442.214652:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.214658:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3fa00/0x7b044d4128f9c05b lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.214675:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3fa00/0x7b044d4128f9c05b lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938442.214689:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000025271679 reply state 000000006672f500 transno 8589934783 ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9c062 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.214700:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9c062 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.214706:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xc2bba7e5 (ffff9f238727c700) 00010000:00010000:3.0:1784938442.214708:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938442.214711:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938442.214740:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9c054 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663de8 expref: 356 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.214755:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f400/0x7b044d4128f9c069 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663de8 expref: 355 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.214762:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2c:0x0].0x0 (ffff9f238727c000) 00010000:00010000:3.0:1784938442.214765:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938442.214767:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3f400, rc 0) 00000100:00100000:3.0:1784938442.214837:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+356:17096:x1871643337419648:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1082us (1331us total) trans 8589934783 rc 0/0 00000100:00100000:3.0:1784938442.214845:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 378 00000100:00100000:0.0:1784938442.225935:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.226183:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337419776 00000100:00100000:1.0:1784938442.226195:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337419776 00000100:00100000:1.0:1784938442.226260:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 582 00000100:00100000:1.0:1784938442.226270:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+93:10960:x1871643337419776:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938442.226292:0:25716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938442.226311:0:25716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000237a9c79/0x7b044d4128f9c077 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663def expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938442.226347:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x56:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938442.226370:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x56:0x0].0x0 since=708s v=(0 0) 00010000:00010000:1.0:1784938442.226375:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x56:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.226384:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000237a9c79/0x7b044d4128f9c077 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663def expref: 94 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.226401:0:25716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000237a9c79/0x7b044d4128f9c077 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663def expref: 94 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.226414:0:25716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f20a600, rc 0) 00000100:00100000:1.0:1784938442.226568:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+94:10960:x1871643337419776:12345-192.168.202.54@tcp:101:cp.0 Request processed in 298us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.226575:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 582 00000100:00100000:0.0:1784938442.230475:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.230568:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337419904 00000100:00100000:3.0:1784938442.230579:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337419904 00000100:00100000:3.0:1784938442.230645:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 583 00000100:00100000:3.0:1784938442.230655:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+94:17096:x1871643337419904:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.230689:0:25715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.230707:0:25715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008352c51b/0x7b044d4128f9c07e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663df6 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.230738:0:25715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000237a9c79/0x7b044d4128f9c077 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663def expref: 95 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.230747:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x56:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.230752:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x56:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.230757:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008352c51b/0x7b044d4128f9c07e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663df6 expref: 95 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.230803:0:25715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000237a9c79/0x7b044d4128f9c077 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663def expref: 95 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.230817:0:25715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000237a9c79/0x7b044d4128f9c077 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663def expref: 95 pid: 25716 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.230832:0:25715:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25715:1871643350837248:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938442.230931:0:25715:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2488d26780 going to sleep for 11 seconds 00000100:00100000:0.0:1784938442.236999:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.237189:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337420032 00000100:00100000:1.0:1784938442.237200:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337420032 00010000:00010000:1.0:1784938442.237243:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000237a9c79/0x7b044d4128f9c077 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663def expref: 96 pid: 25716 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.237296:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 241 00000100:00100000:1.0:1784938442.237305:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+96:10958:x1871643337420032:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.237321:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.237371:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000237a9c79/0x7b044d4128f9c077 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663def expref: 96 pid: 25716 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.237386:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000237a9c79/0x7b044d4128f9c077 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663def expref: 96 pid: 25716 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.237409:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x56:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.237413:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x56:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.237421:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008352c51b/0x7b044d4128f9c07e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663df6 expref: 96 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.237430:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008352c51b/0x7b044d4128f9c07e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663df6 expref: 96 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.237468:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008352c51b/0x7b044d4128f9c07e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663df6 expref: 96 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.237482:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350837376:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938442.237557:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2488a4cd80 going to sleep for 11 seconds 00010000:00010000:3.0:1784938442.237777:0:25715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000237a9c79/0x7b044d4128f9c077 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663def expref: 96 pid: 25716 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.237795:0:25715:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25715:1871643350837248:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938442.237817:0:25715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008352c51b/0x7b044d4128f9c07e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663df6 expref: 95 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.237840:0:25715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3fa00, rc 0) 00000100:00100000:3.0:1784938442.237874:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+95:17096:x1871643337419904:12345-192.168.202.54@tcp:101:cp.0 Request processed in 7221us (7414us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938442.237879:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 583 00000100:00100000:1.0:1784938442.240527:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350837376:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938442.240551:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938442.240600:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+94:10958:x1871643337420032:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3295us (3615us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.240610:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 241 00000100:00100000:1.0:1784938442.247253:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.247368:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337420288 00000100:00100000:3.0:1784938442.247376:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337420288 00000100:00100000:3.0:1784938442.247425:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 63 00000100:00100000:3.0:1784938442.247435:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24857fb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+356:17096:x1871643337420288:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938442.247849:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24857fb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+357:17096:x1871643337420288:12345-192.168.202.54@tcp:35:cp.0 Request processed in 414us (605us total) trans 8589934784 rc 0/0 00000100:00100000:3.0:1784938442.247857:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 63 00000100:00100000:0.0:1784938442.254015:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.254138:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337420416 00000100:00100000:3.0:1784938442.254178:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337420416 00000100:00100000:3.0:1784938442.254244:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 379 00000100:00100000:3.0:1784938442.254254:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+357:17096:x1871643337420416:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.254279:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.254301:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9c085 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663dfd expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.254376:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9c08c lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.254390:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9c08c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.254402:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9c08c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.254432:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9c093 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x2fbacb41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.254438:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9c093 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.254444:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9c093 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.254487:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9c08c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.254494:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9c08c lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.254500:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9c08c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.254506:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3f200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.254511:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9c08c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.254518:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9c08c lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.254530:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938442.254532:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.254536:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9c08c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.254543:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9c08c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.254566:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9c093 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.254572:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9c093 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.254577:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9c093 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.254582:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17ac00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.254584:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9c093 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.254590:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9c093 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.254605:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x2fbacb41 (ffff9f238727c900) 00010000:00010000:3.0:1784938442.254607:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.254610:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9c093 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.254615:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9c093 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.254652:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9c085 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663dfd expref: 358 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.254662:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938442.254665:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.254675:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9c085 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663dfd expref: 358 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.254685:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3e600, rc 0) 00000100:00100000:3.0:1784938442.254751:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+357:17096:x1871643337420416:12345-192.168.202.54@tcp:101:cp.0 Request processed in 497us (743us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938442.254762:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 379 00000100:00100000:0.0:1784938442.258241:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938442.258300:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337420544 00000100:00100000:2.0:1784938442.258309:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337420544 00000100:00100000:2.0:1784938442.258376:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 380 00000100:00100000:2.0:1784938442.258386:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+357:17096:x1871643337420544:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938442.258408:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938442.258432:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9c09a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663e04 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.258490:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9c0a1 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.258500:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9c0a1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.258509:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9c0a1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.258520:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9c0a8 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x2fbacb41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.258524:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9c0a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.258528:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9c0a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.258570:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9c0a1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.258578:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9c0a1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.258584:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9c0a1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.258591:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3d000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938442.258594:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9c0a1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.258603:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9c0a1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.258616:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938442.258620:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.258625:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9c0a1 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.258632:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d000/0x7b044d4128f9c0a1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.258646:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9c0a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.258650:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9c0a8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.258654:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9c0a8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.258657:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938442.258660:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9c0a8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.258663:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9c0a8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.258667:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x2fbacb41 (ffff9f23823dcf00) 00010000:00010000:2.0:1784938442.258669:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.258670:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9c0a8 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.258673:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057e00/0x7b044d4128f9c0a8 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.258708:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9c09a lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e04 expref: 358 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.258718:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938442.258721:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.258725:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9c09a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e04 expref: 358 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.258735:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d3d600, rc 0) 00000100:00100000:2.0:1784938442.258800:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+357:17096:x1871643337420544:12345-192.168.202.54@tcp:101:cp.0 Request processed in 414us (566us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938442.258808:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 380 00000100:00100000:0.0:1784938442.261254:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.261305:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337420800 00000100:00100000:3.0:1784938442.261315:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337420800 00000100:00100000:0.0:1784938442.261429:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 381 00000100:00100000:0.0:1784938442.261440:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+357:17096:x1871643337420800:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938442.261461:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938442.261481:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9c0af lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663e0b expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.261570:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9c0b6 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.261584:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9c0b6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.261669:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9c0b6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.261686:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9c0bd lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x2fbacb41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.261694:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9c0bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.261701:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9c0bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938442.262399:0:24203:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x57:0x0], index 0: 0 00010000:00010000:0.0:1784938442.262548:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6e00/0x7b044d4128f9c0c4 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.262558:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6e00/0x7b044d4128f9c0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.262566:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6e00/0x7b044d4128f9c0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.262717:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9c0b6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.262729:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9c0b6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.262736:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9c0b6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.262742:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a6200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938442.262746:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9c0b6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.262754:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9c0b6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.262766:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938442.262769:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.262773:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9c0b6 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.262779:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9c0b6 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938442.262792:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000092e3f503 reply state 000000008841d18f transno 8589934785 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9c0bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.262803:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9c0bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.262809:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x2fbacb41 (ffff9f2487e3a500) 00010000:00010000:0.0:1784938442.262811:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938442.262814:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938442.262843:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9c0af lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e0b expref: 360 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.262858:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6e00/0x7b044d4128f9c0c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e0b expref: 359 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.262865:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2d:0x0].0x0 (ffff9f2487e3a000) 00010000:00010000:0.0:1784938442.262867:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938442.262870:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a6e00, rc 0) 00000100:00100000:0.0:1784938442.263307:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+360:17096:x1871643337420800:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1867us (2058us total) trans 8589934785 rc 0/0 00000100:00100000:0.0:1784938442.263316:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 381 00000100:00100000:0.0:1784938442.266276:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.266325:0:21152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337420928 00000100:00100000:3.0:1784938442.266354:0:21152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337420928 00000100:00100000:3.0:1784938442.266467:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 584 00000100:00100000:3.0:1784938442.266478:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+93:10958:x1871643337420928:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.266497:0:21152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.266517:0:21152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004078d00f/0x7b044d4128f9c0d2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663e12 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938442.266544:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x57:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938442.266565:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x57:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1784938442.266569:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x57:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.266579:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004078d00f/0x7b044d4128f9c0d2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e12 expref: 94 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.266597:0:21152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004078d00f/0x7b044d4128f9c0d2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e12 expref: 94 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.266610:0:21152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17ac00, rc 0) 00000100:00100000:3.0:1784938442.266675:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+94:10958:x1871643337420928:12345-192.168.202.54@tcp:101:cp.0 Request processed in 199us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938442.266682:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 584 00000100:00100000:0.0:1784938442.269653:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.269700:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337421056 00000100:00100000:3.0:1784938442.269711:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337421056 00000100:00100000:2.0:1784938442.269806:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 585 00000100:00100000:2.0:1784938442.269818:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+94:17096:x1871643337421056:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938442.269839:0:21149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938442.269855:0:21149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db15c6a5/0x7b044d4128f9c0d9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663e19 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.269880:0:21149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004078d00f/0x7b044d4128f9c0d2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e12 expref: 95 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.269887:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x57:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.269890:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x57:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.269901:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db15c6a5/0x7b044d4128f9c0d9 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e19 expref: 95 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.269934:0:21149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004078d00f/0x7b044d4128f9c0d2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663e12 expref: 95 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.269949:0:21149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004078d00f/0x7b044d4128f9c0d2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663e12 expref: 95 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.269960:0:21149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f199f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:21149:1871643350837504:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938442.270021:0:21149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24917d6900 going to sleep for 11 seconds 00000100:00100000:2.0:1784938442.272133:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.272225:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337421184 00000100:00100000:1.0:1784938442.272232:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337421184 00010000:00010000:1.0:1784938442.272270:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004078d00f/0x7b044d4128f9c0d2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663e12 expref: 96 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.272319:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 242 00000100:00100000:1.0:1784938442.272327:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f199500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+96:10960:x1871643337421184:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.272357:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.272381:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004078d00f/0x7b044d4128f9c0d2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663e12 expref: 96 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.272395:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004078d00f/0x7b044d4128f9c0d2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663e12 expref: 96 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.272421:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x57:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.272425:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x57:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.272433:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db15c6a5/0x7b044d4128f9c0d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e19 expref: 96 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.272443:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db15c6a5/0x7b044d4128f9c0d9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e19 expref: 96 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.272452:0:21149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004078d00f/0x7b044d4128f9c0d2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x57:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663e12 expref: 96 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.272467:0:21149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f199f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:21149:1871643350837504:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938442.272483:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000db15c6a5/0x7b044d4128f9c0d9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e19 expref: 95 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.272491:0:21149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db15c6a5/0x7b044d4128f9c0d9 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663e19 expref: 95 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.272496:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350837632:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938442.272501:0:21149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b4057e00, rc 0) 00000100:00100000:0.0:1784938442.272636:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+95:17096:x1871643337421056:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2819us (2990us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.272644:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 585 00000100:00100000:1.0:1784938442.272645:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2488a4c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938442.276092:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350837632:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938442.276119:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938442.276206:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f199500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+94:10960:x1871643337421184:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3878us (4080us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.276217:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 242 00000100:00100000:2.0:1784938442.279288:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.279377:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337421440 00000100:00100000:1.0:1784938442.279387:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337421440 00000100:00100000:1.0:1784938442.279467:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 64 00000100:00100000:1.0:1784938442.279475:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+360:17096:x1871643337421440:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:1.0:1784938442.279930:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+361:17096:x1871643337421440:12345-192.168.202.54@tcp:35:cp.0 Request processed in 454us (648us total) trans 8589934786 rc 0/0 00000100:00100000:1.0:1784938442.279939:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 64 00000100:00100000:2.0:1784938442.283549:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.283691:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337421568 00000100:00100000:3.0:1784938442.283701:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337421568 00000100:00100000:3.0:1784938442.283921:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 382 00000100:00100000:3.0:1784938442.283930:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+361:17096:x1871643337421568:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.283951:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.283969:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9c0e0 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663e20 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.284019:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9c0e7 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.284104:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9c0e7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.284114:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9c0e7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.284126:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9c0ee lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xff118af2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.284133:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9c0ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.284140:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9c0ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.284231:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9c0e7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.284236:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9c0e7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.284241:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9c0e7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.284245:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3e600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.284247:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9c0e7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.284252:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9c0e7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.284261:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938442.284263:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.284266:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9c0e7 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.284271:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9c0e7 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.284280:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9c0ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.284283:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9c0ee lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.284287:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9c0ee lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.284294:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3f200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.284296:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9c0ee lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.284299:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9c0ee lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.284303:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xff118af2 (ffff9f238727ce00) 00010000:00010000:3.0:1784938442.284304:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.284306:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9c0ee lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.284309:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9c0ee lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.284345:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9c0e0 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e20 expref: 362 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.284357:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938442.284359:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.284366:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ac00/0x7b044d4128f9c0e0 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e20 expref: 362 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.284376:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17ac00, rc 0) 00000100:00100000:3.0:1784938442.284434:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+361:17096:x1871643337421568:12345-192.168.202.54@tcp:101:cp.0 Request processed in 505us (896us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938442.284442:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 382 00000100:00100000:0.0:1784938442.286687:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.286789:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337421696 00000100:00100000:1.0:1784938442.286798:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337421696 00000100:00100000:1.0:1784938442.286859:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 383 00000100:00100000:1.0:1784938442.286868:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+361:17096:x1871643337421696:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938442.286885:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938442.286981:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20ba00/0x7b044d4128f9c0f5 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663e27 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.287098:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20aa00/0x7b044d4128f9c0fc lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.287113:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20aa00/0x7b044d4128f9c0fc lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.287124:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20aa00/0x7b044d4128f9c0fc lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.287140:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a600/0x7b044d4128f9c103 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xff118af2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.287225:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a600/0x7b044d4128f9c103 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.287230:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a600/0x7b044d4128f9c103 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.287265:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20aa00/0x7b044d4128f9c0fc lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.287269:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20aa00/0x7b044d4128f9c0fc lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.287273:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20aa00/0x7b044d4128f9c0fc lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.287277:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20aa00/0x7b044d4128f9c0fc lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.287280:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f20aa00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938442.287284:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20aa00/0x7b044d4128f9c0fc lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.287289:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20aa00/0x7b044d4128f9c0fc lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.287296:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938442.287298:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938442.287301:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20aa00/0x7b044d4128f9c0fc lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.287305:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20aa00/0x7b044d4128f9c0fc lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.287314:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a600/0x7b044d4128f9c103 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.287318:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a600/0x7b044d4128f9c103 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.287321:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a600/0x7b044d4128f9c103 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.287324:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f20a600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938442.287325:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a600/0x7b044d4128f9c103 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.287328:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a600/0x7b044d4128f9c103 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.287480:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xff118af2 (ffff9f23823e1500) 00010000:00010000:1.0:1784938442.287482:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938442.287485:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a600/0x7b044d4128f9c103 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.287489:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a600/0x7b044d4128f9c103 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.287515:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20ba00/0x7b044d4128f9c0f5 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e27 expref: 362 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.287522:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938442.287523:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938442.287525:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20ba00/0x7b044d4128f9c0f5 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e27 expref: 362 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.287531:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f20ba00, rc 0) 00000100:00100000:1.0:1784938442.287578:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+361:17096:x1871643337421696:12345-192.168.202.54@tcp:101:cp.0 Request processed in 710us (900us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938442.287585:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 383 00000100:00100000:2.0:1784938442.289605:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.289680:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337421952 00000100:00100000:1.0:1784938442.289688:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337421952 00000100:00100000:1.0:1784938442.289734:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 384 00000100:00100000:1.0:1784938442.289744:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+361:17096:x1871643337421952:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938442.289765:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938442.289787:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20bc00/0x7b044d4128f9c10a lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663e2e expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.289877:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20ac00/0x7b044d4128f9c111 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.289891:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20ac00/0x7b044d4128f9c111 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.289950:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20ac00/0x7b044d4128f9c111 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.289961:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20be00/0x7b044d4128f9c118 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0xff118af2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.289966:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20be00/0x7b044d4128f9c118 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.289970:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20be00/0x7b044d4128f9c118 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938442.292517:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x57:0x0], index 1: 0 00010000:00010000:1.0:1784938442.292708:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20b800/0x7b044d4128f9c11f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.292725:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20b800/0x7b044d4128f9c11f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.292736:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20b800/0x7b044d4128f9c11f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.292774:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20ac00/0x7b044d4128f9c111 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.292781:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20ac00/0x7b044d4128f9c111 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.292788:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20ac00/0x7b044d4128f9c111 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.292794:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f20ac00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938442.292799:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20ac00/0x7b044d4128f9c111 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.292806:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20ac00/0x7b044d4128f9c111 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.292819:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938442.292822:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938442.292827:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20ac00/0x7b044d4128f9c111 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.292833:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20ac00/0x7b044d4128f9c111 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938442.292851:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000000f65350 reply state 00000000e1f43d83 transno 8589934787 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20be00/0x7b044d4128f9c118 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.292862:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20be00/0x7b044d4128f9c118 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.292870:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xff118af2 (ffff9f23823e1100) 00010000:00010000:1.0:1784938442.292872:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938442.292875:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938442.292913:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20bc00/0x7b044d4128f9c10a lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e2e expref: 364 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.292924:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20b800/0x7b044d4128f9c11f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e2e expref: 363 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.292933:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2e:0x0].0x0 (ffff9f23823e1a00) 00010000:00010000:1.0:1784938442.292934:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938442.292936:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f20b800, rc 0) 00000100:00100000:1.0:1784938442.292996:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+364:17096:x1871643337421952:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3254us (3396us total) trans 8589934787 rc 0/0 00000100:00100000:1.0:1784938442.293003:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 384 00000100:00100000:2.0:1784938442.296444:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.296548:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337422080 00000100:00100000:0.0:1784938442.296559:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337422080 00000100:00100000:0.0:1784938442.296623:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 586 00000100:00100000:0.0:1784938442.296634:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+94:10960:x1871643337422080:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938442.296655:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938442.296679:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9c12d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663e35 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938442.296705:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x57:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938442.296728:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x57:0x0].0x0 since=708s v=(0 0) 00010000:00010000:0.0:1784938442.296732:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x57:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.296742:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9c12d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e35 expref: 95 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.296760:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9c12d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e35 expref: 95 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.296773:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a7000, rc 0) 00000100:00100000:0.0:1784938442.296833:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+95:10960:x1871643337422080:12345-192.168.202.54@tcp:101:cp.0 Request processed in 200us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.296841:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 586 00000100:00100000:0.0:1784938442.299604:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938442.299757:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337422208 00000100:00100000:2.0:1784938442.299767:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337422208 00000100:00100000:2.0:1784938442.299820:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 587 00000100:00100000:2.0:1784938442.299829:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+95:17096:x1871643337422208:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938442.299849:0:21629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938442.299867:0:21629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fda55582/0x7b044d4128f9c134 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663e3c expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.299907:0:21629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9c12d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e35 expref: 96 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.299916:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x57:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.299920:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x57:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.299925:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fda55582/0x7b044d4128f9c134 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e3c expref: 96 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.299954:0:21629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9c12d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663e35 expref: 96 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.299968:0:21629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9c12d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663e35 expref: 96 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.299981:0:21629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f243b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:21629:1871643350837760:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938442.300099:0:21629:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24917d6900 going to sleep for 11 seconds 00000100:00100000:2.0:1784938442.302621:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.302643:0:21629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f243b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:21629:1871643350837760:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938442.302678:0:21629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fda55582/0x7b044d4128f9c134 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663e3c expref: 96 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.302702:0:21629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d3d000, rc 0) 00000100:00100000:0.0:1784938442.302718:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337422336 00000100:00100000:0.0:1784938442.302726:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337422336 00010000:00010000:0.0:1784938442.302762:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9c12d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663e35 expref: 97 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.302767:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+97:17096:x1871643337422208:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2936us (3168us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.302785:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 587 00000100:00100000:0.0:1784938442.302970:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 243 00000100:00100000:0.0:1784938442.302981:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f241180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+96:10957:x1871643337422336:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938442.302995:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938442.303018:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9c12d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663e35 expref: 96 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.303094:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9c12d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663e35 expref: 96 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.303116:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9c12d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663e35 expref: 96 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.303140:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x57:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.303165:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x57:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.303174:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fda55582/0x7b044d4128f9c134 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663e3c expref: 95 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.303184:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fda55582/0x7b044d4128f9c134 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663e3c expref: 95 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.303216:0:19220:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fda55582/0x7b044d4128f9c134 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663e3c expref: 95 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.303229:0:19220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68d9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:19220:1871643350837888:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938442.303286:0:19220:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2491ebf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938442.307647:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.307696:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337422592 00000100:00100000:3.0:1784938442.307719:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337422592 00000100:00100000:0.0:1784938442.307731:0:19220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68d9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:19220:1871643350837888:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938442.307753:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938442.307838:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 65 00000100:00100000:0.0:1784938442.307838:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f241180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+95:10957:x1871643337422336:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 4859us (5228us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938442.307847:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+364:17096:x1871643337422592:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:0.0:1784938442.307847:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 243 00000100:00100000:3.0:1784938442.308235:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+365:17096:x1871643337422592:12345-192.168.202.54@tcp:35:cp.0 Request processed in 388us (594us total) trans 8589934788 rc 0/0 00000100:00100000:3.0:1784938442.308242:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 65 00000100:00100000:2.0:1784938442.310289:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.310409:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337422720 00000100:00100000:0.0:1784938442.310416:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337422720 00000100:00100000:0.0:1784938442.310461:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 385 00000100:00100000:0.0:1784938442.310468:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+365:17096:x1871643337422720:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938442.310485:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938442.310503:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7000/0x7b044d4128f9c13b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663e43 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.310561:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9c142 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.310573:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9c142 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.310581:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9c142 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.310591:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7600/0x7b044d4128f9c149 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xb2d5a33e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.310596:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7600/0x7b044d4128f9c149 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.310599:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7600/0x7b044d4128f9c149 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.310638:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9c142 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.310642:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9c142 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.310647:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9c142 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.310651:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a6000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938442.310654:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9c142 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.310659:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9c142 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.310666:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938442.310668:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.310671:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9c142 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.310675:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6000/0x7b044d4128f9c142 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.310683:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7600/0x7b044d4128f9c149 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.310687:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7600/0x7b044d4128f9c149 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.310691:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7600/0x7b044d4128f9c149 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.310694:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a7600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938442.310696:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7600/0x7b044d4128f9c149 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.310699:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7600/0x7b044d4128f9c149 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.310703:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xb2d5a33e (ffff9f2487e3a700) 00010000:00010000:0.0:1784938442.310704:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.310706:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7600/0x7b044d4128f9c149 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.310708:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7600/0x7b044d4128f9c149 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.310730:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7000/0x7b044d4128f9c13b lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e43 expref: 366 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.310736:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938442.310737:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.310739:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7000/0x7b044d4128f9c13b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e43 expref: 366 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.310756:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a7000, rc 0) 00000100:00100000:0.0:1784938442.310808:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+365:17096:x1871643337422720:12345-192.168.202.54@tcp:101:cp.0 Request processed in 339us (526us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938442.310819:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 385 00000100:00100000:2.0:1784938442.312206:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.312282:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337422848 00000100:00100000:3.0:1784938442.312287:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337422848 00000100:00100000:3.0:1784938442.312317:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 386 00000100:00100000:3.0:1784938442.312323:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+365:17096:x1871643337422848:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.312352:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.312373:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9c150 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663e4a expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.312417:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9c157 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.312427:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9c157 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.312434:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9c157 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.312444:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9c15e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xb2d5a33e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.312448:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9c15e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.312452:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9c15e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.312495:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9c157 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.312500:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9c157 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.312504:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9c157 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.312507:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3e600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.312510:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9c157 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.312514:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9c157 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.312521:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938442.312523:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.312525:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9c157 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.312529:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9c157 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.312537:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9c15e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.312541:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9c15e lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.312544:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9c15e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.312549:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3d600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.312550:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9c15e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.312554:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9c15e lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.312557:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xb2d5a33e (ffff9f238727ce00) 00010000:00010000:3.0:1784938442.312558:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.312559:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9c15e lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.312562:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9c15e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.312581:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9c150 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e4a expref: 366 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.312586:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938442.312587:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.312589:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9c150 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e4a expref: 366 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.312594:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3f200, rc 0) 00000100:00100000:3.0:1784938442.312634:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+365:17096:x1871643337422848:12345-192.168.202.54@tcp:101:cp.0 Request processed in 311us (436us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938442.312639:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 386 00000100:00100000:2.0:1784938442.314187:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.314270:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337423104 00000100:00100000:0.0:1784938442.314276:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337423104 00000100:00100000:0.0:1784938442.314308:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 387 00000100:00100000:0.0:1784938442.314314:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+365:17096:x1871643337423104:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938442.314326:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938442.314357:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9c165 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663e51 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.314451:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379dc00/0x7b044d4128f9c16c lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.314465:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379dc00/0x7b044d4128f9c16c lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.314475:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379dc00/0x7b044d4128f9c16c lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.314486:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9c173 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0xb2d5a33e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.314490:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9c173 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.314494:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9c173 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938442.314774:0:24203:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x58:0x0], index 0: 0 00010000:00010000:0.0:1784938442.314895:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625fc00/0x7b044d4128f9c17a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.314903:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625fc00/0x7b044d4128f9c17a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.314915:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625fc00/0x7b044d4128f9c17a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.314948:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379dc00/0x7b044d4128f9c16c lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.314955:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379dc00/0x7b044d4128f9c16c lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.314962:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379dc00/0x7b044d4128f9c16c lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.314967:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b379dc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938442.314970:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379dc00/0x7b044d4128f9c16c lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.314976:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379dc00/0x7b044d4128f9c16c lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.314984:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938442.314986:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.314989:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379dc00/0x7b044d4128f9c16c lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.314993:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379dc00/0x7b044d4128f9c16c lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938442.315002:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007677cabb reply state 0000000024249203 transno 8589934789 ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9c173 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.315008:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9c173 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.315015:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xb2d5a33e (ffff9f24898dc300) 00010000:00010000:0.0:1784938442.315018:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938442.315020:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938442.315046:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9c165 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e51 expref: 368 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.315061:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625fc00/0x7b044d4128f9c17a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e51 expref: 367 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.315067:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2f:0x0].0x0 (ffff9f248390a000) 00010000:00010000:0.0:1784938442.315070:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938442.315072:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24c625fc00, rc 0) 00000100:00100000:0.0:1784938442.315134:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+368:17096:x1871643337423104:12345-192.168.202.54@tcp:101:cp.0 Request processed in 818us (953us total) trans 8589934789 rc 0/0 00000100:00100000:0.0:1784938442.315142:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 387 00000100:00100000:0.0:1784938442.318781:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.318834:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337423232 00000100:00100000:1.0:1784938442.318843:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337423232 00000100:00100000:1.0:1784938442.318893:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 588 00000100:00100000:1.0:1784938442.318909:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+94:10957:x1871643337423232:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938442.318927:0:25716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938442.318951:0:25716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027576e9e/0x7b044d4128f9c188 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663e58 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938442.318973:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x58:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938442.318992:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x58:0x0].0x0 since=708s v=(0 0) 00010000:00010000:1.0:1784938442.318997:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x58:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.319005:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027576e9e/0x7b044d4128f9c188 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e58 expref: 95 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.319021:0:25716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027576e9e/0x7b044d4128f9c188 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e58 expref: 95 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.319049:0:25716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f20bc00, rc 0) 00000100:00100000:1.0:1784938442.319114:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+95:10957:x1871643337423232:12345-192.168.202.54@tcp:101:cp.0 Request processed in 207us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.319122:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 588 00000100:00100000:0.0:1784938442.321600:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.321670:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337423360 00000100:00100000:3.0:1784938442.321680:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337423360 00000100:00100000:3.0:1784938442.321736:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 589 00000100:00100000:3.0:1784938442.321745:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+95:17096:x1871643337423360:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.321763:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.321782:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004078d00f/0x7b044d4128f9c18f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663e5f expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.321812:0:21151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027576e9e/0x7b044d4128f9c188 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e58 expref: 96 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.321820:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x58:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.321825:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x58:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.321830:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004078d00f/0x7b044d4128f9c18f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e5f expref: 96 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.321866:0:21151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000027576e9e/0x7b044d4128f9c188 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663e58 expref: 96 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.321880:0:21151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000027576e9e/0x7b044d4128f9c188 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663e58 expref: 96 pid: 25716 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.321906:0:21151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:21151:1871643350838016:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938442.321992:0:21151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2488d26780 going to sleep for 11 seconds 00000100:00100000:0.0:1784938442.324465:0:21151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:21151:1871643350838016:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938442.324627:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004078d00f/0x7b044d4128f9c18f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663e5f expref: 96 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.324649:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17ac00, rc 0) 00000100:00100000:0.0:1784938442.324705:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+96:17096:x1871643337423360:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2960us (3113us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.324713:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 589 00000100:00100000:1.0:1784938442.325739:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.325836:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337423488 00000100:00100000:3.0:1784938442.325844:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337423488 00010000:00010000:3.0:1784938442.325880:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000027576e9e/0x7b044d4128f9c188 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663e58 expref: 96 pid: 25716 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.326051:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 244 00000100:00100000:3.0:1784938442.326064:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2485ced050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+96:10960:x1871643337423488:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938442.326082:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938442.326112:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000027576e9e/0x7b044d4128f9c188 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663e58 expref: 96 pid: 25716 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.326139:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000027576e9e/0x7b044d4128f9c188 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663e58 expref: 96 pid: 25716 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.326184:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027576e9e/0x7b044d4128f9c188 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663e58 expref: 96 pid: 25716 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.326201:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x58:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.326207:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x58:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.326216:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004078d00f/0x7b044d4128f9c18f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663e5f expref: 95 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.326226:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004078d00f/0x7b044d4128f9c18f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663e5f expref: 95 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.326264:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004078d00f/0x7b044d4128f9c18f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663e5f expref: 95 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.326279:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350838144:192.168.202.54@tcp:105: 00000100:00100000:3.0:1784938442.326370:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2488d26780 going to sleep for 11 seconds 00000100:00100000:2.0:1784938442.330015:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.330196:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337423744 00000100:00100000:0.0:1784938442.330207:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337423744 00000100:00100000:0.0:1784938442.330263:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 66 00000100:00100000:0.0:1784938442.330273:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+368:17096:x1871643337423744:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:0.0:1784938442.330596:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+369:17096:x1871643337423744:12345-192.168.202.54@tcp:35:cp.0 Request processed in 324us (591us total) trans 8589934790 rc 0/0 00000100:00100000:0.0:1784938442.330601:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 66 00000100:00100000:3.0:1784938442.330717:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350838144:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938442.330736:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938442.330753:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2485ced050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+95:10960:x1871643337423488:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 4695us (5021us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938442.330761:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 244 00000100:00100000:2.0:1784938442.334081:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.334196:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337423872 00000100:00100000:3.0:1784938442.334206:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337423872 00000100:00100000:3.0:1784938442.334254:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 388 00000100:00100000:3.0:1784938442.334263:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+369:17096:x1871643337423872:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.334287:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.334310:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9c196 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663e66 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.334386:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9c19d lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.334400:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9c19d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.334412:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9c19d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.334427:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9c1a4 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x4958ff4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.334433:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9c1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.334440:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9c1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.334482:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9c19d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.334489:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9c19d lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.334496:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9c19d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.334502:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3f200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.334506:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9c19d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.334513:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9c19d lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.334524:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938442.334527:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.334532:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9c19d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.334539:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9c19d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.334553:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9c1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.334559:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9c1a4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.334565:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9c1a4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.334571:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3e600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.334574:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9c1a4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.334580:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9c1a4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.334587:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x4958ff4 (ffff9f238727ce00) 00010000:00010000:3.0:1784938442.334589:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.334591:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9c1a4 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.334597:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9c1a4 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.334629:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9c196 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e66 expref: 370 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.334639:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938442.334641:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.334645:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d600/0x7b044d4128f9c196 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e66 expref: 370 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.334654:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d3d600, rc 0) 00000100:00100000:3.0:1784938442.334709:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+369:17096:x1871643337423872:12345-192.168.202.54@tcp:101:cp.0 Request processed in 446us (637us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938442.334716:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 388 00000100:00100000:1.0:1784938442.337697:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.337790:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337424000 00000100:00100000:3.0:1784938442.337800:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337424000 00000100:00100000:3.0:1784938442.337915:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 389 00000100:00100000:3.0:1784938442.337926:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+369:17096:x1871643337424000:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.337944:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.337965:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9c1ab lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663e6d expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.338026:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c1b2 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.338052:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c1b2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.338064:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c1b2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.338079:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1800/0x7b044d4128f9c1b9 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x4958ff4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.338086:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1800/0x7b044d4128f9c1b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.338092:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1800/0x7b044d4128f9c1b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.338130:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c1b2 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.338137:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c1b2 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.338143:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c1b2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.338180:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c1b2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.338187:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf0a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.338191:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c1b2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.338199:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c1b2 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.338211:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938442.338215:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.338220:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c1b2 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.338226:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c1b2 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.338241:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1800/0x7b044d4128f9c1b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.338247:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1800/0x7b044d4128f9c1b9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.338253:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1800/0x7b044d4128f9c1b9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.338258:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.338261:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1800/0x7b044d4128f9c1b9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.338271:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1800/0x7b044d4128f9c1b9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.338278:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x4958ff4 (ffff9f238727c500) 00010000:00010000:3.0:1784938442.338281:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.338283:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1800/0x7b044d4128f9c1b9 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.338288:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1800/0x7b044d4128f9c1b9 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.338322:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9c1ab lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e6d expref: 370 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.338345:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938442.338348:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.338351:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c800/0x7b044d4128f9c1ab lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e6d expref: 370 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.338362:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c95c800, rc 0) 00000100:00100000:3.0:1784938442.338422:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+369:17096:x1871643337424000:12345-192.168.202.54@tcp:101:cp.0 Request processed in 498us (734us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938442.338429:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 389 00000100:00100000:1.0:1784938442.346470:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.346872:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337424256 00000100:00100000:3.0:1784938442.346882:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337424256 00000100:00100000:3.0:1784938442.346946:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 390 00000100:00100000:3.0:1784938442.346957:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+369:17096:x1871643337424256:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.346983:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.347007:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0000/0x7b044d4128f9c1c0 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663e74 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.347210:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0c00/0x7b044d4128f9c1c7 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.347227:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0c00/0x7b044d4128f9c1c7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.347239:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0c00/0x7b044d4128f9c1c7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.347253:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9c1ce lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x4958ff4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.347259:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9c1ce lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.347264:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9c1ce lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938442.347582:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x58:0x0], index 1: 0 00010000:00010000:3.0:1784938442.347728:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0800/0x7b044d4128f9c1d5 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.347737:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0800/0x7b044d4128f9c1d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.347744:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0800/0x7b044d4128f9c1d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.347781:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0c00/0x7b044d4128f9c1c7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.347788:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0c00/0x7b044d4128f9c1c7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.347794:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0c00/0x7b044d4128f9c1c7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.347800:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf0c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.347804:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0c00/0x7b044d4128f9c1c7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.347812:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0c00/0x7b044d4128f9c1c7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.347823:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938442.347825:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.347829:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0c00/0x7b044d4128f9c1c7 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.347834:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0c00/0x7b044d4128f9c1c7 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938442.347848:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000025b5074e reply state 0000000033da5ff0 transno 8589934791 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9c1ce lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.347859:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9c1ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.347865:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x4958ff4 (ffff9f238727c100) 00010000:00010000:3.0:1784938442.347868:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938442.347870:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938442.347900:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0000/0x7b044d4128f9c1c0 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e74 expref: 372 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.347914:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0800/0x7b044d4128f9c1d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e74 expref: 371 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.347921:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x30:0x0].0x0 (ffff9f238727ca00) 00010000:00010000:3.0:1784938442.347923:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938442.347926:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf0800, rc 0) 00000100:00100000:3.0:1784938442.347998:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+372:17096:x1871643337424256:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1043us (1539us total) trans 8589934791 rc 0/0 00000100:00100000:3.0:1784938442.348005:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 390 00000100:00100000:2.0:1784938442.354609:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.354719:0:21152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337424384 00000100:00100000:3.0:1784938442.354729:0:21152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337424384 00000100:00100000:3.0:1784938442.354837:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 590 00000100:00100000:3.0:1784938442.354847:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+95:10959:x1871643337424384:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.354866:0:21152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.354885:0:21152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e54ea8ff/0x7b044d4128f9c1e3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663e7b expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938442.354908:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x58:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938442.354928:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x58:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1784938442.354932:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x58:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.354942:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e54ea8ff/0x7b044d4128f9c1e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e7b expref: 96 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.354963:0:21152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e54ea8ff/0x7b044d4128f9c1e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e7b expref: 96 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.354977:0:21152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf0400, rc 0) 00000100:00100000:3.0:1784938442.355076:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+96:10959:x1871643337424384:12345-192.168.202.54@tcp:101:cp.0 Request processed in 229us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938442.355084:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 590 00000100:00100000:1.0:1784938442.358698:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938442.358810:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337424512 00000100:00100000:2.0:1784938442.358820:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337424512 00000100:00100000:2.0:1784938442.358880:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 591 00000100:00100000:2.0:1784938442.358890:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+96:17096:x1871643337424512:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938442.358919:0:25716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938442.358937:0:25716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084429e5d/0x7b044d4128f9c1ea lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663e82 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.358970:0:25716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e54ea8ff/0x7b044d4128f9c1e3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e7b expref: 97 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.358979:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x58:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.358983:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x58:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.358987:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084429e5d/0x7b044d4128f9c1ea lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e82 expref: 97 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.359021:0:25716:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e54ea8ff/0x7b044d4128f9c1e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663e7b expref: 97 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.359037:0:25716:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e54ea8ff/0x7b044d4128f9c1e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663e7b expref: 97 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.359060:0:25716:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f243800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25716:1871643350838272:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938442.359192:0:25716:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24917d6900 going to sleep for 11 seconds 00000100:00100000:2.0:1784938442.362302:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.362432:0:25716:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f243800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25716:1871643350838272:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938442.362469:0:25716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000084429e5d/0x7b044d4128f9c1ea lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663e82 expref: 97 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.362492:0:25716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f244200, rc 0) 00000100:00100000:1.0:1784938442.362561:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+97:17096:x1871643337424512:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3672us (3872us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.362570:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 591 00000100:00100000:3.0:1784938442.362727:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337424640 00000100:00100000:3.0:1784938442.362735:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337424640 00010000:00010000:3.0:1784938442.362767:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e54ea8ff/0x7b044d4128f9c1e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663e7b expref: 97 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.362807:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 245 00000100:00100000:3.0:1784938442.362816:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f241500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+97:10957:x1871643337424640:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938442.362829:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938442.362851:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e54ea8ff/0x7b044d4128f9c1e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663e7b expref: 97 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.362865:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e54ea8ff/0x7b044d4128f9c1e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663e7b expref: 97 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.362887:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e54ea8ff/0x7b044d4128f9c1e3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663e7b expref: 97 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.362905:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x58:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.362909:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x58:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.362916:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000084429e5d/0x7b044d4128f9c1ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663e82 expref: 96 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.362926:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084429e5d/0x7b044d4128f9c1ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663e82 expref: 96 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.362960:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000084429e5d/0x7b044d4128f9c1ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663e82 expref: 96 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.362973:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350838400:192.168.202.54@tcp:105: 00000100:00100000:3.0:1784938442.363022:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238cd3fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938442.367215:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.367448:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350838400:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938442.367471:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938442.367532:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f241500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+96:10957:x1871643337424640:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 4717us (5238us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.367544:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 245 00000100:00100000:2.0:1784938442.367707:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337424896 00000100:00100000:2.0:1784938442.367716:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337424896 00000100:00100000:2.0:1784938442.367768:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 67 00000100:00100000:2.0:1784938442.367778:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+372:17096:x1871643337424896:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:2.0:1784938442.368049:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+373:17096:x1871643337424896:12345-192.168.202.54@tcp:35:cp.0 Request processed in 272us (843us total) trans 8589934792 rc 0/0 00000100:00100000:2.0:1784938442.368056:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 67 00000100:00100000:2.0:1784938442.370972:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.371828:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337425024 00000100:00100000:0.0:1784938442.371840:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337425024 00000100:00100000:2.0:1784938442.372194:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 391 00000100:00100000:2.0:1784938442.372206:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+373:17096:x1871643337425024:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938442.372232:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938442.372255:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244400/0x7b044d4128f9c1f1 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663e89 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.372320:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245400/0x7b044d4128f9c1f8 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.372346:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245400/0x7b044d4128f9c1f8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.372358:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245400/0x7b044d4128f9c1f8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.372376:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245200/0x7b044d4128f9c1ff lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x57ba1cca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.372383:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245200/0x7b044d4128f9c1ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.372389:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245200/0x7b044d4128f9c1ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.372426:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245400/0x7b044d4128f9c1f8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.372432:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245400/0x7b044d4128f9c1f8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.372439:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245400/0x7b044d4128f9c1f8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.372445:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938442.372449:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245400/0x7b044d4128f9c1f8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.372457:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245400/0x7b044d4128f9c1f8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.372468:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938442.372471:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.372475:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245400/0x7b044d4128f9c1f8 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.372481:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245400/0x7b044d4128f9c1f8 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.372493:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245200/0x7b044d4128f9c1ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.372498:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245200/0x7b044d4128f9c1ff lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.372503:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245200/0x7b044d4128f9c1ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.372509:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938442.372511:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245200/0x7b044d4128f9c1ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.372517:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245200/0x7b044d4128f9c1ff lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.372524:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x57ba1cca (ffff9f23823dcf00) 00010000:00010000:2.0:1784938442.372525:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.372528:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245200/0x7b044d4128f9c1ff lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.372534:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245200/0x7b044d4128f9c1ff lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.372569:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244400/0x7b044d4128f9c1f1 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e89 expref: 374 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.372579:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938442.372581:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.372585:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244400/0x7b044d4128f9c1f1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e89 expref: 374 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.372595:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f244400, rc 0) 00000100:00100000:2.0:1784938442.372658:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+373:17096:x1871643337425024:12345-192.168.202.54@tcp:101:cp.0 Request processed in 455us (1695us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938442.372665:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 391 00000100:00100000:3.0:1784938442.374913:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.375022:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337425152 00000100:00100000:1.0:1784938442.375032:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337425152 00000100:00100000:1.0:1784938442.375133:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 392 00000100:00100000:1.0:1784938442.375179:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+373:17096:x1871643337425152:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938442.375199:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938442.375222:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20ae00/0x7b044d4128f9c206 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663e90 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.375280:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20b200/0x7b044d4128f9c20d lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.375297:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20b200/0x7b044d4128f9c20d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.375308:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20b200/0x7b044d4128f9c20d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.375329:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a000/0x7b044d4128f9c214 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x57ba1cca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.375349:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a000/0x7b044d4128f9c214 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.375356:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a000/0x7b044d4128f9c214 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.375396:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20b200/0x7b044d4128f9c20d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.375406:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20b200/0x7b044d4128f9c20d lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.375412:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20b200/0x7b044d4128f9c20d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.375417:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f20b200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938442.375421:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20b200/0x7b044d4128f9c20d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.375428:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20b200/0x7b044d4128f9c20d lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.375603:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938442.375606:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938442.375611:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20b200/0x7b044d4128f9c20d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.375617:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20b200/0x7b044d4128f9c20d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.375631:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a000/0x7b044d4128f9c214 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.375637:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a000/0x7b044d4128f9c214 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.375643:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a000/0x7b044d4128f9c214 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.375649:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f20a000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938442.375652:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a000/0x7b044d4128f9c214 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.375658:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a000/0x7b044d4128f9c214 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.375665:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x57ba1cca (ffff9f23823e1000) 00010000:00010000:1.0:1784938442.375668:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938442.375670:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a000/0x7b044d4128f9c214 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.375676:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20a000/0x7b044d4128f9c214 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.375708:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20ae00/0x7b044d4128f9c206 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e90 expref: 374 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.375719:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938442.375722:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938442.375726:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20ae00/0x7b044d4128f9c206 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e90 expref: 374 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.375735:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f20ae00, rc 0) 00000100:00100000:1.0:1784938442.375797:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+373:17096:x1871643337425152:12345-192.168.202.54@tcp:101:cp.0 Request processed in 654us (891us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938442.375855:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 392 00000100:00100000:0.0:1784938442.388395:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.388503:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337425408 00000100:00100000:3.0:1784938442.388516:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337425408 00000100:00100000:3.0:1784938442.388582:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 393 00000100:00100000:3.0:1784938442.388594:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+373:17096:x1871643337425408:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.388622:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.388647:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c21b lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663e97 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.388756:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c222 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.388773:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c222 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.388784:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c222 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.388796:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0000/0x7b044d4128f9c229 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x57ba1cca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.388803:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0000/0x7b044d4128f9c229 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.388809:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0000/0x7b044d4128f9c229 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938442.390590:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x59:0x0], index 0: 0 00010000:00010000:2.0:1784938442.390779:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244400/0x7b044d4128f9c230 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.390795:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244400/0x7b044d4128f9c230 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.390806:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244400/0x7b044d4128f9c230 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.393808:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c222 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.393826:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c222 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.393833:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c222 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.393840:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c222 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.393846:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938442.393850:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c222 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.393859:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c222 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.393874:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938442.393877:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.393882:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c222 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.393888:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c222 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938442.394052:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004bd5506b reply state 00000000a0ab48f5 transno 8589934793 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0000/0x7b044d4128f9c229 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.394066:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0000/0x7b044d4128f9c229 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.394073:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x57ba1cca (ffff9f238727c500) 00010000:00010000:2.0:1784938442.394075:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938442.394079:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938442.394129:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c21b lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e97 expref: 376 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.394401:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244400/0x7b044d4128f9c230 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e97 expref: 375 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.394411:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x31:0x0].0x0 (ffff9f23823dcf00) 00010000:00010000:2.0:1784938442.394413:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938442.394416:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f244400, rc 0) 00000100:00100000:2.0:1784938442.394503:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+376:17096:x1871643337425408:12345-192.168.202.54@tcp:101:cp.0 Request processed in 5910us (6115us total) trans 8589934793 rc 0/0 00000100:00100000:2.0:1784938442.394512:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 393 00000100:00100000:2.0:1784938442.398918:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.399215:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337425536 00000100:00100000:0.0:1784938442.399225:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337425536 00000100:00100000:0.0:1784938442.399287:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 592 00000100:00100000:0.0:1784938442.399297:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+95:10957:x1871643337425536:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938442.399316:0:25715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938442.399347:0:25715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000993f7fed/0x7b044d4128f9c23e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x59:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663e9e expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938442.399373:0:25715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x59:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938442.399392:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x59:0x0].0x0 since=708s v=(0 0) 00010000:00010000:0.0:1784938442.399396:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x59:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.399406:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000993f7fed/0x7b044d4128f9c23e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e9e expref: 96 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.399421:0:25715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000993f7fed/0x7b044d4128f9c23e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e9e expref: 96 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.399433:0:25715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b379dc00, rc 0) 00000100:00100000:0.0:1784938442.399485:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+96:10957:x1871643337425536:12345-192.168.202.54@tcp:101:cp.0 Request processed in 190us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.399493:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 592 00000100:00100000:3.0:1784938442.404044:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.404441:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337425664 00000100:00100000:1.0:1784938442.404451:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337425664 00000100:00100000:1.0:1784938442.404520:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 593 00000100:00100000:1.0:1784938442.404531:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+96:17096:x1871643337425664:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938442.404549:0:21629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938442.404567:0:21629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e0722b4/0x7b044d4128f9c245 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663ea5 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.404598:0:21629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000993f7fed/0x7b044d4128f9c23e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e9e expref: 97 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.404608:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x59:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.404613:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x59:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.404618:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e0722b4/0x7b044d4128f9c245 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ea5 expref: 97 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.404655:0:21629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000993f7fed/0x7b044d4128f9c23e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663e9e expref: 97 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.404669:0:21629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000993f7fed/0x7b044d4128f9c23e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663e9e expref: 97 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.404685:0:21629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:21629:1871643350838528:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938442.404796:0:21629:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2488a4c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938442.408643:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.408825:0:21629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:21629:1871643350838528:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938442.408862:0:21629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001e0722b4/0x7b044d4128f9c245 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663ea5 expref: 97 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.408885:0:21629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f20ae00, rc 0) 00000100:00100000:1.0:1784938442.408940:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+97:17096:x1871643337425664:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4411us (4917us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.408950:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 593 00000100:00100000:3.0:1784938442.409412:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:16391:1871643350838784:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938442.409476:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f24b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350839296:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938442.409506:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f249c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350839808:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938442.409535:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1784938442.409541:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:16391:1871643350838912:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938442.409566:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f24b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350839424:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938442.409583:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f249880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350839936:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938442.409808:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938442.409875:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938442.409899:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938442.409917:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938442.409938:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938442.409957:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938442.409977:0:21160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350839296 00000100:00100000:3.0:1784938442.409983:0:21160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350839296 00000100:00100000:1.0:1784938442.410093:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f241880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e07296-2a01-411c-abf2-6d190cb69ef0:16390:1871643350838656:0@lo:400:kworker.0 00000100:00100000:1.0:1784938442.410128:0:16390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938442.410185:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f243b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:16390:1871643350839168:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938442.410218:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f24aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350839680:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938442.410241:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350840192:192.168.202.154@tcp:41:osp-pre-1-0.0 00000100:00100000:1.0:1784938442.410264:0:16390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1784938442.410270:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:16390:1871643350839040:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938442.410290:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:16390:1871643350839552:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938442.410312:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f248380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:16390:1871643350840064:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938442.410357:0:24194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350838656 00000100:00100000:1.0:1784938442.410361:0:24194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350838656 00000100:00100000:1.0:1784938442.410391:0:24194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784938442.410399:0:24194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+24:16390:x1871643350838656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784938442.410448:0:24194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+24:16390:x1871643350838656:12345-0@lo:400:kworker.0 Request processed in 49us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.410455:0:24194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784938442.410500:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f241880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e07296-2a01-411c-abf2-6d190cb69ef0:16390:1871643350838656:0@lo:400:kworker.0 00000100:00100000:0.0:1784938442.411315:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350839808 00000100:00100000:0.0:1784938442.411323:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350839808 00000100:00100000:0.0:1784938442.411382:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350839424 00000100:00100000:0.0:1784938442.411385:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350839424 00000100:00100000:0.0:1784938442.411403:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350839936 00000100:00100000:0.0:1784938442.411406:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350839936 00000100:00100000:0.0:1784938442.411429:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 77 00000100:00100000:0.0:1784938442.411437:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f199c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:16391:x1871643350839808:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938442.411481:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f199c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:16391:x1871643350839808:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 45us (1581us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.411488:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 77 00000100:00100000:0.0:1784938442.411504:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 78 00000100:00100000:0.0:1784938442.411511:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381362050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:16391:x1871643350839424:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938442.411538:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381362050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:16391:x1871643350839424:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 27us (1599us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.411545:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 78 00000100:00100000:0.0:1784938442.411677:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 79 00000100:00100000:0.0:1784938442.411684:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:16391:x1871643350839936:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938442.411704:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:16391:x1871643350839936:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 21us (1746us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.411711:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 79 00000100:00100000:0.0:1784938442.411733:0:21161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 59 00000100:00100000:0.0:1784938442.411741:0:21161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:16391:x1871643350839296:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938442.411764:0:21161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:16391:x1871643350839296:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 24us (1889us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.411770:0:21161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 59 00000004:00080000:0.0:1784938442.411839:0:24946:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 708578692447ns, next at 709578690079ns, rc = 0 00000100:00080000:0.0:1784938442.411876:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784938442.411880:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938442.411886:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938442.411898:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350840320:192.168.202.154@tcp:13:osp-pre-0-1.0 00000100:00100000:0.0:1784938442.411953:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337425792 00000100:00100000:0.0:1784938442.411958:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337425792 00010000:00010000:0.0:1784938442.411982:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000993f7fed/0x7b044d4128f9c23e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663e9e expref: 97 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.412451:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938442.412511:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938442.412530:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938442.412546:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938442.412563:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938442.412574:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938442.412627:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938442.412660:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f24b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350839424:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938442.412671:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f249880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350839936:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938442.412681:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f24b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350839296:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938442.412690:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f249c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350839808:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938442.412723:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350838784 00000100:00100000:3.0:1784938442.412726:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350838784 00000100:00100000:3.0:1784938442.412754:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350838912 00000100:00100000:3.0:1784938442.412757:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350838912 00000100:00100000:3.0:1784938442.412772:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 33 00000100:00100000:3.0:1784938442.412779:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:16391:x1871643350838784:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938442.412813:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:16391:x1871643350838784:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 34us (3006us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938442.412819:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 33 00000100:00100000:3.0:1784938442.412908:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:16391:1871643350838784:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938442.412925:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350839168 00000100:00100000:3.0:1784938442.412927:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350839168 00000100:00100000:3.0:1784938442.412943:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350839040 00000100:00100000:3.0:1784938442.412945:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350839040 00000100:00100000:3.0:1784938442.412955:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350840064 00000100:00100000:3.0:1784938442.412957:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350840064 00000100:00100000:3.0:1784938442.412964:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350839552 00000100:00100000:3.0:1784938442.412966:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350839552 00000100:00100000:3.0:1784938442.412976:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 34 00000100:00100000:3.0:1784938442.412981:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:16391:x1871643350838912:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938442.413847:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 35 00000100:00100000:2.0:1784938442.413858:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:16390:x1871643350839168:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938442.413895:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:16390:x1871643350839168:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 40us (1384us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938442.413902:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 35 00000100:00100000:2.0:1784938442.413919:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 36 00000100:00100000:2.0:1784938442.413925:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:16390:x1871643350839040:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938442.413948:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:16390:x1871643350839040:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 24us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938442.413954:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 36 00000100:00100000:2.0:1784938442.413966:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 37 00000100:00100000:2.0:1784938442.413972:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:16390:x1871643350840064:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938442.413995:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:16390:x1871643350840064:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 23us (1431us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938442.414000:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 37 00000100:00100000:0.0:1784938442.414494:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 246 00000100:00100000:0.0:1784938442.414505:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+97:10960:x1871643337425792:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938442.414519:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938442.414543:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000993f7fed/0x7b044d4128f9c23e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x59:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663e9e expref: 97 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.414558:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000993f7fed/0x7b044d4128f9c23e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x59:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663e9e expref: 97 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.414580:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000993f7fed/0x7b044d4128f9c23e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x59:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663e9e expref: 97 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.414601:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x59:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.414605:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x59:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.414612:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001e0722b4/0x7b044d4128f9c245 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663ea5 expref: 96 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.414622:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e0722b4/0x7b044d4128f9c245 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663ea5 expref: 96 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.414654:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001e0722b4/0x7b044d4128f9c245 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663ea5 expref: 96 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.414667:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68db480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350840448:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938442.414722:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485023b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784938442.414739:0:25714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350839680 00000100:00100000:0.0:1784938442.414744:0:25714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350839680 00000100:00100000:0.0:1784938442.414771:0:25714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350840192 00000100:00100000:0.0:1784938442.414774:0:25714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350840192 00000100:00100000:0.0:1784938442.414786:0:25714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 60 00000100:00100000:0.0:1784938442.414791:0:25714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:16390:x1871643350839680:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938442.414822:0:25714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:16390:x1871643350839680:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 31us (2373us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.414828:0:25714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 60 00000100:00100000:0.0:1784938442.414839:0:25714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 61 00000100:00100000:0.0:1784938442.414844:0:25714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:16390:x1871643350840192:12345-192.168.202.154@tcp:41:osp-pre-1-0.0 00000004:00000024:0.0:1784938442.414863:0:25714:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 218431488 avail 191406080 00000100:00100000:0.0:1784938442.414884:0:25714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:16390:x1871643350840192:12345-192.168.202.154@tcp:41:osp-pre-1-0.0 Request processed in 40us (2338us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.414890:0:25714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 61 00000100:00100000:0.0:1784938442.414905:0:21153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350840320 00000100:00100000:0.0:1784938442.414908:0:21153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350840320 00000100:00100000:0.0:1784938442.414930:0:21153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 70 00000100:00100000:0.0:1784938442.414935:0:21153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16392:x1871643350840320:12345-192.168.202.154@tcp:13:osp-pre-0-1.0 00002000:00000024:0.0:1784938442.414947:0:21153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8711488 pending 0 free 313057280 avail 285245440 00000100:00100000:0.0:1784938442.414967:0:21153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16392:x1871643350840320:12345-192.168.202.154@tcp:13:osp-pre-0-1.0 Request processed in 33us (2341us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.414973:0:21153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 70 00000100:00080000:0.0:1784938442.414990:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784938442.414995:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938442.416267:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 38 00000100:00100000:2.0:1784938442.416308:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:16390:x1871643350839552:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938442.416368:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:16390:x1871643350839552:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 89us (3792us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938442.416375:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 38 00000100:00100000:2.0:1784938442.416753:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:16391:1871643350838912:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938442.416852:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350840320:192.168.202.154@tcp:13:osp-pre-0-1.0 00000004:00080000:1.0:1784938442.417024:0:24948:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 708583877131ns, next at 709583874046ns, rc = 0 00000100:00100000:1.0:1784938442.417063:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:16390:1871643350839040:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938442.417076:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:16390:1871643350839552:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938442.417088:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f248380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:16390:1871643350840064:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938442.417098:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f243b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:16390:1871643350839168:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938442.417110:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f24aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350839680:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938442.417124:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350840192:192.168.202.154@tcp:41:osp-pre-1-0.0 00000100:00100000:3.0:1784938442.417391:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:16391:x1871643350838912:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 27us (3091us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938442.417403:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 34 00000100:00100000:2.0:1784938442.418006:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350840576:192.168.202.154@tcp:13:osp-pre-1-1.0 00000004:00080000:1.0:1784938442.419236:0:24936:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 4 committed 00010000:00010000:1.0:1784938442.419310:0:24936:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f24b4056800/0x7b044d4128f99c58 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b044d4128f99c5f expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938442.419326:0:24936:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f24b4056800/0x7b044d4128f99c58 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b044d4128f99c5f expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.419376:0:24936:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f24b4056800/0x7b044d4128f99c58 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b044d4128f99c5f expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.419383:0:24936:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784938442.419406:0:24936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f24b4056800/0x7b044d4128f99c58 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b044d4128f99c5f expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784938442.419429:0:24936:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934684 is committed 00000004:00080000:1.0:1784938442.419482:0:24936:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3 committed 00000004:00080000:1.0:1784938442.419503:0:24936:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3 committed 00000004:00080000:1.0:1784938442.419589:0:24936:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 2 committed 00000004:00080000:1.0:1784938442.419593:0:24936:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 2 committed 00000100:00100000:1.0:1784938442.419628:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350840704:192.168.202.154@tcp:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1784938442.419717:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350841216:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:1.0:1784938442.419743:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350841728:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:1.0:1784938442.419771:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784938442.419777:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350840832:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:1.0:1784938442.419797:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350841344:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:1.0:1784938442.419905:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350842240:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:1.0:1784938442.419939:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350842752:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:1.0:1784938442.419970:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784938442.419977:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350841856:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:1.0:1784938442.420007:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350842368:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:1.0:1784938442.420109:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938442.420138:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350842240 00000100:00100000:1.0:1784938442.420165:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350842240 00000100:00100000:0.0:1784938442.420184:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938442.420210:0:21152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350842752 00000100:00100000:0.0:1784938442.420214:0:21152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350842752 00000100:00100000:1.0:1784938442.420218:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 594 00000100:00100000:1.0:1784938442.420230:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:16389:x1871643350842240:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:0.0:1784938442.420248:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 595 00002000:00080000:1.0:1784938442.420255:0:21149:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:27 count 1 00000100:00100000:0.0:1784938442.420268:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:16389:x1871643350842752:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00002000:00010000:1.0:1784938442.420289:0:21149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x1b:0x0] initial LVB size: 1654, mtime: 0x6a63ff77, atime: 0x0, ctime: 0x6a63ff77, blocks: 0x8 00002000:00080000:0.0:1784938442.420294:0:21152:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:36 count 1 00010000:00010000:1.0:1784938442.420298:0:21149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efac5f6d/0x7b044d4128f9c24c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.420312:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9c253 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.420314:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x1b:0x0].0x0 since=708s v=(0 0) 00010000:00010000:1.0:1784938442.420322:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.420344:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efac5f6d/0x7b044d4128f9c24c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.420349:0:21152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d109a39b/0x7b044d4128f98b17 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663020 expref: 95 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.420364:0:21149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efac5f6d/0x7b044d4128f9c24c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.420371:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1784938442.420380:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.420382:0:21149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efac5f6d/0x7b044d4128f9c24c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.420385:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9c253 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.420396:0:21149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000efac5f6d/0x7b044d4128f9c24c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.420415:0:21149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938442.420422:0:21152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d109a39b/0x7b044d4128f98b17 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663020 expref: 95 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.420437:0:21152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d109a39b/0x7b044d4128f98b17 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663020 expref: 95 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.420450:0:21152:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:21152:1871643350842880:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938442.420493:0:21152:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b2d2c900 going to sleep for 11 seconds 00000100:00100000:1.0:1784938442.420551:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:16389:x1871643350842240:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 323us (442us total) trans 4294967405 rc 0/0 00000100:00100000:1.0:1784938442.420559:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 594 00000100:00100000:1.0:1784938442.420672:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938442.420698:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350840704 00000004:00080000:0.0:1784938442.420701:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f22c000/2, rc 0, transno 4294967405 00000100:00100000:1.0:1784938442.420703:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350840704 00000100:00100000:0.0:1784938442.420719:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350842240:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:1.0:1784938442.420741:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 21 00000100:00100000:1.0:1784938442.420752:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+8:16389:x1871643350840704:12345-192.168.202.154@tcp:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1784938442.420760:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00010000:00010000:1.0:1784938442.420768:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1784938442.420787:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00010000:00010000:1.0:1784938442.420791:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4056a00/0x7b044d4128f99c5f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.154@tcp remote: 0x7b044d4128f99c58 expref: 8 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.420809:0:19220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xc4959c6c (ffff9f238dcb2b00) 00000100:00100000:0.0:1784938442.420816:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00010000:00010000:1.0:1784938442.420821:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938442.420834:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350841216 00000100:00100000:0.0:1784938442.420839:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350841216 00000100:00100000:1.0:1784938442.420846:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+7:16389:x1871643350840704:12345-192.168.202.154@tcp:103:jbd2/dm-1-8.0 Request processed in 96us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.420855:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 21 00000100:00100000:0.0:1784938442.420866:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350841728 00000100:00100000:0.0:1784938442.420871:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350841728 00000100:00100000:0.0:1784938442.420891:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350840832 00000100:00100000:0.0:1784938442.420895:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350840832 00000100:00100000:1.0:1784938442.420915:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938442.420916:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 596 00000100:00100000:1.0:1784938442.420927:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350843008:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:0.0:1784938442.420929:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+7:16389:x1871643350841216:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:0.0:1784938442.420947:0:21629:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:38 count 1 00010000:00010000:0.0:1784938442.420964:0:21629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4e6532c/0x7b044d4128f9c25a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.420974:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 597 00010000:00010000:0.0:1784938442.420981:0:21629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ae12b8fe/0x7b044d4128f98b33 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766302e expref: 96 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.420986:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+7:16389:x1871643350841728:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00010000:00010000:0.0:1784938442.420997:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1784938442.421001:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00002000:00080000:1.0:1784938442.421005:0:25715:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:19 count 1 00010000:00010000:0.0:1784938442.421006:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4e6532c/0x7b044d4128f9c25a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.421020:0:25715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040dba49b/0x7b044d4128f9c261 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.421035:0:21629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ae12b8fe/0x7b044d4128f98b33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e94766302e expref: 96 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.421036:0:25715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000705d1dae/0x7b044d4128f98ef9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766321f expref: 96 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.421055:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1784938442.421060:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.421062:0:21629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ae12b8fe/0x7b044d4128f98b33 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766302e expref: 96 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.421065:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040dba49b/0x7b044d4128f9c261 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.421091:0:21629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:21629:1871643350843136:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938442.421102:0:25715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000705d1dae/0x7b044d4128f98ef9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e94766321f expref: 96 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.421113:0:25715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000705d1dae/0x7b044d4128f98ef9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766321f expref: 96 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.421121:0:21629:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b2d2c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938442.421125:0:25715:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25715:1871643350843264:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938442.421276:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938442.421360:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350841088:192.168.202.154@tcp:6:osp-syn-0-1.0 00010000:00010000:3.0:1784938442.421473:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b379d000/0x7b044d4128f988e0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.421482:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b379d000/0x7b044d4128f988e0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.421488:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b379d000/0x7b044d4128f988e0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.421493:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b379d000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.421498:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b379d000/0x7b044d4128f988e0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.421508:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b379d000/0x7b044d4128f988e0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.421520:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xbb599949 (ffff9f238dbbfc00) 00010000:00010000:3.0:1784938442.421523:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.421526:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b379d000/0x7b044d4128f988e0 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.421532:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b379d000/0x7b044d4128f988e0 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.421587:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00010000:00010000:3.0:1784938442.421622:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a600/0x7b044d4128f98918 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.421630:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a600/0x7b044d4128f98918 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.421636:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a600/0x7b044d4128f98918 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.421643:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17a600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.421646:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a600/0x7b044d4128f98918 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.421653:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a600/0x7b044d4128f98918 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.421662:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xf0a46efb (ffff9f23861e5000) 00000100:00100000:0.0:1784938442.421663:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00010000:00010000:3.0:1784938442.421667:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.421671:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a600/0x7b044d4128f98918 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.421677:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a600/0x7b044d4128f98918 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.421695:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559600/0x7b044d4128f98950 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.421701:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559600/0x7b044d4128f98950 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.421707:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559600/0x7b044d4128f98950 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.421712:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c559600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.421715:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559600/0x7b044d4128f98950 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.421721:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559600/0x7b044d4128f98950 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.421729:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xd47b514a (ffff9f24898dd800) 00010000:00010000:3.0:1784938442.421731:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.421735:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559600/0x7b044d4128f98950 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.421741:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559600/0x7b044d4128f98950 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.421757:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a200/0x7b044d4128f98988 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.421764:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a200/0x7b044d4128f98988 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.421771:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a200/0x7b044d4128f98988 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.421775:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17a200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.421779:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a200/0x7b044d4128f98988 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.421786:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a200/0x7b044d4128f98988 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.421787:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00010000:00010000:3.0:1784938442.421798:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xa38d6329 (ffff9f23861e5800) 00010000:00010000:3.0:1784938442.421801:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.421804:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a200/0x7b044d4128f98988 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.421812:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00010000:00010000:3.0:1784938442.421814:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a200/0x7b044d4128f98988 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.421831:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f989c0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.421835:0:21153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350840576 00010000:00010000:3.0:1784938442.421838:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f989c0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.421841:0:21153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350840576 00010000:00010000:3.0:1784938442.421847:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f989c0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.421852:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db38000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.421855:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f989c0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.421864:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f989c0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.421872:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x839e9634 (ffff9f24985e9e00) 00000100:00100000:0.0:1784938442.421874:0:21153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 71 00010000:00010000:3.0:1784938442.421876:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.421881:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f989c0 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.421889:0:21153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:16392:x1871643350840576:12345-192.168.202.154@tcp:13:osp-pre-1-1.0 00010000:00010000:3.0:1784938442.421890:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f989c0 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.421905:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f989f8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.421912:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f989f8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00000024:0.0:1784938442.421917:0:21153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8711488 pending 0 free 313057280 avail 285245440 00010000:00010000:3.0:1784938442.421919:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f989f8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.421927:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c559200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.421931:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f989f8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.421937:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f989f8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.421945:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x21aa2247 (ffff9f24898dda00) 00010000:00010000:3.0:1784938442.421947:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.421952:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f989f8 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.421952:0:21153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:16392:x1871643350840576:12345-192.168.202.154@tcp:13:osp-pre-1-1.0 Request processed in 65us (140us total) trans 0 rc 0/0 00010000:00010000:3.0:1784938442.421967:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f989f8 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.421972:0:21153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 71 00010000:00010000:3.0:1784938442.421989:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f98b6b lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x4f:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.421996:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f98b6b lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x4f:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422002:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f98b6b lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x4f:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422007:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.422010:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f98b6b lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x4f:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422016:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f98b6b lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x4f:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.422026:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00010000:00010000:3.0:1784938442.422028:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4f:0x0].0x45fac828 (ffff9f24985e9700) 00010000:00010000:3.0:1784938442.422032:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.422035:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f98b6b lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x4f:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422041:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f98b6b lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x4f:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422057:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559a00/0x7b044d4128f98ba3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x4f:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422064:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559a00/0x7b044d4128f98ba3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x4f:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422071:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559a00/0x7b044d4128f98ba3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x4f:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422076:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c559a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.422080:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559a00/0x7b044d4128f98ba3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x4f:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422085:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559a00/0x7b044d4128f98ba3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x4f:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422093:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4f:0x0].0x1cda55a (ffff9f24898ddf00) 00010000:00010000:3.0:1784938442.422095:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.422098:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559a00/0x7b044d4128f98ba3 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x4f:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422103:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559a00/0x7b044d4128f98ba3 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x4f:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422116:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42dc00/0x7b044d4128f98bdb lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x7026f06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422122:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42dc00/0x7b044d4128f98bdb lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x7026f06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422127:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42dc00/0x7b044d4128f98bdb lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x7026f06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422132:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42dc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.422134:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42dc00/0x7b044d4128f98bdb lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x7026f06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.422257:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350841600:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:2.0:1784938442.422291:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350842112:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:2.0:1784938442.422308:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350842624:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:2.0:1784938442.422349:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350840576:192.168.202.154@tcp:13:osp-pre-1-1.0 00000100:00100000:2.0:1784938442.422366:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1784938442.422371:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350840960:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:2.0:1784938442.422391:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350841472:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:2.0:1784938442.422406:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350841984:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:2.0:1784938442.422419:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350842496:192.168.202.154@tcp:6:osp-syn-1-1.0 00010000:00010000:3.0:1784938442.422567:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42dc00/0x7b044d4128f98bdb lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x7026f06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422579:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x7026f06f (ffff9f23861e5c00) 00010000:00010000:3.0:1784938442.422581:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.422585:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42dc00/0x7b044d4128f98bdb lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x7026f06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422591:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42dc00/0x7b044d4128f98bdb lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x7026f06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422608:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38600/0x7b044d4128f98c7c lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422614:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38600/0x7b044d4128f98c7c lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422620:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38600/0x7b044d4128f98c7c lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422625:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db38600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.422628:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38600/0x7b044d4128f98c7c lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422634:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38600/0x7b044d4128f98c7c lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422641:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xd946e4d2 (ffff9f24985e9300) 00010000:00010000:3.0:1784938442.422644:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.422646:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38600/0x7b044d4128f98c7c lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422652:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38600/0x7b044d4128f98c7c lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422666:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f98cad lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422672:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f98cad lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422678:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f98cad lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422683:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c558800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.422686:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f98cad lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422692:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f98cad lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422699:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x56569231 (ffff9f24898dd000) 00010000:00010000:3.0:1784938442.422701:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.422704:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f98cad lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422710:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f98cad lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422728:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559e00/0x7b044d4128f98d40 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422734:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559e00/0x7b044d4128f98d40 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422742:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559e00/0x7b044d4128f98d40 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422747:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c559e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.422751:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559e00/0x7b044d4128f98d40 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422757:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559e00/0x7b044d4128f98d40 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422765:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x4d2290fc (ffff9f24898ddc00) 00010000:00010000:3.0:1784938442.422768:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.422773:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559e00/0x7b044d4128f98d40 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.422773:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00010000:00010000:3.0:1784938442.422783:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559e00/0x7b044d4128f98d40 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422800:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38400/0x7b044d4128f98ec1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422807:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38400/0x7b044d4128f98ec1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422812:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38400/0x7b044d4128f98ec1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422818:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db38400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.422821:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38400/0x7b044d4128f98ec1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.422830:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38400/0x7b044d4128f98ec1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.422835:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938442.422887:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938442.422899:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938442.422911:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938442.422923:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938442.422936:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00010000:00010000:3.0:1784938442.422997:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xd06bcd9f (ffff9f238dd4b900) 00010000:00010000:3.0:1784938442.422999:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.423002:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38400/0x7b044d4128f98ec1 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.423008:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38400/0x7b044d4128f98ec1 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.423124:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f98fe7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.423131:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f98fe7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.423137:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f98fe7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.423158:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dc65e00 already unused, calling callback (ffffffffc19a14f0) 00000100:00100000:0.0:1784938442.423415:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350841344 00000100:00100000:0.0:1784938442.423423:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350841344 00000100:00100000:0.0:1784938442.423451:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350841856 00000100:00100000:0.0:1784938442.423454:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350841856 00000100:00100000:0.0:1784938442.423466:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350842368 00000100:00100000:0.0:1784938442.423469:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350842368 00000100:00100000:0.0:1784938442.423478:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350843008 00000100:00100000:0.0:1784938442.423480:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350843008 00000100:00100000:0.0:1784938442.423488:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350841088 00000100:00100000:0.0:1784938442.423490:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350841088 00000100:00100000:0.0:1784938442.423498:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350840960 00000100:00100000:0.0:1784938442.423500:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350840960 00000100:00100000:0.0:1784938442.423509:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350841984 00000100:00100000:0.0:1784938442.423511:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350841984 00000100:00100000:0.0:1784938442.423520:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350841600 00000100:00100000:0.0:1784938442.423523:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350841600 00000100:00100000:0.0:1784938442.423530:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350842112 00000100:00100000:0.0:1784938442.423532:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350842112 00000100:00100000:0.0:1784938442.423541:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350842624 00000100:00100000:0.0:1784938442.423543:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350842624 00000100:00100000:0.0:1784938442.423551:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350841472 00000100:00100000:0.0:1784938442.423553:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350841472 00000100:00100000:0.0:1784938442.423559:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350842496 00000100:00100000:0.0:1784938442.423561:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350842496 00000100:00100000:0.0:1784938442.423574:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 598 00000100:00100000:0.0:1784938442.423581:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+12:16389:x1871643350840832:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:0.0:1784938442.423604:0:21149:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:30 count 1 00002000:00010000:0.0:1784938442.423632:0:21149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 143467, mtime: 0x6a63ff78, atime: 0x0, ctime: 0x6a63ff78, blocks: 0x120 00010000:00010000:0.0:1784938442.423639:0:21149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051f4609e/0x7b044d4128f9c268 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.423656:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=708s v=(0 0) 00010000:00010000:0.0:1784938442.423660:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.423666:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051f4609e/0x7b044d4128f9c268 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.423677:0:21149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051f4609e/0x7b044d4128f9c268 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.423685:0:21149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051f4609e/0x7b044d4128f9c268 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.423693:0:21149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051f4609e/0x7b044d4128f9c268 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.423709:0:21149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1784938442.423864:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+13:16389:x1871643350840832:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 281us (3051us total) trans 4294967405 rc 0/0 00000100:00100000:0.0:1784938442.423870:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 598 00000100:00100000:0.0:1784938442.423888:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 599 00010000:00010000:3.0:1784938442.424091:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f98fe7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424101:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f98fe7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424114:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x72a71b3d (ffff9f238dcb2e00) 00010000:00010000:3.0:1784938442.424117:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.424121:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f98fe7 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424127:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f98fe7 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424250:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7e00/0x7b044d4128f99034 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424257:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7e00/0x7b044d4128f99034 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424263:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7e00/0x7b044d4128f99034 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424268:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f7e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.424271:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7e00/0x7b044d4128f99034 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424276:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7e00/0x7b044d4128f99034 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424284:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x22eacdcf (ffff9f23861e5e00) 00010000:00010000:3.0:1784938442.424286:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.424290:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7e00/0x7b044d4128f99034 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424295:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7e00/0x7b044d4128f99034 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424310:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f99153 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424316:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f99153 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424322:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f99153 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424327:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3e800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.424339:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f99153 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424345:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f99153 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424353:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x57ba1cca (ffff9f238dcb2000) 00010000:00010000:3.0:1784938442.424355:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.424358:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f99153 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424363:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f99153 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424378:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b000/0x7b044d4128f99264 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424384:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b000/0x7b044d4128f99264 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424390:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b000/0x7b044d4128f99264 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424395:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17b000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.424398:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b000/0x7b044d4128f99264 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424407:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b000/0x7b044d4128f99264 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424414:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x6caa4986 (ffff9f238dd4b200) 00010000:00010000:3.0:1784938442.424416:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.424419:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b000/0x7b044d4128f99264 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424424:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b000/0x7b044d4128f99264 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424438:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9940f lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424444:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9940f lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424448:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9940f lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424453:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f6e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.424456:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9940f lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424462:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9940f lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424469:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x47a21a83 (ffff9f23861e5a00) 00010000:00010000:3.0:1784938442.424471:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.424473:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9940f lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424479:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9940f lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424493:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7c00/0x7b044d4128f9942b lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424500:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7c00/0x7b044d4128f9942b lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424506:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7c00/0x7b044d4128f9942b lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424511:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c7c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.424514:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7c00/0x7b044d4128f9942b lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424520:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7c00/0x7b044d4128f9942b lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424528:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xe6b34bd0 (ffff9f24975b2500) 00010000:00010000:3.0:1784938442.424631:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.424636:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7c00/0x7b044d4128f9942b lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424643:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7c00/0x7b044d4128f9942b lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424662:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5db600/0x7b044d4128f99519 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424669:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5db600/0x7b044d4128f99519 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424675:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5db600/0x7b044d4128f99519 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424680:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5db600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.424685:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5db600/0x7b044d4128f99519 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424691:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5db600/0x7b044d4128f99519 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424700:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x52815b39 (ffff9f249863b400) 00000100:00100000:0.0:1784938442.424701:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+12:16389:x1871643350841344:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00010000:00010000:3.0:1784938442.424704:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.424709:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5db600/0x7b044d4128f99519 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424716:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5db600/0x7b044d4128f99519 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1784938442.424728:0:21149:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:25 count 1 00010000:00010000:3.0:1784938442.424729:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f995c1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424737:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f995c1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424743:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f995c1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.424746:0:21149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4d7eeea/0x7b044d4128f9c26f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424750:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17b600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.424756:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f995c1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424773:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f995c1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.424775:0:21149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e7a2d07f/0x7b044d4128f98b3a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663043 expref: 96 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424785:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x489b8eb2 (ffff9f238dd4b000) 00010000:00010000:3.0:1784938442.424789:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.424789:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=5s v=(0 0) 00010000:00010000:3.0:1784938442.424794:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f995c1 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.424795:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.424804:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4d7eeea/0x7b044d4128f9c26f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424806:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f995c1 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424831:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b200/0x7b044d4128f995dd lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424839:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b200/0x7b044d4128f995dd lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424845:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b200/0x7b044d4128f995dd lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.424848:0:21149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e7a2d07f/0x7b044d4128f98b3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663043 expref: 96 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424853:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17b200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.424858:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b200/0x7b044d4128f995dd lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424866:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b200/0x7b044d4128f995dd lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.424870:0:21149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e7a2d07f/0x7b044d4128f98b3a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663043 expref: 96 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424877:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xf4c8ca43 (ffff9f238dd4be00) 00010000:00010000:3.0:1784938442.424882:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.424887:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b200/0x7b044d4128f995dd lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424899:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b200/0x7b044d4128f995dd lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424912:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a600/0x7b044d4128f995f9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424917:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a600/0x7b044d4128f995f9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424923:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a600/0x7b044d4128f995f9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424928:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61a600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.424931:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a600/0x7b044d4128f995f9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424937:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a600/0x7b044d4128f995f9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424943:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xa9dd9870 (ffff9f23861f8c00) 00010000:00010000:3.0:1784938442.424945:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.424948:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a600/0x7b044d4128f995f9 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424954:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a600/0x7b044d4128f995f9 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424968:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f99615 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424973:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f99615 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424979:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f99615 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424984:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b29a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.424986:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f99615 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424992:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f99615 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.424999:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x9e90f16b (ffff9f23861f8500) 00010000:00010000:3.0:1784938442.425001:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.425004:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f99615 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.425009:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f99615 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.425184:0:21149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2489ae5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:21149:1871643350843392:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938442.425262:0:21149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b2d2cc00 going to sleep for 11 seconds 00010000:00010000:2.0:1784938442.425309:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938442.425319:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000efac5f6d/0x7b044d4128f9c24c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.425327:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f20a000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938442.425340:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000efac5f6d/0x7b044d4128f9c24c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.425354:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000efac5f6d/0x7b044d4128f9c24c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.425369:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000efac5f6d/0x7b044d4128f9c24c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.425376:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efac5f6d/0x7b044d4128f9c24c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.425393:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938442.425397:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051f4609e/0x7b044d4128f9c268 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.425403:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24cc00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938442.425406:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051f4609e/0x7b044d4128f9c268 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.425414:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051f4609e/0x7b044d4128f9c268 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.425424:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051f4609e/0x7b044d4128f9c268 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.425431:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051f4609e/0x7b044d4128f9c268 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.425449:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938442.425451:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938442.425452:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938442.426246:0:25715:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2482d95780 going to sleep for 11 seconds 00000004:00080000:1.0:1784938442.426299:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24b68da680/2, rc 0, transno 4294967405 00000100:00100000:1.0:1784938442.426314:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350840832:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:1.0:1784938442.426328:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350840704:192.168.202.154@tcp:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1784938442.428418:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1784938442.428430:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938442.428445:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350843520:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:1.0:1784938442.428748:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938442.428771:0:21151:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 6 min 3 max 116 00000100:00100000:1.0:1784938442.428780:0:21151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_006' 00000100:00100000:2.0:1784938442.430058:0:25716:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 6 min 3 max 116 00000100:00100000:2.0:1784938442.430075:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350843520 00000100:00100000:2.0:1784938442.430083:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350843520 00000100:00100000:0.0:1784938442.431735:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.431769:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337425920 00000100:00100000:0.0:1784938442.431775:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337425920 00010000:00010000:0.0:1784938442.431809:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d109a39b/0x7b044d4128f98b17 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663020 expref: 96 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.431852:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 247 00000100:00100000:0.0:1784938442.431861:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+96:10960:x1871643337425920:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938442.431877:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938442.431883:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d109a39b/0x7b044d4128f98b17 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663020 expref: 96 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.431962:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d109a39b/0x7b044d4128f98b17 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663020 expref: 96 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.431989:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.431993:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.432000:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9c253 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.432010:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9c253 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.432093:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938442.432278:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+96:10960:x1871643337425920:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 416us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.432573:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 247 00010000:00010000:2.0:1784938442.434746:0:21152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d109a39b/0x7b044d4128f98b17 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663020 expref: 95 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.434770:0:21152:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:21152:1871643350842880:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938442.434797:0:21152:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9c253 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.434809:0:21152:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9c253 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.434817:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9c253 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.434828:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9c253 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.434835:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9c253 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.434863:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938442.434904:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938442.434913:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9c253 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.434922:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a7000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938442.434927:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9c253 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.434937:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9c253 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.434956:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9c253 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.434964:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9c253 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.434985:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938442.434987:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938442.434989:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938442.435485:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+14:16389:x1871643350842752:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 15228us (15301us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1784938442.435496:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 595 00000100:00100000:2.0:1784938442.435532:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 600 00000100:00100000:2.0:1784938442.435544:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+13:16389:x1871643350841856:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00002000:00080000:2.0:1784938442.435572:0:21152:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:11 count 1 00002000:00010000:2.0:1784938442.435600:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xb:0x0] initial LVB size: 2858, mtime: 0x6a63ff76, atime: 0x0, ctime: 0x6a63ff76, blocks: 0x8 00010000:00010000:2.0:1784938442.435607:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cff32a8e/0x7b044d4128f9c276 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.435619:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xb:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1784938442.435630:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.435689:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cff32a8e/0x7b044d4128f9c276 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.435703:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cff32a8e/0x7b044d4128f9c276 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.435713:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cff32a8e/0x7b044d4128f9c276 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.435721:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cff32a8e/0x7b044d4128f9c276 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.435741:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938442.435928:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27c600/0x7b044d4128f99631 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.435936:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27c600/0x7b044d4128f99631 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.435942:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27c600/0x7b044d4128f99631 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.435948:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27c600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.435953:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27c600/0x7b044d4128f99631 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.435964:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27c600/0x7b044d4128f99631 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.435976:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xa4bfea24 (ffff9f248fb8f600) 00010000:00010000:3.0:1784938442.435979:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.435983:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27c600/0x7b044d4128f99631 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436139:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27c600/0x7b044d4128f99631 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436175:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d800/0x7b044d4128f9964d lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436181:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d800/0x7b044d4128f9964d lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436186:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d800/0x7b044d4128f9964d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436232:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27d800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.436236:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d800/0x7b044d4128f9964d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436242:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d800/0x7b044d4128f9964d lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436250:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x9fe9a331 (ffff9f248fb8f200) 00010000:00010000:3.0:1784938442.436252:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.436255:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d800/0x7b044d4128f9964d lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436262:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d800/0x7b044d4128f9964d lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436278:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f99669 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436285:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f99669 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436290:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f99669 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436626:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b29c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.436630:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f99669 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436637:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f99669 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436647:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xe3541c1d (ffff9f23861f8300) 00010000:00010000:3.0:1784938442.436649:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.436652:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f99669 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436658:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f99669 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436676:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27cc00/0x7b044d4128f99685 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436682:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27cc00/0x7b044d4128f99685 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436688:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27cc00/0x7b044d4128f99685 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436693:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27cc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.436696:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27cc00/0x7b044d4128f99685 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436702:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27cc00/0x7b044d4128f99685 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436709:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xc2bba7e5 (ffff9f248fb8fb00) 00010000:00010000:3.0:1784938442.436711:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.436714:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27cc00/0x7b044d4128f99685 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436721:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27cc00/0x7b044d4128f99685 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436736:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27de00/0x7b044d4128f996a1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436742:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27de00/0x7b044d4128f996a1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436754:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27de00/0x7b044d4128f996a1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436759:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27de00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.436761:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27de00/0x7b044d4128f996a1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436771:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27de00/0x7b044d4128f996a1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436778:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x48e4a31f (ffff9f248fb8fd00) 00010000:00010000:3.0:1784938442.436780:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.436783:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27de00/0x7b044d4128f996a1 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436788:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27de00/0x7b044d4128f996a1 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436804:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b28c00/0x7b044d4128f996bd lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436810:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b28c00/0x7b044d4128f996bd lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436816:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b28c00/0x7b044d4128f996bd lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436821:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b28c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.436824:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b28c00/0x7b044d4128f996bd lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436830:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b28c00/0x7b044d4128f996bd lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436837:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x6b7bd7c (ffff9f23861f8700) 00010000:00010000:3.0:1784938442.436839:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.436842:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b28c00/0x7b044d4128f996bd lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436847:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b28c00/0x7b044d4128f996bd lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436867:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d600/0x7b044d4128f996d9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436879:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d600/0x7b044d4128f996d9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436884:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d600/0x7b044d4128f996d9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436889:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27d600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.436891:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d600/0x7b044d4128f996d9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436899:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d600/0x7b044d4128f996d9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436906:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x7584afcd (ffff9f248fb8f700) 00010000:00010000:3.0:1784938442.436912:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.436914:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d600/0x7b044d4128f996d9 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436920:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d600/0x7b044d4128f996d9 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436934:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b379de00/0x7b044d4128f996f5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436940:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b379de00/0x7b044d4128f996f5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436946:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b379de00/0x7b044d4128f996f5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436951:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b379de00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.436953:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b379de00/0x7b044d4128f996f5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436963:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b379de00/0x7b044d4128f996f5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436970:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x267dbf88 (ffff9f238dcb3400) 00010000:00010000:3.0:1784938442.436972:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.436975:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b379de00/0x7b044d4128f996f5 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436980:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b379de00/0x7b044d4128f996f5 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.436999:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29e00/0x7b044d4128f99711 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437005:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29e00/0x7b044d4128f99711 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437178:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29e00/0x7b044d4128f99711 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437187:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b29e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.437190:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29e00/0x7b044d4128f99711 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437200:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29e00/0x7b044d4128f99711 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437208:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x4c7a76ee (ffff9f23861f8e00) 00010000:00010000:3.0:1784938442.437210:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.437213:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29e00/0x7b044d4128f99711 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437219:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29e00/0x7b044d4128f99711 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437239:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29200/0x7b044d4128f9972d lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437245:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29200/0x7b044d4128f9972d lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437250:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29200/0x7b044d4128f9972d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437255:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b29200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.437258:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29200/0x7b044d4128f9972d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437262:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29200/0x7b044d4128f9972d lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437269:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xe9fa0db8 (ffff9f23861f8d00) 00010000:00010000:3.0:1784938442.437271:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.437273:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29200/0x7b044d4128f9972d lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437279:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29200/0x7b044d4128f9972d lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437291:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238e483a00/0x7b044d4128f99749 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437296:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238e483a00/0x7b044d4128f99749 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437301:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238e483a00/0x7b044d4128f99749 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437306:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238e483a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.437309:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238e483a00/0x7b044d4128f99749 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437314:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238e483a00/0x7b044d4128f99749 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437321:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xf2ca543e (ffff9f238dcb3f00) 00010000:00010000:3.0:1784938442.437323:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.437325:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238e483a00/0x7b044d4128f99749 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437418:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238e483a00/0x7b044d4128f99749 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437434:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8a600/0x7b044d4128f99765 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437440:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8a600/0x7b044d4128f99765 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437446:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8a600/0x7b044d4128f99765 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437451:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b6b8a600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.437454:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8a600/0x7b044d4128f99765 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437459:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8a600/0x7b044d4128f99765 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437466:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x49aa722d (ffff9f238dcb3a00) 00010000:00010000:3.0:1784938442.437468:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.437475:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8a600/0x7b044d4128f99765 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437480:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8a600/0x7b044d4128f99765 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437493:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8ac00/0x7b044d4128f99781 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437499:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8ac00/0x7b044d4128f99781 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437504:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8ac00/0x7b044d4128f99781 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437509:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b6b8ac00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.437512:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8ac00/0x7b044d4128f99781 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437521:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8ac00/0x7b044d4128f99781 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437528:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x37dcc2d3 (ffff9f238dcb3b00) 00010000:00010000:3.0:1784938442.437530:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.437533:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8ac00/0x7b044d4128f99781 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437539:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8ac00/0x7b044d4128f99781 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437554:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9979d lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437560:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9979d lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437566:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9979d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437571:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61ba00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.437573:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9979d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437578:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9979d lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437584:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x2893e4db (ffff9f23861f8800) 00010000:00010000:3.0:1784938442.437586:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.437589:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9979d lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437594:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9979d lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437607:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f997b9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437612:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f997b9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437617:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f997b9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437621:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b29800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.437623:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f997b9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437628:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f997b9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437635:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xaa0c2c16 (ffff9f23861f8200) 00010000:00010000:3.0:1784938442.437636:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.437639:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f997b9 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437643:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f997b9 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437655:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8b400/0x7b044d4128f997d5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437661:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8b400/0x7b044d4128f997d5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437666:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8b400/0x7b044d4128f997d5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437670:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b6b8b400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.437673:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8b400/0x7b044d4128f997d5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437680:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8b400/0x7b044d4128f997d5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437686:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xb34b709f (ffff9f238dcb3000) 00010000:00010000:3.0:1784938442.437688:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.437691:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8b400/0x7b044d4128f997d5 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437697:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8b400/0x7b044d4128f997d5 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437709:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d400/0x7b044d4128f997f1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437715:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d400/0x7b044d4128f997f1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437720:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d400/0x7b044d4128f997f1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437725:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27d400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.437727:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d400/0x7b044d4128f997f1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437736:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d400/0x7b044d4128f997f1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437742:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xbf79d746 (ffff9f248fb8f300) 00010000:00010000:3.0:1784938442.437744:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.437746:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d400/0x7b044d4128f997f1 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437751:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d400/0x7b044d4128f997f1 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437765:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8a000/0x7b044d4128f9980d lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437771:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8a000/0x7b044d4128f9980d lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437777:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8a000/0x7b044d4128f9980d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437781:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b6b8a000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.437784:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8a000/0x7b044d4128f9980d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437789:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8a000/0x7b044d4128f9980d lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437795:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x9cfce7b5 (ffff9f238dcb3800) 00010000:00010000:3.0:1784938442.437797:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.437800:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8a000/0x7b044d4128f9980d lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437806:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8a000/0x7b044d4128f9980d lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437819:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d000/0x7b044d4128f99829 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437825:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d000/0x7b044d4128f99829 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437830:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d000/0x7b044d4128f99829 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437835:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27d000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.437837:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d000/0x7b044d4128f99829 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437843:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d000/0x7b044d4128f99829 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437850:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x868dff87 (ffff9f248fb8f400) 00010000:00010000:3.0:1784938442.437852:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.437855:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d000/0x7b044d4128f99829 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437860:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d000/0x7b044d4128f99829 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437872:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8b600/0x7b044d4128f99845 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437878:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8b600/0x7b044d4128f99845 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437884:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8b600/0x7b044d4128f99845 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437888:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b6b8b600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.437891:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8b600/0x7b044d4128f99845 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437897:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8b600/0x7b044d4128f99845 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437902:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x610aa076 (ffff9f238dcb3c00) 00010000:00010000:3.0:1784938442.437905:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.437907:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8b600/0x7b044d4128f99845 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437913:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8b600/0x7b044d4128f99845 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437925:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8b000/0x7b044d4128f99861 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437931:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8b000/0x7b044d4128f99861 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437936:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8b000/0x7b044d4128f99861 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437941:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b6b8b000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.437944:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8b000/0x7b044d4128f99861 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437952:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8b000/0x7b044d4128f99861 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437958:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xd13f1037 (ffff9f238dcb3700) 00010000:00010000:3.0:1784938442.437960:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.437962:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8b000/0x7b044d4128f99861 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437968:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8b000/0x7b044d4128f99861 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437980:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b379d200/0x7b044d4128f9987d lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437985:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b379d200/0x7b044d4128f9987d lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437991:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b379d200/0x7b044d4128f9987d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.437995:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b379d200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.437998:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b379d200/0x7b044d4128f9987d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.438003:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b379d200/0x7b044d4128f9987d lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.438008:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x89d48c8d (ffff9f238dcb3300) 00000100:00100000:1.0:1784938442.438974:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68db480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350840448:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938442.439001:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938442.439074:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.439092:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.439125:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:3.0:1784938442.439162:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.439169:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b379d200/0x7b044d4128f9987d lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.439175:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:3.0:1784938442.439184:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b379d200/0x7b044d4128f9987d lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439214:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f99899 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.439221:0:21629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:21629:1871643350843136:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938442.439223:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f99899 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439234:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f99899 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.439239:0:21629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c4e6532c/0x7b044d4128f9c25a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439241:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17a800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.439246:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f99899 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439259:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f99899 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439272:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x48840fb6 (ffff9f238dd4b700) 00010000:00010000:3.0:1784938442.439275:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938442.439278:0:21149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2489ae5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:21149:1871643350843392:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938442.439280:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f99899 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439287:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f99899 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439305:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db7aa00/0x7b044d4128f998b5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439311:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db7aa00/0x7b044d4128f998b5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439317:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db7aa00/0x7b044d4128f998b5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439322:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db7aa00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.439325:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db7aa00/0x7b044d4128f998b5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439342:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db7aa00/0x7b044d4128f998b5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439350:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x5b30f298 (ffff9f238dcb3e00) 00010000:00010000:3.0:1784938442.439352:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.439354:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db7aa00/0x7b044d4128f998b5 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439358:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db7aa00/0x7b044d4128f998b5 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439374:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f998d1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439380:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f998d1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439384:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f998d1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439388:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27ca00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.439390:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f998d1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439399:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f998d1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439405:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x2fbacb41 (ffff9f248fb8f000) 00010000:00010000:3.0:1784938442.439406:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.439409:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f998d1 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439413:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f998d1 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439424:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8ba00/0x7b044d4128f998ed lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439429:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8ba00/0x7b044d4128f998ed lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439437:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8ba00/0x7b044d4128f998ed lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439442:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b6b8ba00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.439444:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8ba00/0x7b044d4128f998ed lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.439447:0:21149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d4d7eeea/0x7b044d4128f9c26f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439450:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8ba00/0x7b044d4128f998ed lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439468:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xe087ee79 (ffff9f248fb8ff00) 00010000:00010000:3.0:1784938442.439471:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.439474:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8ba00/0x7b044d4128f998ed lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439480:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8ba00/0x7b044d4128f998ed lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.439484:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337426176 00000100:00100000:0.0:1784938442.439491:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337426176 00010000:00010000:3.0:1784938442.439495:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f99909 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439503:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f99909 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439509:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f99909 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439513:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3fe00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.439515:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f99909 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.439522:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e7a2d07f/0x7b044d4128f98b3a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663043 expref: 97 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439523:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f99909 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439542:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xff118af2 (ffff9f238dd4b600) 00010000:00010000:3.0:1784938442.439546:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.439549:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f99909 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.439554:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337426048 00010000:00010000:3.0:1784938442.439555:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f99909 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.439558:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337426048 00010000:00010000:0.0:1784938442.439570:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ae12b8fe/0x7b044d4128f98b33 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766302e expref: 98 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439574:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65400/0x7b044d4128f99925 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439587:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65400/0x7b044d4128f99925 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.439589:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337426304 00000100:00100000:0.0:1784938442.439592:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337426304 00010000:00010000:3.0:1784938442.439599:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65400/0x7b044d4128f99925 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.439605:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000705d1dae/0x7b044d4128f98ef9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766321f expref: 99 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439607:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dc65400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.439612:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65400/0x7b044d4128f99925 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439626:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65400/0x7b044d4128f99925 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.439631:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 248 00010000:00010000:3.0:1784938442.439638:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xc701cb36 (ffff9f23861f8600) 00000100:00100000:0.0:1784938442.439644:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+99:10958:x1871643337426176:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938442.439645:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.439650:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65400/0x7b044d4128f99925 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439657:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65400/0x7b044d4128f99925 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.439661:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938442.439668:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e7a2d07f/0x7b044d4128f98b3a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663043 expref: 99 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.439679:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e7a2d07f/0x7b044d4128f98b3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663043 expref: 99 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439691:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f800/0x7b044d4128f99941 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.439699:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7a2d07f/0x7b044d4128f98b3a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663043 expref: 99 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439701:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f800/0x7b044d4128f99941 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439719:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f800/0x7b044d4128f99941 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.439725:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.439726:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3f800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.439732:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f800/0x7b044d4128f99941 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.439734:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.439744:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4d7eeea/0x7b044d4128f9c26f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439750:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f800/0x7b044d4128f99941 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.439758:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4d7eeea/0x7b044d4128f9c26f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439763:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x9b815f19 (ffff9f238dd4b400) 00010000:00010000:3.0:1784938442.439768:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.439772:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f800/0x7b044d4128f99941 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439778:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f800/0x7b044d4128f99941 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.439781:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938442.439799:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8bc00/0x7b044d4128f9995d lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439806:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8bc00/0x7b044d4128f9995d lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439811:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8bc00/0x7b044d4128f9995d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439816:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b6b8bc00 already unused, calling callback (ffffffffc19a14f0) 00000100:00100000:0.0:1784938442.439821:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+98:10958:x1871643337426176:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 178us (745us total) trans 0 rc 0/0 00010000:00010000:3.0:1784938442.439822:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8bc00/0x7b044d4128f9995d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.439834:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 248 00010000:00010000:3.0:1784938442.439835:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8bc00/0x7b044d4128f9995d lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.439847:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xbf580d0c (ffff9f24975b2400) 00010000:00010000:3.0:1784938442.439851:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.439854:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8bc00/0x7b044d4128f9995d lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.439855:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 249 00010000:00010000:3.0:1784938442.439866:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b6b8bc00/0x7b044d4128f9995d lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.439866:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+97:10958:x1871643337426048:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938442.439876:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938442.439882:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ae12b8fe/0x7b044d4128f98b33 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766302e expref: 97 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.439948:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ae12b8fe/0x7b044d4128f98b33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766302e expref: 97 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.439962:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae12b8fe/0x7b044d4128f98b33 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766302e expref: 97 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.439971:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.439974:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.439978:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4e6532c/0x7b044d4128f9c25a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.439986:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4e6532c/0x7b044d4128f9c25a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.440001:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938442.440017:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+96:10958:x1871643337426048:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 153us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.440075:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 249 00000100:00100000:0.0:1784938442.440089:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 250 00000100:00100000:0.0:1784938442.440095:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2485cee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+95:10959:x1871643337426304:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938442.440102:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938442.440107:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000705d1dae/0x7b044d4128f98ef9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766321f expref: 95 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.440123:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000705d1dae/0x7b044d4128f98ef9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766321f expref: 95 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.440135:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.440138:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.440142:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000040dba49b/0x7b044d4128f9c261 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.440170:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040dba49b/0x7b044d4128f9c261 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.440181:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938442.440197:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2485cee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+95:10959:x1871643337426304:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 103us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.440203:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 250 00000100:00100000:2.0:1784938442.440505:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+14:16389:x1871643350841856:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 4962us (18916us total) trans 4294967407 rc 0/0 00000100:00100000:2.0:1784938442.440515:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 600 00000100:00100000:2.0:1784938442.440536:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 601 00000100:00100000:2.0:1784938442.440544:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+13:16389:x1871643350842368:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00002000:00080000:2.0:1784938442.440567:0:21152:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:40 count 1 00002000:00010000:2.0:1784938442.440596:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x28:0x0] initial LVB size: 0, mtime: 0x6a63ff79, atime: 0x6a63ff79, ctime: 0x6a63ff79, blocks: 0x0 00010000:00010000:2.0:1784938442.440603:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae3830fe/0x7b044d4128f9c27d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.440613:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x28:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1784938442.440616:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.440620:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae3830fe/0x7b044d4128f9c27d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.440630:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae3830fe/0x7b044d4128f9c27d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.440638:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae3830fe/0x7b044d4128f9c27d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.440645:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae3830fe/0x7b044d4128f9c27d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.440669:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1784938442.440789:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+14:16389:x1871643350842368:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 246us (19126us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1784938442.440795:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 601 00000100:00100000:2.0:1784938442.440808:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 602 00000100:00100000:2.0:1784938442.440814:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+13:16389:x1871643350843008:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00002000:00080000:2.0:1784938442.440826:0:21152:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:18 count 1 00010000:00010000:2.0:1784938442.440837:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000533c7a69/0x7b044d4128f9c284 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.440848:0:21152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b9bb6f8e/0x7b044d4128f98b25 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663035 expref: 94 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.440854:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x12:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1784938442.440857:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.440860:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000533c7a69/0x7b044d4128f9c284 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.440890:0:21152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b9bb6f8e/0x7b044d4128f98b25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663035 expref: 94 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.440905:0:21152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b9bb6f8e/0x7b044d4128f98b25 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663035 expref: 94 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.440926:0:21152:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f248a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:21152:1871643350843648:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938442.440979:0:21152:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24978ca3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938442.441000:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337426560 00000100:00100000:2.0:1784938442.441006:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337426560 00000100:00100000:1.0:1784938442.441194:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+94:10960:x1871643337425792:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 26690us (32561us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.441203:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 246 00000004:00080000:1.0:1784938442.441291:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f22d500/2, rc 0, transno 4294967406 00000100:00100000:1.0:1784938442.441303:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350842752:192.168.202.154@tcp:6:osp-syn-1-1.0 00010000:00010000:1.0:1784938442.441388:0:25715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000705d1dae/0x7b044d4128f98ef9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766321f expref: 93 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.441401:0:25715:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25715:1871643350843264:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938442.441415:0:25715:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000040dba49b/0x7b044d4128f9c261 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.441425:0:25715:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000040dba49b/0x7b044d4128f9c261 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.441437:0:25715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040dba49b/0x7b044d4128f9c261 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.441446:0:25715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040dba49b/0x7b044d4128f9c261 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.441452:0:25715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040dba49b/0x7b044d4128f9c261 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.441467:0:25715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1784938442.441564:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+14:16389:x1871643350841728:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 20581us (20778us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1784938442.441573:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 597 00000100:00100000:1.0:1784938442.441589:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 603 00000100:00100000:1.0:1784938442.441596:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+13:16392:x1871643350841088:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:1.0:1784938442.441611:0:25715:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:41 count 1 00002000:00010000:1.0:1784938442.441631:0:25715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x29:0x0] initial LVB size: 1048576, mtime: 0x6a63ff79, atime: 0x0, ctime: 0x6a63ff79, blocks: 0x800 00010000:00010000:1.0:1784938442.441637:0:25715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e3a956d/0x7b044d4128f9c28b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.441647:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=708s v=(0 0) 00010000:00010000:1.0:1784938442.441651:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.441656:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e3a956d/0x7b044d4128f9c28b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.441672:0:25715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e3a956d/0x7b044d4128f9c28b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.441682:0:25715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e3a956d/0x7b044d4128f9c28b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.441690:0:25715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e3a956d/0x7b044d4128f9c28b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.441702:0:25715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1784938442.441763:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+14:16392:x1871643350841088:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 167us (19741us total) trans 4294967407 rc 0/0 00000100:00100000:1.0:1784938442.441771:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 603 00000100:00100000:1.0:1784938442.441790:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 604 00000100:00100000:1.0:1784938442.441799:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+13:16392:x1871643350840960:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:1.0:1784938442.441812:0:25715:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:35 count 1 00002000:00010000:1.0:1784938442.441850:0:25715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 42517, mtime: 0x6a63ff78, atime: 0x0, ctime: 0x6a63ff78, blocks: 0x58 00010000:00010000:1.0:1784938442.441857:0:25715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3b044b2/0x7b044d4128f9c292 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.441866:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=708s v=(0 0) 00010000:00010000:1.0:1784938442.441869:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.441874:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3b044b2/0x7b044d4128f9c292 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.441889:0:25715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3b044b2/0x7b044d4128f9c292 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.441899:0:25715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3b044b2/0x7b044d4128f9c292 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.441907:0:25715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3b044b2/0x7b044d4128f9c292 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.441919:0:25715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1784938442.441923:0:21629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c4e6532c/0x7b044d4128f9c25a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.441936:0:21629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4e6532c/0x7b044d4128f9c25a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.441946:0:21629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4e6532c/0x7b044d4128f9c25a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.441954:0:21629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4e6532c/0x7b044d4128f9c25a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.441965:0:21629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:1.0:1784938442.441987:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+14:16392:x1871643350840960:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 189us (19215us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1784938442.441995:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 604 00000100:00100000:0.0:1784938442.442039:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+14:16389:x1871643350841216:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 21113us (21284us total) trans 4294967409 rc 0/0 00010000:00010000:3.0:1784938442.442467:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db7ba00/0x7b044d4128f99979 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.442511:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 605 00000100:00100000:1.0:1784938442.442523:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+13:16392:x1871643350841984:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00002000:00080000:1.0:1784938442.442539:0:25715:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:29 count 1 00002000:00010000:1.0:1784938442.442558:0:25715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x1d:0x0] initial LVB size: 116978, mtime: 0x6a63ff78, atime: 0x0, ctime: 0x6a63ff78, blocks: 0xe8 00010000:00010000:1.0:1784938442.442564:0:25715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3e5ca1f/0x7b044d4128f9c299 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.442573:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x1d:0x0].0x0 since=708s v=(0 0) 00010000:00010000:1.0:1784938442.442577:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.442582:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3e5ca1f/0x7b044d4128f9c299 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.442597:0:25715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3e5ca1f/0x7b044d4128f9c299 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.442606:0:25715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3e5ca1f/0x7b044d4128f9c299 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.442613:0:25715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3e5ca1f/0x7b044d4128f9c299 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.442623:0:25715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:1.0:1784938442.442702:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+14:16392:x1871643350841984:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 182us (19866us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1784938442.442786:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 68 00000100:00100000:2.0:1784938442.442795:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+376:17096:x1871643337426560:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:0.0:1784938442.442850:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 596 00000100:00100000:0.0:1784938442.442869:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 606 00000100:00100000:0.0:1784938442.442877:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+13:16392:x1871643350841600:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:0.0:1784938442.442890:0:21629:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:37 count 1 00010000:00010000:0.0:1784938442.442914:0:21629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c4a6658/0x7b044d4128f9c2a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.442926:0:21629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000097541b4a/0x7b044d4128f98d32 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663211 expref: 92 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.442933:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1784938442.442937:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.442941:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4a6658/0x7b044d4128f9c2a0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.442967:0:21629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000097541b4a/0x7b044d4128f98d32 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663211 expref: 92 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.442979:0:21629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000097541b4a/0x7b044d4128f98d32 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663211 expref: 92 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.442997:0:21629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:21629:1871643350843904:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938442.443004:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+377:17096:x1871643337426560:12345-192.168.202.54@tcp:35:cp.0 Request processed in 208us (3855us total) trans 8589934794 rc 0/0 00000100:00100000:0.0:1784938442.443041:0:21629:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b2d2c0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1784938442.443060:0:21149:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d4d7eeea/0x7b044d4128f9c26f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.443069:0:21149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4d7eeea/0x7b044d4128f9c26f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.443077:0:21149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4d7eeea/0x7b044d4128f9c26f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.443084:0:21149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4d7eeea/0x7b044d4128f9c26f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.443094:0:21149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00000100:00100000:0.0:1784938442.443186:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+14:16389:x1871643350841344:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 19290us (21909us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1784938442.443194:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 599 00000100:00100000:0.0:1784938442.443208:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 607 00000100:00100000:0.0:1784938442.443216:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+14:16392:x1871643350842112:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00002000:00080000:0.0:1784938442.443229:0:21149:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:19 count 1 00002000:00010000:0.0:1784938442.443246:0:21149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x13:0x0] initial LVB size: 1790, mtime: 0x6a63ff77, atime: 0x0, ctime: 0x6a63ff77, blocks: 0x8 00010000:00010000:0.0:1784938442.443251:0:21149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d89d376/0x7b044d4128f9c2a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.443260:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x13:0x0].0x0 since=708s v=(0 0) 00010000:00010000:0.0:1784938442.443263:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.443268:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d89d376/0x7b044d4128f9c2a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.443277:0:21149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d89d376/0x7b044d4128f9c2a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443367:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db7ba00/0x7b044d4128f99979 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.443380:0:21149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d89d376/0x7b044d4128f9c2a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443383:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db7ba00/0x7b044d4128f99979 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443400:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db7ba00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938442.443402:0:21149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d89d376/0x7b044d4128f9c2a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443405:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db7ba00/0x7b044d4128f99979 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443420:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db7ba00/0x7b044d4128f99979 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.443421:0:21149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:3.0:1784938442.443438:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x130f79e0 (ffff9f238dcb3d00) 00010000:00010000:3.0:1784938442.443441:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.443446:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db7ba00/0x7b044d4128f99979 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443452:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db7ba00/0x7b044d4128f99979 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443482:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f99995 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443488:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f99995 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443495:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f99995 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.443501:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+15:16392:x1871643350842112:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 282us (20597us total) trans 4294967410 rc 0/0 00010000:00010000:3.0:1784938442.443503:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3f600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.443508:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f99995 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.443516:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 607 00010000:00010000:3.0:1784938442.443519:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f99995 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443529:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x4958ff4 (ffff9f238dd4b500) 00010000:00010000:3.0:1784938442.443532:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938442.443536:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 608 00010000:00010000:3.0:1784938442.443537:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f99995 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443545:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f99995 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.443550:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+14:16392:x1871643350842624:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00002000:00080000:0.0:1784938442.443567:0:21149:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2 count 1 00010000:00010000:3.0:1784938442.443571:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b400/0x7b044d4128f999b1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.443579:0:21149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc902b02/0x7b044d4128f9c2ae lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443580:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b400/0x7b044d4128f999b1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443597:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b400/0x7b044d4128f999b1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.443604:0:21149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000067784924/0x7b044d4128f98b2c lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663019 expref: 94 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443605:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61b400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.443611:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b400/0x7b044d4128f999b1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.443621:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1784938442.443629:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.443633:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b400/0x7b044d4128f999b1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.443634:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc902b02/0x7b044d4128f9c2ae lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443645:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xc025ca7 (ffff9f23861f8400) 00010000:00010000:3.0:1784938442.443647:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.443650:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b400/0x7b044d4128f999b1 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443667:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b400/0x7b044d4128f999b1 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.443687:0:21149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000067784924/0x7b044d4128f98b2c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663019 expref: 94 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443690:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db7a200/0x7b044d4128f999cd lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443706:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db7a200/0x7b044d4128f999cd lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.443710:0:21149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000067784924/0x7b044d4128f98b2c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663019 expref: 94 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443717:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db7a200/0x7b044d4128f999cd lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443731:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db7a200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.443734:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db7a200/0x7b044d4128f999cd lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.443735:0:21149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:21149:1871643350844032:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938442.443747:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db7a200/0x7b044d4128f999cd lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443756:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xe00215d9 (ffff9f238dcb3600) 00010000:00010000:3.0:1784938442.443759:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.443763:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db7a200/0x7b044d4128f999cd lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443769:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db7a200/0x7b044d4128f999cd lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.443781:0:21149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828e7480 going to sleep for 11 seconds 00010000:00010000:3.0:1784938442.443786:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f999e9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443795:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f999e9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443801:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f999e9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443806:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3ea00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.443808:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f999e9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443814:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f999e9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443822:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x45c0cf9c (ffff9f238dd4b800) 00010000:00010000:3.0:1784938442.443825:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.443828:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f999e9 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443833:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f999e9 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443866:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db7a800/0x7b044d4128f99a05 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443874:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db7a800/0x7b044d4128f99a05 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443881:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db7a800/0x7b044d4128f99a05 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443887:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db7a800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.443890:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db7a800/0x7b044d4128f99a05 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443897:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db7a800/0x7b044d4128f99a05 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443905:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x9ca112ae (ffff9f238dcb3200) 00010000:00010000:3.0:1784938442.443908:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.443912:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db7a800/0x7b044d4128f99a05 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443918:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db7a800/0x7b044d4128f99a05 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443938:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ae00/0x7b044d4128f99a21 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443944:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ae00/0x7b044d4128f99a21 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443950:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ae00/0x7b044d4128f99a21 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443956:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61ae00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.443960:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ae00/0x7b044d4128f99a21 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443970:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ae00/0x7b044d4128f99a21 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443979:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x322afea2 (ffff9f23861f8b00) 00010000:00010000:3.0:1784938442.443981:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.443985:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ae00/0x7b044d4128f99a21 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.443991:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ae00/0x7b044d4128f99a21 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.444139:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 605 00000100:00100000:1.0:1784938442.444174:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 609 00000100:00100000:1.0:1784938442.444184:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+13:16392:x1871643350841472:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:1.0:1784938442.444201:0:25715:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:40 count 1 00000100:00100000:0.0:1784938442.444204:0:25718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 610 00000100:00100000:0.0:1784938442.444217:0:25718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+13:16392:x1871643350842496:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00010000:00010000:1.0:1784938442.444218:0:25715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e0ac0a1/0x7b044d4128f9c2b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444234:0:25715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007634da25/0x7b044d4128f98d1d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766309e expref: 92 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1784938442.444235:0:25718:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:12 count 1 00010000:00010000:1.0:1784938442.444246:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1784938442.444249:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.444251:0:25718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e420deed/0x7b044d4128f9c2bc lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444255:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e0ac0a1/0x7b044d4128f9c2b5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.444280:0:25718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007f169e32/0x7b044d4128f98b1e lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663027 expref: 94 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444291:0:25715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007634da25/0x7b044d4128f98d1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e94766309e expref: 92 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444312:0:25715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007634da25/0x7b044d4128f98d1d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766309e expref: 92 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.444313:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xc:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1784938442.444320:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.444339:0:25718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e420deed/0x7b044d4128f9c2bc lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.444347:0:25715:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25715:1871643350844160:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938442.444367:0:25718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007f169e32/0x7b044d4128f98b1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663027 expref: 94 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.444378:0:25718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007f169e32/0x7b044d4128f98b1e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663027 expref: 94 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.444391:0:25718:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25718:1871643350844288:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938442.444396:0:25715:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828af600 going to sleep for 11 seconds 00010000:00010000:1.0:1784938442.444412:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1784938442.444419:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cff32a8e/0x7b044d4128f9c276 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.444422:0:25718:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2488eec780 going to sleep for 11 seconds 00010000:00010000:1.0:1784938442.444431:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f244800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938442.444435:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cff32a8e/0x7b044d4128f9c276 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444445:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cff32a8e/0x7b044d4128f9c276 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444458:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cff32a8e/0x7b044d4128f9c276 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444466:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cff32a8e/0x7b044d4128f9c276 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444482:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1784938442.444487:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae3830fe/0x7b044d4128f9c27d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444494:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938442.444497:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae3830fe/0x7b044d4128f9c27d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444504:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae3830fe/0x7b044d4128f9c27d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444513:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae3830fe/0x7b044d4128f9c27d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444520:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae3830fe/0x7b044d4128f9c27d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444537:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1784938442.444541:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040dba49b/0x7b044d4128f9c261 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444546:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f20a400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938442.444549:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040dba49b/0x7b044d4128f9c261 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444561:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040dba49b/0x7b044d4128f9c261 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444572:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040dba49b/0x7b044d4128f9c261 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444579:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040dba49b/0x7b044d4128f9c261 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444591:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1784938442.444595:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e3a956d/0x7b044d4128f9c28b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444601:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f20b400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938442.444604:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e3a956d/0x7b044d4128f9c28b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444611:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e3a956d/0x7b044d4128f9c28b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444620:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e3a956d/0x7b044d4128f9c28b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444626:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e3a956d/0x7b044d4128f9c28b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444644:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1784938442.444647:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3b044b2/0x7b044d4128f9c292 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444654:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f20a800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938442.444656:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3b044b2/0x7b044d4128f9c292 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444664:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3b044b2/0x7b044d4128f9c292 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444674:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3b044b2/0x7b044d4128f9c292 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444681:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3b044b2/0x7b044d4128f9c292 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444692:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1784938442.444695:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4e6532c/0x7b044d4128f9c25a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444701:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a6000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938442.444703:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4e6532c/0x7b044d4128f9c25a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444716:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4e6532c/0x7b044d4128f9c25a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444723:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4e6532c/0x7b044d4128f9c25a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444731:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4e6532c/0x7b044d4128f9c25a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444745:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784938442.444749:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3e5ca1f/0x7b044d4128f9c299 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444755:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f20b600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938442.444758:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3e5ca1f/0x7b044d4128f9c299 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444765:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3e5ca1f/0x7b044d4128f9c299 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444775:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3e5ca1f/0x7b044d4128f9c299 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444782:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3e5ca1f/0x7b044d4128f9c299 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444798:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784938442.444802:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4d7eeea/0x7b044d4128f9c26f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444808:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24ca00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938442.444811:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4d7eeea/0x7b044d4128f9c26f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444819:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4d7eeea/0x7b044d4128f9c26f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444828:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4d7eeea/0x7b044d4128f9c26f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444834:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4d7eeea/0x7b044d4128f9c26f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444844:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938442.444848:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d89d376/0x7b044d4128f9c2a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444854:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24d400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938442.444857:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d89d376/0x7b044d4128f9c2a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444869:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d89d376/0x7b044d4128f9c2a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444878:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d89d376/0x7b044d4128f9c2a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444885:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d89d376/0x7b044d4128f9c2a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.444897:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.444899:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.444901:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1784938442.444938:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f22f480/2, rc 0, transno 4294967407 00000100:00100000:1.0:1784938442.444961:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350841856:192.168.202.154@tcp:6:osp-syn-1-1.0 00000004:00080000:1.0:1784938442.444973:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f22c380/2, rc 0, transno 4294967408 00000100:00100000:1.0:1784938442.444977:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350842368:192.168.202.154@tcp:6:osp-syn-1-1.0 00000004:00080000:1.0:1784938442.444986:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24b68d9880/2, rc 0, transno 4294967410 00000100:00100000:1.0:1784938442.444996:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350841344:192.168.202.154@tcp:6:osp-syn-0-1.0 00000004:00080000:1.0:1784938442.445003:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24b68db800/2, rc 0, transno 4294967409 00000100:00100000:1.0:1784938442.445006:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350841216:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:2.0:1784938442.445099:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 68 00010000:00010000:2.0:1784938442.445122:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938442.445131:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938442.445138:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938442.445159:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350843776:192.168.202.154@tcp:6:osp-syn-1-1.0 00000004:00080000:2.0:1784938442.445214:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24b68d9c00/2, rc 0, transno 4294967408 00000100:00100000:2.0:1784938442.445219:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350840960:192.168.202.154@tcp:6:osp-syn-0-1.0 00000004:00080000:2.0:1784938442.445228:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f22ea00/2, rc 0, transno 4294967409 00000100:00100000:2.0:1784938442.445232:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350841984:192.168.202.154@tcp:6:osp-syn-1-1.0 00000004:00080000:2.0:1784938442.445241:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24b68daa00/2, rc 0, transno 4294967407 00000100:00100000:2.0:1784938442.445247:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350841088:192.168.202.154@tcp:6:osp-syn-0-1.0 00000004:00080000:2.0:1784938442.445255:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f22ca80/2, rc 0, transno 4294967410 00000100:00100000:2.0:1784938442.445259:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350842112:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:2.0:1784938442.445295:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350844672:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:2.0:1784938442.445505:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938442.445512:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2489ae4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350844800:192.168.202.154@tcp:6:osp-syn-1-1.0 00010000:00010000:3.0:1784938442.448742:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9e4600/0x7b044d4128f99a3d lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.448766:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9e4600/0x7b044d4128f99a3d lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.448775:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9e4600/0x7b044d4128f99a3d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.448782:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9e4600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.448787:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9e4600/0x7b044d4128f99a3d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.448797:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9e4600/0x7b044d4128f99a3d lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.448815:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x130bf32a (ffff9f238dcb3100) 00010000:00010000:3.0:1784938442.448819:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.448824:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9e4600/0x7b044d4128f99a3d lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.448831:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9e4600/0x7b044d4128f99a3d lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.448875:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc64c00/0x7b044d4128f99a59 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.448882:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc64c00/0x7b044d4128f99a59 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.448888:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc64c00/0x7b044d4128f99a59 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.448893:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dc64c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.448896:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc64c00/0x7b044d4128f99a59 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.448903:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc64c00/0x7b044d4128f99a59 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.448910:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x1a616f3f (ffff9f23861f8900) 00010000:00010000:3.0:1784938442.448913:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.448916:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc64c00/0x7b044d4128f99a59 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.448922:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc64c00/0x7b044d4128f99a59 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.448943:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ee00/0x7b044d4128f99a75 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.448949:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ee00/0x7b044d4128f99a75 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.448955:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ee00/0x7b044d4128f99a75 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.448960:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3ee00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.448963:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ee00/0x7b044d4128f99a75 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.448969:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ee00/0x7b044d4128f99a75 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.448977:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x407c6222 (ffff9f238dbbf300) 00010000:00010000:3.0:1784938442.448980:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.448983:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ee00/0x7b044d4128f99a75 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.448988:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ee00/0x7b044d4128f99a75 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.449026:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f99a91 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.449034:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f99a91 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.449040:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f99a91 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.449044:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3e400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.449048:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f99a91 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.449058:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f99a91 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.449065:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x7772308b (ffff9f238dbbff00) 00010000:00010000:3.0:1784938442.449068:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.449071:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f99a91 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.449076:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f99a91 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.449092:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d200/0x7b044d4128f99aad lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.449098:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d200/0x7b044d4128f99aad lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.449104:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d200/0x7b044d4128f99aad lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.449109:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27d200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.449113:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d200/0x7b044d4128f99aad lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.449119:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d200/0x7b044d4128f99aad lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.449126:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x6d38f012 (ffff9f24975b2900) 00010000:00010000:3.0:1784938442.449129:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.449132:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d200/0x7b044d4128f99aad lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.449138:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d200/0x7b044d4128f99aad lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.449173:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238e483200/0x7b044d4128f99ac9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.449180:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238e483200/0x7b044d4128f99ac9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.449186:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238e483200/0x7b044d4128f99ac9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.449191:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238e483200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.449194:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238e483200/0x7b044d4128f99ac9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.449199:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238e483200/0x7b044d4128f99ac9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.449207:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x15c8a56e (ffff9f238dbbfa00) 00010000:00010000:3.0:1784938442.449209:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.449212:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238e483200/0x7b044d4128f99ac9 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.449218:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238e483200/0x7b044d4128f99ac9 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.449234:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625e400/0x7b044d4128f99ae5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.449241:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625e400/0x7b044d4128f99ae5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.449247:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625e400/0x7b044d4128f99ae5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.449252:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c625e400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.449255:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625e400/0x7b044d4128f99ae5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.449261:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625e400/0x7b044d4128f99ae5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.449269:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x712be7d1 (ffff9f238dcb3500) 00010000:00010000:3.0:1784938442.449271:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.449273:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625e400/0x7b044d4128f99ae5 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.449278:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625e400/0x7b044d4128f99ae5 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.449294:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056000/0x7b044d4128f99b01 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.449299:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056000/0x7b044d4128f99b01 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.449304:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056000/0x7b044d4128f99b01 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.449309:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4056000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.449312:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056000/0x7b044d4128f99b01 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.449320:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056000/0x7b044d4128f99b01 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.449326:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xb2d5a33e (ffff9f238dbbf700) 00010000:00010000:3.0:1784938442.449328:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00080000:1.0:1784938442.449657:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24b68dad80/2, rc 0, transno 4294967406 00000100:00100000:1.0:1784938442.449669:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350841728:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:1.0:1784938442.449693:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350844416:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:1.0:1784938442.449766:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938442.449774:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350844544:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:1.0:1784938442.449914:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f241500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350845056:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:1.0:1784938442.449942:0:16390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784938442.449948:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350844928:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:1.0:1784938442.449972:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350845440:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:1.0:1784938442.450220:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938442.450569:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350845312:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:2.0:1784938442.450605:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784938442.450610:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f243b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350845184:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:2.0:1784938442.450643:0:25716:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 7 min 3 max 116 00000100:00100000:2.0:1784938442.450651:0:25716:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_007' 00000100:00100000:1.0:1784938442.451190:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938442.451229:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938442.451283:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938442.451294:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938442.451305:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938442.451315:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938442.451325:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938442.451350:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938442.451364:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938442.451460:0:21151:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 7 min 3 max 116 00000100:00100000:2.0:1784938442.451468:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350844928 00000100:00100000:2.0:1784938442.451474:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350844928 00000100:00100000:2.0:1784938442.451504:0:21151:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 7 min 3 max 116 00000100:00100000:2.0:1784938442.451508:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350845312 00000100:00100000:2.0:1784938442.451510:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350845312 00000100:00100000:2.0:1784938442.451518:0:21151:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 7 min 3 max 116 00000100:00100000:2.0:1784938442.451522:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350845184 00000100:00100000:2.0:1784938442.451524:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350845184 00000100:00100000:2.0:1784938442.451530:0:21151:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 7 min 3 max 116 00000100:00100000:2.0:1784938442.451535:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350843776 00000100:00100000:2.0:1784938442.451537:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350843776 00000100:00100000:2.0:1784938442.451544:0:21151:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 7 min 3 max 116 00000100:00100000:2.0:1784938442.451548:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350844672 00000100:00100000:2.0:1784938442.451549:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350844672 00000100:00100000:2.0:1784938442.451555:0:21151:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 7 min 3 max 116 00000100:00100000:2.0:1784938442.451558:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350844800 00000100:00100000:2.0:1784938442.451560:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350844800 00000100:00100000:2.0:1784938442.451566:0:21151:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 7 min 3 max 116 00000100:00100000:2.0:1784938442.451569:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350844416 00000100:00100000:2.0:1784938442.451571:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350844416 00000100:00100000:2.0:1784938442.451577:0:21151:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 7 min 3 max 116 00000100:00100000:2.0:1784938442.451580:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350844544 00000100:00100000:2.0:1784938442.451582:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350844544 00000100:00100000:2.0:1784938442.451589:0:21151:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 7 min 3 max 116 00000100:00100000:2.0:1784938442.451592:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350845056 00000100:00100000:2.0:1784938442.451593:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350845056 00000100:00100000:2.0:1784938442.451599:0:21151:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 7 min 3 max 116 00000100:00100000:2.0:1784938442.451602:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350845440 00000100:00100000:2.0:1784938442.451604:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350845440 00010000:00010000:3.0:1784938442.451723:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056000/0x7b044d4128f99b01 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.451735:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4056000/0x7b044d4128f99b01 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.451775:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057400/0x7b044d4128f99b1d lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.451782:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057400/0x7b044d4128f99b1d lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.451789:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057400/0x7b044d4128f99b1d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.451794:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.451798:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057400/0x7b044d4128f99b1d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.451805:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057400/0x7b044d4128f99b1d lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.451818:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x10fe8da8 (ffff9f238dbbfe00) 00010000:00010000:3.0:1784938442.451820:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.451823:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057400/0x7b044d4128f99b1d lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.451830:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057400/0x7b044d4128f99b1d lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.451843:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057000/0x7b044d4128f99b39 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.451849:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057000/0x7b044d4128f99b39 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.451855:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057000/0x7b044d4128f99b39 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.451860:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.451862:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057000/0x7b044d4128f99b39 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.451868:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057000/0x7b044d4128f99b39 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.451874:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x39c3d8fe (ffff9f238dcb2500) 00010000:00010000:3.0:1784938442.451876:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.451878:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057000/0x7b044d4128f99b39 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.451883:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057000/0x7b044d4128f99b39 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.451905:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057c00/0x7b044d4128f99b55 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.451911:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057c00/0x7b044d4128f99b55 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.451917:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057c00/0x7b044d4128f99b55 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.451923:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.451926:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057c00/0x7b044d4128f99b55 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.451931:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057c00/0x7b044d4128f99b55 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.451938:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xecc4f14 (ffff9f238dcb2400) 00010000:00010000:3.0:1784938442.451940:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.451942:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057c00/0x7b044d4128f99b55 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.451947:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057c00/0x7b044d4128f99b55 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.451960:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625ee00/0x7b044d4128f99b71 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.451966:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625ee00/0x7b044d4128f99b71 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.451972:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625ee00/0x7b044d4128f99b71 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.451977:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c625ee00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.451979:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625ee00/0x7b044d4128f99b71 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.451990:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625ee00/0x7b044d4128f99b71 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.451996:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x151c8ac3 (ffff9f23861f4d00) 00010000:00010000:3.0:1784938442.451998:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.452001:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625ee00/0x7b044d4128f99b71 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452006:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625ee00/0x7b044d4128f99b71 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452031:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057a00/0x7b044d4128f99b8d lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452036:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057a00/0x7b044d4128f99b8d lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452041:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057a00/0x7b044d4128f99b8d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452046:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.452053:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057a00/0x7b044d4128f99b8d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452059:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057a00/0x7b044d4128f99b8d lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452065:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xe7eb4718 (ffff9f238dcb2800) 00010000:00010000:3.0:1784938442.452068:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.452071:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057a00/0x7b044d4128f99b8d lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452076:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057a00/0x7b044d4128f99b8d lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452091:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42c800/0x7b044d4128f99ba9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452096:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42c800/0x7b044d4128f99ba9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452102:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42c800/0x7b044d4128f99ba9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452107:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42c800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.452110:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42c800/0x7b044d4128f99ba9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452116:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42c800/0x7b044d4128f99ba9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452122:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xa6e7eec (ffff9f248fb8f800) 00010000:00010000:3.0:1784938442.452124:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.452127:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42c800/0x7b044d4128f99ba9 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452133:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42c800/0x7b044d4128f99ba9 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452175:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057800/0x7b044d4128f99bc5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452182:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057800/0x7b044d4128f99bc5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452188:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057800/0x7b044d4128f99bc5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452194:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.452197:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057800/0x7b044d4128f99bc5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452203:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057800/0x7b044d4128f99bc5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452210:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x4ee593e6 (ffff9f238dcb2300) 00010000:00010000:3.0:1784938442.452212:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.452215:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057800/0x7b044d4128f99bc5 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452221:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b4057800/0x7b044d4128f99bc5 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452234:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625f200/0x7b044d4128f99be1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452240:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625f200/0x7b044d4128f99be1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452245:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625f200/0x7b044d4128f99be1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452250:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c625f200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.452253:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625f200/0x7b044d4128f99be1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452262:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625f200/0x7b044d4128f99be1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452269:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xe708c894 (ffff9f23861f4500) 00010000:00010000:3.0:1784938442.452271:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.452273:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625f200/0x7b044d4128f99be1 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452279:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625f200/0x7b044d4128f99be1 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452293:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625f000/0x7b044d4128f99bfd lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452301:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625f000/0x7b044d4128f99bfd lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452305:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625f000/0x7b044d4128f99bfd lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452310:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c625f000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.452312:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625f000/0x7b044d4128f99bfd lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452317:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625f000/0x7b044d4128f99bfd lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452324:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xc735cef4 (ffff9f23861f4e00) 00010000:00010000:3.0:1784938442.452327:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.452329:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625f000/0x7b044d4128f99bfd lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452347:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c625f000/0x7b044d4128f99bfd lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452378:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42ce00/0x7b044d4128f99c19 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452384:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42ce00/0x7b044d4128f99c19 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452389:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42ce00/0x7b044d4128f99c19 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452394:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42ce00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.452397:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42ce00/0x7b044d4128f99c19 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452402:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42ce00/0x7b044d4128f99c19 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452410:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x239dea14 (ffff9f2484afd200) 00010000:00010000:3.0:1784938442.452412:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.452415:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42ce00/0x7b044d4128f99c19 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452420:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42ce00/0x7b044d4128f99c19 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452434:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17ae00/0x7b044d4128f99c35 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452440:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17ae00/0x7b044d4128f99c35 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452446:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17ae00/0x7b044d4128f99c35 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452451:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17ae00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.452454:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17ae00/0x7b044d4128f99c35 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452459:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17ae00/0x7b044d4128f99c35 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452466:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x9ce4d69c (ffff9f238dcb2100) 00010000:00010000:3.0:1784938442.452468:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.452471:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17ae00/0x7b044d4128f99c35 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452477:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17ae00/0x7b044d4128f99c35 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.452736:0:25719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 611 00000100:00100000:3.0:1784938442.452747:0:25719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+18:16392:x1871643350843520:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:3.0:1784938442.452779:0:25719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:20 count 1 00010000:00010000:3.0:1784938442.452801:0:25719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000964eb9b6/0x7b044d4128f9c2c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452819:0:25719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e0df92c2/0x7b044d4128f98f0e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663226 expref: 92 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452828:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=5s v=(0 0) 00010000:00010000:3.0:1784938442.452832:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.452837:0:25719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000964eb9b6/0x7b044d4128f9c2c3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452869:0:25719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e0df92c2/0x7b044d4128f98f0e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663226 expref: 92 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.452880:0:25719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e0df92c2/0x7b044d4128f98f0e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663226 expref: 92 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.452895:0:25719:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd55d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:25719:1871643350845568:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938442.454750:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.454776:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.454797:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.454820:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.454868:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337426944 00000100:00100000:1.0:1784938442.454876:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337426944 00010000:00010000:1.0:1784938442.454920:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000067784924/0x7b044d4128f98b2c lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663019 expref: 95 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.454956:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337426816 00000100:00100000:1.0:1784938442.454959:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337426816 00010000:00010000:1.0:1784938442.454972:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000097541b4a/0x7b044d4128f98d32 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663211 expref: 93 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.454984:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337426688 00000100:00100000:1.0:1784938442.454986:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337426688 00010000:00010000:1.0:1784938442.454996:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b9bb6f8e/0x7b044d4128f98b25 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663035 expref: 96 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.455226:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 251 00000100:00100000:1.0:1784938442.455238:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f181500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+96:10958:x1871643337426944:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.455254:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.455260:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000067784924/0x7b044d4128f98b2c lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663019 expref: 96 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.455273:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000067784924/0x7b044d4128f98b2c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663019 expref: 96 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.455298:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.455303:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.455309:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc902b02/0x7b044d4128f9c2ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.455318:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc902b02/0x7b044d4128f9c2ae lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.455349:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938442.455389:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f181500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+96:10958:x1871643337426944:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 154us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.455396:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 251 00000100:00100000:1.0:1784938442.455413:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 252 00000100:00100000:1.0:1784938442.455419:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f180380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+93:10958:x1871643337426816:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.455427:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.455431:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000097541b4a/0x7b044d4128f98d32 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663211 expref: 93 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.455440:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000097541b4a/0x7b044d4128f98d32 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663211 expref: 93 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.455453:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.455456:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.455459:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4a6658/0x7b044d4128f9c2a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.455467:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4a6658/0x7b044d4128f9c2a0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.455479:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938442.455496:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f180380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+93:10958:x1871643337426816:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 77us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.455505:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 252 00000100:00100000:1.0:1784938442.455517:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 253 00000100:00100000:1.0:1784938442.455523:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f180a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+95:10960:x1871643337426688:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.455529:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.455534:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b9bb6f8e/0x7b044d4128f98b25 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663035 expref: 95 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.455543:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b9bb6f8e/0x7b044d4128f98b25 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663035 expref: 95 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.455554:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.455557:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.455562:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000533c7a69/0x7b044d4128f9c284 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.455569:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000533c7a69/0x7b044d4128f9c284 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.455580:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938442.455597:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f180a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+95:10960:x1871643337426688:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 74us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.455603:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 253 00010000:00010000:1.0:1784938442.455652:0:21629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097541b4a/0x7b044d4128f98d32 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663211 expref: 92 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.455671:0:21629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:21629:1871643350843904:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938442.455690:0:21629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001c4a6658/0x7b044d4128f9c2a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.455700:0:21629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001c4a6658/0x7b044d4128f9c2a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.455708:0:21629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4a6658/0x7b044d4128f9c2a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.455718:0:21629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c4a6658/0x7b044d4128f9c2a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.455726:0:21629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c4a6658/0x7b044d4128f9c2a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.455741:0:21629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938442.455880:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+19:16392:x1871643350841600:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 13004us (32992us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1784938442.455888:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 606 00010000:00010000:2.0:1784938442.456157:0:21152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9bb6f8e/0x7b044d4128f98b25 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663035 expref: 94 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.456171:0:21152:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f248a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:21152:1871643350843648:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938442.456185:0:21152:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000533c7a69/0x7b044d4128f9c284 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.456195:0:21152:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000533c7a69/0x7b044d4128f9c284 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.456201:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000533c7a69/0x7b044d4128f9c284 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.456209:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000533c7a69/0x7b044d4128f9c284 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.456217:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000533c7a69/0x7b044d4128f9c284 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.456232:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1784938442.456313:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+19:16389:x1871643350843008:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 15498us (34527us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1784938442.456324:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 602 00000100:00100000:1.0:1784938442.456386:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 612 00000100:00100000:1.0:1784938442.456394:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f240380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+18:16390:x1871643350844928:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:1.0:1784938442.456414:0:21629:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:22 count 1 00010000:00010000:1.0:1784938442.456434:0:21629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000237a9c79/0x7b044d4128f9c2ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.456447:0:21629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000002f45a6a/0x7b044d4128f98f15 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766322d expref: 91 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.456457:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1784938442.456460:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.456464:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000237a9c79/0x7b044d4128f9c2ca lrc: 4/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.456492:0:21629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000002f45a6a/0x7b044d4128f98f15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e94766322d expref: 91 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.456503:0:21629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000002f45a6a/0x7b044d4128f98f15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766322d expref: 91 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.456517:0:21629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f182300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:21629:1871643350845696:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938442.456565:0:21629:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828af780 going to sleep for 11 seconds 00010000:00010000:1.0:1784938442.456580:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784938442.456586:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c4a6658/0x7b044d4128f9c2a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.456595:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24c000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938442.456600:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4a6658/0x7b044d4128f9c2a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.456616:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4a6658/0x7b044d4128f9c2a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.456629:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c4a6658/0x7b044d4128f9c2a0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.456636:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4a6658/0x7b044d4128f9c2a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.456653:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938442.456657:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000533c7a69/0x7b044d4128f9c284 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.456663:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938442.456667:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000533c7a69/0x7b044d4128f9c284 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.456674:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000533c7a69/0x7b044d4128f9c284 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.456682:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000533c7a69/0x7b044d4128f9c284 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.456689:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000533c7a69/0x7b044d4128f9c284 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.456707:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.456709:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.456711:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.456737:0:21149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067784924/0x7b044d4128f98b2c lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663019 expref: 93 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.456747:0:21149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:21149:1871643350844032:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938442.456759:0:21149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fc902b02/0x7b044d4128f9c2ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.456768:0:21149:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fc902b02/0x7b044d4128f9c2ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.456774:0:21149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc902b02/0x7b044d4128f9c2ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.456782:0:21149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc902b02/0x7b044d4128f9c2ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.456789:0:21149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc902b02/0x7b044d4128f9c2ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.456802:0:21149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938442.456864:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+20:16392:x1871643350842624:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 13318us (33951us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1784938442.456874:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 608 00000100:00100000:2.0:1784938442.456914:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 613 00000100:00100000:2.0:1784938442.456921:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+18:16392:x1871643350845312:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:2.0:1784938442.456936:0:21152:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:13 count 1 00010000:00010000:2.0:1784938442.456946:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d379049d/0x7b044d4128f9c2d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.456957:0:21152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000527ab402/0x7b044d4128f99455 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766328f expref: 91 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.456964:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784938442.456967:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.456970:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d379049d/0x7b044d4128f9c2d1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.456985:0:21152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000527ab402/0x7b044d4128f99455 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e94766328f expref: 91 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.456994:0:21152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000527ab402/0x7b044d4128f99455 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766328f expref: 91 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.457004:0:21152:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f248a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:21152:1871643350845824:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938442.457187:0:21152:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24978ca3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1784938442.457199:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938442.457203:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc902b02/0x7b044d4128f9c2ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.457211:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24d200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938442.457215:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc902b02/0x7b044d4128f9c2ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.457222:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc902b02/0x7b044d4128f9c2ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.457235:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc902b02/0x7b044d4128f9c2ae lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.457242:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc902b02/0x7b044d4128f9c2ae lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.457258:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938442.457260:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938442.457262:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938442.457268:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938442.457280:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337427072 00000100:00100000:2.0:1784938442.457287:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337427072 00000100:00100000:2.0:1784938442.457326:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 394 00000100:00100000:2.0:1784938442.457352:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+377:17096:x1871643337427072:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938442.457366:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938442.457380:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244a00/0x7b044d4128f9c2d8 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663eac expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.457430:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244c00/0x7b044d4128f9c2df lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.457443:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244c00/0x7b044d4128f9c2df lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.457451:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244c00/0x7b044d4128f9c2df lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.457463:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244600/0x7b044d4128f9c2e6 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x407c6222 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.457470:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244600/0x7b044d4128f9c2e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.457476:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244600/0x7b044d4128f9c2e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.457507:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244c00/0x7b044d4128f9c2df lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.457513:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244c00/0x7b044d4128f9c2df lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.457519:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244c00/0x7b044d4128f9c2df lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.457524:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244c00/0x7b044d4128f9c2df lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.457530:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f244c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938442.457533:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244c00/0x7b044d4128f9c2df lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.457539:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244c00/0x7b044d4128f9c2df lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.457547:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938442.457550:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.457553:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244c00/0x7b044d4128f9c2df lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.457558:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244c00/0x7b044d4128f9c2df lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.457568:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244600/0x7b044d4128f9c2e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.457574:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244600/0x7b044d4128f9c2e6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.457580:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244600/0x7b044d4128f9c2e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.457584:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f244600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938442.457587:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244600/0x7b044d4128f9c2e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.457592:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244600/0x7b044d4128f9c2e6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.457598:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x407c6222 (ffff9f238d49e800) 00010000:00010000:2.0:1784938442.457600:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.457602:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244600/0x7b044d4128f9c2e6 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.457608:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244600/0x7b044d4128f9c2e6 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.457639:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244a00/0x7b044d4128f9c2d8 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663eac expref: 378 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.457648:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938442.457650:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.457654:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244a00/0x7b044d4128f9c2d8 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663eac expref: 378 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.457662:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f244a00, rc 0) 00000100:00100000:2.0:1784938442.457681:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+377:17096:x1871643337427072:12345-192.168.202.54@tcp:101:cp.0 Request processed in 349us (2860us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938442.457686:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 394 00000100:00100000:1.0:1784938442.457768:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 614 00000100:00100000:1.0:1784938442.457776:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+18:16392:x1871643350845184:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:1.0:1784938442.457788:0:21149:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:21 count 1 00010000:00010000:1.0:1784938442.457801:0:21149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b257ac75/0x7b044d4128f9c2ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.457813:0:21149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a97217e/0x7b044d4128f99478 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663288 expref: 91 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.457820:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1784938442.457823:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.457827:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b257ac75/0x7b044d4128f9c2ed lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.457846:0:21149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003a97217e/0x7b044d4128f99478 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663288 expref: 91 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.457856:0:21149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003a97217e/0x7b044d4128f99478 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663288 expref: 91 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.457866:0:21149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f180700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:21149:1871643350845952:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938442.457889:0:21149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828afd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938442.457915:0:25715:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25715:1871643350844160:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938442.457931:0:25715:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002e0ac0a1/0x7b044d4128f9c2b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938442.458448:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24b68db100/2, rc 0, transno 4294967411 00000100:00100000:2.0:1784938442.458462:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350841600:192.168.202.154@tcp:6:osp-syn-0-1.0 00000004:00080000:2.0:1784938442.458472:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f22dc00/2, rc 0, transno 4294967412 00000100:00100000:2.0:1784938442.458482:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350842624:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:2.0:1784938442.458548:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784938442.458557:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f24a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350846208:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:2.0:1784938442.458600:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f249f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350846080:192.168.202.154@tcp:6:osp-syn-0-1.0 00000004:00080000:2.0:1784938442.458633:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f22fb80/2, rc 0, transno 4294967411 00000100:00100000:2.0:1784938442.458640:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350843008:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:2.0:1784938442.458666:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f24bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350846336:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:2.0:1784938442.458754:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938442.458771:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938442.458785:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938442.458798:0:21151:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 8 min 3 max 116 00000100:00100000:2.0:1784938442.458804:0:21151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_008' 00000100:00100000:2.0:1784938442.458916:0:25716:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 8 min 3 max 116 00000100:00100000:2.0:1784938442.458922:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350846208 00000100:00100000:2.0:1784938442.458926:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350846208 00000100:00100000:2.0:1784938442.458945:0:25716:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 8 min 3 max 116 00000100:00100000:2.0:1784938442.458949:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350846080 00000100:00100000:2.0:1784938442.458951:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350846080 00000100:00100000:2.0:1784938442.458958:0:25716:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 8 min 3 max 116 00000100:00100000:2.0:1784938442.458961:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350846336 00000100:00100000:2.0:1784938442.458963:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350846336 00000100:00100000:1.0:1784938442.459257:0:25720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 615 00000100:00100000:1.0:1784938442.459266:0:25720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+20:16391:x1871643350843776:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00002000:00080000:1.0:1784938442.459282:0:25720:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:38 count 1 00010000:00010000:1.0:1784938442.459298:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f124848a/0x7b044d4128f9c2f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.459313:0:25720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b20eee20/0x7b044d4128f98b5d lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766303c expref: 92 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.459321:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x26:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1784938442.459325:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.459340:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f124848a/0x7b044d4128f9c2f4 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.459361:0:25720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b20eee20/0x7b044d4128f98b5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e94766303c expref: 92 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.459372:0:25720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b20eee20/0x7b044d4128f98b5d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766303c expref: 92 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.459382:0:25720:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f182d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:25720:1871643350846464:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938442.459444:0:25720:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828af6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938442.461120:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.461167:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.461236:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337427200 00000100:00100000:1.0:1784938442.461243:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337427200 00010000:00010000:1.0:1784938442.461276:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007634da25/0x7b044d4128f98d1d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766309e expref: 92 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.461305:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337427456 00000100:00100000:1.0:1784938442.461309:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337427456 00010000:00010000:1.0:1784938442.461322:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e0df92c2/0x7b044d4128f98f0e lrc: 6/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663226 expref: 93 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.461359:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 254 00000100:00100000:1.0:1784938442.461368:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f183480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+93:10960:x1871643337427200:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.461381:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.461386:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007634da25/0x7b044d4128f98d1d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766309e expref: 93 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.461398:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007634da25/0x7b044d4128f98d1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766309e expref: 93 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.461420:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007634da25/0x7b044d4128f98d1d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766309e expref: 93 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.461436:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.461439:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.461445:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002e0ac0a1/0x7b044d4128f9c2b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.461456:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e0ac0a1/0x7b044d4128f9c2b5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.461479:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938442.461516:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f183480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+92:10960:x1871643337427200:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 148us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.461523:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 254 00000100:00100000:1.0:1784938442.461543:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 255 00000100:00100000:1.0:1784938442.461549:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f182a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+91:10958:x1871643337427456:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.461557:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.461562:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e0df92c2/0x7b044d4128f98f0e lrc: 6/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663226 expref: 91 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.461572:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e0df92c2/0x7b044d4128f98f0e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663226 expref: 91 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.461584:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.461587:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.461592:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000964eb9b6/0x7b044d4128f9c2c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.461599:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000964eb9b6/0x7b044d4128f9c2c3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.461616:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938442.461632:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f182a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+91:10958:x1871643337427456:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 83us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.461637:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 255 00000100:00100000:1.0:1784938442.461678:0:21629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f182300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:21629:1871643350845696:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938442.461697:0:21629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000237a9c79/0x7b044d4128f9c2ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.461723:0:21149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f180700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:21149:1871643350845952:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938442.461733:0:21149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b257ac75/0x7b044d4128f9c2ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.461755:0:25715:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002e0ac0a1/0x7b044d4128f9c2b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.461764:0:25715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e0ac0a1/0x7b044d4128f9c2b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.461773:0:25715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e0ac0a1/0x7b044d4128f9c2b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.461781:0:25715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e0ac0a1/0x7b044d4128f9c2b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.461804:0:25715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938442.461977:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+20:16392:x1871643350841472:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 17795us (39052us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1784938442.461985:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 609 00000100:00100000:1.0:1784938442.462003:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 616 00000100:00100000:1.0:1784938442.462264:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+20:16391:x1871643350844672:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00002000:00080000:1.0:1784938442.462289:0:25715:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:31 count 1 00010000:00010000:1.0:1784938442.462310:0:25715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e77fc85/0x7b044d4128f9c2fb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.462324:0:25715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000001457c98/0x7b044d4128f98d2b lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766320a expref: 92 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.462343:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x1f:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1784938442.462346:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.462350:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e77fc85/0x7b044d4128f9c2fb lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.462376:0:25715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000001457c98/0x7b044d4128f98d2b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e94766320a expref: 92 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.462389:0:25715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000001457c98/0x7b044d4128f98d2b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766320a expref: 92 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.462407:0:25715:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f180700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25715:1871643350846592:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938442.462448:0:25715:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828af780 going to sleep for 11 seconds 00010000:00010000:1.0:1784938442.462463:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938442.462470:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e0ac0a1/0x7b044d4128f9c2b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.462478:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f20a200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938442.462483:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e0ac0a1/0x7b044d4128f9c2b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.462492:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e0ac0a1/0x7b044d4128f9c2b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.462504:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e0ac0a1/0x7b044d4128f9c2b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.462511:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e0ac0a1/0x7b044d4128f9c2b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.462528:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.462530:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.462531:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938442.470596:0:21152:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f248a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:21152:1871643350845824:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938442.470631:0:21152:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d379049d/0x7b044d4128f9c2d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.470675:0:25718:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25718:1871643350844288:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938442.470690:0:25718:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e420deed/0x7b044d4128f9c2bc lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938442.474559:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24b68d9f80/2, rc 0, transno 4294967412 00000100:00100000:0.0:1784938442.474596:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350841472:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:2.0:1784938442.475011:0:16390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784938442.475033:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350846720:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:3.0:1784938442.475057:0:25719:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238cd3fcc0 going to sleep for 11 seconds 00010000:00010000:3.0:1784938442.475093:0:25719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0df92c2/0x7b044d4128f98f0e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663226 expref: 90 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.475204:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938442.475452:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938442.475480:0:25716:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 9 min 3 max 116 00000100:00100000:2.0:1784938442.475489:0:25716:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_009' 00000100:00100000:1.0:1784938442.475665:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.475691:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.475712:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.475746:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.475798:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938442.476206:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350846720 00000100:00100000:2.0:1784938442.476214:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350846720 00000100:00100000:2.0:1784938442.476327:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 617 00000100:00100000:2.0:1784938442.476348:0:25721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+20:16391:x1871643350844800:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00002000:00080000:2.0:1784938442.476380:0:25721:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:13 count 1 00010000:00010000:2.0:1784938442.476411:0:25721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb1ec7ed/0x7b044d4128f9c302 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.476432:0:25721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000de589446/0x7b044d4128f98d55 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663218 expref: 92 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.476448:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xd:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1784938442.476452:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.476457:0:25721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb1ec7ed/0x7b044d4128f9c302 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.476491:0:25721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000de589446/0x7b044d4128f98d55 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663218 expref: 92 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.476504:0:25721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000de589446/0x7b044d4128f98d55 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663218 expref: 92 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.476519:0:25721:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f248000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:25721:1871643350846848:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938442.476575:0:25721:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248a7b1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938442.480061:0:25719:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd55d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:25719:1871643350845568:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938442.480113:0:25719:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000964eb9b6/0x7b044d4128f9c2c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.480139:0:25719:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000964eb9b6/0x7b044d4128f9c2c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.480220:0:25719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000964eb9b6/0x7b044d4128f9c2c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.480233:0:25719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000964eb9b6/0x7b044d4128f9c2c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.480242:0:25719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000964eb9b6/0x7b044d4128f9c2c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.480267:0:25719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938442.480426:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938442.480436:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000964eb9b6/0x7b044d4128f9c2c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.480453:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf0c00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938442.480458:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000964eb9b6/0x7b044d4128f9c2c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.480469:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000964eb9b6/0x7b044d4128f9c2c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.480496:0:25719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+21:16392:x1871643350843520:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 27749us (51747us total) trans 4294967413 rc 0/0 00010000:00010000:2.0:1784938442.480497:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000964eb9b6/0x7b044d4128f9c2c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.480512:0:25719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 611 00010000:00010000:2.0:1784938442.480512:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000964eb9b6/0x7b044d4128f9c2c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.480539:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938442.480542:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938442.480545:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938442.480555:0:25719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 618 00000100:00100000:3.0:1784938442.480568:0:25719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+20:16389:x1871643350844416:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00002000:00080000:3.0:1784938442.480606:0:25719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:39 count 1 00010000:00010000:3.0:1784938442.480631:0:25719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000089d1f6a/0x7b044d4128f9c309 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.480647:0:25719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cfc96367/0x7b044d4128f9884d lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947662f71 expref: 92 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.480656:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x27:0x0].0x0 since=13s v=(0 0) 00010000:00010000:3.0:1784938442.480661:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.480666:0:25719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000089d1f6a/0x7b044d4128f9c309 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.480701:0:25719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cfc96367/0x7b044d4128f9884d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947662f71 expref: 92 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.480721:0:25719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cfc96367/0x7b044d4128f9884d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947662f71 expref: 92 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.480738:0:25719:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd55d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:25719:1871643350846976:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938442.480789:0:25719:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238cd3fcc0 going to sleep for 11 seconds 00000004:00080000:0.0:1784938442.482208:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f22ed80/2, rc 0, transno 4294967413 00000100:00100000:0.0:1784938442.482245:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350843520:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:0.0:1784938442.482375:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938442.482393:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd55fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350847104:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:3.0:1784938442.482618:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938442.482714:0:25716:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 10 min 3 max 116 00000100:00100000:2.0:1784938442.482724:0:25716:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_010' 00000100:00100000:1.0:1784938442.482964:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337427712 00000100:00100000:1.0:1784938442.482972:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337427712 00000100:00100000:1.0:1784938442.482988:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337427840 00000100:00100000:1.0:1784938442.482991:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337427840 00010000:00010000:1.0:1784938442.483018:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000527ab402/0x7b044d4128f99455 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766328f expref: 91 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.483132:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337427584 00000100:00100000:0.0:1784938442.483137:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337427584 00000100:00100000:0.0:1784938442.483206:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 395 00000100:00100000:0.0:1784938442.483216:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+377:17096:x1871643337427584:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938442.483232:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938442.483253:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d000/0x7b044d4128f9c310 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663eb3 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.483317:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c600/0x7b044d4128f9c317 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.483343:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c600/0x7b044d4128f9c317 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.483355:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c600/0x7b044d4128f9c317 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.483370:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24cc00/0x7b044d4128f9c31e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x407c6222 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.483377:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24cc00/0x7b044d4128f9c31e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.483384:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24cc00/0x7b044d4128f9c31e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.483426:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c600/0x7b044d4128f9c317 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.483433:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c600/0x7b044d4128f9c317 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.483441:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c600/0x7b044d4128f9c317 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.483447:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24c600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938442.483452:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c600/0x7b044d4128f9c317 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.483459:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c600/0x7b044d4128f9c317 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.483471:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938442.483474:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.483478:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c600/0x7b044d4128f9c317 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.483484:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c600/0x7b044d4128f9c317 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.483497:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24cc00/0x7b044d4128f9c31e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.483502:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24cc00/0x7b044d4128f9c31e lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.483507:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24cc00/0x7b044d4128f9c31e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.483511:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24cc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938442.483513:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24cc00/0x7b044d4128f9c31e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.483522:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24cc00/0x7b044d4128f9c31e lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.483529:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x407c6222 (ffff9f248390aa00) 00010000:00010000:0.0:1784938442.483531:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.483534:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24cc00/0x7b044d4128f9c31e lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.483540:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24cc00/0x7b044d4128f9c31e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.483577:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d000/0x7b044d4128f9c310 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663eb3 expref: 378 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.483587:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938442.483590:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.483592:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d000/0x7b044d4128f9c310 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663eb3 expref: 378 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.483601:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24d000, rc 0) 00000100:00100000:0.0:1784938442.483646:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+377:17096:x1871643337427584:12345-192.168.202.54@tcp:101:cp.0 Request processed in 432us (7981us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938442.483653:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 395 00000100:00100000:0.0:1784938442.483676:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337427968 00000100:00100000:0.0:1784938442.483680:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337427968 00010000:00010000:0.0:1784938442.483695:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003a97217e/0x7b044d4128f99478 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663288 expref: 92 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.483715:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337427328 00000100:00100000:0.0:1784938442.483718:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337427328 00010000:00010000:0.0:1784938442.483730:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007f169e32/0x7b044d4128f98b1e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663027 expref: 93 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.483743:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 256 00000100:00100000:0.0:1784938442.483748:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f180e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+92:10960:x1871643337427968:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938442.483757:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938442.483761:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003a97217e/0x7b044d4128f99478 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663288 expref: 92 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.483770:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003a97217e/0x7b044d4128f99478 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663288 expref: 92 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.483784:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a97217e/0x7b044d4128f99478 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663288 expref: 92 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.483796:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.483800:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.483805:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b257ac75/0x7b044d4128f9c2ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.483814:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b257ac75/0x7b044d4128f9c2ed lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.483840:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938442.483858:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f180e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+91:10960:x1871643337427968:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 110us (8112us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.483865:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 256 00000100:00100000:0.0:1784938442.483878:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 257 00000100:00100000:0.0:1784938442.483885:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f181880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+93:10959:x1871643337427328:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938442.483892:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938442.483897:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007f169e32/0x7b044d4128f98b1e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663027 expref: 93 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.483908:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007f169e32/0x7b044d4128f98b1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663027 expref: 93 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.483921:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f169e32/0x7b044d4128f98b1e lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663027 expref: 93 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.483932:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.483934:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.483939:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e420deed/0x7b044d4128f9c2bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.483946:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e420deed/0x7b044d4128f9c2bc lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.483969:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938442.483987:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f181880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+92:10959:x1871643337427328:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 103us (8189us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.483994:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 257 00000100:00100000:0.0:1784938442.484138:0:25720:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f182d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:25720:1871643350846464:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938442.484181:0:25720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f124848a/0x7b044d4128f9c2f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.484201:0:25718:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e420deed/0x7b044d4128f9c2bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.484208:0:25718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e420deed/0x7b044d4128f9c2bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.484217:0:25718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e420deed/0x7b044d4128f9c2bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.484808:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 258 00000100:00100000:1.0:1784938442.484819:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2485cef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+90:10960:x1871643337427840:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.484829:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.484835:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000527ab402/0x7b044d4128f99455 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766328f expref: 90 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.484846:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000527ab402/0x7b044d4128f99455 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766328f expref: 90 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.484863:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000527ab402/0x7b044d4128f99455 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766328f expref: 90 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.484876:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.484879:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.484884:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d379049d/0x7b044d4128f9c2d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.484892:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d379049d/0x7b044d4128f9c2d1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.484926:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938442.484967:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2485cef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+89:10960:x1871643337427840:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 153us (9255us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.484974:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 258 00010000:00010000:1.0:1784938442.485003:0:21149:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b257ac75/0x7b044d4128f9c2ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.485012:0:21149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b257ac75/0x7b044d4128f9c2ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.485019:0:21149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b257ac75/0x7b044d4128f9c2ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.485216:0:21149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b257ac75/0x7b044d4128f9c2ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.485240:0:21149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938442.485399:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+21:16392:x1871643350845184:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 27622us (34168us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1784938442.485407:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 614 00000100:00100000:1.0:1784938442.485426:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350847104 00000100:00100000:1.0:1784938442.485432:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350847104 00000100:00100000:1.0:1784938442.485459:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 619 00000100:00100000:1.0:1784938442.485467:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+20:16389:x1871643350844544:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00002000:00080000:1.0:1784938442.485490:0:21149:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:3 count 1 00010000:00010000:1.0:1784938442.485509:0:21149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3e5ca1f/0x7b044d4128f9c325 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.485521:0:21149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000de3acb31/0x7b044d4128f98d24 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476630a5 expref: 91 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.485528:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1784938442.485531:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.485535:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3e5ca1f/0x7b044d4128f9c325 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.485562:0:21149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000de3acb31/0x7b044d4128f98d24 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476630a5 expref: 91 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.485574:0:21149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000de3acb31/0x7b044d4128f98d24 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476630a5 expref: 91 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.485588:0:21149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:21149:1871643350847232:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938442.485638:0:21149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828afe40 going to sleep for 11 seconds 00010000:00010000:1.0:1784938442.485810:0:21152:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d379049d/0x7b044d4128f9c2d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.485819:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d379049d/0x7b044d4128f9c2d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.485827:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d379049d/0x7b044d4128f9c2d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.485835:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d379049d/0x7b044d4128f9c2d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.485850:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1784938442.485925:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+22:16392:x1871643350845312:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 29003us (34735us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1784938442.485931:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 613 00000100:00100000:1.0:1784938442.485948:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 620 00000100:00100000:1.0:1784938442.485956:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+21:16390:x1871643350845056:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:1.0:1784938442.485968:0:21152:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:7 count 1 00010000:00010000:1.0:1784938442.485979:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040dba49b/0x7b044d4128f9c32c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.485990:0:21152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f99463 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663281 expref: 88 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.485997:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1784938442.486000:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.486003:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040dba49b/0x7b044d4128f9c32c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.486023:0:21152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f99463 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663281 expref: 88 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.486177:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938442.486184:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b257ac75/0x7b044d4128f9c2ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.486193:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f20ba00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938442.486197:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b257ac75/0x7b044d4128f9c2ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.486207:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b257ac75/0x7b044d4128f9c2ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.486222:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b257ac75/0x7b044d4128f9c2ed lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.486228:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b257ac75/0x7b044d4128f9c2ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.486244:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938442.486247:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d379049d/0x7b044d4128f9c2d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.486253:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245c00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938442.486256:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d379049d/0x7b044d4128f9c2d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.486262:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d379049d/0x7b044d4128f9c2d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.486271:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d379049d/0x7b044d4128f9c2d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.486277:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d379049d/0x7b044d4128f9c2d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.486290:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938442.486291:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938442.486293:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938442.486368:0:25718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e420deed/0x7b044d4128f9c2bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938442.486482:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f243b80/2, rc 0, transno 4294967414 00000100:00100000:0.0:1784938442.486506:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f243b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350845184:192.168.202.154@tcp:6:osp-syn-0-1.0 00000004:00080000:0.0:1784938442.486518:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f241180/2, rc 0, transno 4294967415 00000100:00100000:0.0:1784938442.486522:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350845312:192.168.202.154@tcp:6:osp-syn-0-1.0 00010000:00010000:0.0:1784938442.486540:0:25718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784938442.486637:0:25718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+21:16392:x1871643350842496:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 42424us (63699us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1784938442.486645:0:25718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 610 00000004:00080000:0.0:1784938442.486735:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f22e300/2, rc 0, transno 4294967413 00000100:00100000:0.0:1784938442.486745:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350842496:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:0.0:1784938442.486762:0:25718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 621 00000100:00100000:0.0:1784938442.486770:0:25718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381361050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+21:16390:x1871643350845440:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:0.0:1784938442.486785:0:25718:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:12 count 1 00010000:00010000:0.0:1784938442.486798:0:25718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c333 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.486810:0:25718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000061bd733a/0x7b044d4128f9944e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663296 expref: 88 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.486817:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1784938442.486820:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.486824:0:25718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c333 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.486846:0:25718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000061bd733a/0x7b044d4128f9944e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663296 expref: 88 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.486856:0:25718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000061bd733a/0x7b044d4128f9944e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663296 expref: 88 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.486873:0:25718:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2489ae5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25718:1871643350847488:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938442.486931:0:25718:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2488eeccc0 going to sleep for 11 seconds 00010000:00010000:2.0:1784938442.487320:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938442.487327:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e420deed/0x7b044d4128f9c2bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.487345:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24de00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938442.487349:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e420deed/0x7b044d4128f9c2bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.487358:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e420deed/0x7b044d4128f9c2bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.487372:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e420deed/0x7b044d4128f9c2bc lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.487379:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e420deed/0x7b044d4128f9c2bc lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.487404:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938442.487406:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938442.487408:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938442.487519:0:16390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784938442.487532:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f248a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350847872:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:2.0:1784938442.487580:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f24ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350847744:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:2.0:1784938442.487606:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784938442.487612:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f24b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350847616:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:0.0:1784938442.487799:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938442.487868:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00010000:00010000:1.0:1784938442.487941:0:21152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f99463 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663281 expref: 88 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.487952:0:21152:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f182d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:21152:1871643350847360:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938442.487992:0:21152:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828af900 going to sleep for 11 seconds 00010000:00010000:1.0:1784938442.488004:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.488071:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000002f45a6a/0x7b044d4128f98f15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766322d expref: 88 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.488110:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 259 00000100:00100000:1.0:1784938442.488118:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f183100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+88:10957:x1871643337427712:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.488130:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.488134:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000002f45a6a/0x7b044d4128f98f15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766322d expref: 88 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.488163:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000002f45a6a/0x7b044d4128f98f15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766322d expref: 88 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.488181:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002f45a6a/0x7b044d4128f98f15 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766322d expref: 88 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.488193:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.488197:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.488202:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000237a9c79/0x7b044d4128f9c2ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.488212:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000237a9c79/0x7b044d4128f9c2ca lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.488235:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938442.488260:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f183100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+87:10957:x1871643337427712:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 143us (12567us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.488267:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 259 00010000:00010000:1.0:1784938442.488325:0:21629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000237a9c79/0x7b044d4128f9c2ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.488348:0:21629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000237a9c79/0x7b044d4128f9c2ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.488357:0:21629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000237a9c79/0x7b044d4128f9c2ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.488364:0:21629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000237a9c79/0x7b044d4128f9c2ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.488378:0:21629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938442.488496:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f240380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+22:16390:x1871643350844928:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 32102us (38277us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1784938442.488503:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 612 00000100:00100000:0.0:1784938442.489730:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938442.489756:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350847872 00000100:00100000:1.0:1784938442.489764:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350847872 00000100:00100000:1.0:1784938442.489787:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350847744 00000100:00100000:1.0:1784938442.489789:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350847744 00000100:00100000:1.0:1784938442.489802:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 622 00000100:00100000:1.0:1784938442.489809:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f249180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+20:16392:x1871643350846208:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00002000:00080000:1.0:1784938442.489833:0:21629:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:4 count 1 00010000:00010000:1.0:1784938442.489854:0:21629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027576e9e/0x7b044d4128f9c33a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.489869:0:21629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b9262d3d/0x7b044d4128f98f00 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663234 expref: 91 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.489878:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1784938442.489881:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.489885:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027576e9e/0x7b044d4128f9c33a lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.489921:0:21629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b9262d3d/0x7b044d4128f98f00 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663234 expref: 91 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.489932:0:21629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b9262d3d/0x7b044d4128f98f00 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663234 expref: 91 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.489945:0:21629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f181500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:21629:1871643350848000:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938442.489993:0:21629:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828af180 going to sleep for 11 seconds 00010000:00010000:1.0:1784938442.490009:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938442.490015:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000237a9c79/0x7b044d4128f9c2ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.490037:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f20a600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938442.490042:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000237a9c79/0x7b044d4128f9c2ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.490052:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000237a9c79/0x7b044d4128f9c2ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.490069:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000237a9c79/0x7b044d4128f9c2ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.490076:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000237a9c79/0x7b044d4128f9c2ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.490093:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.490095:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.490096:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938442.494275:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.494303:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.494394:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.494418:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337428096 00000100:00100000:1.0:1784938442.494427:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337428096 00010000:00010000:1.0:1784938442.494467:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b20eee20/0x7b044d4128f98b5d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766303c expref: 92 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.494498:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337428224 00000100:00100000:1.0:1784938442.494501:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337428224 00010000:00010000:1.0:1784938442.494513:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000001457c98/0x7b044d4128f98d2b lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766320a expref: 93 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.494522:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337428352 00000100:00100000:1.0:1784938442.494525:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337428352 00010000:00010000:1.0:1784938442.494536:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000de589446/0x7b044d4128f98d55 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663218 expref: 94 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.494549:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 260 00000100:00100000:1.0:1784938442.494557:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f180380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+94:10957:x1871643337428096:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.494573:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.494578:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b20eee20/0x7b044d4128f98b5d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766303c expref: 94 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.494590:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b20eee20/0x7b044d4128f98b5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766303c expref: 94 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.494615:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b20eee20/0x7b044d4128f98b5d lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766303c expref: 94 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.494633:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.494638:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.494643:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f124848a/0x7b044d4128f9c2f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.494652:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f124848a/0x7b044d4128f9c2f4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.494681:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938442.494735:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f180380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+93:10957:x1871643337428096:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 177us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.494741:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 260 00000100:00100000:1.0:1784938442.494758:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 261 00000100:00100000:1.0:1784938442.494763:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f180a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+92:10958:x1871643337428224:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.494770:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.494774:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000001457c98/0x7b044d4128f98d2b lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766320a expref: 92 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.494783:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000001457c98/0x7b044d4128f98d2b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766320a expref: 92 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.494793:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.494795:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.494799:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002e77fc85/0x7b044d4128f9c2fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.494806:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e77fc85/0x7b044d4128f9c2fb lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.494816:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938442.494831:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f180a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+92:10958:x1871643337428224:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 67us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.494839:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 261 00000100:00100000:1.0:1784938442.494849:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 262 00000100:00100000:1.0:1784938442.494853:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f183480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+91:10960:x1871643337428352:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.494859:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.494863:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000de589446/0x7b044d4128f98d55 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663218 expref: 91 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.494872:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000de589446/0x7b044d4128f98d55 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663218 expref: 91 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.494881:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.494884:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.494888:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb1ec7ed/0x7b044d4128f9c302 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.494895:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb1ec7ed/0x7b044d4128f9c302 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.494904:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938442.494918:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f183480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+91:10960:x1871643337428352:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 64us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.494923:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 262 00010000:00010000:1.0:1784938442.499012:0:25720:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f124848a/0x7b044d4128f9c2f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.499050:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f124848a/0x7b044d4128f9c2f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.499063:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f124848a/0x7b044d4128f9c2f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.499071:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f124848a/0x7b044d4128f9c2f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.499110:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938442.499344:0:25720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+21:16391:x1871643350843776:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 40063us (48044us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1784938442.499354:0:25720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 615 00000100:00100000:1.0:1784938442.499525:0:25720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 623 00000100:00100000:1.0:1784938442.499537:0:25720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f248e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+23:16390:x1871643350846080:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:1.0:1784938442.499566:0:25720:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:9 count 1 00010000:00010000:1.0:1784938442.499589:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e3a956d/0x7b044d4128f9c341 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.499607:0:25720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3ec11b4/0x7b044d4128f9945c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476632ab expref: 86 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.499615:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1784938442.499620:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.499624:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e3a956d/0x7b044d4128f9c341 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.499660:0:25720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c3ec11b4/0x7b044d4128f9945c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632ab expref: 86 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.499673:0:25720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c3ec11b4/0x7b044d4128f9945c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632ab expref: 86 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.499687:0:25720:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f182a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:25720:1871643350848128:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938442.499766:0:25720:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828af480 going to sleep for 11 seconds 00010000:00010000:3.0:1784938442.500732:0:25715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001457c98/0x7b044d4128f98d2b lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766320a expref: 90 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.500751:0:25715:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f180700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25715:1871643350846592:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938442.500771:0:25715:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002e77fc85/0x7b044d4128f9c2fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.500781:0:25715:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002e77fc85/0x7b044d4128f9c2fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.500788:0:25715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e77fc85/0x7b044d4128f9c2fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.500798:0:25715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e77fc85/0x7b044d4128f9c2fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.500806:0:25715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e77fc85/0x7b044d4128f9c2fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.500823:0:25715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1784938442.501294:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+21:16391:x1871643350844672:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 39013us (49727us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1784938442.501306:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 616 00000100:00100000:3.0:1784938442.501348:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 624 00000100:00100000:3.0:1784938442.501359:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f24a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+20:16392:x1871643350846336:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00002000:00080000:3.0:1784938442.501385:0:25715:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:28 count 1 00010000:00010000:3.0:1784938442.501408:0:25715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082ab8fc0/0x7b044d4128f9c348 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.501423:0:25715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000008b05b7f/0x7b044d4128f99440 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663273 expref: 89 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.501430:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x1c:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1784938442.501434:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.501439:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082ab8fc0/0x7b044d4128f9c348 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.501471:0:25715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000008b05b7f/0x7b044d4128f99440 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663273 expref: 89 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.501483:0:25715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000008b05b7f/0x7b044d4128f99440 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663273 expref: 89 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.501502:0:25715:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386362d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25715:1871643350848256:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938442.501547:0:25715:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2484c73240 going to sleep for 11 seconds 00000004:00080000:3.0:1784938442.502529:0:16390:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f22f100/2, rc 0, transno 4294967416 00000100:00100000:3.0:1784938442.502547:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350844928:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:3.0:1784938442.502665:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 625 00000100:00100000:3.0:1784938442.502674:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f248700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+23:16390:x1871643350846720:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:3.0:1784938442.502692:0:25722:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:17 count 1 00010000:00010000:3.0:1784938442.502709:0:25722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c34f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.502724:0:25722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000681ee7bc/0x7b044d4128f994a9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476632ff expref: 86 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.502732:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1784938442.502736:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.502740:0:25722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c34f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.502762:0:25722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000681ee7bc/0x7b044d4128f994a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632ff expref: 86 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.502773:0:25722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000681ee7bc/0x7b044d4128f994a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632ff expref: 86 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.502791:0:25722:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386362680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25722:1871643350848384:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938442.502829:0:25722:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2484c73540 going to sleep for 11 seconds 00010000:00010000:1.0:1784938442.502944:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784938442.502953:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f124848a/0x7b044d4128f9c2f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.502961:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f20aa00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938442.502966:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f124848a/0x7b044d4128f9c2f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.502976:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f124848a/0x7b044d4128f9c2f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.502993:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f124848a/0x7b044d4128f9c2f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.503001:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f124848a/0x7b044d4128f9c2f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.503015:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938442.503019:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e77fc85/0x7b044d4128f9c2fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.503025:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f20ac00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938442.503028:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e77fc85/0x7b044d4128f9c2fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.503035:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e77fc85/0x7b044d4128f9c2fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.503044:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e77fc85/0x7b044d4128f9c2fb lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.503051:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e77fc85/0x7b044d4128f9c2fb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.503062:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.503064:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.503066:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938442.503404:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.503423:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.503439:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.503455:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.503469:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.503486:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.503516:0:21149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:21149:1871643350847232:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938442.503532:0:21149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f3e5ca1f/0x7b044d4128f9c325 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.503553:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337428480 00000100:00100000:1.0:1784938442.503559:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337428480 00010000:00010000:1.0:1784938442.503583:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cfc96367/0x7b044d4128f9884d lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947662f71 expref: 90 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.503601:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337428864 00000100:00100000:1.0:1784938442.503603:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337428864 00010000:00010000:1.0:1784938442.503614:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f99463 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663281 expref: 87 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.503623:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337428608 00000100:00100000:1.0:1784938442.503625:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337428608 00010000:00010000:1.0:1784938442.503634:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000de3acb31/0x7b044d4128f98d24 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476630a5 expref: 91 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.503643:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337428736 00000100:00100000:1.0:1784938442.503645:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337428736 00010000:00010000:1.0:1784938442.503655:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000061bd733a/0x7b044d4128f9944e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663296 expref: 88 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.503667:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337428992 00000100:00100000:1.0:1784938442.503669:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337428992 00010000:00010000:1.0:1784938442.503678:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b9262d3d/0x7b044d4128f98f00 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663234 expref: 92 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.503696:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 263 00000100:00100000:1.0:1784938442.503702:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f183100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+92:10960:x1871643337428480:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.503711:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.503716:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cfc96367/0x7b044d4128f9884d lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947662f71 expref: 92 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.503727:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cfc96367/0x7b044d4128f9884d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947662f71 expref: 92 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.503743:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.503746:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.503751:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000089d1f6a/0x7b044d4128f9c309 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.503760:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000089d1f6a/0x7b044d4128f9c309 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.503772:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938442.503799:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f183100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+92:10960:x1871643337428480:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 96us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.503805:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 263 00000100:00100000:1.0:1784938442.503819:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 264 00000100:00100000:1.0:1784938442.503824:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2485cedc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+88:10960:x1871643337428864:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.503833:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.503837:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f99463 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663281 expref: 88 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.503846:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f99463 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663281 expref: 88 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.503858:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.503861:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.503864:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000040dba49b/0x7b044d4128f9c32c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.503871:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040dba49b/0x7b044d4128f9c32c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.503881:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938442.503897:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2485cedc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+88:10960:x1871643337428864:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 73us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.503903:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 264 00000100:00100000:1.0:1784938442.503938:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 265 00000100:00100000:1.0:1784938442.503945:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f180700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+91:10957:x1871643337428608:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.503952:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.503956:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000de3acb31/0x7b044d4128f98d24 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476630a5 expref: 91 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.503970:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000de3acb31/0x7b044d4128f98d24 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476630a5 expref: 91 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.503982:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de3acb31/0x7b044d4128f98d24 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476630a5 expref: 91 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.503992:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.503995:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.503999:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3e5ca1f/0x7b044d4128f9c325 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.504007:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3e5ca1f/0x7b044d4128f9c325 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.504022:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938442.504039:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f180700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+90:10957:x1871643337428608:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 95us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.504046:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 265 00000100:00100000:1.0:1784938442.504059:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 266 00000100:00100000:1.0:1784938442.504065:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+87:10957:x1871643337428736:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.504071:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.504076:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000061bd733a/0x7b044d4128f9944e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663296 expref: 87 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.504092:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000061bd733a/0x7b044d4128f9944e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663296 expref: 87 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.504105:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.504107:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.504112:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c333 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.504120:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c333 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.504131:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938442.504172:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+87:10957:x1871643337428736:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 107us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.504178:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 266 00000100:00100000:1.0:1784938442.504192:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 267 00000100:00100000:1.0:1784938442.504199:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+89:10960:x1871643337428992:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.504206:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.504210:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b9262d3d/0x7b044d4128f98f00 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663234 expref: 89 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.504219:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b9262d3d/0x7b044d4128f98f00 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663234 expref: 89 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.504234:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.504238:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.504241:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000027576e9e/0x7b044d4128f9c33a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.504249:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027576e9e/0x7b044d4128f9c33a lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.504259:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938442.504276:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+89:10960:x1871643337428992:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 78us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.504282:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 267 00010000:00010000:1.0:1784938442.504318:0:21629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9262d3d/0x7b044d4128f98f00 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663234 expref: 88 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.504342:0:21629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f181500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:21629:1871643350848000:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938442.504353:0:21629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000027576e9e/0x7b044d4128f9c33a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.504363:0:21629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000027576e9e/0x7b044d4128f9c33a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.504370:0:21629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027576e9e/0x7b044d4128f9c33a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.504386:0:21629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027576e9e/0x7b044d4128f9c33a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.504394:0:21629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027576e9e/0x7b044d4128f9c33a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.504410:0:21629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938442.504544:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f249180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+21:16392:x1871643350846208:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 14734us (45789us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1784938442.504551:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 622 00000100:00100000:1.0:1784938442.504570:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 626 00000100:00100000:1.0:1784938442.504577:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+23:16389:x1871643350847104:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:1.0:1784938442.504595:0:21629:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:8 count 1 00010000:00010000:1.0:1784938442.504611:0:21629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000705d1dae/0x7b044d4128f9c356 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.504624:0:21629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000083e77be6/0x7b044d4128f994da lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663329 expref: 86 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.504631:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1784938442.504635:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.504639:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000705d1dae/0x7b044d4128f9c356 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.504663:0:21629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000083e77be6/0x7b044d4128f994da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663329 expref: 86 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.504676:0:21629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000083e77be6/0x7b044d4128f994da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663329 expref: 86 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.504688:0:21629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:21629:1871643350848512:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938442.504729:0:21629:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828af0c0 going to sleep for 11 seconds 00010000:00010000:1.0:1784938442.504742:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938442.504747:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027576e9e/0x7b044d4128f9c33a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.504755:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f20bc00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938442.504759:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027576e9e/0x7b044d4128f9c33a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.504767:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027576e9e/0x7b044d4128f9c33a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.504778:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027576e9e/0x7b044d4128f9c33a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.504786:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027576e9e/0x7b044d4128f9c33a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.504801:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.504803:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.504805:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.504814:0:21149:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f3e5ca1f/0x7b044d4128f9c325 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.504822:0:21149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3e5ca1f/0x7b044d4128f9c325 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.504831:0:21149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3e5ca1f/0x7b044d4128f9c325 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.504838:0:21149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3e5ca1f/0x7b044d4128f9c325 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.504851:0:21149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938442.504923:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+21:16389:x1871643350844544:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 19456us (53596us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1784938442.504930:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 619 00000100:00100000:1.0:1784938442.504945:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 627 00000100:00100000:1.0:1784938442.504953:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f199880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+23:16390:x1871643350847872:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:1.0:1784938442.504967:0:21149:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:15 count 1 00010000:00010000:1.0:1784938442.504978:0:21149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0df92c2/0x7b044d4128f9c35d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.504990:0:21149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006b04cfea/0x7b044d4128f9950b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766333e expref: 86 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.504997:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1784938442.505001:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.505004:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0df92c2/0x7b044d4128f9c35d lrc: 4/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.505031:0:21149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006b04cfea/0x7b044d4128f9950b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e94766333e expref: 86 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.505041:0:21149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006b04cfea/0x7b044d4128f9950b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766333e expref: 86 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.505051:0:21149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f181500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:21149:1871643350848640:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938442.505074:0:21149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828afc00 going to sleep for 11 seconds 00010000:00010000:1.0:1784938442.505085:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938442.505089:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3e5ca1f/0x7b044d4128f9c325 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.505096:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f20b600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938442.505100:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3e5ca1f/0x7b044d4128f9c325 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.505108:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3e5ca1f/0x7b044d4128f9c325 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.505119:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3e5ca1f/0x7b044d4128f9c325 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.505126:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3e5ca1f/0x7b044d4128f9c325 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.505140:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.505173:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.505175:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.505418:0:21152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f99463 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663281 expref: 86 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.505430:0:21152:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f182d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:21152:1871643350847360:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938442.505446:0:21152:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000040dba49b/0x7b044d4128f9c32c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.505455:0:21152:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000040dba49b/0x7b044d4128f9c32c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.505464:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040dba49b/0x7b044d4128f9c32c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.505472:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040dba49b/0x7b044d4128f9c32c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.505479:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040dba49b/0x7b044d4128f9c32c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.505494:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938442.505593:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+24:16390:x1871643350845056:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 19635us (54241us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1784938442.505603:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 620 00000100:00100000:1.0:1784938442.505620:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 628 00000100:00100000:1.0:1784938442.505627:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f19a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+23:16392:x1871643350847744:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:1.0:1784938442.505641:0:21152:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:32 count 1 00010000:00010000:1.0:1784938442.505653:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a1e393b/0x7b044d4128f9c364 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.505664:0:21152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010729705/0x7b044d4128f994e8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663337 expref: 85 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.505672:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1784938442.505675:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.505679:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a1e393b/0x7b044d4128f9c364 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.505699:0:21152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000010729705/0x7b044d4128f994e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663337 expref: 85 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.505709:0:21152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000010729705/0x7b044d4128f994e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663337 expref: 85 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.505720:0:21152:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f182d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:21152:1871643350848768:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938442.505751:0:21152:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828af180 going to sleep for 11 seconds 00010000:00010000:1.0:1784938442.505763:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938442.505767:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040dba49b/0x7b044d4128f9c32c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.505775:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f20a400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938442.505778:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040dba49b/0x7b044d4128f9c32c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.505787:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040dba49b/0x7b044d4128f9c32c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.505799:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040dba49b/0x7b044d4128f9c32c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.505806:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040dba49b/0x7b044d4128f9c32c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.505820:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.505822:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.505823:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784938442.506682:0:16390:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f241500/2, rc 0, transno 4294967417 00000100:00100000:3.0:1784938442.506694:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f241500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350845056:192.168.202.154@tcp:6:osp-syn-0-1.0 00010000:00010000:3.0:1784938442.506721:0:25719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfc96367/0x7b044d4128f9884d lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947662f71 expref: 87 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.506735:0:25719:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd55d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:25719:1871643350846976:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938442.506752:0:25719:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000089d1f6a/0x7b044d4128f9c309 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.506761:0:25719:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000089d1f6a/0x7b044d4128f9c309 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.506769:0:25719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000089d1f6a/0x7b044d4128f9c309 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.506778:0:25719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000089d1f6a/0x7b044d4128f9c309 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.506786:0:25719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000089d1f6a/0x7b044d4128f9c309 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.506806:0:25719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784938442.506937:0:25719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+21:16389:x1871643350844416:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 26373us (55619us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1784938442.506947:0:25719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 618 00010000:00010000:2.0:1784938442.508482:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938442.508495:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000089d1f6a/0x7b044d4128f9c309 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.508506:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf0a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938442.508512:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000089d1f6a/0x7b044d4128f9c309 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.508523:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000089d1f6a/0x7b044d4128f9c309 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.508543:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000089d1f6a/0x7b044d4128f9c309 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.508550:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000089d1f6a/0x7b044d4128f9c309 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.508569:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938442.508571:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938442.508573:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938442.508612:0:25721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de589446/0x7b044d4128f98d55 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663218 expref: 86 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.508622:0:25721:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f248000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:25721:1871643350846848:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938442.508644:0:25721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eb1ec7ed/0x7b044d4128f9c302 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.508653:0:25721:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eb1ec7ed/0x7b044d4128f9c302 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.508660:0:25721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb1ec7ed/0x7b044d4128f9c302 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.508674:0:25721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb1ec7ed/0x7b044d4128f9c302 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.508681:0:25721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb1ec7ed/0x7b044d4128f9c302 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.508701:0:25721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784938442.508839:0:25721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+21:16391:x1871643350844800:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 32493us (57532us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1784938442.508848:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 617 00000100:00100000:2.0:1784938442.508883:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337429248 00000100:00100000:2.0:1784938442.508890:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337429248 00000100:00100000:2.0:1784938442.508934:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 396 00000100:00100000:2.0:1784938442.508943:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+377:17096:x1871643337429248:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938442.508960:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938442.508978:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244a00/0x7b044d4128f9c36b lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663eba expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.509068:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244600/0x7b044d4128f9c372 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.509082:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244600/0x7b044d4128f9c372 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.509092:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244600/0x7b044d4128f9c372 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.509110:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244c00/0x7b044d4128f9c379 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x407c6222 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.509115:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244c00/0x7b044d4128f9c379 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.509118:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244c00/0x7b044d4128f9c379 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938442.509421:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x59:0x0], index 1: 0 00010000:00010000:2.0:1784938442.509546:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244000/0x7b044d4128f9c380 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.509555:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244000/0x7b044d4128f9c380 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.509563:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244000/0x7b044d4128f9c380 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.509600:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244600/0x7b044d4128f9c372 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.509607:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244600/0x7b044d4128f9c372 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.509612:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244600/0x7b044d4128f9c372 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.509618:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244600/0x7b044d4128f9c372 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.509624:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f244600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938442.509628:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244600/0x7b044d4128f9c372 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.509634:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244600/0x7b044d4128f9c372 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.509643:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938442.509646:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.509650:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244600/0x7b044d4128f9c372 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.509656:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244600/0x7b044d4128f9c372 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938442.509666:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eac74234 reply state 000000009cca995d transno 8589934795 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244c00/0x7b044d4128f9c379 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.509675:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244c00/0x7b044d4128f9c379 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.509681:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x407c6222 (ffff9f238d49e800) 00010000:00010000:2.0:1784938442.509683:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938442.509686:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938442.509712:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244a00/0x7b044d4128f9c36b lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663eba expref: 380 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.509724:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244000/0x7b044d4128f9c380 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663eba expref: 379 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.509731:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x32:0x0].0x0 (ffff9f238d49e700) 00010000:00010000:2.0:1784938442.509733:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938442.509736:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f244000, rc 0) 00000004:00080000:0.0:1784938442.510509:0:16391:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f1b7b80/2, rc 0, transno 4294967415 00000100:00100000:0.0:1784938442.510528:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350844672:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:0.0:1784938442.510980:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350847616 00000100:00100000:0.0:1784938442.510989:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350847616 00000100:00100000:0.0:1784938442.511034:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 629 00000100:00100000:0.0:1784938442.511042:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f198700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+21:16392:x1871643350847616:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00002000:00080000:0.0:1784938442.511069:0:25716:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:22 count 1 00010000:00010000:0.0:1784938442.511090:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003329ae01/0x7b044d4128f9c38e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.511105:0:25716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001a59b7f1/0x7b044d4128f99447 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766327a expref: 85 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.511113:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x16:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1784938442.511117:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.511122:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003329ae01/0x7b044d4128f9c38e lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.511172:0:25716:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001a59b7f1/0x7b044d4128f99447 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e94766327a expref: 85 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.511185:0:25716:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001a59b7f1/0x7b044d4128f99447 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766327a expref: 85 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.511200:0:25716:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f198000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25716:1871643350848896:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938442.511369:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938442.511377:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb1ec7ed/0x7b044d4128f9c302 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.511385:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245e00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938442.511389:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb1ec7ed/0x7b044d4128f9c302 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.511399:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb1ec7ed/0x7b044d4128f9c302 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.511417:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb1ec7ed/0x7b044d4128f9c302 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.511425:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb1ec7ed/0x7b044d4128f9c302 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.511447:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.511449:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.511451:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938442.512388:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+380:17096:x1871643337429248:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3438us (8891us total) trans 8589934795 rc 0/0 00000100:00100000:2.0:1784938442.512455:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 396 00000100:00100000:0.0:1784938442.512459:0:25716:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2488eec780 going to sleep for 11 seconds 00010000:00010000:0.0:1784938442.512506:0:25718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061bd733a/0x7b044d4128f9944e lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663296 expref: 85 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.512520:0:25718:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2489ae5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25718:1871643350847488:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938442.512543:0:25718:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c333 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.512554:0:25718:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c333 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.512562:0:25718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c333 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.512568:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f248000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350849024:192.168.202.154@tcp:6:osp-syn-1-1.0 00010000:00010000:0.0:1784938442.512572:0:25718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c333 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.512579:0:25718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c333 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.512599:0:25718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938442.512615:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938442.512619:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c333 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.512627:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24d800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938442.512630:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c333 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.512638:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c333 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.512652:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c333 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.512659:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c333 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.512673:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938442.512674:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938442.512676:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938442.512733:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f24aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350849152:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:0.0:1784938442.512738:0:25718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381361050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+24:16390:x1871643350845440:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 25968us (61372us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1784938442.512765:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938442.512770:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f248380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350849280:192.168.202.154@tcp:6:osp-syn-0-1.0 00010000:00010000:2.0:1784938442.512801:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938442.513090:0:25718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 621 00000100:00100000:2.0:1784938442.513272:0:25720:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f182a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:25720:1871643350848128:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938442.513287:0:25720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002e3a956d/0x7b044d4128f9c341 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938442.513322:0:16391:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f22f800/2, rc 0, transno 4294967414 00000100:00100000:2.0:1784938442.513343:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350843776:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:2.0:1784938442.513394:0:16390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784938442.513404:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350849408:192.168.202.154@tcp:6:osp-syn-1-1.0 00000004:00080000:2.0:1784938442.513448:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f24a680/2, rc 0, transno 4294967416 00000100:00100000:2.0:1784938442.513456:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f24a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350846208:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:1.0:1784938442.513468:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938442.513487:0:25721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350849152 00000100:00100000:2.0:1784938442.513492:0:25721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350849152 00000100:00100000:2.0:1784938442.513526:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 630 00000100:00100000:2.0:1784938442.513533:0:25721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+24:16391:x1871643350849152:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:2.0:1784938442.513555:0:25721:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:18 count 1 00010000:00010000:2.0:1784938442.513577:0:25721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000533c7a69/0x7b044d4128f9c395 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.513594:0:25721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000753d2ec8/0x7b044d4128f9952e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663345 expref: 84 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.513596:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00010000:00010000:2.0:1784938442.513608:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784938442.513612:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.513616:0:25721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000533c7a69/0x7b044d4128f9c395 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.513640:0:25721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000753d2ec8/0x7b044d4128f9952e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663345 expref: 84 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.513653:0:25721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000753d2ec8/0x7b044d4128f9952e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663345 expref: 84 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.513665:0:25721:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f24b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:25721:1871643350849664:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938442.513677:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938442.513695:0:25721:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d077b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938442.513708:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f249c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350849536:192.168.202.154@tcp:6:osp-syn-1-1.0 00000004:00080000:0.0:1784938442.513720:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f1b6300/2, rc 0, transno 4294967417 00000100:00100000:0.0:1784938442.513730:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350844544:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:0.0:1784938442.513760:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938442.513767:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f19ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350849792:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:1.0:1784938442.513834:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000004:00080000:2.0:1784938442.514107:0:16390:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f243800/2, rc 0, transno 4294967418 00000004:00080000:0.0:1784938442.514108:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f1b4e00/2, rc 0, transno 4294967418 00000100:00100000:2.0:1784938442.514117:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350845440:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:0.0:1784938442.514117:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350844416:192.168.202.154@tcp:6:osp-syn-1-1.0 00000004:00080000:2.0:1784938442.514138:0:16391:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f2489ae4000/2, rc 0, transno 4294967419 00000100:00100000:2.0:1784938442.514142:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2489ae4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350844800:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:2.0:1784938442.514163:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938442.514170:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f19b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350849920:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:0.0:1784938442.514191:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f19b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350850048:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:0.0:1784938442.514215:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938442.514221:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f249880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350850176:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:2.0:1784938442.514228:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350849408 00000100:00100000:2.0:1784938442.514232:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350849408 00000100:00100000:2.0:1784938442.514249:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350849280 00000100:00100000:0.0:1784938442.514249:0:25718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350849024 00000100:00100000:2.0:1784938442.514252:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350849280 00000100:00100000:0.0:1784938442.514252:0:25718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350849024 00000100:00100000:2.0:1784938442.514264:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 631 00000100:00100000:2.0:1784938442.514270:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+23:16390:x1871643350849408:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00002000:00080000:2.0:1784938442.514283:0:21151:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:37 count 1 00000100:00100000:0.0:1784938442.514288:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:2.0:1784938442.514297:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cd96e79/0x7b044d4128f9c39c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.514310:0:21151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad501493/0x7b044d4128f994cc lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476632f1 expref: 85 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.514318:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x25:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784938442.514321:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.514325:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cd96e79/0x7b044d4128f9c39c lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.514364:0:21151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ad501493/0x7b044d4128f994cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632f1 expref: 85 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.514375:0:21151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ad501493/0x7b044d4128f994cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632f1 expref: 85 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.514386:0:21151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f24b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:21151:1871643350850304:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938442.514386:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337429376 00000100:00100000:1.0:1784938442.514390:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337429376 00010000:00010000:1.0:1784938442.514415:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c3ec11b4/0x7b044d4128f9945c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632ab expref: 85 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.514420:0:21151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d077180 going to sleep for 11 seconds 00000100:00100000:1.0:1784938442.514441:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 268 00000100:00100000:1.0:1784938442.514448:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f198a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+85:10957:x1871643337429376:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.514464:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.514469:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c3ec11b4/0x7b044d4128f9945c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632ab expref: 85 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.514482:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c3ec11b4/0x7b044d4128f9945c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632ab expref: 85 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.514502:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3ec11b4/0x7b044d4128f9945c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632ab expref: 85 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.514516:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.514519:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.514525:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002e3a956d/0x7b044d4128f9c341 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.514534:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e3a956d/0x7b044d4128f9c341 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.514561:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938442.514583:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f198a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+84:10957:x1871643337429376:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 136us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.514589:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 268 00000100:00100000:1.0:1784938442.514667:0:25722:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386362680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25722:1871643350848384:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938442.514683:0:25722:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c34f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.514730:0:25715:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386362d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25715:1871643350848256:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938442.514742:0:25715:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000082ab8fc0/0x7b044d4128f9c348 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.514845:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938442.514862:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938442.514872:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938442.514882:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938442.514892:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938442.514903:0:25718:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 11 min 3 max 116 00000100:00100000:0.0:1784938442.514910:0:25718:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_011' 00010000:00010000:2.0:1784938442.515257:0:25720:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002e3a956d/0x7b044d4128f9c341 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.515272:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e3a956d/0x7b044d4128f9c341 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.515294:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e3a956d/0x7b044d4128f9c341 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.515302:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e3a956d/0x7b044d4128f9c341 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.515361:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938442.515409:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1784938442.515413:0:25719:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 11 min 3 max 116 00010000:00010000:0.0:1784938442.515416:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e3a956d/0x7b044d4128f9c341 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.515422:0:25719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350849536 00010000:00010000:0.0:1784938442.515425:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f20b400 already unused, calling callback (ffffffffc0d954a0) 00000100:00100000:3.0:1784938442.515427:0:25719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350849536 00010000:00010000:0.0:1784938442.515430:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e3a956d/0x7b044d4128f9c341 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.515439:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e3a956d/0x7b044d4128f9c341 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.515446:0:25719:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 11 min 3 max 116 00000100:00100000:3.0:1784938442.515451:0:25719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350849792 00000100:00100000:3.0:1784938442.515453:0:25719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350849792 00010000:00010000:0.0:1784938442.515454:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e3a956d/0x7b044d4128f9c341 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.515462:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e3a956d/0x7b044d4128f9c341 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.515481:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938442.515483:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938442.515484:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938442.515505:0:25719:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 11 min 3 max 116 00000100:00100000:3.0:1784938442.515511:0:25719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350849920 00000100:00100000:3.0:1784938442.515515:0:25719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350849920 00000100:00100000:3.0:1784938442.515527:0:25719:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 11 min 3 max 116 00000100:00100000:1.0:1784938442.515528:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.515530:0:25719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350850048 00000100:00100000:3.0:1784938442.515532:0:25719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350850048 00000100:00100000:3.0:1784938442.515541:0:25719:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 11 min 3 max 116 00000100:00100000:3.0:1784938442.515545:0:25719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350850176 00000100:00100000:3.0:1784938442.515547:0:25719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350850176 00000100:00100000:1.0:1784938442.515556:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.515580:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.515621:0:21629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:21629:1871643350848512:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938442.515636:0:21629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000705d1dae/0x7b044d4128f9c356 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.515656:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337429632 00000100:00100000:1.0:1784938442.515658:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337429632 00010000:00010000:1.0:1784938442.515674:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000083e77be6/0x7b044d4128f994da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663329 expref: 84 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.515697:0:25720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f248e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+27:16390:x1871643350846080:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 16164us (56924us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1784938442.515698:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337429504 00000100:00100000:1.0:1784938442.515700:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337429504 00000100:00100000:2.0:1784938442.515705:0:25720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 623 00010000:00010000:1.0:1784938442.515712:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000681ee7bc/0x7b044d4128f994a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632ff expref: 85 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.515722:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337429760 00000100:00100000:2.0:1784938442.515723:0:25720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 632 00000100:00100000:1.0:1784938442.515724:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337429760 00000100:00100000:2.0:1784938442.515729:0:25720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+26:16391:x1871643350849280:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00010000:00010000:1.0:1784938442.515734:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000008b05b7f/0x7b044d4128f99440 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663273 expref: 86 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.515745:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 269 00002000:00080000:2.0:1784938442.515746:0:25720:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:33 count 1 00000100:00100000:1.0:1784938442.515750:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f183480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+85:10960:x1871643337429632:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.515757:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.515761:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000083e77be6/0x7b044d4128f994da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663329 expref: 85 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.515762:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006adbddea/0x7b044d4128f9c3a3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.515772:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000083e77be6/0x7b044d4128f994da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663329 expref: 85 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.515775:0:25720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000023799176/0x7b044d4128f99535 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766334c expref: 85 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.515782:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1784938442.515785:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083e77be6/0x7b044d4128f994da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663329 expref: 85 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.515786:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.515791:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006adbddea/0x7b044d4128f9c3a3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.515796:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.515799:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.515804:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000705d1dae/0x7b044d4128f9c356 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.515812:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000705d1dae/0x7b044d4128f9c356 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.515813:0:25720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000023799176/0x7b044d4128f99535 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e94766334c expref: 84 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.515825:0:25720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000023799176/0x7b044d4128f99535 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766334c expref: 84 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.515828:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938442.515836:0:25720:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:25720:1871643350850432:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938442.515849:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f183480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+84:10960:x1871643337429632:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 99us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.515856:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 269 00000100:00100000:1.0:1784938442.515869:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 270 00000100:00100000:2.0:1784938442.515871:0:25720:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d077cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938442.515874:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f183100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+83:10958:x1871643337429504:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.515881:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.515885:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000681ee7bc/0x7b044d4128f994a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632ff expref: 83 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.515895:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000681ee7bc/0x7b044d4128f994a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632ff expref: 83 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.515908:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000681ee7bc/0x7b044d4128f994a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632ff expref: 83 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.515923:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.515926:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1784938442.515928:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 271 00010000:00010000:1.0:1784938442.515930:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c34f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.515936:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2488a65c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+86:10960:x1871643337429760:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.515937:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c34f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.515944:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938442.515948:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000008b05b7f/0x7b044d4128f99440 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663273 expref: 86 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.515958:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000008b05b7f/0x7b044d4128f99440 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663273 expref: 86 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.515962:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938442.515977:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008b05b7f/0x7b044d4128f99440 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663273 expref: 86 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.515979:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f183100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+82:10958:x1871643337429504:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 105us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.515985:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 270 00010000:00010000:3.0:1784938442.515988:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.515991:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.515995:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000082ab8fc0/0x7b044d4128f9c348 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.516002:0:21629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000705d1dae/0x7b044d4128f9c356 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.516003:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082ab8fc0/0x7b044d4128f9c348 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.516010:0:21629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000705d1dae/0x7b044d4128f9c356 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.516018:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938442.516018:0:21629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000705d1dae/0x7b044d4128f9c356 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.516026:0:21629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000705d1dae/0x7b044d4128f9c356 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.516037:0:21629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784938442.516045:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2488a65c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+85:10960:x1871643337429760:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 111us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938442.516051:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 271 00000100:00100000:1.0:1784938442.516102:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+27:16389:x1871643350847104:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 11525us (33485us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1784938442.516109:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 626 00010000:00010000:2.0:1784938442.516118:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938442.516123:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000705d1dae/0x7b044d4128f9c356 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.516126:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 633 00010000:00010000:2.0:1784938442.516132:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f7200 already unused, calling callback (ffffffffc0d954a0) 00000100:00100000:1.0:1784938442.516134:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+27:16390:x1871643350849024:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00010000:00010000:2.0:1784938442.516135:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000705d1dae/0x7b044d4128f9c356 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.516169:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000705d1dae/0x7b044d4128f9c356 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.516181:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000705d1dae/0x7b044d4128f9c356 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.516188:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000705d1dae/0x7b044d4128f9c356 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.516200:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1784938442.516201:0:21629:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:17 count 1 00010000:00010000:2.0:1784938442.516202:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938442.516204:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938442.516212:0:25722:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c34f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.516213:0:21629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec965129/0x7b044d4128f9c3aa lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.516221:0:25722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c34f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.516225:0:21629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000095b82f9b/0x7b044d4128f9946a lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766329d expref: 84 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.516230:0:25722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c34f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.516232:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x11:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1784938442.516235:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.516237:0:25722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c34f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.516239:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec965129/0x7b044d4128f9c3aa lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.516255:0:25722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938442.516258:0:21629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000095b82f9b/0x7b044d4128f9946a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e94766329d expref: 84 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.516266:0:21629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000095b82f9b/0x7b044d4128f9946a lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766329d expref: 84 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.516276:0:21629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:21629:1871643350850560:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938442.516304:0:21629:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828af900 going to sleep for 11 seconds 00000100:00100000:2.0:1784938442.516321:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f248700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+27:16390:x1871643350846720:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 13648us (40871us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1784938442.516328:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 625 00000100:00100000:2.0:1784938442.516356:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 634 00000100:00100000:2.0:1784938442.516363:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f199c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+27:16390:x1871643350849536:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00002000:00080000:2.0:1784938442.516375:0:25722:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:21 count 1 00010000:00010000:2.0:1784938442.516387:0:25722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012221821/0x7b044d4128f9c3b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.516402:0:25722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000995490d1/0x7b044d4128f994d3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766330d expref: 84 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.516408:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x15:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784938442.516412:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.516415:0:25722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012221821/0x7b044d4128f9c3b1 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.516434:0:25722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000995490d1/0x7b044d4128f994d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e94766330d expref: 84 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.516443:0:25722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000995490d1/0x7b044d4128f994d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766330d expref: 84 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.516452:0:25722:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25722:1871643350850688:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938442.516507:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938442.516510:0:25715:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000082ab8fc0/0x7b044d4128f9c348 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.516512:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c34f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.516520:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938442.516524:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c34f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.516525:0:25715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082ab8fc0/0x7b044d4128f9c348 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.516532:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c34f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.516535:0:25715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082ab8fc0/0x7b044d4128f9c348 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.516544:0:25715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082ab8fc0/0x7b044d4128f9c348 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.516549:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c34f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.516555:0:25715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938442.516556:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c34f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.516569:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938442.516572:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082ab8fc0/0x7b044d4128f9c348 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.516577:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938442.516580:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082ab8fc0/0x7b044d4128f9c348 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.516587:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082ab8fc0/0x7b044d4128f9c348 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.516596:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082ab8fc0/0x7b044d4128f9c348 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.516603:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082ab8fc0/0x7b044d4128f9c348 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.516613:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938442.516615:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938442.516617:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784938442.516663:0:16390:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f249f80/2, rc 0, transno 4294967419 00000100:00100000:2.0:1784938442.516681:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f249f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350846080:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:2.0:1784938442.516701:0:25722:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248fb1cf00 going to sleep for 11 seconds 00000004:00080000:2.0:1784938442.516715:0:16390:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f182300/2, rc 0, transno 4294967421 00000100:00100000:2.0:1784938442.516720:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350846720:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:0.0:1784938442.516842:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f24a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+28:16392:x1871643350846336:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 15485us (58054us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1784938442.516847:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386361c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350850816:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:0.0:1784938442.516850:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 624 00000100:00100000:0.0:1784938442.516867:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 635 00000100:00100000:0.0:1784938442.516874:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+27:16392:x1871643350849792:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:2.0:1784938442.516878:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938442.516884:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386363800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350850944:192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:0.0:1784938442.516886:0:25715:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:16 count 1 00010000:00010000:0.0:1784938442.516898:0:25715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a065435d/0x7b044d4128f9c3b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.516910:0:25715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000072795495/0x7b044d4128f994b0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766331b expref: 84 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.516918:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x10:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1784938442.516921:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.516924:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a065435d/0x7b044d4128f9c3b8 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.516943:0:25715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000072795495/0x7b044d4128f994b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e94766331b expref: 84 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.516952:0:25715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000072795495/0x7b044d4128f994b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766331b expref: 84 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.516962:0:25715:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd5a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25715:1871643350851072:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938442.517024:0:25715:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2488eeccc0 going to sleep for 11 seconds 00010000:00010000:0.0:1784938442.517043:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784938442.517069:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24bd55fb80/2, rc 0, transno 4294967420 00000100:00100000:0.0:1784938442.517080:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd55fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350847104:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:1.0:1784938442.517257:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938442.517281:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938442.517294:0:16390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784938442.517306:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386363b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350851200:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:3.0:1784938442.517320:0:25719:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 11 min 3 max 116 00000100:00100000:3.0:1784938442.517339:0:25719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350850816 00000100:00100000:3.0:1784938442.517344:0:25719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350850816 00000004:00080000:0.0:1784938442.517362:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f24bb80/2, rc 0, transno 4294967420 00000100:00100000:3.0:1784938442.517368:0:25719:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 11 min 3 max 116 00000100:00100000:3.0:1784938442.517375:0:25719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350850944 00000100:00100000:3.0:1784938442.517378:0:25719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350850944 00000100:00100000:0.0:1784938442.517379:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f24bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350846336:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:3.0:1784938442.517457:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd5a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350851328:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:1.0:1784938442.517485:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938442.517517:0:25718:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 11 min 3 max 116 00000100:00100000:0.0:1784938442.517524:0:25718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350851200 00000100:00100000:0.0:1784938442.517528:0:25718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350851200 00000100:00100000:1.0:1784938442.517535:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938442.517542:0:25718:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 11 min 3 max 116 00000100:00100000:0.0:1784938442.517548:0:25718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350851328 00000100:00100000:0.0:1784938442.517550:0:25718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350851328 00000100:00100000:2.0:1784938442.517652:0:25723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 636 00000100:00100000:2.0:1784938442.517658:0:25723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+28:16391:x1871643350849920:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00002000:00080000:2.0:1784938442.517669:0:25723:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:34 count 1 00010000:00010000:2.0:1784938442.517680:0:25723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9c3bf lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.517691:0:25723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000034778f5e/0x7b044d4128f9949b lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663322 expref: 84 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.517699:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x22:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784938442.517702:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.517705:0:25723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9c3bf lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.517724:0:25723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000034778f5e/0x7b044d4128f9949b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663322 expref: 84 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.517734:0:25723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000034778f5e/0x7b044d4128f9949b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663322 expref: 84 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.517744:0:25723:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:25723:1871643350851456:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938442.517785:0:25723:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248fb1c480 going to sleep for 11 seconds 00000100:00100000:1.0:1784938442.529685:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.529723:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.529752:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337430016 00000100:00100000:1.0:1784938442.529763:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337430016 00010000:00010000:1.0:1784938442.529805:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006b04cfea/0x7b044d4128f9950b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766333e expref: 82 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.529844:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 272 00000100:00100000:1.0:1784938442.529855:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f183800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+82:10958:x1871643337430016:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.529871:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.529876:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006b04cfea/0x7b044d4128f9950b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766333e expref: 82 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.529890:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006b04cfea/0x7b044d4128f9950b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766333e expref: 82 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.529918:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.529922:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.529928:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e0df92c2/0x7b044d4128f9c35d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.529938:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0df92c2/0x7b044d4128f9c35d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.529938:0:25718:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 12 min 3 max 116 00000100:00100000:0.0:1784938442.529948:0:25718:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_012' 00010000:00010000:1.0:1784938442.529962:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938442.530016:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f183800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+82:10958:x1871643337430016:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 162us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.530036:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 272 00000100:00100000:1.0:1784938442.530077:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.530254:0:25716:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f198000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25716:1871643350848896:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938442.530278:0:25716:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003329ae01/0x7b044d4128f9c38e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.530365:0:21629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:21629:1871643350850560:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938442.530377:0:21629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ec965129/0x7b044d4128f9c3aa lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.530383:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.530407:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337430144 00000100:00100000:1.0:1784938442.530410:0:25715:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd5a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25715:1871643350851072:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938442.530410:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337430144 00010000:00010000:1.0:1784938442.530422:0:25715:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a065435d/0x7b044d4128f9c3b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.530428:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000010729705/0x7b044d4128f994e8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663337 expref: 82 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.530439:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337430656 00000100:00100000:1.0:1784938442.530441:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337430656 00000100:00100000:1.0:1784938442.530453:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 273 00000100:00100000:1.0:1784938442.530464:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f181180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+83:10960:x1871643337430144:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.530474:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.530479:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000010729705/0x7b044d4128f994e8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663337 expref: 83 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.530491:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000010729705/0x7b044d4128f994e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663337 expref: 83 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.530505:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.530509:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.530513:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001a1e393b/0x7b044d4128f9c364 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.530522:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a1e393b/0x7b044d4128f9c364 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.530534:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938442.530561:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f181180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+83:10960:x1871643337430144:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 102us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.530568:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 273 00010000:00010000:1.0:1784938442.530596:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000023799176/0x7b044d4128f99535 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766334c expref: 82 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.530619:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 274 00000100:00100000:1.0:1784938442.530626:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f182680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+82:10959:x1871643337430656:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.530633:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.530638:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000023799176/0x7b044d4128f99535 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766334c expref: 82 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.530648:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000023799176/0x7b044d4128f99535 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766334c expref: 82 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.530661:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.530664:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.530667:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006adbddea/0x7b044d4128f9c3a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.530675:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006adbddea/0x7b044d4128f9c3a3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.530683:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938442.530705:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f182680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+82:10959:x1871643337430656:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 79us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.530710:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 274 00000100:00100000:1.0:1784938442.530745:0:25722:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25722:1871643350850688:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938442.530759:0:25722:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000012221821/0x7b044d4128f9c3b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.531504:0:25721:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f24b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:25721:1871643350849664:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938442.531523:0:25721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000533c7a69/0x7b044d4128f9c395 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.531554:0:21149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b04cfea/0x7b044d4128f9950b lrc: 0/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766333e expref: 81 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.531569:0:21149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f181500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:21149:1871643350848640:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938442.531585:0:21149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e0df92c2/0x7b044d4128f9c35d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.531593:0:21149:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e0df92c2/0x7b044d4128f9c35d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.531600:0:21149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0df92c2/0x7b044d4128f9c35d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.531611:0:21149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0df92c2/0x7b044d4128f9c35d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.531614:0:21152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010729705/0x7b044d4128f994e8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663337 expref: 80 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.531628:0:21149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0df92c2/0x7b044d4128f9c35d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.531633:0:21152:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f182d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:21152:1871643350848768:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938442.531650:0:21152:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001a1e393b/0x7b044d4128f9c364 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.531658:0:21152:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001a1e393b/0x7b044d4128f9c364 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.531662:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a1e393b/0x7b044d4128f9c364 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.531667:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a1e393b/0x7b044d4128f9c364 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.531671:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a1e393b/0x7b044d4128f9c364 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.531716:0:21149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1784938442.531866:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f199880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+30:16390:x1871643350847872:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 26913us (44068us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1784938442.531877:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 627 00000100:00100000:2.0:1784938442.531894:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337429888 00000100:00100000:2.0:1784938442.531912:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337429888 00000100:00100000:2.0:1784938442.531938:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 637 00000100:00100000:2.0:1784938442.531945:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+28:16389:x1871643350850048:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00002000:00080000:2.0:1784938442.531969:0:21149:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:7 count 1 00010000:00010000:2.0:1784938442.531990:0:21149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9c3c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.532003:0:21149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000087008cea/0x7b044d4128f99504 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663330 expref: 85 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.532010:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784938442.532014:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.532018:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9c3c6 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.532059:0:21149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000087008cea/0x7b044d4128f99504 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663330 expref: 85 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.532076:0:21149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000087008cea/0x7b044d4128f99504 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663330 expref: 85 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.532089:0:21149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68d8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:21149:1871643350851584:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938442.532171:0:21149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248fb1c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938442.532202:0:21151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f24b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:21151:1871643350850304:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938442.532214:0:21151:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006cd96e79/0x7b044d4128f9c39c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.532238:0:25720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023799176/0x7b044d4128f99535 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766334c expref: 79 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.532248:0:25720:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:25720:1871643350850432:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938442.532258:0:25720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006adbddea/0x7b044d4128f9c3a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.532266:0:25720:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006adbddea/0x7b044d4128f9c3a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.532273:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006adbddea/0x7b044d4128f9c3a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.532281:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006adbddea/0x7b044d4128f9c3a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.532287:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006adbddea/0x7b044d4128f9c3a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.532389:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.532487:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:3.0:1784938442.532501:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1784938442.532584:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.532606:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f19a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+30:16392:x1871643350847744:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 26976us (44734us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1784938442.532615:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.532621:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 628 00000100:00100000:3.0:1784938442.532645:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 638 00000100:00100000:3.0:1784938442.532655:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+29:16389:x1871643350850176:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:3.0:1784938442.532672:0:21152:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:29 count 1 00000100:00100000:0.0:1784938442.532679:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:3.0:1784938442.532691:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082ab8fc0/0x7b044d4128f9c3cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.532706:0:21152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006a6a8420/0x7b044d4128f99543 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663353 expref: 78 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.532714:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1784938442.532718:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1784938442.532723:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:3.0:1784938442.532727:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082ab8fc0/0x7b044d4128f9c3cd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.532754:0:21152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006a6a8420/0x7b044d4128f99543 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663353 expref: 78 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.532766:0:21152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006a6a8420/0x7b044d4128f99543 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663353 expref: 78 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.532780:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.532792:0:21152:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386362a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:21152:1871643350851712:192.168.202.54@tcp:104: 00000004:00080000:0.0:1784938442.532819:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f24ad80/2, rc 0, transno 4294967423 00000100:00100000:0.0:1784938442.532835:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f24ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350847744:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:3.0:1784938442.532840:0:21152:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2484c73600 going to sleep for 11 seconds 00010000:00010000:3.0:1784938442.532859:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784938442.532865:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0df92c2/0x7b044d4128f9c35d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.532875:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f6c00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938442.532880:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0df92c2/0x7b044d4128f9c35d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.532891:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0df92c2/0x7b044d4128f9c35d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.532907:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337430272 00000100:00100000:0.0:1784938442.532912:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337430272 00010000:00010000:3.0:1784938442.532913:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0df92c2/0x7b044d4128f9c35d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.532922:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0df92c2/0x7b044d4128f9c35d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.532935:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001a59b7f1/0x7b044d4128f99447 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766327a expref: 86 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.532941:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938442.532948:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a1e393b/0x7b044d4128f9c364 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.532955:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337430784 00010000:00010000:3.0:1784938442.532956:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057c00 already unused, calling callback (ffffffffc0d954a0) 00000100:00100000:0.0:1784938442.532959:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337430784 00010000:00010000:3.0:1784938442.532962:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a1e393b/0x7b044d4128f9c364 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.532973:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a1e393b/0x7b044d4128f9c364 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.532974:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000095b82f9b/0x7b044d4128f9946a lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766329d expref: 87 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.532998:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a1e393b/0x7b044d4128f9c364 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.532999:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337430528 00000100:00100000:0.0:1784938442.533002:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337430528 00010000:00010000:3.0:1784938442.533012:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a1e393b/0x7b044d4128f9c364 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.533015:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ad501493/0x7b044d4128f994cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632f1 expref: 88 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.533030:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337431040 00000100:00100000:0.0:1784938442.533033:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337431040 00010000:00010000:0.0:1784938442.533044:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000072795495/0x7b044d4128f994b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766331b expref: 89 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.533055:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337430400 00000100:00100000:0.0:1784938442.533057:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337430400 00010000:00010000:0.0:1784938442.533091:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000753d2ec8/0x7b044d4128f9952e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663345 expref: 79 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.533103:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1784938442.533107:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337430912 00010000:00010000:3.0:1784938442.533110:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006adbddea/0x7b044d4128f9c3a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.533111:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337430912 00010000:00010000:3.0:1784938442.533121:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938442.533125:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000995490d1/0x7b044d4128f994d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766330d expref: 90 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.533137:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337431168 00000100:00100000:0.0:1784938442.533140:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337431168 00010000:00010000:0.0:1784938442.533168:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000034778f5e/0x7b044d4128f9949b lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663322 expref: 91 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.533178:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 275 00000100:00100000:0.0:1784938442.533182:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+91:10960:x1871643337430272:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938442.533192:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938442.533195:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001a59b7f1/0x7b044d4128f99447 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766327a expref: 91 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.533203:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001a59b7f1/0x7b044d4128f99447 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766327a expref: 91 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.533216:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a59b7f1/0x7b044d4128f99447 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766327a expref: 91 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.533224:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.533226:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.533230:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003329ae01/0x7b044d4128f9c38e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.533235:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003329ae01/0x7b044d4128f9c38e lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.533250:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938442.533266:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+90:10960:x1871643337430272:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 84us (888us total) trans 0 rc 0/0 00010000:00010000:3.0:1784938442.533272:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006adbddea/0x7b044d4128f9c3a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.533272:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 275 00010000:00010000:3.0:1784938442.533284:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006adbddea/0x7b044d4128f9c3a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.533285:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 276 00000100:00100000:0.0:1784938442.533293:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+89:10960:x1871643337430784:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938442.533303:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938442.533305:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006adbddea/0x7b044d4128f9c3a3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.533307:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000095b82f9b/0x7b044d4128f9946a lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766329d expref: 89 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.533327:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000095b82f9b/0x7b044d4128f9946a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766329d expref: 89 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.533338:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938442.533342:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938442.533345:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938442.533356:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095b82f9b/0x7b044d4128f9946a lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766329d expref: 89 pid: 21629 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.533369:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x11:0x0].0x0 since=0s v=(0 0) 00000004:00080000:3.0:1784938442.533375:0:16390:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f248a80/2, rc 0, transno 4294967422 00010000:00010000:0.0:1784938442.533376:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.533385:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec965129/0x7b044d4128f9c3aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.533392:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f248a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350847872:192.168.202.154@tcp:6:osp-syn-0-1.0 00010000:00010000:0.0:1784938442.533395:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec965129/0x7b044d4128f9c3aa lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.533422:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938442.533442:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+88:10960:x1871643337430784:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 149us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.533449:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 276 00000100:00100000:0.0:1784938442.533463:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 277 00000100:00100000:0.0:1784938442.533469:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+87:10958:x1871643337430528:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938442.533477:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938442.533482:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ad501493/0x7b044d4128f994cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632f1 expref: 87 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.533490:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ad501493/0x7b044d4128f994cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632f1 expref: 87 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.533503:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad501493/0x7b044d4128f994cc lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632f1 expref: 87 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.533512:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.533515:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.533518:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006cd96e79/0x7b044d4128f9c39c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.533525:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cd96e79/0x7b044d4128f9c39c lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.533546:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938442.533565:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+86:10958:x1871643337430528:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 96us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.533572:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 277 00010000:00010000:3.0:1784938442.533574:0:21151:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006cd96e79/0x7b044d4128f9c39c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.533585:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cd96e79/0x7b044d4128f9c39c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.533594:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 278 00010000:00010000:3.0:1784938442.533595:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cd96e79/0x7b044d4128f9c39c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.533603:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2488a67450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+85:10958:x1871643337431040:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.533608:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938442.533610:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cd96e79/0x7b044d4128f9c39c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.533614:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1784938442.533622:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 279 00010000:00010000:0.0:1784938442.533622:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000072795495/0x7b044d4128f994b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766331b expref: 85 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.533632:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+79:10957:x1871643337430400:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938442.533633:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938442.533640:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000072795495/0x7b044d4128f994b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766331b expref: 85 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.533641:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.533646:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000753d2ec8/0x7b044d4128f9952e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663345 expref: 79 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.533653:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072795495/0x7b044d4128f994b0 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766331b expref: 85 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.533656:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000753d2ec8/0x7b044d4128f9952e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663345 expref: 79 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.533663:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.533666:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.533668:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000753d2ec8/0x7b044d4128f9952e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663345 expref: 79 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.533670:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a065435d/0x7b044d4128f9c3b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.533680:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a065435d/0x7b044d4128f9c3b8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.533684:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.533687:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.533691:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000533c7a69/0x7b044d4128f9c395 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.533698:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938442.533699:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000533c7a69/0x7b044d4128f9c395 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.533717:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938442.533718:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2488a67450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+84:10958:x1871643337431040:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 117us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.533724:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 278 00000100:00100000:1.0:1784938442.533734:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+78:10957:x1871643337430400:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 106us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.533740:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 279 00000100:00100000:3.0:1784938442.533757:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+29:16390:x1871643350849408:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 19482us (20156us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1784938442.533757:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 280 00000100:00100000:1.0:1784938442.533767:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f243480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+83:10957:x1871643337430912:12345-192.168.202.54@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1784938442.533767:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 281 00000100:00100000:3.0:1784938442.533774:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 631 00000100:00100000:0.0:1784938442.533775:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f242680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+83:10959:x1871643337431168:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.533777:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.533782:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000995490d1/0x7b044d4128f994d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766330d expref: 83 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.533784:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938442.533789:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000034778f5e/0x7b044d4128f9949b lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663322 expref: 83 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.533792:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000995490d1/0x7b044d4128f994d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766330d expref: 83 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.533805:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 639 00010000:00010000:1.0:1784938442.533807:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000995490d1/0x7b044d4128f994d3 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766330d expref: 83 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.533807:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000034778f5e/0x7b044d4128f9949b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663322 expref: 83 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.533820:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+29:16391:x1871643350850816:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00010000:00010000:0.0:1784938442.533820:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.533827:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.533829:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.533832:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.533833:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9c3bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.533836:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000012221821/0x7b044d4128f9c3b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1784938442.533842:0:21151:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:16 count 1 00010000:00010000:0.0:1784938442.533842:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9c3bf lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.533845:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012221821/0x7b044d4128f9c3b1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.533858:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938442.533864:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c3d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.533865:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938442.533878:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f242680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+82:10959:x1871643337431168:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 103us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.533879:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f243480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+82:10957:x1871643337430912:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 113us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.533891:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 281 00010000:00010000:3.0:1784938442.533899:0:21151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008f2d18e0/0x7b044d4128f99558 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663361 expref: 77 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.533908:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1784938442.533912:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.533917:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c3d4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.533934:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784938442.533940:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f241c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350851968:192.168.202.154@tcp:6:osp-syn-0-1.0 00010000:00010000:2.0:1784938442.533941:0:25720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006adbddea/0x7b044d4128f9c3a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.533944:0:21151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008f2d18e0/0x7b044d4128f99558 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663361 expref: 77 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.533974:0:21151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008f2d18e0/0x7b044d4128f99558 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663361 expref: 77 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.533976:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938442.533986:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350851840:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:3.0:1784938442.533992:0:21151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386360700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:21151:1871643350852096:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938442.533994:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938442.534001:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cd96e79/0x7b044d4128f9c39c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.534009:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938442.534013:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cd96e79/0x7b044d4128f9c39c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.534020:0:25716:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003329ae01/0x7b044d4128f9c38e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.534021:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cd96e79/0x7b044d4128f9c39c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.534028:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003329ae01/0x7b044d4128f9c38e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.534043:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003329ae01/0x7b044d4128f9c38e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.534045:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cd96e79/0x7b044d4128f9c39c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.534052:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003329ae01/0x7b044d4128f9c38e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.534053:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cd96e79/0x7b044d4128f9c39c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.534065:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938442.534065:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938442.534068:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003329ae01/0x7b044d4128f9c38e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.534074:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24c800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938442.534077:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003329ae01/0x7b044d4128f9c38e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.534088:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003329ae01/0x7b044d4128f9c38e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.534098:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003329ae01/0x7b044d4128f9c38e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.534105:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003329ae01/0x7b044d4128f9c38e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.534107:0:21151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2484c73a80 going to sleep for 11 seconds 00010000:00010000:2.0:1784938442.534123:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938442.534125:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938442.534127:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938442.534133:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f198700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+29:16392:x1871643350847616:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 23091us (44406us total) trans 4294967422 rc 0/0 00010000:00010000:2.0:1784938442.534137:0:25721:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000533c7a69/0x7b044d4128f9c395 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.534139:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 629 00010000:00010000:2.0:1784938442.534160:0:25721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000533c7a69/0x7b044d4128f9c395 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.534168:0:25721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000533c7a69/0x7b044d4128f9c395 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.534172:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 640 00010000:00010000:2.0:1784938442.534176:0:25721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000533c7a69/0x7b044d4128f9c395 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.534180:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+29:16391:x1871643350850944:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00010000:00010000:2.0:1784938442.534190:0:25721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1784938442.534195:0:25716:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:23 count 1 00010000:00010000:0.0:1784938442.534207:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4def6fc/0x7b044d4128f9c3db lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.534219:0:25716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9acc545/0x7b044d4128f99566 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663368 expref: 77 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.534225:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1784938442.534228:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.534232:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4def6fc/0x7b044d4128f9c3db lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.534254:0:25716:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d9acc545/0x7b044d4128f99566 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663368 expref: 77 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.534264:0:25716:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d9acc545/0x7b044d4128f99566 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663368 expref: 77 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.534273:0:25716:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f241880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25716:1871643350852224:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938442.534362:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 280 00010000:00010000:1.0:1784938442.534480:0:25715:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a065435d/0x7b044d4128f9c3b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.534489:0:25715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a065435d/0x7b044d4128f9c3b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.534497:0:25715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a065435d/0x7b044d4128f9c3b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.534505:0:25715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a065435d/0x7b044d4128f9c3b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.534514:0:25715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1784938442.534607:0:25721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+30:16391:x1871643350849152:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 21073us (21138us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1784938442.534615:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 630 00000100:00100000:2.0:1784938442.534633:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 641 00000100:00100000:2.0:1784938442.534641:0:25721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+29:16390:x1871643350851200:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:2.0:1784938442.534654:0:25721:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:36 count 1 00010000:00010000:2.0:1784938442.534667:0:25721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c3e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.534679:0:25721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000e8ea1de/0x7b044d4128f9954a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766336f expref: 77 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.534686:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784938442.534689:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.534693:0:25721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c3e2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.534713:0:25721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000e8ea1de/0x7b044d4128f9954a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e94766336f expref: 77 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.534722:0:25721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000e8ea1de/0x7b044d4128f9954a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766336f expref: 77 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.534733:0:25721:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:25721:1871643350852352:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938442.534760:0:25721:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248fb1c900 going to sleep for 11 seconds 00010000:00010000:2.0:1784938442.534771:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938442.534776:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000533c7a69/0x7b044d4128f9c395 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.534783:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938442.534787:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000533c7a69/0x7b044d4128f9c395 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.534795:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000533c7a69/0x7b044d4128f9c395 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.534807:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000533c7a69/0x7b044d4128f9c395 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.534815:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000533c7a69/0x7b044d4128f9c395 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.534830:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938442.534833:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a065435d/0x7b044d4128f9c3b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.534840:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24d000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938442.534843:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a065435d/0x7b044d4128f9c3b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.534848:0:25716:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2488eeccc0 going to sleep for 11 seconds 00010000:00010000:2.0:1784938442.534850:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a065435d/0x7b044d4128f9c3b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.534861:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938442.534865:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a065435d/0x7b044d4128f9c3b8 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.534872:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a065435d/0x7b044d4128f9c3b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.534872:0:21629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ec965129/0x7b044d4128f9c3aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.534881:0:21629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec965129/0x7b044d4128f9c3aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.534887:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938442.534889:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938442.534889:0:21629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec965129/0x7b044d4128f9c3aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.534891:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938442.534908:0:21629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec965129/0x7b044d4128f9c3aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.534918:0:25723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034778f5e/0x7b044d4128f9949b lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663322 expref: 80 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.534922:0:21629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784938442.534927:0:25723:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:25723:1871643350851456:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938442.534946:0:25723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9c3bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.534955:0:25723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9c3bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.534962:0:25723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9c3bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.534970:0:25723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9c3bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.534983:0:25723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9c3bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.534988:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+30:16390:x1871643350849024:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 18855us (21310us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1784938442.534998:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 633 00000004:00080000:2.0:1784938442.535014:0:16391:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f24aa00/2, rc 0, transno 4294967424 00000100:00100000:0.0:1784938442.535016:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 642 00000004:00080000:3.0:1784938442.535107:0:16390:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f248000/2, rc 0, transno 4294967424 00000100:00100000:2.0:1784938442.535256:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f24aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350849152:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:2.0:1784938442.535304:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350852480:192.168.202.154@tcp:6:osp-syn-0-1.0 00010000:00010000:2.0:1784938442.535349:0:25723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784938442.535356:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938442.535360:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec965129/0x7b044d4128f9c3aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.535367:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4056a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938442.535371:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec965129/0x7b044d4128f9c3aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.535387:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec965129/0x7b044d4128f9c3aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.535398:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec965129/0x7b044d4128f9c3aa lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.535404:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec965129/0x7b044d4128f9c3aa lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.535421:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938442.535425:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9c3bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.535430:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245c00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938442.535433:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9c3bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.535439:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9c3bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.535446:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9c3bf lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.535452:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9c3bf lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.535460:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938442.535462:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938442.535464:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938442.535523:0:25723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+30:16391:x1871643350849920:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 17864us (20649us total) trans 4294967425 rc 0/0 00000100:00100000:2.0:1784938442.535530:0:25723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 636 00000100:00100000:2.0:1784938442.535544:0:25723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 643 00000100:00100000:2.0:1784938442.535551:0:25723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7ea6e988-18ba-4c98-b179-17995571b98b+79:10957:x1871643337429888:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938442.535560:0:25723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938442.535571:0:25723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003298af1d/0x7b044d4128f9c3e9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x59:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663ec1 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938442.535586:0:25723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x59:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938442.535597:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x59:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1784938442.535600:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x59:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.535605:0:25723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003298af1d/0x7b044d4128f9c3e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ec1 expref: 80 pid: 25723 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.535616:0:25723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003298af1d/0x7b044d4128f9c3e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ec1 expref: 80 pid: 25723 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.535625:0:25723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f244e00, rc 0) 00000100:00100000:2.0:1784938442.535637:0:25723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7ea6e988-18ba-4c98-b179-17995571b98b+80:10957:x1871643337429888:12345-192.168.202.54@tcp:101:cp.0 Request processed in 87us (5965us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938442.535642:0:25723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 643 00000100:00100000:0.0:1784938442.535741:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+29:16390:x1871643350851328:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:1.0:1784938442.535754:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+29:16392:x1871643350849792:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 18234us (20244us total) trans 4294967423 rc 0/0 00002000:00080000:0.0:1784938442.535757:0:21629:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:6 count 1 00000100:00100000:3.0:1784938442.535760:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f248000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350849024:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:1.0:1784938442.535766:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 635 00010000:00010000:0.0:1784938442.535771:0:21629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c3f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.535783:0:21629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a075a0f7/0x7b044d4128f9953c lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766335a expref: 79 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.535788:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938442.535790:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1784938442.535793:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.535797:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c3f0 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.535819:0:21629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a075a0f7/0x7b044d4128f9953c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e94766335a expref: 79 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.535830:0:21629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a075a0f7/0x7b044d4128f9953c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766335a expref: 79 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.535841:0:21629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd5a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:21629:1871643350852608:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938442.535876:0:21629:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2488b80000 going to sleep for 11 seconds 00000100:00100000:3.0:1784938442.535979:0:25720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+30:16391:x1871643350849280:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 20247us (22143us total) trans 4294967425 rc 0/0 00000100:00100000:3.0:1784938442.535989:0:25720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 632 00000100:00100000:0.0:1784938442.536006:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350852736:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:1.0:1784938442.536043:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938442.536108:0:25719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350852480 00000100:00100000:3.0:1784938442.536115:0:25719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350852480 00000004:00080000:0.0:1784938442.536189:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f19ad80/2, rc 0, transno 4294967423 00000100:00100000:0.0:1784938442.536201:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f19ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350849792:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:2.0:1784938442.536207:0:25723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 644 00000100:00100000:2.0:1784938442.536216:0:25723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+30:16389:x1871643350852480:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:2.0:1784938442.536228:0:25723:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:4 count 1 00010000:00010000:2.0:1784938442.536240:0:25723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae3830fe/0x7b044d4128f9c3f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.536252:0:25723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ed98232f/0x7b044d4128f994c5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476632d5 expref: 77 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938442.536256:0:16390:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f249500/2, rc 0, transno 4294967421 00000100:00100000:0.0:1784938442.536263:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350849408:192.168.202.154@tcp:6:osp-syn-1-1.0 00010000:00010000:2.0:1784938442.536266:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784938442.536269:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.536273:0:25723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae3830fe/0x7b044d4128f9c3f7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.536290:0:25723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ed98232f/0x7b044d4128f994c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632d5 expref: 77 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.536293:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2489ae5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350852992:192.168.202.154@tcp:6:osp-syn-1-1.0 00010000:00010000:2.0:1784938442.536300:0:25723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ed98232f/0x7b044d4128f994c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632d5 expref: 77 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.536310:0:25723:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:25723:1871643350853120:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938442.536319:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938442.536325:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350852864:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:2.0:1784938442.536346:0:25723:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248fb1c480 going to sleep for 11 seconds 00010000:00010000:0.0:1784938442.536368:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938442.536407:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938442.536433:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350851968 00000100:00100000:3.0:1784938442.536439:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350851968 00010000:00010000:1.0:1784938442.536471:0:25722:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000012221821/0x7b044d4128f9c3b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.536474:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938442.536482:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 645 00010000:00010000:1.0:1784938442.536483:0:25722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012221821/0x7b044d4128f9c3b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.536496:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+31:16392:x1871643350851968:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00010000:00010000:1.0:1784938442.536496:0:25722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012221821/0x7b044d4128f9c3b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.536512:0:25722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012221821/0x7b044d4128f9c3b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1784938442.536518:0:25715:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2 count 1 00010000:00010000:1.0:1784938442.536527:0:25722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938442.536534:0:25715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000216039b/0x7b044d4128f9c3fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.536537:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938442.536544:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012221821/0x7b044d4128f9c3b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.536553:0:25715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba5ff4a4/0x7b044d4128f99486 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476632ce expref: 77 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.536556:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938442.536562:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012221821/0x7b044d4128f9c3b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.536564:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1784938442.536573:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.536580:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000216039b/0x7b044d4128f9c3fe lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.536603:0:25715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba5ff4a4/0x7b044d4128f99486 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632ce expref: 77 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.536614:0:25715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba5ff4a4/0x7b044d4128f99486 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632ce expref: 77 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.536625:0:25715:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386363100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25715:1871643350853248:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938442.536633:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938442.536660:0:25715:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2484c730c0 going to sleep for 11 seconds 00010000:00010000:1.0:1784938442.536662:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012221821/0x7b044d4128f9c3b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.536681:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012221821/0x7b044d4128f9c3b1 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938442.536688:0:16391:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f19b800/2, rc 0, transno 4294967425 00010000:00010000:1.0:1784938442.536689:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012221821/0x7b044d4128f9c3b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.536702:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f19b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350849920:192.168.202.154@tcp:6:osp-syn-1-1.0 00010000:00010000:1.0:1784938442.536714:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.536717:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784938442.536719:0:16391:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f248380/2, rc 0, transno 4294967425 00010000:00010000:1.0:1784938442.536720:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938442.536738:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f248380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350849280:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:3.0:1784938442.536754:0:25719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350851840 00000100:00100000:3.0:1784938442.536757:0:25719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350851840 00000100:00100000:3.0:1784938442.536776:0:25719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350852736 00000100:00100000:3.0:1784938442.536779:0:25719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350852736 00000100:00100000:3.0:1784938442.536797:0:25719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 646 00000100:00100000:3.0:1784938442.536805:0:25719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+32:16392:x1871643350851840:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:3.0:1784938442.536817:0:25719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:28 count 1 00010000:00010000:3.0:1784938442.536830:0:25719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038131b1d/0x7b044d4128f9c405 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.536837:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00010000:00010000:3.0:1784938442.536850:0:25719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b85dfb87/0x7b044d4128f9947f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476632a4 expref: 77 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.536859:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1784938442.536862:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.536866:0:25719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038131b1d/0x7b044d4128f9c405 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.536883:0:16390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1784938442.536891:0:25719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b85dfb87/0x7b044d4128f9947f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632a4 expref: 77 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.536894:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350853376:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:0.0:1784938442.536904:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00010000:00010000:3.0:1784938442.536914:0:25719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b85dfb87/0x7b044d4128f9947f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632a4 expref: 77 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.536927:0:25719:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:25719:1871643350853504:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938442.536963:0:25719:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2484c73180 going to sleep for 11 seconds 00000004:00080000:0.0:1784938442.536968:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f24b100/2, rc 0, transno 4294967422 00000100:00100000:0.0:1784938442.536979:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f24b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350847616:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:3.0:1784938442.536983:0:25720:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 12 min 3 max 116 00000100:00100000:3.0:1784938442.536993:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350852992 00000100:00100000:3.0:1784938442.536996:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350852992 00000100:00100000:2.0:1784938442.537002:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938442.537018:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2489ae5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350853760:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:3.0:1784938442.537021:0:25720:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 12 min 3 max 116 00000100:00100000:3.0:1784938442.537028:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350852864 00000100:00100000:3.0:1784938442.537030:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350852864 00000100:00100000:3.0:1784938442.537043:0:25720:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 12 min 3 max 116 00000100:00100000:2.0:1784938442.537047:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2489ae6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350853632:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:3.0:1784938442.537050:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350853376 00000100:00100000:3.0:1784938442.537056:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350853376 00000100:00100000:1.0:1784938442.537263:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f199c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+32:16390:x1871643350849536:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 20898us (22415us total) trans 4294967426 rc 0/0 00000100:00100000:1.0:1784938442.537272:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 634 00000100:00100000:1.0:1784938442.537293:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 647 00000100:00100000:1.0:1784938442.537301:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+31:16390:x1871643350852736:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00002000:00080000:1.0:1784938442.537319:0:25722:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:23 count 1 00010000:00010000:1.0:1784938442.537345:0:25722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f60ab065/0x7b044d4128f9c40c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.537357:0:25722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002b7dca5e/0x7b044d4128f99551 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663376 expref: 79 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.537364:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1784938442.537367:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.537371:0:25722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f60ab065/0x7b044d4128f9c40c lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.537398:0:25722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002b7dca5e/0x7b044d4128f99551 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663376 expref: 79 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.537408:0:25722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002b7dca5e/0x7b044d4128f99551 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663376 expref: 79 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.537418:0:25722:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f181180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25722:1871643350853888:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938442.537451:0:25722:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828af480 going to sleep for 11 seconds 00000100:00100000:3.0:1784938442.538472:0:25724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 648 00000100:00100000:3.0:1784938442.538481:0:25724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+31:16392:x1871643350852992:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00002000:00080000:3.0:1784938442.538499:0:25724:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:8 count 1 00010000:00010000:3.0:1784938442.538515:0:25724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000089d1f6a/0x7b044d4128f9c413 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.538531:0:25724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc8b5333/0x7b044d4128f9956d lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663384 expref: 79 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.538539:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x8:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1784938442.538542:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.538546:0:25724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000089d1f6a/0x7b044d4128f9c413 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.538568:0:25724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cc8b5333/0x7b044d4128f9956d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663384 expref: 79 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.538578:0:25724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cc8b5333/0x7b044d4128f9956d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663384 expref: 79 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.538590:0:25724:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386360a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:25724:1871643350854016:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938442.538654:0:25724:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2484c73240 going to sleep for 11 seconds 00000004:00080000:3.0:1784938442.538768:0:16390:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f249c00/2, rc 0, transno 4294967426 00000100:00100000:0.0:1784938442.538769:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938442.538787:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f249c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350849536:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:3.0:1784938442.538807:0:25720:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 13 min 3 max 116 00000100:00100000:3.0:1784938442.538813:0:25720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_013' 00000100:00100000:3.0:1784938442.538869:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938442.538880:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350854144:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:2.0:1784938442.538964:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938442.538997:0:25718:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 13 min 3 max 116 00000100:00100000:2.0:1784938442.539002:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938442.539010:0:25718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350853760 00000100:00100000:1.0:1784938442.539015:0:25718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350853760 00000100:00100000:1.0:1784938442.539047:0:25718:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 13 min 3 max 116 00000100:00100000:1.0:1784938442.539053:0:25718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350853632 00000100:00100000:1.0:1784938442.539056:0:25718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350853632 00000100:00100000:1.0:1784938442.539068:0:25718:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 13 min 3 max 116 00000100:00100000:2.0:1784938442.539071:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350854144 00000100:00100000:2.0:1784938442.539077:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350854144 00000100:00100000:2.0:1784938442.539220:0:25725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 649 00000100:00100000:2.0:1784938442.539228:0:25725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+34:16392:x1871643350852864:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00002000:00080000:2.0:1784938442.539240:0:25725:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:33 count 1 00010000:00010000:2.0:1784938442.539252:0:25725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3c3b4db/0x7b044d4128f9c41a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.539263:0:25725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e54e2326/0x7b044d4128f9955f lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766337d expref: 79 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.539271:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784938442.539274:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.539279:0:25725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3c3b4db/0x7b044d4128f9c41a lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.539295:0:25725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e54e2326/0x7b044d4128f9955f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e94766337d expref: 79 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.539304:0:25725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e54e2326/0x7b044d4128f9955f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766337d expref: 79 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.539313:0:25725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f24b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:25725:1871643350854272:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938442.539358:0:25725:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248fb1ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938442.541903:0:21149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68d8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:21149:1871643350851584:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938442.541929:0:21149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9c3c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.548010:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.548175:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.548236:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.548261:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.548292:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337431296 00000100:00100000:0.0:1784938442.548301:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337431296 00010000:00010000:0.0:1784938442.548358:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000087008cea/0x7b044d4128f99504 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663330 expref: 80 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.548393:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337431552 00000100:00100000:0.0:1784938442.548397:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337431552 00000100:00100000:2.0:1784938442.548409:0:25720:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 14 min 3 max 116 00010000:00010000:0.0:1784938442.548412:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006a6a8420/0x7b044d4128f99543 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663353 expref: 78 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.548418:0:25720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_014' 00000100:00100000:0.0:1784938442.548424:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337431680 00000100:00100000:0.0:1784938442.548426:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337431680 00010000:00010000:0.0:1784938442.548436:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008f2d18e0/0x7b044d4128f99558 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663361 expref: 79 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.548453:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 282 00000100:00100000:0.0:1784938442.548462:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+80:10960:x1871643337431296:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938442.548482:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938442.548488:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000087008cea/0x7b044d4128f99504 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663330 expref: 80 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.548502:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000087008cea/0x7b044d4128f99504 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663330 expref: 80 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.548526:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087008cea/0x7b044d4128f99504 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663330 expref: 80 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.548544:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.548548:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.548554:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9c3c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.548563:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9c3c6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.548598:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938442.548648:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+79:10960:x1871643337431296:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 187us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.548655:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 282 00000100:00100000:0.0:1784938442.548673:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 283 00000100:00100000:0.0:1784938442.548680:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d3afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+79:10957:x1871643337431552:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938442.548688:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938442.548693:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006a6a8420/0x7b044d4128f99543 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663353 expref: 79 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.548703:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006a6a8420/0x7b044d4128f99543 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663353 expref: 79 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.548717:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.548721:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.548725:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000082ab8fc0/0x7b044d4128f9c3cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.548732:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082ab8fc0/0x7b044d4128f9c3cd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.548743:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938442.548760:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d3afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+79:10957:x1871643337431552:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 82us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.548770:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 283 00000100:00100000:0.0:1784938442.548784:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 284 00000100:00100000:0.0:1784938442.548790:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d3ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+78:10957:x1871643337431680:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938442.548796:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938442.548801:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008f2d18e0/0x7b044d4128f99558 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663361 expref: 78 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.548812:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008f2d18e0/0x7b044d4128f99558 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663361 expref: 78 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.548823:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.548825:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.548830:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c3d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.548837:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c3d4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.548849:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938442.548866:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d3ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+78:10957:x1871643337431680:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 76us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.548872:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 284 00010000:00010000:3.0:1784938442.549405:0:21152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a6a8420/0x7b044d4128f99543 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663353 expref: 77 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.549422:0:21152:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386362a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:21152:1871643350851712:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938442.549451:0:21152:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000082ab8fc0/0x7b044d4128f9c3cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.549540:0:21151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f2d18e0/0x7b044d4128f99558 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663361 expref: 76 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.549552:0:21151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386360700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:21151:1871643350852096:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938442.549566:0:21151:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c3d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.549579:0:21151:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c3d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.549591:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c3d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.549600:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c3d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.549608:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c3d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.549628:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938442.549790:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+34:16391:x1871643350850816:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 15975us (32534us total) trans 4294967426 rc 0/0 00000100:00100000:1.0:1784938442.549798:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 639 00000100:00100000:1.0:1784938442.549815:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337431424 00000100:00100000:1.0:1784938442.549821:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337431424 00000100:00100000:1.0:1784938442.549851:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 650 00000100:00100000:1.0:1784938442.549859:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381363450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+33:16390:x1871643350853376:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:1.0:1784938442.549882:0:21151:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:34 count 1 00010000:00010000:1.0:1784938442.549902:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000239932ac/0x7b044d4128f9c421 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.549917:0:21151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c010a79b/0x7b044d4128f994ef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476632dc expref: 75 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.549925:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1784938442.549929:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.549933:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000239932ac/0x7b044d4128f9c421 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.549964:0:21151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c010a79b/0x7b044d4128f994ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632dc expref: 75 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.549984:0:21151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c010a79b/0x7b044d4128f994ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632dc expref: 75 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.549999:0:21151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f182d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:21151:1871643350854400:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938442.550058:0:21151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828af840 going to sleep for 11 seconds 00010000:00010000:3.0:1784938442.550062:0:21152:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000082ab8fc0/0x7b044d4128f9c3cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.550073:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082ab8fc0/0x7b044d4128f9c3cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.550077:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938442.550087:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c3d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.550088:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082ab8fc0/0x7b044d4128f9c3cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.550109:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938442.550117:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c3d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.550120:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082ab8fc0/0x7b044d4128f9c3cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.550137:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c3d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.550173:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938442.550191:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c3d4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.550205:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c3d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.550226:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938442.550230:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082ab8fc0/0x7b044d4128f9c3cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.550236:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938442.550240:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082ab8fc0/0x7b044d4128f9c3cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.550248:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082ab8fc0/0x7b044d4128f9c3cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.550259:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082ab8fc0/0x7b044d4128f9c3cd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.550266:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+34:16389:x1871643350850176:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 17611us (35369us total) trans 4294967427 rc 0/0 00010000:00010000:1.0:1784938442.550270:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082ab8fc0/0x7b044d4128f9c3cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.550287:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.550289:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938442.550292:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 638 00010000:00010000:1.0:1784938442.550293:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938442.550316:0:25718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 651 00010000:00010000:2.0:1784938442.550395:0:21149:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9c3c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.550404:0:21149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9c3c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.550412:0:21149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9c3c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.550419:0:21149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9c3c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.550438:0:21149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784938442.550524:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+35:16389:x1871643350850048:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 18578us (35639us total) trans 4294967427 rc 0/0 00000100:00100000:1.0:1784938442.550551:0:25718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d3ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+35:16391:x1871643350853760:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00010000:00010000:1.0:1784938442.550565:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938442.550570:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9c3c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.550577:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f244a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938442.550580:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9c3c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.550587:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9c3c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.550597:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9c3c6 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.550604:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9c3c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.550618:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.550620:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.550621:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1784938442.550634:0:25718:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:24 count 1 00010000:00010000:1.0:1784938442.550648:0:25718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcd3e12b/0x7b044d4128f9c428 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.550658:0:25718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008efe5b0a/0x7b044d4128f994be lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476632b9 expref: 79 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.550670:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x18:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1784938442.550673:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.550676:0:25718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcd3e12b/0x7b044d4128f9c428 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.550696:0:25718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008efe5b0a/0x7b044d4128f994be lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632b9 expref: 79 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.550705:0:25718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008efe5b0a/0x7b044d4128f994be lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632b9 expref: 79 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.550715:0:25718:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f181500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25718:1871643350854528:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938442.550747:0:25718:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828af780 going to sleep for 11 seconds 00010000:00010000:0.0:1784938442.550820:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938442.550964:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.550994:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.551133:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.551221:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337431808 00000100:00100000:0.0:1784938442.551226:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337431808 00010000:00010000:0.0:1784938442.551248:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000e8ea1de/0x7b044d4128f9954a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766336f expref: 76 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.551268:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337431936 00000100:00100000:0.0:1784938442.551271:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337431936 00010000:00010000:0.0:1784938442.551282:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d9acc545/0x7b044d4128f99566 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663368 expref: 77 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.551293:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337432064 00000100:00100000:0.0:1784938442.551296:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337432064 00010000:00010000:0.0:1784938442.551306:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a075a0f7/0x7b044d4128f9953c lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766335a expref: 80 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.551319:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 285 00000100:00100000:0.0:1784938442.551325:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2488a64850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+77:10959:x1871643337431808:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938442.551348:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938442.551352:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000e8ea1de/0x7b044d4128f9954a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766336f expref: 77 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.551363:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000e8ea1de/0x7b044d4128f9954a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766336f expref: 77 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.551380:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.551383:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.551389:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c3e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.551397:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c3e2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.551414:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938442.551441:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2488a64850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+77:10959:x1871643337431808:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 115us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.551447:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 285 00000100:00100000:0.0:1784938442.551485:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 286 00000100:00100000:0.0:1784938442.551491:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d3ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+76:10959:x1871643337431936:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938442.551498:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938442.551502:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d9acc545/0x7b044d4128f99566 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663368 expref: 76 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.551512:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d9acc545/0x7b044d4128f99566 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663368 expref: 76 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.551523:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.551525:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.551529:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e4def6fc/0x7b044d4128f9c3db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.551536:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4def6fc/0x7b044d4128f9c3db lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.551552:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938442.551568:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d3ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+76:10959:x1871643337431936:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 78us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.551574:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 286 00000100:00100000:0.0:1784938442.551585:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 287 00000100:00100000:0.0:1784938442.551590:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d3aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+80:10957:x1871643337432064:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938442.551597:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938442.551601:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a075a0f7/0x7b044d4128f9953c lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766335a expref: 80 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.551610:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a075a0f7/0x7b044d4128f9953c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766335a expref: 80 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.551621:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.551624:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.551628:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c3f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.551636:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c3f0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.551644:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938442.551658:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d3aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+80:10957:x1871643337432064:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 68us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.551666:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 287 00010000:00010000:0.0:1784938442.552021:0:21629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a075a0f7/0x7b044d4128f9953c lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766335a expref: 79 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.552131:0:25716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9acc545/0x7b044d4128f99566 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663368 expref: 75 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.552160:0:25716:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f241880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25716:1871643350852224:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938442.552179:0:25716:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e4def6fc/0x7b044d4128f9c3db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.552189:0:25716:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e4def6fc/0x7b044d4128f9c3db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.552203:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4def6fc/0x7b044d4128f9c3db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.552213:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4def6fc/0x7b044d4128f9c3db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.552220:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4def6fc/0x7b044d4128f9c3db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.552238:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938442.552389:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+34:16391:x1871643350850944:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 18208us (35104us total) trans 4294967428 rc 0/0 00000100:00100000:0.0:1784938442.552445:0:21629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd5a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:21629:1871643350852608:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938442.552460:0:21629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c3f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.552468:0:21629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c3f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.552474:0:21629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c3f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.552481:0:21629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c3f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.552488:0:21629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c3f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.552502:0:21629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1784938442.552572:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+36:16390:x1871643350851328:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 17549us (35036us total) trans 4294967428 rc 0/0 00000100:00100000:2.0:1784938442.552974:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 637 00000100:00100000:2.0:1784938442.553006:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 652 00000004:00080000:3.0:1784938442.553014:0:16391:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f2386361c00/2, rc 0, transno 4294967426 00000100:00100000:2.0:1784938442.553019:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+35:16390:x1871643350853632:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:3.0:1784938442.553044:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386361c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350850816:192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:2.0:1784938442.553056:0:21149:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:26 count 1 00010000:00010000:2.0:1784938442.553079:0:21149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9c42f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.553100:0:21149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000076ff25e4/0x7b044d4128f99471 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476632b2 expref: 78 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.553108:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x1a:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784938442.553111:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.553116:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9c42f lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.553159:0:21149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000076ff25e4/0x7b044d4128f99471 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632b2 expref: 78 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.553172:0:21149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000076ff25e4/0x7b044d4128f99471 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632b2 expref: 78 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.553186:0:21149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68d8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:21149:1871643350854656:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938442.553238:0:21149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248fb1c3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1784938442.553265:0:25721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e8ea1de/0x7b044d4128f9954a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766336f expref: 74 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.553275:0:25721:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:25721:1871643350852352:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938442.553287:0:25721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c3e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.553295:0:25721:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c3e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.553302:0:25721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c3e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.553310:0:25721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c3e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.553316:0:25721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c3e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.553344:0:25721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1784938442.553431:0:25721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+35:16390:x1871643350851200:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 18790us (35945us total) trans 4294967429 rc 0/0 00000100:00100000:2.0:1784938442.553439:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 641 00000100:00100000:2.0:1784938442.553457:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 653 00000100:00100000:2.0:1784938442.553463:0:25721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f24b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+35:16391:x1871643350854144:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00002000:00080000:2.0:1784938442.553474:0:25721:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:9 count 1 00010000:00010000:2.0:1784938442.553485:0:25721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000533c7a69/0x7b044d4128f9c436 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.553497:0:25721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc245ddc/0x7b044d4128f994e1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476632c0 expref: 78 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.553503:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x9:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784938442.553506:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.553510:0:25721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000533c7a69/0x7b044d4128f9c436 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.553529:0:25721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fc245ddc/0x7b044d4128f994e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632c0 expref: 78 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.553539:0:25721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fc245ddc/0x7b044d4128f994e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632c0 expref: 78 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.553549:0:25721:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:25721:1871643350854784:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938442.553570:0:25721:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248fb1ccc0 going to sleep for 11 seconds 00000004:00080000:2.0:1784938442.553598:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f249880/2, rc 0, transno 4294967427 00000100:00100000:2.0:1784938442.553603:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f249880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350850176:192.168.202.154@tcp:6:osp-syn-0-1.0 00000004:00080000:2.0:1784938442.553618:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f19b480/2, rc 0, transno 4294967427 00000100:00100000:2.0:1784938442.553629:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f19b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350850048:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:2.0:1784938442.553725:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f2cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350854912:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:2.0:1784938442.553757:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784938442.553763:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f2cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350855040:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:1.0:1784938442.554009:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 640 00000100:00100000:1.0:1784938442.554042:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 654 00000100:00100000:1.0:1784938442.554050:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d3ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+78:17096:x1871643337431424:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938442.554061:0:25716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938442.554073:0:25716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f10ec8f1/0x7b044d4128f9c43d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663ec8 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.554093:0:25716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003298af1d/0x7b044d4128f9c3e9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ec1 expref: 79 pid: 25723 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.554100:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x59:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.554103:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x59:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.554108:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f10ec8f1/0x7b044d4128f9c43d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ec8 expref: 79 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.554129:0:25716:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003298af1d/0x7b044d4128f9c3e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663ec1 expref: 79 pid: 25723 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.554138:0:25716:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003298af1d/0x7b044d4128f9c3e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663ec1 expref: 79 pid: 25723 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.554175:0:25716:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25716:1871643350855168:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938442.554205:0:25716:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828af6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938442.554966:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938442.554990:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938442.555094:0:25715:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386363100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25715:1871643350853248:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938442.555116:0:25715:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000216039b/0x7b044d4128f9c3fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.555139:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784938442.555167:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4def6fc/0x7b044d4128f9c3db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.555175:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24dc00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938442.555180:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4def6fc/0x7b044d4128f9c3db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.555190:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4def6fc/0x7b044d4128f9c3db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.555211:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4def6fc/0x7b044d4128f9c3db lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.555220:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4def6fc/0x7b044d4128f9c3db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.555243:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784938442.555247:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c3f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.555254:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24d800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938442.555257:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c3f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.555265:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c3f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.555275:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c3f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.555282:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c3f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.555294:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938442.555298:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c3e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.555306:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f244600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938442.555308:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c3e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.555316:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c3e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.555326:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c3e2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.555345:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c3e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.555360:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.555362:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.555363:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938442.555392:0:25724:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386360a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:25724:1871643350854016:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938442.555406:0:25724:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000089d1f6a/0x7b044d4128f9c413 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938442.555514:0:16390:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24bd5a7800/2, rc 0, transno 4294967428 00000100:00100000:2.0:1784938442.555532:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd5a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350851328:192.168.202.154@tcp:6:osp-syn-1-1.0 00000004:00080000:2.0:1784938442.555549:0:16390:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f2386363b80/2, rc 0, transno 4294967429 00000100:00100000:2.0:1784938442.555559:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386363b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350851200:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:2.0:1784938442.555624:0:25723:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:25723:1871643350853120:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938442.555637:0:25723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ae3830fe/0x7b044d4128f9c3f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.555661:0:25725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f24b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:25725:1871643350854272:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938442.555673:0:25725:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d3c3b4db/0x7b044d4128f9c41a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.555789:0:16390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784938442.555805:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2381d29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350855552:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:1.0:1784938442.556061:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938442.556217:0:25719:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:25719:1871643350853504:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938442.556232:0:25719:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000038131b1d/0x7b044d4128f9c405 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.556270:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350854912 00000100:00100000:2.0:1784938442.556276:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350854912 00000100:00100000:2.0:1784938442.556313:0:25720:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 14 min 3 max 116 00000100:00100000:2.0:1784938442.556321:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350855040 00000100:00100000:2.0:1784938442.556324:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350855040 00000100:00100000:2.0:1784938442.556346:0:25720:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 14 min 3 max 116 00000100:00100000:2.0:1784938442.556350:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350855552 00000100:00100000:2.0:1784938442.556353:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350855552 00000100:00100000:2.0:1784938442.556457:0:25726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 655 00000100:00100000:2.0:1784938442.556467:0:25726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+35:16389:x1871643350854912:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:2.0:1784938442.556492:0:25726:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:14 count 1 00010000:00010000:2.0:1784938442.556518:0:25726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cd96e79/0x7b044d4128f9c444 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.556535:0:25726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b1ac958c/0x7b044d4128f994a2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476632e3 expref: 73 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.556550:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784938442.556554:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.556558:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cd96e79/0x7b044d4128f9c444 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.556583:0:25726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b1ac958c/0x7b044d4128f994a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632e3 expref: 73 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.556596:0:25726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b1ac958c/0x7b044d4128f994a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632e3 expref: 73 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.556607:0:25726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f2cb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:25726:1871643350855680:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938442.556659:0:25726:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248fb1c480 going to sleep for 11 seconds 00000100:00100000:0.0:1784938442.559016:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 642 00010000:00010000:0.0:1784938442.559069:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938442.559075:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938442.559095:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f2cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350855424:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:0.0:1784938442.559345:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938442.559355:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350855296:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:0.0:1784938442.559403:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 656 00000100:00100000:0.0:1784938442.559417:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+35:16389:x1871643350855040:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:0.0:1784938442.559452:0:21629:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:31 count 1 00010000:00010000:0.0:1784938442.559479:0:21629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc902b02/0x7b044d4128f9c44b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.559502:0:21629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e45c1791/0x7b044d4128f994fd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663314 expref: 73 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.559511:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1784938442.559515:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.559520:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc902b02/0x7b044d4128f9c44b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.559556:0:21629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e45c1791/0x7b044d4128f994fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663314 expref: 73 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.559569:0:21629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e45c1791/0x7b044d4128f994fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663314 expref: 73 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.559583:0:21629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d3afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:21629:1871643350855808:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938442.559866:0:21629:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2488b803c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938442.560075:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938442.560102:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938442.560121:0:25720:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 15 min 3 max 116 00000100:00100000:2.0:1784938442.560129:0:25720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_015' 00000100:00100000:2.0:1784938442.560170:0:21152:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 15 min 3 max 116 00000100:00100000:2.0:1784938442.560179:0:21152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350855424 00000100:00100000:2.0:1784938442.560186:0:21152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350855424 00000100:00100000:2.0:1784938442.560216:0:21152:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 15 min 3 max 116 00000100:00100000:2.0:1784938442.560221:0:21152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350855296 00000100:00100000:2.0:1784938442.560223:0:21152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350855296 00000100:00100000:0.0:1784938442.560611:0:25727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 657 00000100:00100000:0.0:1784938442.560618:0:25727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+36:16390:x1871643350855552:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00002000:00080000:0.0:1784938442.560636:0:25727:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:30 count 1 00010000:00010000:0.0:1784938442.560650:0:25727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d89d376/0x7b044d4128f9c452 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.560661:0:25727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007601bf81/0x7b044d4128f9948d lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476632ea expref: 79 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.560666:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x1e:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1784938442.560669:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.560671:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d89d376/0x7b044d4128f9c452 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.560687:0:25727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007601bf81/0x7b044d4128f9948d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632ea expref: 79 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.560695:0:25727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007601bf81/0x7b044d4128f9948d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632ea expref: 79 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.560703:0:25727:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d3ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:25727:1871643350855936:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938442.560751:0:25727:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2488b806c0 going to sleep for 11 seconds 00000004:00080000:3.0:1784938442.562804:0:16391:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f2386363800/2, rc 0, transno 4294967428 00000100:00100000:3.0:1784938442.562833:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386363800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350850944:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:0.0:1784938442.562935:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d3ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350856064:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:0.0:1784938442.563098:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938442.563401:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.563457:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938442.563513:0:25722:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f181180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25722:1871643350853888:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938442.563537:0:25722:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f60ab065/0x7b044d4128f9c40c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.563562:0:21152:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 16 min 3 max 116 00000100:00100000:2.0:1784938442.563570:0:21152:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_016' 00000100:00100000:1.0:1784938442.563656:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.563711:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337432192 00000100:00100000:0.0:1784938442.563718:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337432192 00010000:00010000:0.0:1784938442.563751:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba5ff4a4/0x7b044d4128f99486 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632ce expref: 74 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.563785:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337432320 00000100:00100000:0.0:1784938442.563789:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337432320 00010000:00010000:0.0:1784938442.563803:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b85dfb87/0x7b044d4128f9947f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632a4 expref: 75 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.563826:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 288 00000100:00100000:0.0:1784938442.563834:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+75:10958:x1871643337432192:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938442.563847:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938442.563853:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba5ff4a4/0x7b044d4128f99486 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632ce expref: 75 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.563864:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba5ff4a4/0x7b044d4128f99486 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632ce expref: 75 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.563887:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba5ff4a4/0x7b044d4128f99486 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632ce expref: 75 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.563902:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.563906:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.563911:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000216039b/0x7b044d4128f9c3fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.563926:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000216039b/0x7b044d4128f9c3fe lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.563947:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938442.563978:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+74:10958:x1871643337432192:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 144us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.563986:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 288 00000100:00100000:0.0:1784938442.564004:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 289 00000100:00100000:0.0:1784938442.564010:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+73:10960:x1871643337432320:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938442.564017:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938442.564021:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b85dfb87/0x7b044d4128f9947f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632a4 expref: 73 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.564031:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b85dfb87/0x7b044d4128f9947f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632a4 expref: 73 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.564044:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b85dfb87/0x7b044d4128f9947f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632a4 expref: 73 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.564054:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.564057:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.564061:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000038131b1d/0x7b044d4128f9c405 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.564073:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038131b1d/0x7b044d4128f9c405 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.564089:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938442.564107:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+72:10960:x1871643337432320:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 97us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.564113:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 289 00010000:00010000:0.0:1784938442.564132:0:25719:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000038131b1d/0x7b044d4128f9c405 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.564140:0:25719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038131b1d/0x7b044d4128f9c405 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.564174:0:25719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038131b1d/0x7b044d4128f9c405 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.564182:0:25719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038131b1d/0x7b044d4128f9c405 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.564197:0:25719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784938442.564348:0:25719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+37:16392:x1871643350851840:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 27543us (27873us total) trans 4294967430 rc 0/0 00000100:00100000:0.0:1784938442.564355:0:25719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 646 00000100:00100000:0.0:1784938442.564370:0:25719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350856064 00000100:00100000:0.0:1784938442.564374:0:25719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350856064 00000100:00100000:0.0:1784938442.564397:0:25719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 658 00000100:00100000:0.0:1784938442.564404:0:25719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f2c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+37:16392:x1871643350855424:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:0.0:1784938442.564424:0:25719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:24 count 1 00010000:00010000:0.0:1784938442.564445:0:25719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c459 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.564459:0:25719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000062c58f3a/0x7b044d4128f99589 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663399 expref: 71 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.564466:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1784938442.564468:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.564471:0:25719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c459 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.564490:0:25719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000062c58f3a/0x7b044d4128f99589 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663399 expref: 71 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.564498:0:25719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000062c58f3a/0x7b044d4128f99589 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663399 expref: 71 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.564507:0:25719:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d3af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:25719:1871643350856192:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938442.564541:0:25719:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2488b80000 going to sleep for 11 seconds 00000004:00080000:0.0:1784938442.564786:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f240380/2, rc 0, transno 4294967430 00000100:00100000:0.0:1784938442.564794:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350851840:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:0.0:1784938442.564841:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938442.564850:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d3ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350856320:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:0.0:1784938442.564946:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938442.564962:0:25720:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 16 min 3 max 116 00000100:00100000:0.0:1784938442.564969:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350856320 00000100:00100000:0.0:1784938442.564972:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350856320 00010000:00010000:3.0:1784938442.565218:0:25715:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000216039b/0x7b044d4128f9c3fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.565226:0:25715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000216039b/0x7b044d4128f9c3fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.565231:0:25715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000216039b/0x7b044d4128f9c3fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.565235:0:25715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000216039b/0x7b044d4128f9c3fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.565245:0:25715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1784938442.565317:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+39:16392:x1871643350851968:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 28825us (28911us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1784938442.565322:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 645 00000100:00100000:3.0:1784938442.565356:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 659 00000100:00100000:3.0:1784938442.565368:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f2caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+36:16392:x1871643350855296:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00002000:00080000:3.0:1784938442.565386:0:25715:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:14 count 1 00010000:00010000:3.0:1784938442.565401:0:25715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d72bda27/0x7b044d4128f9c460 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.565415:0:25715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dca7d77a/0x7b044d4128f994b7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476632c7 expref: 79 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.565423:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xe:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1784938442.565426:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.565430:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d72bda27/0x7b044d4128f9c460 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.565451:0:25715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dca7d77a/0x7b044d4128f994b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632c7 expref: 79 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.565462:0:25715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dca7d77a/0x7b044d4128f994b7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632c7 expref: 79 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.565470:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1784938442.565472:0:25715:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386362a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25715:1871643350856448:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938442.565477:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038131b1d/0x7b044d4128f9c405 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.565485:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938442.565489:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038131b1d/0x7b044d4128f9c405 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.565498:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038131b1d/0x7b044d4128f9c405 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.565505:0:25715:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2484c73180 going to sleep for 11 seconds 00010000:00010000:1.0:1784938442.565512:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038131b1d/0x7b044d4128f9c405 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.565517:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337432448 00010000:00010000:1.0:1784938442.565518:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038131b1d/0x7b044d4128f9c405 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.565521:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337432448 00010000:00010000:1.0:1784938442.565534:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938442.565537:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000216039b/0x7b044d4128f9c3fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.565540:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cc8b5333/0x7b044d4128f9956d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663384 expref: 80 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.565545:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938442.565548:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000216039b/0x7b044d4128f9c3fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.565558:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 290 00010000:00010000:1.0:1784938442.565561:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000216039b/0x7b044d4128f9c3fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.565564:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+80:10960:x1871643337432448:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.565570:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000216039b/0x7b044d4128f9c3fe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.565572:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938442.565576:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cc8b5333/0x7b044d4128f9956d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663384 expref: 80 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.565578:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000216039b/0x7b044d4128f9c3fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.565586:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cc8b5333/0x7b044d4128f9956d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663384 expref: 80 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.565590:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.565592:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.565594:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938442.565600:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc8b5333/0x7b044d4128f9956d lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663384 expref: 80 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.565610:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.565613:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.565618:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000089d1f6a/0x7b044d4128f9c413 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.565627:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000089d1f6a/0x7b044d4128f9c413 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.565719:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784938442.565739:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f241c00/2, rc 0, transno 4294967431 00000100:00100000:0.0:1784938442.565748:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f241c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350851968:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:0.0:1784938442.565784:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d3ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350856576:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:2.0:1784938442.565789:0:25728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 660 00000100:00100000:0.0:1784938442.565890:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938442.565904:0:25720:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 17 min 3 max 116 00000100:00100000:0.0:1784938442.565910:0:25720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_017' 00000100:00100000:2.0:1784938442.565912:0:25728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d3adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+38:16390:x1871643350856064:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:2.0:1784938442.565926:0:25728:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:10 count 1 00010000:00010000:2.0:1784938442.565939:0:25728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c467 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.565950:0:25728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000684fc97c/0x7b044d4128f99597 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476633ae expref: 71 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.565957:0:25728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784938442.565960:0:25728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.565964:0:25728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c467 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.565982:0:25728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000684fc97c/0x7b044d4128f99597 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633ae expref: 71 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.565991:0:25728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000684fc97c/0x7b044d4128f99597 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633ae expref: 71 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.566001:0:25728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f2c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:25728:1871643350856704:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938442.566034:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938442.566043:0:25728:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248fb1cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938442.566055:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+79:10960:x1871643337432448:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 490us (2398us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938442.566062:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 290 00010000:00010000:1.0:1784938442.566270:0:25724:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000089d1f6a/0x7b044d4128f9c413 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.566277:0:25724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000089d1f6a/0x7b044d4128f9c413 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.566283:0:25724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000089d1f6a/0x7b044d4128f9c413 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.566287:0:25724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000089d1f6a/0x7b044d4128f9c413 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.566300:0:25724:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938442.566307:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938442.566310:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000089d1f6a/0x7b044d4128f9c413 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.566315:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf0a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938442.566317:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000089d1f6a/0x7b044d4128f9c413 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.566321:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000089d1f6a/0x7b044d4128f9c413 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.566339:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000089d1f6a/0x7b044d4128f9c413 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.566346:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000089d1f6a/0x7b044d4128f9c413 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.566358:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.566359:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.566360:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938442.566440:0:25724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+37:16392:x1871643350852992:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 27960us (29607us total) trans 4294967429 rc 0/0 00000100:00100000:1.0:1784938442.566444:0:25724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 648 00000100:00100000:1.0:1784938442.566459:0:25724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350856576 00000100:00100000:1.0:1784938442.566463:0:25724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350856576 00000100:00100000:1.0:1784938442.566491:0:25724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 661 00000100:00100000:1.0:1784938442.566497:0:25724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d3af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+39:16392:x1871643350856320:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:1.0:1784938442.566512:0:25724:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:5 count 1 00010000:00010000:1.0:1784938442.566524:0:25724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec965129/0x7b044d4128f9c46e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.566536:0:25724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000268e9728/0x7b044d4128f9959e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476633b5 expref: 71 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.566544:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1784938442.566546:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.566548:0:25724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec965129/0x7b044d4128f9c46e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.566562:0:25724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000268e9728/0x7b044d4128f9959e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633b5 expref: 71 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.566567:0:25724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000268e9728/0x7b044d4128f9959e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633b5 expref: 71 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.566574:0:25724:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2381d28000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:25724:1871643350856832:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938442.566657:0:25724:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828afd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938442.566721:0:25729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 662 00000100:00100000:1.0:1784938442.566726:0:25729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d3aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+39:16392:x1871643350856576:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:1.0:1784938442.566734:0:25729:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:6 count 1 00010000:00010000:1.0:1784938442.566741:0:25729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad501493/0x7b044d4128f9c475 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.566752:0:25729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000034c21370/0x7b044d4128f995a5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476633bc expref: 71 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.566756:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1784938442.566758:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.566760:0:25729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad501493/0x7b044d4128f9c475 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.566772:0:25729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000034c21370/0x7b044d4128f995a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633bc expref: 71 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.566777:0:25729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000034c21370/0x7b044d4128f995a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633bc expref: 71 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.566782:0:25729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2381d2b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:25729:1871643350856960:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938442.566820:0:25729:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828af480 going to sleep for 11 seconds 00000004:00080000:0.0:1784938442.566882:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f2489ae5180/2, rc 0, transno 4294967429 00000100:00100000:0.0:1784938442.566928:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2489ae5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350852992:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:3.0:1784938442.566995:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2381d2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350857088:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:1.0:1784938442.567102:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938442.567133:0:21152:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 18 min 3 max 116 00000100:00100000:2.0:1784938442.567140:0:21152:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_018' 00000100:00100000:2.0:1784938442.567305:0:21152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350857088 00000100:00100000:2.0:1784938442.567310:0:21152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350857088 00000100:00100000:2.0:1784938442.567372:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 663 00000100:00100000:2.0:1784938442.567380:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+37:16389:x1871643350857088:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00002000:00080000:2.0:1784938442.567393:0:21152:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:25 count 1 00010000:00010000:2.0:1784938442.567407:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9c47c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.567419:0:21152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000164ff879/0x7b044d4128f994f6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476632f8 expref: 78 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.567427:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x19:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784938442.567430:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.567434:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9c47c lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.567452:0:21152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000164ff879/0x7b044d4128f994f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632f8 expref: 78 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.567462:0:21152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000164ff879/0x7b044d4128f994f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632f8 expref: 78 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.567472:0:21152:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f2c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:21152:1871643350857216:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938442.567504:0:21152:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248fb1c840 going to sleep for 11 seconds 00000100:00100000:1.0:1784938442.582591:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.582640:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.582673:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.582792:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337432576 00000100:00100000:0.0:1784938442.582815:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337432576 00010000:00010000:0.0:1784938442.582855:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e54e2326/0x7b044d4128f9955f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766337d expref: 79 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.582883:0:21151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f182d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:21151:1871643350854400:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938442.582888:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337432704 00000100:00100000:0.0:1784938442.582891:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337432704 00010000:00010000:0.0:1784938442.582902:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002b7dca5e/0x7b044d4128f99551 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663376 expref: 80 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.582914:0:21151:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000239932ac/0x7b044d4128f9c421 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.582914:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337432832 00000100:00100000:0.0:1784938442.582917:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337432832 00010000:00010000:0.0:1784938442.582927:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ed98232f/0x7b044d4128f994c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632d5 expref: 72 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.582945:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 291 00000100:00100000:0.0:1784938442.582953:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+80:10958:x1871643337432576:12345-192.168.202.54@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1784938442.582957:0:21149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68d8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:21149:1871643350854656:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938442.582969:0:21149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9c42f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.582969:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938442.582975:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e54e2326/0x7b044d4128f9955f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766337d expref: 80 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.582985:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e54e2326/0x7b044d4128f9955f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766337d expref: 80 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.582991:0:25716:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25716:1871643350855168:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938442.583007:0:25716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f10ec8f1/0x7b044d4128f9c43d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663ec8 expref: 80 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.583007:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e54e2326/0x7b044d4128f9955f lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766337d expref: 80 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.583022:0:25716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b4056800, rc 0) 00010000:00010000:0.0:1784938442.583022:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.583039:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.583044:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d3c3b4db/0x7b044d4128f9c41a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.583054:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3c3b4db/0x7b044d4128f9c41a lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.583075:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938442.583120:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+79:10958:x1871643337432576:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 167us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.583127:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 291 00000100:00100000:0.0:1784938442.583184:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 292 00000100:00100000:0.0:1784938442.583192:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2488a67050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+78:10958:x1871643337432704:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938442.583200:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938442.583205:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002b7dca5e/0x7b044d4128f99551 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663376 expref: 78 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.583214:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002b7dca5e/0x7b044d4128f99551 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663376 expref: 78 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.583227:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b7dca5e/0x7b044d4128f99551 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663376 expref: 78 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.583239:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.583242:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.583246:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f60ab065/0x7b044d4128f9c40c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.583252:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f60ab065/0x7b044d4128f9c40c lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.583270:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938442.583288:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2488a67050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+77:10958:x1871643337432704:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 98us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.583295:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 292 00000100:00100000:3.0:1784938442.583323:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 293 00000100:00100000:3.0:1784938442.583344:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+72:10959:x1871643337432832:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938442.583353:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938442.583358:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ed98232f/0x7b044d4128f994c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632d5 expref: 72 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.583359:0:25719:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d3af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:25719:1871643350856192:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938442.583370:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ed98232f/0x7b044d4128f994c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632d5 expref: 72 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.583373:0:25719:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c459 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.583384:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed98232f/0x7b044d4128f994c5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632d5 expref: 72 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.583394:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.583397:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.583401:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ae3830fe/0x7b044d4128f9c3f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.583409:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae3830fe/0x7b044d4128f9c3f7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.583423:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938442.583442:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+71:10959:x1871643337432832:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 110us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938442.583449:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 293 00000100:00100000:1.0:1784938442.583535:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d3ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+76:17096:x1871643337431424:12345-192.168.202.54@tcp:101:cp.0 Request processed in 29486us (35360us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.583541:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 654 00000100:00100000:1.0:1784938442.583574:0:25715:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386362a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25715:1871643350856448:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938442.583587:0:25715:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d72bda27/0x7b044d4128f9c460 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.583591:0:25721:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:25721:1871643350854784:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938442.583602:0:25721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000533c7a69/0x7b044d4128f9c436 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.583608:0:25718:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f181500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25718:1871643350854528:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938442.583618:0:25718:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fcd3e12b/0x7b044d4128f9c428 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.583625:0:25726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f2cb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:25726:1871643350855680:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938442.583637:0:25726:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006cd96e79/0x7b044d4128f9c444 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.583658:0:25725:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d3c3b4db/0x7b044d4128f9c41a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.583667:0:25725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3c3b4db/0x7b044d4128f9c41a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.583677:0:25725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3c3b4db/0x7b044d4128f9c41a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.583684:0:25725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3c3b4db/0x7b044d4128f9c41a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.583705:0:25725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784938442.583990:0:25727:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d3ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:25727:1871643350855936:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938442.584002:0:25727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004d89d376/0x7b044d4128f9c452 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.584435:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938442.584444:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3c3b4db/0x7b044d4128f9c41a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.584455:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938442.584460:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3c3b4db/0x7b044d4128f9c41a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.584470:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3c3b4db/0x7b044d4128f9c41a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.584486:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3c3b4db/0x7b044d4128f9c41a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.584493:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3c3b4db/0x7b044d4128f9c41a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.584512:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.584514:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.584515:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938442.584537:0:25724:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2381d28000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:25724:1871643350856832:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938442.584550:0:25724:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ec965129/0x7b044d4128f9c46e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.584674:0:25722:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f60ab065/0x7b044d4128f9c40c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.584684:0:25722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f60ab065/0x7b044d4128f9c40c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.584693:0:25722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f60ab065/0x7b044d4128f9c40c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.584700:0:25722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f60ab065/0x7b044d4128f9c40c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.584718:0:25722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938442.585005:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.585372:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.585398:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.585420:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.585434:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.585448:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.585459:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.585470:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.585482:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.585493:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.585504:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.585519:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.585540:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337432960 00000100:00100000:1.0:1784938442.585546:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337432960 00010000:00010000:1.0:1784938442.585576:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c010a79b/0x7b044d4128f994ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632dc expref: 71 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.585598:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337433472 00000100:00100000:1.0:1784938442.585601:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337433472 00010000:00010000:1.0:1784938442.585615:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003298af1d/0x7b044d4128f9c3e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663ec1 expref: 76 pid: 25723 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.585634:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337433984 00000100:00100000:1.0:1784938442.585636:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337433984 00010000:00010000:1.0:1784938442.585649:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000062c58f3a/0x7b044d4128f99589 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663399 expref: 72 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.585661:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337434496 00000100:00100000:1.0:1784938442.585663:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337434496 00010000:00010000:1.0:1784938442.585673:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000034c21370/0x7b044d4128f995a5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633bc expref: 73 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.585684:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337433344 00000100:00100000:1.0:1784938442.585687:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337433344 00010000:00010000:1.0:1784938442.585696:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fc245ddc/0x7b044d4128f994e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632c0 expref: 77 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.585706:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337433216 00000100:00100000:1.0:1784938442.585709:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337433216 00010000:00010000:1.0:1784938442.585719:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000076ff25e4/0x7b044d4128f99471 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632b2 expref: 78 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.585728:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337433728 00000100:00100000:1.0:1784938442.585731:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337433728 00010000:00010000:1.0:1784938442.585741:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e45c1791/0x7b044d4128f994fd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663314 expref: 74 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.585752:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337434240 00000100:00100000:1.0:1784938442.585754:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337434240 00010000:00010000:1.0:1784938442.585764:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000684fc97c/0x7b044d4128f99597 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633ae expref: 75 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.585775:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337433088 00000100:00100000:1.0:1784938442.585777:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337433088 00010000:00010000:1.0:1784938442.585787:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008efe5b0a/0x7b044d4128f994be lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632b9 expref: 79 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.585805:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337433600 00000100:00100000:1.0:1784938442.585808:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337433600 00010000:00010000:1.0:1784938442.585819:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b1ac958c/0x7b044d4128f994a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632e3 expref: 76 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.585836:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337434112 00000100:00100000:1.0:1784938442.585838:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337434112 00010000:00010000:1.0:1784938442.585849:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dca7d77a/0x7b044d4128f994b7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632c7 expref: 80 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.585859:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337434624 00000100:00100000:1.0:1784938442.585862:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337434624 00010000:00010000:1.0:1784938442.585871:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000164ff879/0x7b044d4128f994f6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632f8 expref: 81 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.585886:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 294 00010000:00010000:0.0:1784938442.585981:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938442.585989:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f60ab065/0x7b044d4128f9c40c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.585998:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4056000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938442.586002:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f60ab065/0x7b044d4128f9c40c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.586010:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f60ab065/0x7b044d4128f9c40c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.586025:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f60ab065/0x7b044d4128f9c40c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.586033:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f60ab065/0x7b044d4128f9c40c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.586052:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938442.586054:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938442.586056:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938442.586070:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 295 00000100:00100000:0.0:1784938442.586079:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+81:10960:x1871643337433472:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938442.586093:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938442.586111:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003298af1d/0x7b044d4128f9c3e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x59:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663ec1 expref: 81 pid: 25723 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.586123:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003298af1d/0x7b044d4128f9c3e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x59:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663ec1 expref: 81 pid: 25723 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.586138:0:22955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003298af1d/0x7b044d4128f9c3e9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x59:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663ec1 expref: 81 pid: 25723 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.586165:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x59:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.586169:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x59:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.586178:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f10ec8f1/0x7b044d4128f9c43d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663ec8 expref: 80 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.586187:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f10ec8f1/0x7b044d4128f9c43d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663ec8 expref: 80 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.586222:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f10ec8f1/0x7b044d4128f9c43d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663ec8 expref: 80 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.586237:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d3ac380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22955:1871643350857344:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938442.586307:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2488b806c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938442.586596:0:25725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+39:16392:x1871643350852864:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 47366us (49692us total) trans 4294967430 rc 0/0 00000100:00100000:2.0:1784938442.586606:0:25725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 649 00000100:00100000:3.0:1784938442.586635:0:19221:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00010000:00010000:2.0:1784938442.586638:0:25723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ae3830fe/0x7b044d4128f9c3f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.586642:0:19221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:2.0:1784938442.586652:0:25723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae3830fe/0x7b044d4128f9c3f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.586657:0:19220:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00010000:00010000:2.0:1784938442.586661:0:25723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae3830fe/0x7b044d4128f9c3f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.586665:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 296 00010000:00010000:2.0:1784938442.586669:0:25723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae3830fe/0x7b044d4128f9c3f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.586672:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+76:10960:x1871643337433984:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938442.586681:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938442.586683:0:25723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938442.586686:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000062c58f3a/0x7b044d4128f99589 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663399 expref: 76 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.586696:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000062c58f3a/0x7b044d4128f99589 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663399 expref: 76 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.586715:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062c58f3a/0x7b044d4128f99589 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663399 expref: 76 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.586726:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.586729:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.586732:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c459 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.586739:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c459 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.586761:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938442.586777:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+75:10960:x1871643337433984:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 105us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938442.586777:0:25723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+40:16389:x1871643350852480:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 50562us (50734us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1784938442.586784:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 296 00000100:00100000:2.0:1784938442.586784:0:25723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 644 00000100:00100000:3.0:1784938442.586797:0:19220:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1784938442.586804:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 297 00000100:00100000:3.0:1784938442.586810:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+74:10960:x1871643337434496:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938442.586818:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938442.586818:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938442.586823:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000034c21370/0x7b044d4128f995a5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633bc expref: 74 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.586823:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae3830fe/0x7b044d4128f9c3f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.586831:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938442.586834:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000034c21370/0x7b044d4128f995a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633bc expref: 74 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.586835:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae3830fe/0x7b044d4128f9c3f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.586844:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae3830fe/0x7b044d4128f9c3f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.586851:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.586852:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae3830fe/0x7b044d4128f9c3f7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.586854:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.586859:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad501493/0x7b044d4128f9c475 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.586860:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae3830fe/0x7b044d4128f9c3f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.586867:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad501493/0x7b044d4128f9c475 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.586875:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938442.586877:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938442.586877:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938442.586879:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938442.586906:0:21152:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f2c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:21152:1871643350857216:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938442.586922:0:21152:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9c47c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.586949:0:25728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f2c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:25728:1871643350856704:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938442.586960:0:25728:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c467 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.587082:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+74:10960:x1871643337434496:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 271us (1660us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938442.587090:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 297 00010000:00010000:0.0:1784938442.587096:0:25719:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c459 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.587103:0:19220:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00010000:00010000:0.0:1784938442.587105:0:25719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c459 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.587109:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 298 00000100:00100000:3.0:1784938442.587115:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+80:10960:x1871643337433344:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938442.587115:0:25719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c459 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.587122:0:25719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c459 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.587124:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938442.587129:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fc245ddc/0x7b044d4128f994e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632c0 expref: 80 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.587137:0:25719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938442.587139:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fc245ddc/0x7b044d4128f994e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632c0 expref: 80 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.587228:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+38:16390:x1871643350852736:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 49927us (50596us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1784938442.587236:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 647 00010000:00010000:3.0:1784938442.587241:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc245ddc/0x7b044d4128f994e1 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632c0 expref: 80 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.587258:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.587261:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.587266:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000533c7a69/0x7b044d4128f9c436 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.587273:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000533c7a69/0x7b044d4128f9c436 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.587292:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938442.587313:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+79:10960:x1871643337433344:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 197us (1877us total) trans 0 rc 0/0 00010000:00010000:2.0:1784938442.587314:0:25721:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000533c7a69/0x7b044d4128f9c436 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.587320:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 298 00010000:00010000:2.0:1784938442.587323:0:25721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000533c7a69/0x7b044d4128f9c436 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.587344:0:25721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000533c7a69/0x7b044d4128f9c436 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.587345:0:19220:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1784938442.587351:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 299 00010000:00010000:2.0:1784938442.587352:0:25721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000533c7a69/0x7b044d4128f9c436 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.587358:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2488a65450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+78:10958:x1871643337433216:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938442.587365:0:25721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784938442.587366:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938442.587371:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000076ff25e4/0x7b044d4128f99471 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632b2 expref: 78 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.587380:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000076ff25e4/0x7b044d4128f99471 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632b2 expref: 78 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.587391:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076ff25e4/0x7b044d4128f99471 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632b2 expref: 78 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.587406:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.587409:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.587413:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9c42f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.587420:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9c42f lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.587437:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938442.587447:0:25721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f24b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+38:16391:x1871643350854144:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 33983us (48447us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1784938442.587451:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2488a65450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+77:10958:x1871643337433216:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 94us (2002us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938442.587455:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 653 00000100:00100000:3.0:1784938442.587457:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 299 00000100:00100000:3.0:1784938442.587468:0:19220:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1784938442.587474:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 300 00010000:00010000:2.0:1784938442.587474:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938442.587479:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c459 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.587481:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+73:10958:x1871643337433728:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938442.587486:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24d800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938442.587489:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938442.587489:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c459 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.587494:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e45c1791/0x7b044d4128f994fd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663314 expref: 73 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.587497:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c459 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.587503:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e45c1791/0x7b044d4128f994fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663314 expref: 73 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.587508:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c459 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.587514:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.587515:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c459 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.587517:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.587522:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc902b02/0x7b044d4128f9c44b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.587529:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938442.587530:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc902b02/0x7b044d4128f9c44b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.587533:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000533c7a69/0x7b044d4128f9c436 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.587540:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938442.587540:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938442.587543:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000533c7a69/0x7b044d4128f9c436 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.587552:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000533c7a69/0x7b044d4128f9c436 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.587557:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+73:10958:x1871643337433728:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 77us (2097us total) trans 0 rc 0/0 00010000:00010000:2.0:1784938442.587562:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000533c7a69/0x7b044d4128f9c436 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.587563:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 300 00010000:00010000:2.0:1784938442.587569:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000533c7a69/0x7b044d4128f9c436 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.587573:0:19220:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1784938442.587579:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 301 00010000:00010000:2.0:1784938442.587580:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938442.587582:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938442.587584:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+72:10958:x1871643337434240:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938442.587584:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938442.587593:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938442.587598:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000684fc97c/0x7b044d4128f99597 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633ae expref: 72 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.587607:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000684fc97c/0x7b044d4128f99597 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633ae expref: 72 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.587620:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000684fc97c/0x7b044d4128f99597 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633ae expref: 72 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.587629:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.587631:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.587635:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c467 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.587643:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c467 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.587664:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938442.587683:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+71:10958:x1871643337434240:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 98us (2211us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938442.587689:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 301 00000100:00100000:3.0:1784938442.587701:0:19220:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1784938442.587707:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 302 00000100:00100000:3.0:1784938442.587713:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+76:10958:x1871643337433088:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938442.587721:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938442.587726:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008efe5b0a/0x7b044d4128f994be lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632b9 expref: 76 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.587735:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008efe5b0a/0x7b044d4128f994be lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632b9 expref: 76 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.587746:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008efe5b0a/0x7b044d4128f994be lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632b9 expref: 76 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.587758:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.587760:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.587764:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fcd3e12b/0x7b044d4128f9c428 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.587777:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcd3e12b/0x7b044d4128f9c428 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.587794:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938442.587812:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+75:10958:x1871643337433088:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 99us (2329us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938442.587819:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 302 00000100:00100000:3.0:1784938442.587831:0:19220:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1784938442.587838:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 303 00000100:00100000:3.0:1784938442.587844:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+70:10958:x1871643337433600:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938442.587851:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938442.587856:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b1ac958c/0x7b044d4128f994a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632e3 expref: 70 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.587866:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b1ac958c/0x7b044d4128f994a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632e3 expref: 70 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.587879:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1ac958c/0x7b044d4128f994a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632e3 expref: 70 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.587889:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.587903:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.587908:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006cd96e79/0x7b044d4128f9c444 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.587911:0:25728:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c467 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.587920:0:25728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c467 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.587922:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cd96e79/0x7b044d4128f9c444 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.587929:0:25728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c467 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.587939:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938442.587941:0:25728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c467 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.587953:0:25728:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784938442.587954:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+69:10958:x1871643337433600:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 110us (2459us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938442.587960:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 303 00010000:00010000:2.0:1784938442.587961:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938442.587964:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c467 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.587970:0:19220:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00010000:00010000:2.0:1784938442.587971:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f244600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938442.587974:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c467 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.587976:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 304 00000100:00100000:3.0:1784938442.587982:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+74:10958:x1871643337434112:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938442.587983:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c467 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.587990:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938442.587993:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c467 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.587995:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dca7d77a/0x7b044d4128f994b7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632c7 expref: 74 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.588000:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c467 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.588006:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dca7d77a/0x7b044d4128f994b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632c7 expref: 74 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.588013:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938442.588014:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938442.588016:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dca7d77a/0x7b044d4128f994b7 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632c7 expref: 74 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.588016:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938442.588123:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+68:10960:x1871643337432960:12345-192.168.202.54@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1784938442.588133:0:25728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d3adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+40:16390:x1871643350856064:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 22338us (25037us total) trans 4294967433 rc 0/0 00010000:00010000:1.0:1784938442.588134:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.588139:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c010a79b/0x7b044d4128f994ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632dc expref: 68 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.588140:0:25728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 660 00010000:00010000:1.0:1784938442.589111:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c010a79b/0x7b044d4128f994ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632dc expref: 68 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.589132:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c010a79b/0x7b044d4128f994ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632dc expref: 68 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.589251:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.589255:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.589262:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000239932ac/0x7b044d4128f9c421 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.589272:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000239932ac/0x7b044d4128f9c421 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.589744:0:25719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f2c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+40:16392:x1871643350855424:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 25338us (29668us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1784938442.589754:0:25719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 658 00010000:00010000:0.0:1784938442.589787:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784938442.589838:0:16390:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238d3ac700/2, rc 0, transno 4294967433 00000100:00100000:0.0:1784938442.589851:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d3ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350856064:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:0.0:1784938442.589939:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d3af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350857472:192.168.202.154@tcp:6:osp-syn-0-1.0 00000004:00080000:0.0:1784938442.590675:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f2cb480/2, rc 0, transno 4294967434 00000100:00100000:0.0:1784938442.590686:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f2cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350855424:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:0.0:1784938442.590721:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938442.590730:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d3ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350857600:192.168.202.154@tcp:6:osp-syn-0-1.0 00000004:00080000:0.0:1784938442.590818:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f22c700/2, rc 0, transno 4294967430 00000100:00100000:0.0:1784938442.590830:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350852864:192.168.202.154@tcp:6:osp-syn-1-1.0 00000004:00080000:0.0:1784938442.590920:0:16390:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f22df80/2, rc 0, transno 4294967431 00000100:00100000:0.0:1784938442.590928:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350852736:192.168.202.154@tcp:6:osp-syn-1-1.0 00000004:00080000:0.0:1784938442.591058:0:16391:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f182680/2, rc 0, transno 4294967432 00000100:00100000:0.0:1784938442.591068:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350854144:192.168.202.154@tcp:6:osp-syn-1-1.0 00000004:00080000:2.0:1784938442.591202:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24b68dbb80/2, rc 0, transno 4294967432 00000100:00100000:2.0:1784938442.591212:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350852480:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:2.0:1784938442.591251:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f2c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350857728:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:1.0:1784938442.591403:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938442.591462:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938442.591539:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00010000:00010000:3.0:1784938442.592461:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.592468:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.592477:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d72bda27/0x7b044d4128f9c460 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.592497:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d72bda27/0x7b044d4128f9c460 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.592533:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938442.592642:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+73:10958:x1871643337434112:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 4657us (7133us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938442.592653:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 304 00000100:00100000:3.0:1784938442.592688:0:19220:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1784938442.592699:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 305 00000100:00100000:3.0:1784938442.592711:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+72:10958:x1871643337434624:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938442.592728:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938442.592736:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000164ff879/0x7b044d4128f994f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632f8 expref: 72 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.592748:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000164ff879/0x7b044d4128f994f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632f8 expref: 72 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.592771:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000164ff879/0x7b044d4128f994f6 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632f8 expref: 72 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.592784:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.592788:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.592792:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9c47c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.592805:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9c47c lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.592824:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938442.592845:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+71:10958:x1871643337434624:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 138us (7324us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938442.592852:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 305 00010000:00010000:3.0:1784938442.592887:0:25726:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006cd96e79/0x7b044d4128f9c444 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.592897:0:25726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cd96e79/0x7b044d4128f9c444 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.592908:0:25726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cd96e79/0x7b044d4128f9c444 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.592916:0:25726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006cd96e79/0x7b044d4128f9c444 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.592934:0:25726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784938442.593065:0:25726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+40:16389:x1871643350854912:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 36599us (38100us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1784938442.593073:0:25726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 655 00000100:00100000:1.0:1784938442.593583:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.593681:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.595199:0:25726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350857472 00000100:00100000:3.0:1784938442.595212:0:25726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350857472 00000100:00100000:3.0:1784938442.595262:0:25726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350857600 00000100:00100000:3.0:1784938442.595266:0:25726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350857600 00000100:00100000:3.0:1784938442.595281:0:25726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350857728 00000100:00100000:3.0:1784938442.595284:0:25726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350857728 00000100:00100000:3.0:1784938442.595305:0:25726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 664 00000100:00100000:3.0:1784938442.595313:0:25726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+42:16390:x1871643350857472:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:3.0:1784938442.595352:0:25726:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:3 count 1 00010000:00010000:3.0:1784938442.595377:0:25726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000735f81e4/0x7b044d4128f9c483 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.595398:0:25726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c885a3e3/0x7b044d4128f995ac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476633c3 expref: 67 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.595407:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1784938442.595412:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.595416:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000735f81e4/0x7b044d4128f9c483 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.595451:0:25726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c885a3e3/0x7b044d4128f995ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633c3 expref: 67 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.595464:0:25726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c885a3e3/0x7b044d4128f995ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633c3 expref: 67 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.595479:0:25726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386361f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:25726:1871643350857856:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938442.595550:0:25726:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2484c73600 going to sleep for 11 seconds 00010000:00010000:3.0:1784938442.595580:0:21149:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9c42f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.595590:0:21149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9c42f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.595601:0:21149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9c42f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.595610:0:21149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9c42f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.595627:0:21149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1784938442.595766:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+38:16390:x1871643350853632:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 42751us (56802us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1784938442.595775:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 652 00000100:00100000:3.0:1784938442.595794:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 665 00000100:00100000:3.0:1784938442.595801:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+42:16392:x1871643350857600:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:3.0:1784938442.595814:0:21149:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:11 count 1 00010000:00010000:3.0:1784938442.595826:0:21149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000964eb9b6/0x7b044d4128f9c48a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.595838:0:21149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000af5a1535/0x7b044d4128f995b3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476633ca expref: 67 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.595845:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1784938442.595849:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.595853:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000964eb9b6/0x7b044d4128f9c48a lrc: 4/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.595874:0:21149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000af5a1535/0x7b044d4128f995b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633ca expref: 67 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.595884:0:21149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000af5a1535/0x7b044d4128f995b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633ca expref: 67 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.596043:0:21149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386360e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:21149:1871643350857984:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938442.596075:0:21149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2484c73240 going to sleep for 11 seconds 00010000:00010000:3.0:1784938442.596088:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938442.596093:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006cd96e79/0x7b044d4128f9c444 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.596101:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938442.596105:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006cd96e79/0x7b044d4128f9c444 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.596114:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006cd96e79/0x7b044d4128f9c444 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.596129:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006cd96e79/0x7b044d4128f9c444 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.596136:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cd96e79/0x7b044d4128f9c444 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.596167:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938442.596171:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9c42f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.596176:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245c00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938442.596179:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9c42f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.596186:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9c42f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.596194:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9c42f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.596200:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9c42f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.596211:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938442.596212:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938442.596214:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938442.596234:0:21152:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9c47c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.596243:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9c47c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.596255:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9c47c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.596261:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9c47c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.596274:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784938442.596350:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+38:16389:x1871643350857088:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 28970us (29246us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1784938442.596356:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 663 00000100:00100000:3.0:1784938442.596373:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 666 00000100:00100000:3.0:1784938442.596570:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+42:16392:x1871643350857728:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:3.0:1784938442.596608:0:21152:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:27 count 1 00010000:00010000:3.0:1784938442.596623:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a01e5ace/0x7b044d4128f9c491 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.596636:0:21152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d1223b5/0x7b044d4128f98f38 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766325e expref: 67 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.596643:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=5s v=(0 0) 00010000:00010000:3.0:1784938442.596647:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.596651:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a01e5ace/0x7b044d4128f9c491 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.596678:0:21152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008d1223b5/0x7b044d4128f98f38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e94766325e expref: 67 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.596688:0:21152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008d1223b5/0x7b044d4128f98f38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766325e expref: 67 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.596699:0:21152:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386363480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:21152:1871643350858112:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938442.596744:0:21152:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2484c730c0 going to sleep for 11 seconds 00010000:00010000:3.0:1784938442.596760:0:25715:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d72bda27/0x7b044d4128f9c460 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.596769:0:25715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d72bda27/0x7b044d4128f9c460 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.596778:0:25715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d72bda27/0x7b044d4128f9c460 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.596786:0:25715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d72bda27/0x7b044d4128f9c460 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.596800:0:25715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1784938442.596876:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f2caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+38:16392:x1871643350855296:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 31512us (36771us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1784938442.596883:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 659 00010000:00010000:3.0:1784938442.596913:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938442.596917:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9c47c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.596924:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f244a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938442.596928:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9c47c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.596935:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9c47c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.596948:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9c47c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.596955:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9c47c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.596970:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938442.596974:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d72bda27/0x7b044d4128f9c460 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.596981:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf0600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938442.596984:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d72bda27/0x7b044d4128f9c460 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.596991:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d72bda27/0x7b044d4128f9c460 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.597006:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d72bda27/0x7b044d4128f9c460 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.597013:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d72bda27/0x7b044d4128f9c460 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.597026:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938442.597028:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938442.597029:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938442.597173:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784938442.597512:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f2cb100/2, rc 0, transno 4294967435 00000100:00100000:2.0:1784938442.597538:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f2cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350854912:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:2.0:1784938442.597698:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386362300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350858240:192.168.202.154@tcp:6:osp-syn-0-1.0 00010000:00010000:0.0:1784938442.597873:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938442.598373:0:19220:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1784938442.598386:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337433856 00000100:00100000:0.0:1784938442.598392:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337433856 00010000:00010000:0.0:1784938442.598421:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007601bf81/0x7b044d4128f9948d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632ea expref: 71 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.598443:0:19220:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1784938442.598449:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337434368 00000100:00100000:0.0:1784938442.598452:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337434368 00010000:00010000:0.0:1784938442.598464:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000268e9728/0x7b044d4128f9959e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633b5 expref: 68 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.598476:0:19220:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1784938442.598483:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 306 00000100:00100000:0.0:1784938442.598490:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2488a66050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+71:10960:x1871643337433856:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938442.598502:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938442.598507:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007601bf81/0x7b044d4128f9948d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632ea expref: 71 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.598519:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007601bf81/0x7b044d4128f9948d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632ea expref: 71 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.598527:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00010000:00010000:0.0:1784938442.598537:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007601bf81/0x7b044d4128f9948d lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476632ea expref: 71 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.598549:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.598553:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.598554:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784938442.598558:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004d89d376/0x7b044d4128f9c452 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.598567:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d89d376/0x7b044d4128f9c452 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.598569:0:21151:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000239932ac/0x7b044d4128f9c421 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.598577:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000239932ac/0x7b044d4128f9c421 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.598585:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938442.598587:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000239932ac/0x7b044d4128f9c421 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.598594:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000239932ac/0x7b044d4128f9c421 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.598607:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784938442.598608:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2488a66050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+70:10960:x1871643337433856:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 118us (5026us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.598614:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 306 00000100:00100000:0.0:1784938442.598648:0:19220:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1784938442.598654:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 307 00000100:00100000:0.0:1784938442.598659:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+68:10960:x1871643337434368:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938442.598666:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938442.598671:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000268e9728/0x7b044d4128f9959e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633b5 expref: 68 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.598680:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000268e9728/0x7b044d4128f9959e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633b5 expref: 68 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.598697:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000268e9728/0x7b044d4128f9959e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633b5 expref: 68 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.598708:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381363450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+43:16390:x1871643350853376:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 48850us (61707us total) trans 4294967436 rc 0/0 00010000:00010000:0.0:1784938442.598708:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.598711:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1784938442.598715:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 650 00010000:00010000:0.0:1784938442.598715:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec965129/0x7b044d4128f9c46e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.598723:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec965129/0x7b044d4128f9c46e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.598738:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938442.598753:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+67:10960:x1871643337434368:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 94us (5072us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.598759:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 307 00000004:00080000:0.0:1784938442.598787:0:16390:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f2489ae6300/2, rc 0, transno 4294967433 00000100:00100000:1.0:1784938442.598808:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350858240 00000100:00100000:1.0:1784938442.598812:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350858240 00000100:00100000:1.0:1784938442.598835:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 667 00000100:00100000:1.0:1784938442.598842:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+43:16389:x1871643350858240:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:1.0:1784938442.598861:0:21151:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:26 count 1 00010000:00010000:1.0:1784938442.598878:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095b82f9b/0x7b044d4128f9c498 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.598889:0:21151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a3bd6645/0x7b044d4128f98f4d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663265 expref: 66 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.598910:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1784938442.598912:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.598916:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095b82f9b/0x7b044d4128f9c498 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.598938:0:21151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a3bd6645/0x7b044d4128f98f4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663265 expref: 66 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.598949:0:21151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a3bd6645/0x7b044d4128f98f4d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663265 expref: 66 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.598960:0:21151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:21151:1871643350858368:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938442.598996:0:21151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828af780 going to sleep for 11 seconds 00010000:00010000:1.0:1784938442.599009:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938442.599014:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000239932ac/0x7b044d4128f9c421 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.599022:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938442.599026:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000239932ac/0x7b044d4128f9c421 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.599035:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000239932ac/0x7b044d4128f9c421 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.599047:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000239932ac/0x7b044d4128f9c421 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.599054:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000239932ac/0x7b044d4128f9c421 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.599070:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.599072:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.599074:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.599215:0:25724:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ec965129/0x7b044d4128f9c46e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.599225:0:25724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec965129/0x7b044d4128f9c46e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.599234:0:25724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec965129/0x7b044d4128f9c46e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.599242:0:25724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec965129/0x7b044d4128f9c46e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.599256:0:25724:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938442.599341:0:25724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d3af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+44:16392:x1871643350856320:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 32831us (34383us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1784938442.599349:0:25724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 661 00010000:00010000:1.0:1784938442.599426:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938442.599431:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec965129/0x7b044d4128f9c46e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.599440:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4056a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938442.599443:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec965129/0x7b044d4128f9c46e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.599451:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec965129/0x7b044d4128f9c46e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.599462:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec965129/0x7b044d4128f9c46e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.599469:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec965129/0x7b044d4128f9c46e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.599483:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.599485:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.599487:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938442.599510:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+66:10960:x1871643337432960:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 13616us (14506us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.599517:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 294 00000100:00100000:0.0:1784938442.599535:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2489ae6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350853632:192.168.202.154@tcp:6:osp-syn-1-1.0 00000004:00080000:0.0:1784938442.599555:0:16390:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24b68d9180/2, rc 0, transno 4294967436 00000100:00100000:0.0:1784938442.599566:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350853376:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:0.0:1784938442.599618:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d3aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350858496:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:2.0:1784938442.599687:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d3ac380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22955:1871643350857344:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938442.599702:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938442.599703:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938442.599721:0:25719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350858496 00000100:00100000:2.0:1784938442.599722:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+69:10960:x1871643337433472:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 13645us (14350us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.599725:0:25719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350858496 00000100:00100000:2.0:1784938442.599728:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 295 00000100:00100000:0.0:1784938442.599749:0:25719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 668 00000100:00100000:0.0:1784938442.599755:0:25719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d3ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+44:16390:x1871643350858496:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 00002000:00080000:0.0:1784938442.599769:0:25719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:39 count 1 00000004:00080000:2.0:1784938442.599773:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238d3ad500/2, rc 0, transno 4294967437 00000100:00100000:2.0:1784938442.599777:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d3ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350856320:192.168.202.154@tcp:6:osp-syn-0-1.0 00010000:00010000:0.0:1784938442.599781:0:25719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e420deed/0x7b044d4128f9c49f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938442.599788:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f1b4700/2, rc 0, transno 4294967435 00000100:00100000:2.0:1784938442.599795:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350855296:192.168.202.154@tcp:6:osp-syn-1-1.0 00000004:00080000:2.0:1784938442.599823:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f2381d2b480/2, rc 0, transno 4294967434 00000100:00100000:2.0:1784938442.599827:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2381d2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350857088:192.168.202.154@tcp:6:osp-syn-1-1.0 00010000:00010000:3.0:1784938442.599979:0:25718:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fcd3e12b/0x7b044d4128f9c428 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.599990:0:25718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcd3e12b/0x7b044d4128f9c428 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.599998:0:25718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcd3e12b/0x7b044d4128f9c428 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.600005:0:25718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcd3e12b/0x7b044d4128f9c428 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.600020:0:25718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784938442.600114:0:25718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d3ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+38:16391:x1871643350853760:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 49790us (61346us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1784938442.600125:0:25718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 651 00010000:00010000:3.0:1784938442.600183:0:21629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e45c1791/0x7b044d4128f994fd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663314 expref: 65 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.600196:0:21629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d3afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:21629:1871643350855808:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938442.600209:0:21629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fc902b02/0x7b044d4128f9c44b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.600218:0:21629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fc902b02/0x7b044d4128f9c44b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.600226:0:21629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc902b02/0x7b044d4128f9c44b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.600234:0:21629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc902b02/0x7b044d4128f9c44b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.600241:0:21629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc902b02/0x7b044d4128f9c44b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.600259:0:21629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1784938442.600339:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+45:16389:x1871643350855040:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 40918us (45338us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1784938442.600346:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 656 00010000:00010000:0.0:1784938442.600353:0:25719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d69cb8e1/0x7b044d4128f98f46 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766326c expref: 65 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.600363:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1784938442.600367:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.600372:0:25719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e420deed/0x7b044d4128f9c49f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.600381:0:25729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034c21370/0x7b044d4128f995a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633bc expref: 64 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.600391:0:25729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2381d2b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:25729:1871643350856960:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938442.600393:0:25719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d69cb8e1/0x7b044d4128f98f46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e94766326c expref: 63 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.600404:0:25729:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ad501493/0x7b044d4128f9c475 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.600404:0:25719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d69cb8e1/0x7b044d4128f98f46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766326c expref: 63 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.600413:0:25729:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ad501493/0x7b044d4128f9c475 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.600415:0:25719:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d3aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:25719:1871643350858624:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938442.600420:0:25729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad501493/0x7b044d4128f9c475 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.600428:0:25729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad501493/0x7b044d4128f9c475 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.600434:0:25729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad501493/0x7b044d4128f9c475 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.600446:0:25719:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2488b80cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1784938442.600447:0:25729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1784938442.600492:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784938442.600497:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcd3e12b/0x7b044d4128f9c428 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.600506:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938442.600510:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcd3e12b/0x7b044d4128f9c428 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.600518:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcd3e12b/0x7b044d4128f9c428 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.600521:0:25729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d3aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+45:16392:x1871643350856576:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 33794us (34631us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1784938442.600527:0:25729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 662 00010000:00010000:0.0:1784938442.600532:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcd3e12b/0x7b044d4128f9c428 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.600539:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcd3e12b/0x7b044d4128f9c428 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.600554:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938442.600558:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc902b02/0x7b044d4128f9c44b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.600564:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24d200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938442.600567:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc902b02/0x7b044d4128f9c44b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.600573:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc902b02/0x7b044d4128f9c44b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.600583:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc902b02/0x7b044d4128f9c44b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.600589:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc902b02/0x7b044d4128f9c44b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.600601:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938442.600605:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad501493/0x7b044d4128f9c475 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.600610:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f6400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938442.600612:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad501493/0x7b044d4128f9c475 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.600620:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad501493/0x7b044d4128f9c475 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.600628:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad501493/0x7b044d4128f9c475 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.600635:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad501493/0x7b044d4128f9c475 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.600647:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938442.600649:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938442.600650:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938442.600691:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784938442.600794:0:16391:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f2489ae5880/2, rc 0, transno 4294967436 00000004:00080000:3.0:1784938442.600936:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f2cad80/2, rc 0, transno 4294967438 00000100:00100000:3.0:1784938442.600942:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f2cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350855040:192.168.202.154@tcp:6:osp-syn-0-1.0 00010000:00010000:1.0:1784938442.601125:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938442.601172:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.601194:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337434880 00000100:00100000:1.0:1784938442.601199:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337434880 00000100:00100000:1.0:1784938442.601238:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 69 00000100:00100000:1.0:1784938442.601247:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24857f9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+380:17096:x1871643337434880:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:2.0:1784938442.601856:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2489ae5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350853760:192.168.202.154@tcp:6:osp-syn-1-1.0 00000004:00080000:2.0:1784938442.601957:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238d3ad880/2, rc 0, transno 4294967439 00000100:00100000:2.0:1784938442.601963:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d3ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350856576:192.168.202.154@tcp:6:osp-syn-0-1.0 00010000:00010000:2.0:1784938442.602214:0:25727:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004d89d376/0x7b044d4128f9c452 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.602227:0:25727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d89d376/0x7b044d4128f9c452 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.602237:0:25727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d89d376/0x7b044d4128f9c452 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.602245:0:25727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d89d376/0x7b044d4128f9c452 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.602262:0:25727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938442.604610:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24857f9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+381:17096:x1871643337434880:12345-192.168.202.54@tcp:35:cp.0 Request processed in 3353us (3427us total) trans 8589934796 rc 0/0 00000100:00100000:1.0:1784938442.604624:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 69 00010000:00010000:0.0:1784938442.604932:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938442.604941:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d89d376/0x7b044d4128f9c452 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.604953:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24d400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938442.604958:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d89d376/0x7b044d4128f9c452 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.604970:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d89d376/0x7b044d4128f9c452 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.604991:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d89d376/0x7b044d4128f9c452 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.604998:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d89d376/0x7b044d4128f9c452 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.605021:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938442.605023:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938442.605025:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938442.605309:0:25726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386361f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:25726:1871643350857856:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938442.605309:0:21149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386360e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:21149:1871643350857984:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938442.605340:0:21149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000964eb9b6/0x7b044d4128f9c48a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.605351:0:25726:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000735f81e4/0x7b044d4128f9c483 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.605617:0:25727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+38:16390:x1871643350855552:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 44995us (49554us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1784938442.605628:0:25727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 657 00000004:00080000:3.0:1784938442.606236:0:16390:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f2381d29880/2, rc 0, transno 4294967437 00000100:00100000:0.0:1784938442.606273:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.606288:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2381d29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350855552:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:0.0:1784938442.606306:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.606357:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.606360:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337435136 00000100:00100000:1.0:1784938442.606367:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337435136 00000100:00100000:0.0:1784938442.606372:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337435008 00000100:00100000:0.0:1784938442.606375:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337435008 00010000:00010000:1.0:1784938442.606397:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000af5a1535/0x7b044d4128f995b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633ca expref: 65 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.606397:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c885a3e3/0x7b044d4128f995ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633c3 expref: 65 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.606421:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337435264 00000100:00100000:1.0:1784938442.606424:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337435264 00000100:00100000:0.0:1784938442.606427:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 308 00000100:00100000:0.0:1784938442.606433:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d3afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+66:10960:x1871643337435136:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.606435:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008d1223b5/0x7b044d4128f98f38 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766325e expref: 66 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.606447:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 309 00010000:00010000:0.0:1784938442.606447:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1784938442.606453:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d3ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+66:10957:x1871643337435008:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938442.606453:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000af5a1535/0x7b044d4128f995b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633ca expref: 66 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.606459:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.606464:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c885a3e3/0x7b044d4128f995ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633c3 expref: 66 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.606464:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000af5a1535/0x7b044d4128f995b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633ca expref: 66 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.606473:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c885a3e3/0x7b044d4128f995ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633c3 expref: 66 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.606487:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c885a3e3/0x7b044d4128f995ac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633c3 expref: 66 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.606487:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af5a1535/0x7b044d4128f995b3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633ca expref: 66 pid: 21152 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.606502:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.606502:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.606507:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.606507:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.606513:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000735f81e4/0x7b044d4128f9c483 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.606513:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000964eb9b6/0x7b044d4128f9c48a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.606523:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000735f81e4/0x7b044d4128f9c483 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.606523:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000964eb9b6/0x7b044d4128f9c48a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.606544:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784938442.606544:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938442.606586:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d3afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+64:10960:x1871643337435136:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 152us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.606593:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 308 00000100:00100000:3.0:1784938442.606602:0:21152:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386363480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:21152:1871643350858112:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938442.606608:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 310 00000100:00100000:0.0:1784938442.606613:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+63:10959:x1871643337435264:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938442.606620:0:21152:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a01e5ace/0x7b044d4128f9c491 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.606620:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938442.606625:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008d1223b5/0x7b044d4128f98f38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766325e expref: 63 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.606634:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008d1223b5/0x7b044d4128f98f38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766325e expref: 63 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.606638:0:25726:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000735f81e4/0x7b044d4128f9c483 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.606646:0:25726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000735f81e4/0x7b044d4128f9c483 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.606646:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d1223b5/0x7b044d4128f98f38 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766325e expref: 63 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.606656:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.606658:0:25726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000735f81e4/0x7b044d4128f9c483 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.606659:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.606663:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a01e5ace/0x7b044d4128f9c491 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.606667:0:25726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000735f81e4/0x7b044d4128f9c483 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.606671:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a01e5ace/0x7b044d4128f9c491 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.606684:0:25726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938442.606685:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938442.606959:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938442.606966:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000735f81e4/0x7b044d4128f9c483 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.606974:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf0e00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938442.606978:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000735f81e4/0x7b044d4128f9c483 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.606991:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000735f81e4/0x7b044d4128f9c483 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.607002:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000735f81e4/0x7b044d4128f9c483 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.607008:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000735f81e4/0x7b044d4128f9c483 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.607024:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938442.607026:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938442.607027:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938442.607070:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d3ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+62:10957:x1871643337435008:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 616us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.607077:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 309 00000100:00100000:1.0:1784938442.607254:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.607442:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337435392 00000100:00100000:1.0:1784938442.607448:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337435392 00010000:00010000:1.0:1784938442.607469:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a3bd6645/0x7b044d4128f98f4d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663265 expref: 62 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.607499:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 311 00000100:00100000:1.0:1784938442.607506:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+62:10958:x1871643337435392:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.607515:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.607519:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a3bd6645/0x7b044d4128f98f4d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663265 expref: 62 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.607529:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a3bd6645/0x7b044d4128f98f4d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663265 expref: 62 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.607543:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.607547:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.607551:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000095b82f9b/0x7b044d4128f9c498 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.607559:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095b82f9b/0x7b044d4128f9c498 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.607573:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938442.607597:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+62:10958:x1871643337435392:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 92us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.607604:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 311 00010000:00010000:2.0:1784938442.607805:0:21151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3bd6645/0x7b044d4128f98f4d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663265 expref: 61 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.607819:0:21151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:21151:1871643350858368:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938442.607837:0:21151:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000095b82f9b/0x7b044d4128f9c498 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.607846:0:21151:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000095b82f9b/0x7b044d4128f9c498 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.607853:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095b82f9b/0x7b044d4128f9c498 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.607868:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095b82f9b/0x7b044d4128f9c498 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.607876:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095b82f9b/0x7b044d4128f9c498 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.607982:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784938442.608103:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+46:16389:x1871643350858240:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 9261us (9575us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1784938442.608111:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 667 00010000:00010000:1.0:1784938442.608474:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938442.608480:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095b82f9b/0x7b044d4128f9c498 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.608494:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f6600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938442.608497:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095b82f9b/0x7b044d4128f9c498 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.608506:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095b82f9b/0x7b044d4128f9c498 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.608519:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095b82f9b/0x7b044d4128f9c498 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.608525:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095b82f9b/0x7b044d4128f9c498 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.608540:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.608542:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.608543:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938442.608686:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+60:10959:x1871643337435264:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 2069us (2325us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.608694:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 310 00010000:00010000:0.0:1784938442.608722:0:21149:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000964eb9b6/0x7b044d4128f9c48a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.608737:0:21149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000964eb9b6/0x7b044d4128f9c48a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.608745:0:21149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000964eb9b6/0x7b044d4128f9c48a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.608753:0:21149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000964eb9b6/0x7b044d4128f9c48a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.608766:0:21149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784938442.608807:0:25726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+45:16390:x1871643350857472:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 13492us (17403us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1784938442.608815:0:25726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 664 00000004:00080000:3.0:1784938442.608857:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f2386362300/2, rc 0, transno 4294967441 00000100:00100000:3.0:1784938442.608862:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386362300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350858240:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:1.0:1784938442.609056:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.609269:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337435520 00000100:00100000:3.0:1784938442.609275:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337435520 00000100:00100000:0.0:1784938442.609287:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+45:16392:x1871643350857600:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 13487us (17825us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1784938442.609294:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 665 00010000:00010000:0.0:1784938442.609314:0:21152:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a01e5ace/0x7b044d4128f9c491 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.609323:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a01e5ace/0x7b044d4128f9c491 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.609341:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a01e5ace/0x7b044d4128f9c491 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.609348:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a01e5ace/0x7b044d4128f9c491 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.609368:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1784938442.609432:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+45:16392:x1871643350857728:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 13052us (17892us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1784938442.609438:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 666 00010000:00010000:0.0:1784938442.609453:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938442.609458:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000964eb9b6/0x7b044d4128f9c48a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.609466:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf0c00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938442.609470:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000964eb9b6/0x7b044d4128f9c48a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.609478:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000964eb9b6/0x7b044d4128f9c48a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.609490:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000964eb9b6/0x7b044d4128f9c48a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938442.609491:0:16390:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238d3af800/2, rc 0, transno 4294967440 00000100:00100000:1.0:1784938442.609496:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d3af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350857472:192.168.202.154@tcp:6:osp-syn-0-1.0 00010000:00010000:0.0:1784938442.609498:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000964eb9b6/0x7b044d4128f9c48a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.609514:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938442.609517:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a01e5ace/0x7b044d4128f9c491 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.609529:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938442.609532:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a01e5ace/0x7b044d4128f9c491 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.609539:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a01e5ace/0x7b044d4128f9c491 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938442.609563:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f2c9c00/2, rc 0, transno 4294967443 00000100:00100000:2.0:1784938442.609569:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f2c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350857728:192.168.202.154@tcp:6:osp-syn-0-1.0 00000004:00080000:2.0:1784938442.609578:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238d3ac000/2, rc 0, transno 4294967442 00000100:00100000:2.0:1784938442.609581:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d3ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350857600:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:3.0:1784938442.609675:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 397 00000100:00100000:3.0:1784938442.609685:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+381:17096:x1871643337435520:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.609705:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.609722:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0200/0x7b044d4128f9c4a6 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663ecf expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.609784:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c4ad lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.609798:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c4ad lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.609808:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c4ad lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.609821:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c4b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x239dea14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.609828:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c4b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.609835:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c4b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.609870:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c4ad lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.609880:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c4ad lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.609887:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c4ad lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.609966:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf0400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.609971:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c4ad lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.609978:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c4ad lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.609987:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938442.609990:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.609993:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c4ad lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.609998:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c4ad lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.610010:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c4b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.610015:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c4b4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.610020:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c4b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.610025:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.610028:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c4b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.610033:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c4b4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.610038:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x239dea14 (ffff9f238727ce00) 00010000:00010000:3.0:1784938442.610041:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.610043:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c4b4 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.610050:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c4b4 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.610080:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0200/0x7b044d4128f9c4a6 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ecf expref: 382 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.610090:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938442.610092:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.610095:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0200/0x7b044d4128f9c4a6 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ecf expref: 382 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.610104:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf0200, rc 0) 00000100:00100000:3.0:1784938442.610166:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+381:17096:x1871643337435520:12345-192.168.202.54@tcp:101:cp.0 Request processed in 461us (1089us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938442.610173:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 397 00010000:00010000:0.0:1784938442.610257:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a01e5ace/0x7b044d4128f9c491 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.610267:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a01e5ace/0x7b044d4128f9c491 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.610282:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938442.610284:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938442.610286:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938442.610292:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938442.612347:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.612374:0:25719:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d3aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:25719:1871643350858624:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938442.612399:0:25719:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e420deed/0x7b044d4128f9c49f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.612433:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.612493:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337435648 00000100:00100000:3.0:1784938442.612538:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337435648 00010000:00010000:3.0:1784938442.612570:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d69cb8e1/0x7b044d4128f98f46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766326c expref: 60 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.612616:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 312 00000100:00100000:3.0:1784938442.612625:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f2c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+60:10958:x1871643337435648:12345-192.168.202.54@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1784938442.612631:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337435776 00000100:00100000:0.0:1784938442.612634:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337435776 00010000:00010000:3.0:1784938442.612639:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938442.612644:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d69cb8e1/0x7b044d4128f98f46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766326c expref: 60 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.612656:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d69cb8e1/0x7b044d4128f98f46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766326c expref: 60 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.612662:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 398 00000100:00100000:0.0:1784938442.612667:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f2cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+381:17096:x1871643337435776:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.612677:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d69cb8e1/0x7b044d4128f98f46 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766326c expref: 60 pid: 21151 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.612692:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.612697:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.612703:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e420deed/0x7b044d4128f9c49f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.612712:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e420deed/0x7b044d4128f9c49f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.612735:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938442.612783:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f2c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+59:10958:x1871643337435648:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 160us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938442.612790:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 312 00010000:00010000:0.0:1784938442.613404:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938442.613424:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d400/0x7b044d4128f9c4bb lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663ed6 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.613484:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d200/0x7b044d4128f9c4c2 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.613497:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d200/0x7b044d4128f9c4c2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.613507:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d200/0x7b044d4128f9c4c2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.613521:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24cc00/0x7b044d4128f9c4c9 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x239dea14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.613528:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24cc00/0x7b044d4128f9c4c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.613535:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24cc00/0x7b044d4128f9c4c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.613578:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d200/0x7b044d4128f9c4c2 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.613585:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d200/0x7b044d4128f9c4c2 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.613591:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d200/0x7b044d4128f9c4c2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.613598:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d200/0x7b044d4128f9c4c2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.613605:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24d200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938442.613610:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d200/0x7b044d4128f9c4c2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.613617:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d200/0x7b044d4128f9c4c2 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.613628:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938442.613631:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.613635:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d200/0x7b044d4128f9c4c2 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.613641:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d200/0x7b044d4128f9c4c2 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.613652:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24cc00/0x7b044d4128f9c4c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.613658:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24cc00/0x7b044d4128f9c4c9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.613665:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24cc00/0x7b044d4128f9c4c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.613670:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24cc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938442.613672:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24cc00/0x7b044d4128f9c4c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.613678:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24cc00/0x7b044d4128f9c4c9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.613689:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x239dea14 (ffff9f248390aa00) 00010000:00010000:0.0:1784938442.613691:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.613694:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24cc00/0x7b044d4128f9c4c9 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.613699:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24cc00/0x7b044d4128f9c4c9 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.613729:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d400/0x7b044d4128f9c4bb lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ed6 expref: 382 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.613739:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938442.613741:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.613744:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d400/0x7b044d4128f9c4bb lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ed6 expref: 382 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.613753:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24d400, rc 0) 00000100:00100000:0.0:1784938442.613785:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f2cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+381:17096:x1871643337435776:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1117us (1353us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938442.613793:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 398 00010000:00010000:0.0:1784938442.613822:0:25719:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e420deed/0x7b044d4128f9c49f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.613831:0:25719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e420deed/0x7b044d4128f9c49f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.613839:0:25719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e420deed/0x7b044d4128f9c49f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.613848:0:25719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e420deed/0x7b044d4128f9c49f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.613875:0:25719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784938442.614075:0:25719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d3ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+45:16390:x1871643350858496:12345-192.168.202.154@tcp:6:osp-syn-0-1.0 Request processed in 14318us (14370us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1784938442.614085:0:25719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 668 00010000:00010000:1.0:1784938442.614133:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938442.614140:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e420deed/0x7b044d4128f9c49f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.614176:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24de00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938442.614180:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e420deed/0x7b044d4128f9c49f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.614188:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e420deed/0x7b044d4128f9c49f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.614202:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e420deed/0x7b044d4128f9c49f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.614209:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e420deed/0x7b044d4128f9c49f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.614225:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.614227:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938442.614229:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1784938442.614631:0:16390:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238d3aca80/2, rc 0, transno 4294967444 00000100:00100000:1.0:1784938442.614641:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d3aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350858496:192.168.202.154@tcp:6:osp-syn-0-1.0 00000100:00100000:2.0:1784938442.618000:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.618085:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337436032 00000100:00100000:0.0:1784938442.618095:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337436032 00000100:00100000:0.0:1784938442.618182:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 399 00000100:00100000:0.0:1784938442.618192:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f2c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+381:17096:x1871643337436032:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938442.618214:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938442.618236:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d600/0x7b044d4128f9c4d0 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663edd expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.618358:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c4d7 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.618373:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c4d7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.618384:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c4d7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.618397:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d000/0x7b044d4128f9c4de lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x239dea14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.618405:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d000/0x7b044d4128f9c4de lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.618412:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d000/0x7b044d4128f9c4de lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938442.618722:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5a:0x0], index 0: 0 00010000:00010000:0.0:1784938442.618863:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c800/0x7b044d4128f9c4e5 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.618873:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c800/0x7b044d4128f9c4e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.618880:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c800/0x7b044d4128f9c4e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.618913:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c4d7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.618921:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c4d7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.618928:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c4d7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.618934:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24d800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938442.618938:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c4d7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.618945:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c4d7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.618957:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938442.618961:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.618966:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c4d7 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.618973:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c4d7 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938442.618987:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000359d398a reply state 000000000c45c7d9 transno 8589934797 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d000/0x7b044d4128f9c4de lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.618998:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d000/0x7b044d4128f9c4de lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.619004:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x239dea14 (ffff9f248390a700) 00010000:00010000:0.0:1784938442.619006:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938442.619008:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938442.619036:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d600/0x7b044d4128f9c4d0 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663edd expref: 384 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.619052:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c800/0x7b044d4128f9c4e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663edd expref: 383 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.619060:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x33:0x0].0x0 (ffff9f248390af00) 00010000:00010000:0.0:1784938442.619062:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938442.619064:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24c800, rc 0) 00000100:00100000:0.0:1784938442.619127:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f2c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+384:17096:x1871643337436032:12345-192.168.202.54@tcp:101:cp.0 Request processed in 937us (1137us total) trans 8589934797 rc 0/0 00000100:00100000:0.0:1784938442.619135:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 399 00000100:00100000:0.0:1784938442.621986:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938442.622087:0:25725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337436160 00000100:00100000:2.0:1784938442.622097:0:25725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337436160 00000100:00100000:2.0:1784938442.622186:0:25725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 669 00000100:00100000:2.0:1784938442.622199:0:25725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7ea6e988-18ba-4c98-b179-17995571b98b+59:10960:x1871643337436160:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938442.622218:0:25725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938442.622237:0:25725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb1ec7ed/0x7b044d4128f9c4f3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663ee4 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938442.622262:0:25725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938442.622279:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5a:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1784938442.622282:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.622289:0:25725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb1ec7ed/0x7b044d4128f9c4f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ee4 expref: 60 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.622302:0:25725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eb1ec7ed/0x7b044d4128f9c4f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ee4 expref: 60 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.622312:0:25725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f245e00, rc 0) 00000100:00100000:2.0:1784938442.622490:0:25725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7ea6e988-18ba-4c98-b179-17995571b98b+60:10960:x1871643337436160:12345-192.168.202.54@tcp:101:cp.0 Request processed in 293us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938442.622498:0:25725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 669 00000100:00100000:2.0:1784938442.625093:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.625243:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337436288 00000100:00100000:0.0:1784938442.625255:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337436288 00000100:00100000:2.0:1784938442.625375:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 670 00000100:00100000:2.0:1784938442.625383:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f2c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+60:17096:x1871643337436288:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938442.625398:0:25722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938442.625414:0:25722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cff32a8e/0x7b044d4128f9c4fa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663eeb expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.625439:0:25722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb1ec7ed/0x7b044d4128f9c4f3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ee4 expref: 61 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.625445:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.625449:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.625453:0:25722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cff32a8e/0x7b044d4128f9c4fa lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663eeb expref: 61 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.625479:0:25722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eb1ec7ed/0x7b044d4128f9c4f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663ee4 expref: 61 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.625488:0:25722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eb1ec7ed/0x7b044d4128f9c4f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663ee4 expref: 61 pid: 25725 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.625499:0:25722:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f2c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25722:1871643350858752:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938442.625561:0:25722:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248fb1cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938442.630783:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938442.631122:0:25722:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f2c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25722:1871643350858752:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938442.631189:0:25722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cff32a8e/0x7b044d4128f9c4fa lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663eeb expref: 61 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.631212:0:25722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f244800, rc 0) 00000100:00100000:2.0:1784938442.631315:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f2c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+61:17096:x1871643337436288:12345-192.168.202.54@tcp:101:cp.0 Request processed in 5931us (6230us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938442.631324:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 670 00000100:00100000:1.0:1784938442.633282:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337436416 00000100:00100000:1.0:1784938442.633295:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337436416 00010000:00010000:1.0:1784938442.633357:0:25731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eb1ec7ed/0x7b044d4128f9c4f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663ee4 expref: 61 pid: 25725 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.633405:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 313 00000100:00100000:1.0:1784938442.633415:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2488a66c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+61:10960:x1871643337436416:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.633430:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.633453:0:25731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eb1ec7ed/0x7b044d4128f9c4f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663ee4 expref: 61 pid: 25725 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.633474:0:25731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eb1ec7ed/0x7b044d4128f9c4f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663ee4 expref: 61 pid: 25725 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.633498:0:25731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb1ec7ed/0x7b044d4128f9c4f3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663ee4 expref: 61 pid: 25725 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.633517:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.633522:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.633530:0:25731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cff32a8e/0x7b044d4128f9c4fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663eeb expref: 60 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.633541:0:25731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cff32a8e/0x7b044d4128f9c4fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663eeb expref: 60 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.633577:0:25731:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cff32a8e/0x7b044d4128f9c4fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663eeb expref: 60 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.633592:0:25731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:25731:1871643350858880:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938442.633666:0:25731:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828af180 going to sleep for 11 seconds 00000100:00100000:0.0:1784938442.637415:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.637436:0:25731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:25731:1871643350858880:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938442.637468:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938442.637529:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2488a66c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+60:10960:x1871643337436416:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 4114us (6754us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.637541:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 313 00000100:00100000:2.0:1784938442.637542:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337436672 00000100:00100000:2.0:1784938442.637551:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337436672 00000100:00100000:2.0:1784938442.637643:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 70 00000100:00100000:2.0:1784938442.637652:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+384:17096:x1871643337436672:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:2.0:1784938442.637930:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+385:17096:x1871643337436672:12345-192.168.202.54@tcp:35:cp.0 Request processed in 278us (524us total) trans 8589934798 rc 0/0 00000100:00100000:2.0:1784938442.637938:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 70 00000100:00100000:0.0:1784938442.641080:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938442.641502:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337436800 00000100:00100000:2.0:1784938442.641512:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337436800 00000100:00100000:2.0:1784938442.641566:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 400 00000100:00100000:2.0:1784938442.641575:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+385:17096:x1871643337436800:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938442.641598:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938442.641618:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c501 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663ef2 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.641677:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244a00/0x7b044d4128f9c508 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.641691:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244a00/0x7b044d4128f9c508 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.641702:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244a00/0x7b044d4128f9c508 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.641716:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245c00/0x7b044d4128f9c50f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x130f79e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.641722:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245c00/0x7b044d4128f9c50f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.641728:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245c00/0x7b044d4128f9c50f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.641771:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244a00/0x7b044d4128f9c508 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.641781:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244a00/0x7b044d4128f9c508 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.641788:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244a00/0x7b044d4128f9c508 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.641794:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244a00/0x7b044d4128f9c508 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.641800:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f244a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938442.641805:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244a00/0x7b044d4128f9c508 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.641812:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244a00/0x7b044d4128f9c508 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.641823:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938442.641827:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.641831:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244a00/0x7b044d4128f9c508 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.641837:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244a00/0x7b044d4128f9c508 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.641850:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245c00/0x7b044d4128f9c50f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.641857:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245c00/0x7b044d4128f9c50f lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.641863:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245c00/0x7b044d4128f9c50f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.641870:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938442.641873:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245c00/0x7b044d4128f9c50f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.641880:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245c00/0x7b044d4128f9c50f lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.641888:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x130f79e0 (ffff9f238d49e500) 00010000:00010000:2.0:1784938442.641902:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.641906:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245c00/0x7b044d4128f9c50f lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.641913:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245c00/0x7b044d4128f9c50f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.641953:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c501 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ef2 expref: 386 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.641963:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938442.641966:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.641969:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c501 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ef2 expref: 386 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.641977:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f245600, rc 0) 00000100:00100000:2.0:1784938442.642037:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+385:17096:x1871643337436800:12345-192.168.202.54@tcp:101:cp.0 Request processed in 463us (965us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938442.642045:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 400 00000100:00100000:3.0:1784938442.645048:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.645137:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337436928 00000100:00100000:0.0:1784938442.645261:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337436928 00000100:00100000:0.0:1784938442.645407:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 401 00000100:00100000:0.0:1784938442.645418:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+385:17096:x1871643337436928:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938442.645439:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938442.645462:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d600/0x7b044d4128f9c516 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663ef9 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.645528:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c51d lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.645544:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c51d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.645555:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c51d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.645570:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24cc00/0x7b044d4128f9c524 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x130f79e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.645577:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24cc00/0x7b044d4128f9c524 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.645584:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24cc00/0x7b044d4128f9c524 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.645625:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c51d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.645632:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c51d lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.645638:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c51d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.645644:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24d800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938442.645647:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c51d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.645654:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c51d lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.645665:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938442.645667:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.645672:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c51d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.645678:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c51d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.645690:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24cc00/0x7b044d4128f9c524 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.645695:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24cc00/0x7b044d4128f9c524 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.645700:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24cc00/0x7b044d4128f9c524 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.645704:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24cc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938442.645707:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24cc00/0x7b044d4128f9c524 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.645716:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24cc00/0x7b044d4128f9c524 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.645722:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x130f79e0 (ffff9f248390aa00) 00010000:00010000:0.0:1784938442.645724:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.645726:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24cc00/0x7b044d4128f9c524 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.645732:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24cc00/0x7b044d4128f9c524 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.645764:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d600/0x7b044d4128f9c516 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ef9 expref: 386 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.645774:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938442.645776:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.645780:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d600/0x7b044d4128f9c516 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ef9 expref: 386 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.645788:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24d600, rc 0) 00000100:00100000:0.0:1784938442.645855:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+385:17096:x1871643337436928:12345-192.168.202.54@tcp:101:cp.0 Request processed in 438us (817us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938442.645862:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 401 00000100:00100000:3.0:1784938442.649388:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938442.649467:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337437184 00000100:00100000:2.0:1784938442.649479:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337437184 00000100:00100000:2.0:1784938442.649584:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 402 00000100:00100000:2.0:1784938442.649595:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386361f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+385:17096:x1871643337437184:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938442.649617:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938442.649641:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c52b lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663f00 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.649753:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245c00/0x7b044d4128f9c532 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.649768:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245c00/0x7b044d4128f9c532 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.649781:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245c00/0x7b044d4128f9c532 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.649796:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244a00/0x7b044d4128f9c539 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x130f79e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.649803:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244a00/0x7b044d4128f9c539 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.649809:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244a00/0x7b044d4128f9c539 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938442.650326:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5a:0x0], index 1: 0 00010000:00010000:2.0:1784938442.650508:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245800/0x7b044d4128f9c540 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.650518:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245800/0x7b044d4128f9c540 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.650530:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245800/0x7b044d4128f9c540 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.650566:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245c00/0x7b044d4128f9c532 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.650574:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245c00/0x7b044d4128f9c532 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.650581:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245c00/0x7b044d4128f9c532 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.650589:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245c00/0x7b044d4128f9c532 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.650595:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938442.650599:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245c00/0x7b044d4128f9c532 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.650607:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245c00/0x7b044d4128f9c532 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.650620:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938442.650624:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.650628:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245c00/0x7b044d4128f9c532 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.650635:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245c00/0x7b044d4128f9c532 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938442.650649:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ab232238 reply state 000000008c760081 transno 8589934799 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244a00/0x7b044d4128f9c539 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.650661:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244a00/0x7b044d4128f9c539 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.650668:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x130f79e0 (ffff9f238d49e500) 00010000:00010000:2.0:1784938442.650670:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938442.650672:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938442.650704:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c52b lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f00 expref: 388 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.650719:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245800/0x7b044d4128f9c540 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f00 expref: 387 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.650727:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x34:0x0].0x0 (ffff9f238d49e100) 00010000:00010000:2.0:1784938442.650729:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938442.650731:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f245800, rc 0) 00000100:00100000:2.0:1784938442.650812:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386361f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+388:17096:x1871643337437184:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1218us (1433us total) trans 8589934799 rc 0/0 00000100:00100000:2.0:1784938442.650821:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 402 00000100:00100000:1.0:1784938442.655086:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.655323:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337437312 00000100:00100000:3.0:1784938442.655345:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337437312 00000100:00100000:3.0:1784938442.655417:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 671 00000100:00100000:3.0:1784938442.655429:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+69:10957:x1871643337437312:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.655451:0:25716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.655475:0:25716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9c54e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663f07 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938442.655503:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938442.655527:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5a:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1784938442.655532:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.655541:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9c54e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f07 expref: 70 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.655560:0:25716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9c54e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f07 expref: 70 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.655575:0:25716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf1600, rc 0) 00000100:00100000:3.0:1784938442.655646:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+70:10957:x1871643337437312:12345-192.168.202.54@tcp:101:cp.0 Request processed in 219us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938442.655654:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 671 00000100:00100000:3.0:1784938442.660908:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.661044:0:25724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337437440 00000100:00100000:1.0:1784938442.661056:0:25724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337437440 00000100:00100000:1.0:1784938442.661129:0:25724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 672 00000100:00100000:1.0:1784938442.661140:0:25724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386361500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7ea6e988-18ba-4c98-b179-17995571b98b+70:17096:x1871643337437440:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938442.661208:0:25724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938442.661231:0:25724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000527ab402/0x7b044d4128f9c555 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663f0e expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.661294:0:25724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9c54e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f07 expref: 71 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.661303:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.661307:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.661313:0:25724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000527ab402/0x7b044d4128f9c555 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f0e expref: 71 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.661362:0:25724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9c54e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663f07 expref: 71 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.661379:0:25724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9c54e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663f07 expref: 71 pid: 25716 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.661395:0:25724:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37cb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:25724:1871643350859008:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938442.661480:0:25724:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828afc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938442.666780:0:25724:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37cb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:25724:1871643350859008:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938442.666824:0:25724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000527ab402/0x7b044d4128f9c555 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663f0e expref: 71 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.666851:0:25724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c9f7c00, rc 0) 00000100:00100000:2.0:1784938442.666936:0:25724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386361500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7ea6e988-18ba-4c98-b179-17995571b98b+71:17096:x1871643337437440:12345-192.168.202.54@tcp:101:cp.0 Request processed in 5796us (6037us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938442.666945:0:25724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 672 00000100:00100000:0.0:1784938442.671008:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.671711:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337437568 00000100:00100000:1.0:1784938442.671725:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337437568 00010000:00010000:1.0:1784938442.671777:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9c54e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663f07 expref: 71 pid: 25716 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.671838:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 314 00000100:00100000:1.0:1784938442.671851:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+71:10958:x1871643337437568:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.671868:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.671906:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9c54e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663f07 expref: 71 pid: 25716 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.671922:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9c54e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663f07 expref: 71 pid: 25716 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.671949:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9c54e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663f07 expref: 71 pid: 25716 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.671967:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.671971:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.671981:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000527ab402/0x7b044d4128f9c555 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663f0e expref: 70 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.671991:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000527ab402/0x7b044d4128f9c555 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663f0e expref: 70 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.672046:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000527ab402/0x7b044d4128f9c555 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663f0e expref: 70 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.672068:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:19219:1871643350859136:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938442.672598:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828af900 going to sleep for 11 seconds 00000100:00100000:1.0:1784938442.677091:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:19219:1871643350859136:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938442.677129:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938442.677223:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+70:10958:x1871643337437568:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 5374us (6225us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.677235:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 314 00000100:00100000:2.0:1784938442.680483:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.680660:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337437824 00000100:00100000:1.0:1784938442.680671:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337437824 00000100:00100000:1.0:1784938442.680739:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 71 00000100:00100000:1.0:1784938442.680750:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f2c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+388:17096:x1871643337437824:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:1.0:1784938442.681620:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f2c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+389:17096:x1871643337437824:12345-192.168.202.54@tcp:35:cp.0 Request processed in 866us (1142us total) trans 8589934800 rc 0/0 00000100:00100000:1.0:1784938442.681630:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 71 00000100:00100000:0.0:1784938442.686795:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.686991:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337437952 00000100:00100000:1.0:1784938442.687004:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337437952 00000100:00100000:1.0:1784938442.687215:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 403 00000100:00100000:1.0:1784938442.687228:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+389:17096:x1871643337437952:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938442.687270:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938442.687426:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9c55c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663f15 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.687515:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c563 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.687540:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c563 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.687553:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c563 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.687570:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6000/0x7b044d4128f9c56a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xc735cef4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.687578:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6000/0x7b044d4128f9c56a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.687584:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6000/0x7b044d4128f9c56a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.687633:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c563 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.687640:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c563 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.687647:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c563 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.687653:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f6e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938442.687657:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c563 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.687665:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c563 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.687677:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938442.687681:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938442.687685:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c563 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.687691:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c563 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.687704:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6000/0x7b044d4128f9c56a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.687710:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6000/0x7b044d4128f9c56a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.687715:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6000/0x7b044d4128f9c56a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.687720:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f6000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938442.687722:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6000/0x7b044d4128f9c56a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.687727:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6000/0x7b044d4128f9c56a lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.687734:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xc735cef4 (ffff9f23823e0b00) 00010000:00010000:1.0:1784938442.687736:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938442.687738:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6000/0x7b044d4128f9c56a lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.687743:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6000/0x7b044d4128f9c56a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.687775:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9c55c lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f15 expref: 390 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.687786:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938442.687789:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938442.687793:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9c55c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f15 expref: 390 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.687803:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c9f7e00, rc 0) 00000100:00100000:1.0:1784938442.687873:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+389:17096:x1871643337437952:12345-192.168.202.54@tcp:101:cp.0 Request processed in 647us (1087us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938442.687881:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 403 00000100:00100000:2.0:1784938442.692354:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.692552:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337438080 00000100:00100000:0.0:1784938442.692565:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337438080 00000100:00100000:0.0:1784938442.692644:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 404 00000100:00100000:0.0:1784938442.692656:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f2ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+389:17096:x1871643337438080:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938442.692682:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938442.692710:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c571 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663f1c expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.692798:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d200/0x7b044d4128f9c578 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.692816:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d200/0x7b044d4128f9c578 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.692830:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d200/0x7b044d4128f9c578 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.692849:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24da00/0x7b044d4128f9c57f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xc735cef4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.692857:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24da00/0x7b044d4128f9c57f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.692864:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24da00/0x7b044d4128f9c57f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.692922:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d200/0x7b044d4128f9c578 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.692930:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d200/0x7b044d4128f9c578 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.692936:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d200/0x7b044d4128f9c578 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.692948:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24d200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938442.692954:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d200/0x7b044d4128f9c578 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.692962:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d200/0x7b044d4128f9c578 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.692977:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938442.692980:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.692984:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d200/0x7b044d4128f9c578 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.692991:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d200/0x7b044d4128f9c578 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.693006:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24da00/0x7b044d4128f9c57f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.693012:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24da00/0x7b044d4128f9c57f lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.693018:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24da00/0x7b044d4128f9c57f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.693022:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24da00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938442.693041:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24da00/0x7b044d4128f9c57f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.693046:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24da00/0x7b044d4128f9c57f lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.693057:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xc735cef4 (ffff9f248390aa00) 00010000:00010000:0.0:1784938442.693059:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.693062:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24da00/0x7b044d4128f9c57f lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.693068:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24da00/0x7b044d4128f9c57f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.693107:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c571 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f1c expref: 390 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.693117:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938442.693120:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.693274:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c571 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f1c expref: 390 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.693424:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24d800, rc 0) 00000100:00100000:0.0:1784938442.693512:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f2ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+389:17096:x1871643337438080:12345-192.168.202.54@tcp:101:cp.0 Request processed in 859us (1182us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938442.693521:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 404 00000100:00100000:2.0:1784938442.697481:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.697541:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337438336 00000100:00100000:3.0:1784938442.697553:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337438336 00000100:00100000:3.0:1784938442.697614:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 405 00000100:00100000:3.0:1784938442.697625:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f2cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+389:17096:x1871643337438336:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.697649:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.697677:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0200/0x7b044d4128f9c586 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663f23 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.697800:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c58d lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.697819:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c58d lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.697841:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c58d lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.698024:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0600/0x7b044d4128f9c594 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0xc735cef4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.698033:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0600/0x7b044d4128f9c594 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.698042:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0600/0x7b044d4128f9c594 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938442.698763:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5b:0x0], index 0: 0 00010000:00010000:2.0:1784938442.699407:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245a00/0x7b044d4128f9c59b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.699420:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245a00/0x7b044d4128f9c59b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.699429:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245a00/0x7b044d4128f9c59b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.699463:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c58d lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.699470:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c58d lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.699478:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c58d lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.699485:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf0400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938442.699489:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c58d lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.699496:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c58d lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.699508:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938442.699510:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.699516:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c58d lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.699522:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c58d lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938442.699539:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fe5467d9 reply state 00000000800a340a transno 8589934801 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0600/0x7b044d4128f9c594 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.699550:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0600/0x7b044d4128f9c594 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.699556:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xc735cef4 (ffff9f238727c300) 00010000:00010000:2.0:1784938442.699559:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938442.699562:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938442.699602:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0200/0x7b044d4128f9c586 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f23 expref: 392 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.699620:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245a00/0x7b044d4128f9c59b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f23 expref: 391 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.699627:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x35:0x0].0x0 (ffff9f238d49ea00) 00010000:00010000:2.0:1784938442.699629:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938442.699632:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f245a00, rc 0) 00000100:00100000:2.0:1784938442.699710:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f2cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+392:17096:x1871643337438336:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2087us (2238us total) trans 8589934801 rc 0/0 00000100:00100000:2.0:1784938442.699719:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 405 00000100:00100000:3.0:1784938442.703350:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938442.703477:0:25728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337438464 00000100:00100000:2.0:1784938442.703489:0:25728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337438464 00000100:00100000:2.0:1784938442.703552:0:25728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 673 00000100:00100000:2.0:1784938442.703563:0:25728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386360e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:7ea6e988-18ba-4c98-b179-17995571b98b+60:10960:x1871643337438464:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938442.703586:0:25728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938442.703613:0:25728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c5a9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663f2a expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938442.703643:0:25728:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938442.703671:0:25728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5b:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1784938442.703676:0:25728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.703687:0:25728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c5a9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f2a expref: 61 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.703707:0:25728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c5a9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f2a expref: 61 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.703720:0:25728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f244600, rc 0) 00000100:00100000:2.0:1784938442.703795:0:25728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386360e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:7ea6e988-18ba-4c98-b179-17995571b98b+61:10960:x1871643337438464:12345-192.168.202.54@tcp:101:cp.0 Request processed in 233us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938442.703803:0:25728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 673 00000100:00100000:0.0:1784938442.707212:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.707567:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337438592 00000100:00100000:3.0:1784938442.707578:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337438592 00000100:00100000:3.0:1784938442.707649:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 674 00000100:00100000:3.0:1784938442.707661:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+61:17096:x1871643337438592:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.707680:0:21629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.707703:0:21629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1519450/0x7b044d4128f9c5b0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663f31 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.707738:0:21629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c5a9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f2a expref: 62 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.707748:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.707752:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.707757:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1519450/0x7b044d4128f9c5b0 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f31 expref: 62 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.707794:0:21629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c5a9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663f2a expref: 62 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.707810:0:21629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c5a9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663f2a expref: 62 pid: 25728 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.707827:0:21629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386360000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:21629:1871643350859264:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938442.708081:0:21629:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2484c73600 going to sleep for 11 seconds 00000100:00100000:3.0:1784938442.711730:0:21629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386360000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:21629:1871643350859264:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938442.711773:0:21629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d1519450/0x7b044d4128f9c5b0 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663f31 expref: 62 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.711797:0:21629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf0200, rc 0) 00000100:00100000:3.0:1784938442.711867:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+62:17096:x1871643337438592:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4207us (4667us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938442.711882:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 674 00000100:00100000:0.0:1784938442.714263:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.714612:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337438720 00000100:00100000:1.0:1784938442.714624:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337438720 00010000:00010000:1.0:1784938442.714665:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c5a9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663f2a expref: 62 pid: 25728 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.714749:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 315 00000100:00100000:1.0:1784938442.714759:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+62:10959:x1871643337438720:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.714774:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.714795:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c5a9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663f2a expref: 62 pid: 25728 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.714810:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c5a9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663f2a expref: 62 pid: 25728 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.714834:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9c5a9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663f2a expref: 62 pid: 25728 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.714851:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.714855:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.714864:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1519450/0x7b044d4128f9c5b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663f31 expref: 61 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.714874:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1519450/0x7b044d4128f9c5b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663f31 expref: 61 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.714922:0:19220:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d1519450/0x7b044d4128f9c5b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663f31 expref: 61 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.714936:0:19220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:19220:1871643350859392:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938442.715015:0:19220:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828afc00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938442.718916:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938442.719022:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337438976 00000100:00100000:2.0:1784938442.719039:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337438976 00000100:00100000:2.0:1784938442.719092:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 72 00000100:00100000:2.0:1784938442.719101:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+392:17096:x1871643337438976:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:2.0:1784938442.719571:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+393:17096:x1871643337438976:12345-192.168.202.54@tcp:35:cp.0 Request processed in 470us (663us total) trans 8589934802 rc 0/0 00000100:00100000:2.0:1784938442.719580:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 72 00000100:00100000:3.0:1784938442.722361:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.722513:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337439104 00000100:00100000:0.0:1784938442.722522:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337439104 00000100:00100000:0.0:1784938442.722580:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 406 00000100:00100000:0.0:1784938442.722589:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+393:17096:x1871643337439104:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938442.722617:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938442.722636:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c000/0x7b044d4128f9c5b7 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663f38 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.722701:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24dc00/0x7b044d4128f9c5be lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.722716:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24dc00/0x7b044d4128f9c5be lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.722727:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24dc00/0x7b044d4128f9c5be lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.722741:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c200/0x7b044d4128f9c5c5 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x21aa2247 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.722749:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c200/0x7b044d4128f9c5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.722755:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c200/0x7b044d4128f9c5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.722795:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24dc00/0x7b044d4128f9c5be lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.722802:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24dc00/0x7b044d4128f9c5be lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.722808:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24dc00/0x7b044d4128f9c5be lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.722815:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24dc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938442.722819:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24dc00/0x7b044d4128f9c5be lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.722827:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24dc00/0x7b044d4128f9c5be lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.722837:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938442.722840:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.722845:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24dc00/0x7b044d4128f9c5be lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.722852:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24dc00/0x7b044d4128f9c5be lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.722864:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c200/0x7b044d4128f9c5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.722870:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c200/0x7b044d4128f9c5c5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.722877:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c200/0x7b044d4128f9c5c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.722882:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24c200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938442.722885:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c200/0x7b044d4128f9c5c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.722902:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c200/0x7b044d4128f9c5c5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.722909:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x21aa2247 (ffff9f248390aa00) 00010000:00010000:0.0:1784938442.722912:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.722915:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c200/0x7b044d4128f9c5c5 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.722921:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c200/0x7b044d4128f9c5c5 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.722955:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c000/0x7b044d4128f9c5b7 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f38 expref: 394 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.722965:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938442.722968:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.722972:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c000/0x7b044d4128f9c5b7 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f38 expref: 394 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.722981:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24c000, rc 0) 00000100:00100000:0.0:1784938442.723046:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+393:17096:x1871643337439104:12345-192.168.202.54@tcp:101:cp.0 Request processed in 458us (694us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938442.723053:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 406 00000100:00100000:1.0:1784938442.724733:0:19220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:19220:1871643350859392:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938442.724761:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938442.724814:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+61:10959:x1871643337438720:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 10056us (10561us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.724824:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 315 00000100:00100000:3.0:1784938442.729487:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.729657:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337439232 00000100:00100000:1.0:1784938442.729667:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337439232 00000100:00100000:1.0:1784938442.729730:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 407 00000100:00100000:1.0:1784938442.729740:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386362a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+393:17096:x1871643337439232:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938442.729761:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938442.729783:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6000/0x7b044d4128f9c5cc lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663f3f expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.729845:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c5d3 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.729861:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c5d3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.729873:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c5d3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.729886:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c5da lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x21aa2247 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.729902:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c5da lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.729910:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c5da lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.729946:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c5d3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.729954:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c5d3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.729960:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c5d3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.729966:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f6e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938442.729970:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c5d3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.729982:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c5d3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.729993:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938442.729996:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938442.730001:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c5d3 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.730006:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c5d3 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.730017:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c5da lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.730023:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c5da lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.730029:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c5da lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.730034:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f6600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938442.730037:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c5da lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.730043:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c5da lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.730049:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x21aa2247 (ffff9f23823e0b00) 00010000:00010000:1.0:1784938442.730051:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938442.730054:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c5da lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.730064:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c5da lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.730099:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6000/0x7b044d4128f9c5cc lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f3f expref: 394 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.730110:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938442.730113:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938442.730117:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6000/0x7b044d4128f9c5cc lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f3f expref: 394 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.730138:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c9f6000, rc 0) 00000100:00100000:1.0:1784938442.730221:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386362a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+393:17096:x1871643337439232:12345-192.168.202.54@tcp:101:cp.0 Request processed in 482us (745us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938442.730228:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 407 00000100:00100000:3.0:1784938442.733925:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.739549:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337439488 00000100:00100000:0.0:1784938442.739566:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337439488 00000100:00100000:0.0:1784938442.739648:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 408 00000100:00100000:0.0:1784938442.739658:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386361880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+393:17096:x1871643337439488:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938442.739680:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938442.739702:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c000/0x7b044d4128f9c5e1 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663f46 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.739814:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c200/0x7b044d4128f9c5e8 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.739834:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c200/0x7b044d4128f9c5e8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.739846:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c200/0x7b044d4128f9c5e8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.739859:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24dc00/0x7b044d4128f9c5ef lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x21aa2247 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.739867:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24dc00/0x7b044d4128f9c5ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.739873:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24dc00/0x7b044d4128f9c5ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938442.740448:0:24203:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5b:0x0], index 1: 0 00010000:00010000:0.0:1784938442.740576:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ce00/0x7b044d4128f9c5f6 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.740588:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ce00/0x7b044d4128f9c5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.740596:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ce00/0x7b044d4128f9c5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.740626:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c200/0x7b044d4128f9c5e8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.740633:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c200/0x7b044d4128f9c5e8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.740640:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c200/0x7b044d4128f9c5e8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.740648:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24c200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938442.740652:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c200/0x7b044d4128f9c5e8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.740660:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c200/0x7b044d4128f9c5e8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.740672:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938442.740675:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.740680:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c200/0x7b044d4128f9c5e8 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.740687:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c200/0x7b044d4128f9c5e8 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938442.740701:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000625b956c reply state 0000000013d15e2b transno 8589934803 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24dc00/0x7b044d4128f9c5ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.740711:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24dc00/0x7b044d4128f9c5ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.740718:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x21aa2247 (ffff9f248390aa00) 00010000:00010000:0.0:1784938442.740720:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938442.740722:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938442.740748:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c000/0x7b044d4128f9c5e1 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f46 expref: 396 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.740762:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ce00/0x7b044d4128f9c5f6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f46 expref: 395 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.740775:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x36:0x0].0x0 (ffff9f248390ad00) 00010000:00010000:0.0:1784938442.740778:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938442.740780:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24ce00, rc 0) 00000100:00100000:0.0:1784938442.740854:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386361880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+396:17096:x1871643337439488:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1196us (6939us total) trans 8589934803 rc 0/0 00000100:00100000:0.0:1784938442.740861:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 408 00000100:00100000:3.0:1784938442.744092:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938442.744585:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337439616 00000100:00100000:2.0:1784938442.744596:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337439616 00000100:00100000:2.0:1784938442.744648:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 675 00000100:00100000:2.0:1784938442.744658:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+70:10957:x1871643337439616:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938442.744678:0:25715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938442.744698:0:25715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3c3b4db/0x7b044d4128f9c604 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663f4d expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938442.744726:0:25715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938442.744748:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5b:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1784938442.744753:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.744762:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3c3b4db/0x7b044d4128f9c604 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f4d expref: 71 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.744780:0:25715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d3c3b4db/0x7b044d4128f9c604 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f4d expref: 71 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.744795:0:25715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f245200, rc 0) 00000100:00100000:2.0:1784938442.744846:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+71:10957:x1871643337439616:12345-192.168.202.54@tcp:101:cp.0 Request processed in 189us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938442.744853:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 675 00000100:00100000:3.0:1784938442.747838:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938442.747970:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337439744 00000100:00100000:2.0:1784938442.747980:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337439744 00000100:00100000:2.0:1784938442.748043:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 676 00000100:00100000:2.0:1784938442.748053:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386363100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+71:17096:x1871643337439744:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938442.748070:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938442.748088:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003298af1d/0x7b044d4128f9c60b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663f54 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.748121:0:21151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d3c3b4db/0x7b044d4128f9c604 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f4d expref: 72 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.748131:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.748136:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.748141:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003298af1d/0x7b044d4128f9c60b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f54 expref: 72 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.748191:0:21151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d3c3b4db/0x7b044d4128f9c604 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663f4d expref: 72 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.748206:0:21151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d3c3b4db/0x7b044d4128f9c604 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663f4d expref: 72 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.748222:0:21151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f2c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:21151:1871643350859520:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938442.748286:0:21151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248fb1c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938442.751804:0:21151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f2c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:21151:1871643350859520:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938442.751805:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:2.0:1784938442.751840:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003298af1d/0x7b044d4128f9c60b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663f54 expref: 72 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.751862:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f244e00, rc 0) 00000100:00100000:2.0:1784938442.751923:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386363100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+72:17096:x1871643337439744:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3871us (4096us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938442.751932:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 676 00000100:00100000:0.0:1784938442.753432:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337439872 00000100:00100000:0.0:1784938442.753443:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337439872 00010000:00010000:0.0:1784938442.753886:0:25731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d3c3b4db/0x7b044d4128f9c604 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663f4d expref: 72 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.753931:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 316 00000100:00100000:0.0:1784938442.753941:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386360700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+72:10958:x1871643337439872:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938442.753956:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938442.753979:0:25731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d3c3b4db/0x7b044d4128f9c604 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663f4d expref: 72 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.753992:0:25731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d3c3b4db/0x7b044d4128f9c604 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663f4d expref: 72 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.754015:0:25731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3c3b4db/0x7b044d4128f9c604 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663f4d expref: 72 pid: 25715 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.754034:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.754039:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.754048:0:25731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003298af1d/0x7b044d4128f9c60b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663f54 expref: 71 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.754057:0:25731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003298af1d/0x7b044d4128f9c60b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663f54 expref: 71 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.754096:0:25731:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003298af1d/0x7b044d4128f9c60b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663f54 expref: 71 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.754110:0:25731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2381d28e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:25731:1871643350859648:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938442.754886:0:25731:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238108e600 going to sleep for 11 seconds 00000100:00100000:0.0:1784938442.757455:0:25731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2381d28e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:25731:1871643350859648:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938442.757488:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938442.757493:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.757550:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386360700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+71:10958:x1871643337439872:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3609us (5746us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938442.757558:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337440128 00000100:00100000:0.0:1784938442.757562:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 316 00000100:00100000:3.0:1784938442.757567:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337440128 00000100:00100000:3.0:1784938442.757616:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 73 00000100:00100000:3.0:1784938442.757625:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f2c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+396:17096:x1871643337440128:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938442.758765:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f2c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+397:17096:x1871643337440128:12345-192.168.202.54@tcp:35:cp.0 Request processed in 1135us (1271us total) trans 8589934804 rc 0/0 00000100:00100000:3.0:1784938442.758777:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 73 00000100:00100000:3.0:1784938442.762361:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.762441:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337440256 00000100:00100000:1.0:1784938442.762451:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337440256 00000100:00100000:1.0:1784938442.762515:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 409 00000100:00100000:1.0:1784938442.762524:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386362d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+397:17096:x1871643337440256:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938442.762550:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938442.762571:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6000/0x7b044d4128f9c612 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663f5b expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.762630:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c619 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.762644:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c619 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.762655:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c619 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.762668:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c620 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xbf580d0c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.762675:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c620 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.762682:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c620 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.762718:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c619 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.762724:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c619 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.762731:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c619 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.762737:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f6600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938442.762742:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c619 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.762749:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c619 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.762760:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938442.762763:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938442.762767:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c619 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.762774:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c619 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.762785:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c620 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.762791:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c620 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.762797:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c620 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.762802:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f6e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938442.762805:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c620 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.762810:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c620 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.762817:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xbf580d0c (ffff9f23823e0b00) 00010000:00010000:1.0:1784938442.762819:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938442.762821:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c620 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.762827:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c620 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.762853:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6000/0x7b044d4128f9c612 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f5b expref: 398 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.762868:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938442.762871:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938442.762874:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6000/0x7b044d4128f9c612 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f5b expref: 398 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.762883:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c9f6000, rc 0) 00000100:00100000:1.0:1784938442.762951:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386362d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+397:17096:x1871643337440256:12345-192.168.202.54@tcp:101:cp.0 Request processed in 428us (598us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938442.762959:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 409 00000100:00100000:0.0:1784938442.765883:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938442.765963:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337440384 00000100:00100000:2.0:1784938442.765971:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337440384 00000100:00100000:2.0:1784938442.766032:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 410 00000100:00100000:2.0:1784938442.766042:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+397:17096:x1871643337440384:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938442.766065:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938442.766086:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245c00/0x7b044d4128f9c627 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663f62 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.766196:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c62e lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.766213:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c62e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.766224:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c62e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.766239:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245e00/0x7b044d4128f9c635 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xbf580d0c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.766246:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245e00/0x7b044d4128f9c635 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.766252:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245e00/0x7b044d4128f9c635 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.766293:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c62e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.766300:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c62e lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.766308:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c62e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.766314:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938442.766318:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c62e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.766325:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c62e lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.766350:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938442.766353:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.766358:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c62e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.766364:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c62e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.766376:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245e00/0x7b044d4128f9c635 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.766382:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245e00/0x7b044d4128f9c635 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.766389:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245e00/0x7b044d4128f9c635 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.766394:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938442.766397:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245e00/0x7b044d4128f9c635 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.766407:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245e00/0x7b044d4128f9c635 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.766414:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xbf580d0c (ffff9f238d49ef00) 00010000:00010000:2.0:1784938442.766416:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.766419:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245e00/0x7b044d4128f9c635 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.766424:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245e00/0x7b044d4128f9c635 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.766457:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245c00/0x7b044d4128f9c627 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f62 expref: 398 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.766467:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938442.766470:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.766474:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245c00/0x7b044d4128f9c627 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f62 expref: 398 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.766483:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f245c00, rc 0) 00000100:00100000:2.0:1784938442.766542:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+397:17096:x1871643337440384:12345-192.168.202.54@tcp:101:cp.0 Request processed in 502us (671us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938442.766549:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 410 00000100:00100000:3.0:1784938442.769835:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.769938:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337440640 00000100:00100000:1.0:1784938442.769950:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337440640 00000100:00100000:1.0:1784938442.770018:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 411 00000100:00100000:1.0:1784938442.770036:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386362680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+397:17096:x1871643337440640:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938442.770062:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938442.770084:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7800/0x7b044d4128f9c63c lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663f69 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.770220:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7200/0x7b044d4128f9c643 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.770237:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7200/0x7b044d4128f9c643 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.770248:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7200/0x7b044d4128f9c643 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.770262:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6400/0x7b044d4128f9c64a lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0xbf580d0c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.770270:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6400/0x7b044d4128f9c64a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.770276:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6400/0x7b044d4128f9c64a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938442.770584:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5c:0x0], index 0: 0 00010000:00010000:1.0:1784938442.770708:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6800/0x7b044d4128f9c651 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.770717:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6800/0x7b044d4128f9c651 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.770725:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6800/0x7b044d4128f9c651 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.770756:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7200/0x7b044d4128f9c643 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.770765:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7200/0x7b044d4128f9c643 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.770773:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7200/0x7b044d4128f9c643 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.770780:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f7200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938442.770785:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7200/0x7b044d4128f9c643 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.770794:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7200/0x7b044d4128f9c643 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.770811:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938442.770814:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938442.770819:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7200/0x7b044d4128f9c643 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.770826:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7200/0x7b044d4128f9c643 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938442.770838:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008f123a40 reply state 00000000b06985cf transno 8589934805 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6400/0x7b044d4128f9c64a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.770849:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6400/0x7b044d4128f9c64a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.770855:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xbf580d0c (ffff9f23823e0400) 00010000:00010000:1.0:1784938442.770858:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938442.770860:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938442.770886:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7800/0x7b044d4128f9c63c lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f69 expref: 400 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.770900:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6800/0x7b044d4128f9c651 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f69 expref: 399 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.770908:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x37:0x0].0x0 (ffff9f23823e0800) 00010000:00010000:1.0:1784938442.770911:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938442.770913:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c9f6800, rc 0) 00000100:00100000:1.0:1784938442.770977:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386362680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+400:17096:x1871643337440640:12345-192.168.202.54@tcp:101:cp.0 Request processed in 943us (1155us total) trans 8589934805 rc 0/0 00000100:00100000:1.0:1784938442.770985:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 411 00000100:00100000:3.0:1784938442.774764:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.774852:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337440768 00000100:00100000:0.0:1784938442.774863:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337440768 00000100:00100000:0.0:1784938442.774931:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 677 00000100:00100000:0.0:1784938442.774940:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f199f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+61:10960:x1871643337440768:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938442.774960:0:21149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938442.774979:0:21149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4a6658/0x7b044d4128f9c65f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663f70 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938442.775010:0:21149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938442.775041:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5c:0x0].0x0 since=708s v=(0 0) 00010000:00010000:0.0:1784938442.775045:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.775055:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4a6658/0x7b044d4128f9c65f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f70 expref: 62 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.775072:0:21149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4a6658/0x7b044d4128f9c65f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f70 expref: 62 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.775085:0:21149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24c000, rc 0) 00000100:00100000:0.0:1784938442.775365:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f199f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+62:10960:x1871643337440768:12345-192.168.202.54@tcp:101:cp.0 Request processed in 206us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.775373:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 677 00000100:00100000:3.0:1784938442.778391:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.778885:0:25719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337440896 00000100:00100000:0.0:1784938442.778906:0:25719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337440896 00000100:00100000:0.0:1784938442.778968:0:25719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 678 00000100:00100000:0.0:1784938442.778978:0:25719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f199880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7ea6e988-18ba-4c98-b179-17995571b98b+62:17096:x1871643337440896:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938442.778995:0:25719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938442.779013:0:25719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ae1c5a0/0x7b044d4128f9c666 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663f77 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.779043:0:25719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4a6658/0x7b044d4128f9c65f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f70 expref: 63 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.779058:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.779062:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.779068:0:25719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ae1c5a0/0x7b044d4128f9c666 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5c:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f77 expref: 63 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.779100:0:25719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001c4a6658/0x7b044d4128f9c65f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663f70 expref: 63 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.779114:0:25719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001c4a6658/0x7b044d4128f9c65f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663f70 expref: 63 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.779129:0:25719:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2381d2a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:25719:1871643350859776:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938442.779233:0:25719:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238108e600 going to sleep for 11 seconds 00000100:00100000:0.0:1784938442.782035:0:25719:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2381d2a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:25719:1871643350859776:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938442.782073:0:25719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002ae1c5a0/0x7b044d4128f9c666 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5c:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663f77 expref: 63 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.782096:0:25719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24c200, rc 0) 00000100:00100000:0.0:1784938442.782180:0:25719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f199880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7ea6e988-18ba-4c98-b179-17995571b98b+63:17096:x1871643337440896:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3203us (3798us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.782189:0:25719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 678 00000100:00100000:3.0:1784938442.784595:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.784689:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337441024 00000100:00100000:1.0:1784938442.784698:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337441024 00010000:00010000:1.0:1784938442.784736:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001c4a6658/0x7b044d4128f9c65f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663f70 expref: 63 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.784778:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 317 00000100:00100000:1.0:1784938442.784787:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f19a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+63:10959:x1871643337441024:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.784805:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.784828:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001c4a6658/0x7b044d4128f9c65f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663f70 expref: 63 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.784842:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001c4a6658/0x7b044d4128f9c65f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663f70 expref: 63 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.784867:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4a6658/0x7b044d4128f9c65f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663f70 expref: 63 pid: 21149 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.784885:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.784890:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.784911:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002ae1c5a0/0x7b044d4128f9c666 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663f77 expref: 62 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.784922:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ae1c5a0/0x7b044d4128f9c666 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663f77 expref: 62 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.784959:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002ae1c5a0/0x7b044d4128f9c666 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663f77 expref: 62 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.784974:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350859904:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938442.785058:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828af780 going to sleep for 11 seconds 00000100:00100000:3.0:1784938442.788253:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938442.788354:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337441280 00000100:00100000:2.0:1784938442.788363:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337441280 00000100:00100000:2.0:1784938442.788420:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 74 00000100:00100000:2.0:1784938442.788429:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+400:17096:x1871643337441280:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:2.0:1784938442.788698:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+401:17096:x1871643337441280:12345-192.168.202.54@tcp:35:cp.0 Request processed in 270us (454us total) trans 8589934806 rc 0/0 00000100:00100000:2.0:1784938442.788706:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 74 00000100:00100000:1.0:1784938442.789626:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350859904:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938442.789650:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938442.789692:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f19a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+62:10959:x1871643337441024:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 4906us (5104us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.789702:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 317 00000100:00100000:3.0:1784938442.793466:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938442.793807:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337441408 00000100:00100000:2.0:1784938442.793817:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337441408 00000100:00100000:2.0:1784938442.793934:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 412 00000100:00100000:2.0:1784938442.793944:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+401:17096:x1871643337441408:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938442.793968:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938442.793989:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245e00/0x7b044d4128f9c66d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663f7e expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.794252:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c674 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.794269:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c674 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.794280:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c674 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.794294:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245000/0x7b044d4128f9c67b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe3541c1d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.794301:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245000/0x7b044d4128f9c67b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.794307:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245000/0x7b044d4128f9c67b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.794356:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c674 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.794364:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c674 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.794371:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c674 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.794377:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938442.794381:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c674 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.794389:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c674 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.794401:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938442.794404:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.794409:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c674 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.794415:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c674 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.794428:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245000/0x7b044d4128f9c67b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.794435:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245000/0x7b044d4128f9c67b lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.794441:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245000/0x7b044d4128f9c67b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.794446:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938442.794449:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245000/0x7b044d4128f9c67b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.794455:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245000/0x7b044d4128f9c67b lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.794461:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xe3541c1d (ffff9f238d49ef00) 00010000:00010000:2.0:1784938442.794463:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.794466:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245000/0x7b044d4128f9c67b lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.794471:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245000/0x7b044d4128f9c67b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.794507:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245e00/0x7b044d4128f9c66d lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f7e expref: 402 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.794517:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938442.794519:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.794523:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245e00/0x7b044d4128f9c66d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f7e expref: 402 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.794532:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f245e00, rc 0) 00000100:00100000:2.0:1784938442.794610:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+401:17096:x1871643337441408:12345-192.168.202.54@tcp:101:cp.0 Request processed in 667us (1153us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938442.794619:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 412 00000100:00100000:3.0:1784938442.797109:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.798080:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337441536 00000100:00100000:0.0:1784938442.798094:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337441536 00000100:00100000:0.0:1784938442.798186:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 413 00000100:00100000:0.0:1784938442.798196:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+401:17096:x1871643337441536:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938442.798217:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938442.798237:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ca00/0x7b044d4128f9c682 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663f85 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.798298:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c000/0x7b044d4128f9c689 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.798313:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c000/0x7b044d4128f9c689 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.798323:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c000/0x7b044d4128f9c689 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.798352:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c400/0x7b044d4128f9c690 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe3541c1d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.798359:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c400/0x7b044d4128f9c690 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.798366:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c400/0x7b044d4128f9c690 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.798406:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c000/0x7b044d4128f9c689 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.798413:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c000/0x7b044d4128f9c689 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.798419:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c000/0x7b044d4128f9c689 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.798430:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c000/0x7b044d4128f9c689 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.798437:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24c000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938442.798441:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c000/0x7b044d4128f9c689 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.798448:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c000/0x7b044d4128f9c689 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.798461:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938442.798464:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.798469:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c000/0x7b044d4128f9c689 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.798475:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c000/0x7b044d4128f9c689 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.798488:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c400/0x7b044d4128f9c690 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.798495:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c400/0x7b044d4128f9c690 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.798500:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c400/0x7b044d4128f9c690 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.798505:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24c400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938442.798508:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c400/0x7b044d4128f9c690 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.798518:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c400/0x7b044d4128f9c690 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.798525:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xe3541c1d (ffff9f248390a400) 00010000:00010000:0.0:1784938442.798527:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.798530:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c400/0x7b044d4128f9c690 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.798535:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c400/0x7b044d4128f9c690 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.798563:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ca00/0x7b044d4128f9c682 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f85 expref: 402 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.798573:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938442.798575:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.798579:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ca00/0x7b044d4128f9c682 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f85 expref: 402 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.798587:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24ca00, rc 0) 00000100:00100000:0.0:1784938442.798639:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+401:17096:x1871643337441536:12345-192.168.202.54@tcp:101:cp.0 Request processed in 445us (1539us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938442.798647:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 413 00000100:00100000:0.0:1784938442.801364:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938442.801569:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337441792 00000100:00100000:2.0:1784938442.801579:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337441792 00000100:00100000:3.0:1784938442.801673:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 414 00000100:00100000:3.0:1784938442.801684:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+401:17096:x1871643337441792:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.801705:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.801725:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c697 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663f8c expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.801826:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c69e lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.801840:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c69e lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.801854:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c69e lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.801868:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1800/0x7b044d4128f9c6a5 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0xe3541c1d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.801875:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1800/0x7b044d4128f9c6a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.801881:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1800/0x7b044d4128f9c6a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938442.802408:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5c:0x0], index 1: 0 00010000:00010000:3.0:1784938442.802545:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0c00/0x7b044d4128f9c6ac lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.802555:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0c00/0x7b044d4128f9c6ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.802563:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0c00/0x7b044d4128f9c6ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.802594:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c69e lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.802607:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c69e lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.802614:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c69e lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.802621:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c69e lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.802627:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.802631:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c69e lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.802639:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c69e lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.802651:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938442.802654:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.802658:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c69e lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.802665:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c69e lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938442.802680:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000751e4ed6 reply state 00000000589aee89 transno 8589934807 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1800/0x7b044d4128f9c6a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.802692:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1800/0x7b044d4128f9c6a5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.802699:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xe3541c1d (ffff9f238727cb00) 00010000:00010000:3.0:1784938442.802702:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938442.802704:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938442.802730:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c697 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f8c expref: 404 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.802744:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0c00/0x7b044d4128f9c6ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f8c expref: 403 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.802752:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x38:0x0].0x0 (ffff9f238727cd00) 00010000:00010000:3.0:1784938442.802754:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938442.802757:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf0c00, rc 0) 00000100:00100000:3.0:1784938442.802859:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+404:17096:x1871643337441792:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1177us (1504us total) trans 8589934807 rc 0/0 00000100:00100000:3.0:1784938442.802867:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 414 00000100:00100000:0.0:1784938442.805910:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.806015:0:25725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337441920 00000100:00100000:3.0:1784938442.806033:0:25725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337441920 00000100:00100000:3.0:1784938442.806087:0:25725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 679 00000100:00100000:3.0:1784938442.806096:0:25725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7ea6e988-18ba-4c98-b179-17995571b98b+71:10957:x1871643337441920:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.806115:0:25725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.806403:0:25725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000735f81e4/0x7b044d4128f9c6ba lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663f93 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938442.806430:0:25725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938442.806450:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5c:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1784938442.806454:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.806464:0:25725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000735f81e4/0x7b044d4128f9c6ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f93 expref: 72 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.806488:0:25725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000735f81e4/0x7b044d4128f9c6ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f93 expref: 72 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.806501:0:25725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf0e00, rc 0) 00000100:00100000:3.0:1784938442.806583:0:25725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7ea6e988-18ba-4c98-b179-17995571b98b+72:10957:x1871643337441920:12345-192.168.202.54@tcp:101:cp.0 Request processed in 487us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938442.806591:0:25725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 679 00000100:00100000:0.0:1784938442.809452:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938442.809524:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337442048 00000100:00100000:2.0:1784938442.809534:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337442048 00000100:00100000:2.0:1784938442.809626:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 680 00000100:00100000:2.0:1784938442.809638:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+72:17096:x1871643337442048:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938442.809658:0:25722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938442.809680:0:25722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb1ec7ed/0x7b044d4128f9c6c1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663f9a expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.809714:0:25722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000735f81e4/0x7b044d4128f9c6ba lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f93 expref: 73 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.809723:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.809728:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.809734:0:25722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb1ec7ed/0x7b044d4128f9c6c1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5c:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f9a expref: 73 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.809770:0:25722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000735f81e4/0x7b044d4128f9c6ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663f93 expref: 73 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.809786:0:25722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000735f81e4/0x7b044d4128f9c6ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663f93 expref: 73 pid: 25725 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.809803:0:25722:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f2c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25722:1871643350860032:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938442.810007:0:25722:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248fb1c240 going to sleep for 11 seconds 00000100:00100000:0.0:1784938442.813373:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.813440:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337442176 00000100:00100000:1.0:1784938442.813449:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337442176 00010000:00010000:1.0:1784938442.813487:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000735f81e4/0x7b044d4128f9c6ba lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663f93 expref: 74 pid: 25725 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.813528:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 318 00000100:00100000:1.0:1784938442.813536:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d3afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+74:10957:x1871643337442176:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.813552:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.813573:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000735f81e4/0x7b044d4128f9c6ba lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663f93 expref: 74 pid: 25725 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.813599:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000735f81e4/0x7b044d4128f9c6ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663f93 expref: 74 pid: 25725 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.813626:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.813630:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.813640:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb1ec7ed/0x7b044d4128f9c6c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f9a expref: 74 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.813652:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb1ec7ed/0x7b044d4128f9c6c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f9a expref: 74 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.813686:0:19220:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000eb1ec7ed/0x7b044d4128f9c6c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f9a expref: 74 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.813701:0:19220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:19220:1871643350860160:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938442.813779:0:19220:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828af780 going to sleep for 11 seconds 00000100:00100000:1.0:1784938442.816209:0:19220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:19220:1871643350860160:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938442.816233:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938442.816282:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d3afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+74:10957:x1871643337442176:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 2746us (2918us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.816293:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 318 00010000:00010000:2.0:1784938442.817462:0:25722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000735f81e4/0x7b044d4128f9c6ba lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663f93 expref: 73 pid: 25725 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.817489:0:25722:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f2c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25722:1871643350860032:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938442.817520:0:25722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eb1ec7ed/0x7b044d4128f9c6c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663f9a expref: 72 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.817538:0:25722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f245e00, rc 0) 00000100:00100000:2.0:1784938442.817582:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+72:17096:x1871643337442048:12345-192.168.202.54@tcp:101:cp.0 Request processed in 7947us (8137us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938442.817590:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 680 00000100:00100000:0.0:1784938442.820754:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.820829:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337442432 00000100:00100000:3.0:1784938442.820838:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337442432 00000100:00100000:3.0:1784938442.820902:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 75 00000100:00100000:3.0:1784938442.820912:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24857f8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+404:17096:x1871643337442432:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938442.821219:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24857f8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+405:17096:x1871643337442432:12345-192.168.202.54@tcp:35:cp.0 Request processed in 308us (476us total) trans 8589934808 rc 0/0 00000100:00100000:3.0:1784938442.821228:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 75 00000100:00100000:0.0:1784938442.824557:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.824642:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337442560 00000100:00100000:3.0:1784938442.824651:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337442560 00000100:00100000:3.0:1784938442.824710:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 415 00000100:00100000:3.0:1784938442.824720:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d3ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+405:17096:x1871643337442560:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.824743:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.824766:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c6c8 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663fa1 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.824832:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c6cf lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.824852:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c6cf lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.824864:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c6cf lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.824878:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c6d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x89d48c8d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.824886:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c6d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.824904:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c6d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.824943:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c6cf lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.824950:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c6cf lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.824957:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c6cf lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.824964:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c6cf lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.824970:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.824974:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c6cf lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.824981:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c6cf lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.824993:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938442.824997:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.825001:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c6cf lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.825008:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c6cf lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.825022:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c6d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.825028:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c6d6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.825034:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c6d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.825039:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf0a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.825042:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c6d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.825048:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c6d6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.825054:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x89d48c8d (ffff9f2496483600) 00010000:00010000:3.0:1784938442.825056:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.825058:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c6d6 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.825064:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c6d6 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.825100:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c6c8 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663fa1 expref: 406 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.825110:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938442.825113:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.825117:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c6c8 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663fa1 expref: 406 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.825125:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf0400, rc 0) 00000100:00100000:3.0:1784938442.825226:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d3ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+405:17096:x1871643337442560:12345-192.168.202.54@tcp:101:cp.0 Request processed in 507us (677us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938442.825234:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 415 00000100:00100000:0.0:1784938442.827710:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.827786:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337442688 00000100:00100000:3.0:1784938442.827795:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337442688 00000100:00100000:3.0:1784938442.827856:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 416 00000100:00100000:3.0:1784938442.827866:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d3aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+405:17096:x1871643337442688:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.827887:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.827915:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9c6dd lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663fa8 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.827971:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1a00/0x7b044d4128f9c6e4 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.827984:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1a00/0x7b044d4128f9c6e4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.827996:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1a00/0x7b044d4128f9c6e4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.828009:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9c6eb lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x89d48c8d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.828017:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9c6eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.828032:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9c6eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.828071:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1a00/0x7b044d4128f9c6e4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.828078:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1a00/0x7b044d4128f9c6e4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.828085:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1a00/0x7b044d4128f9c6e4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.828091:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.828096:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1a00/0x7b044d4128f9c6e4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.828105:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1a00/0x7b044d4128f9c6e4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.828116:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938442.828120:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.828124:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1a00/0x7b044d4128f9c6e4 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.828131:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1a00/0x7b044d4128f9c6e4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.828178:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9c6eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.828186:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9c6eb lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.828192:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9c6eb lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.828197:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.828200:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9c6eb lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.828207:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9c6eb lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.828214:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x89d48c8d (ffff9f2496483300) 00010000:00010000:3.0:1784938442.828216:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.828219:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9c6eb lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.828224:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9c6eb lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.828256:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9c6dd lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663fa8 expref: 406 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.828267:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938442.828269:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.828274:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9c6dd lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663fa8 expref: 406 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.828283:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf1400, rc 0) 00000100:00100000:3.0:1784938442.828345:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d3aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+405:17096:x1871643337442688:12345-192.168.202.54@tcp:101:cp.0 Request processed in 480us (645us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938442.828352:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 416 00000100:00100000:1.0:1784938442.831615:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.831699:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337442944 00000100:00100000:3.0:1784938442.831710:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337442944 00000100:00100000:3.0:1784938442.831793:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 417 00000100:00100000:3.0:1784938442.831804:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+405:17096:x1871643337442944:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.831825:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.831845:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9c6f2 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663faf expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.831955:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9c6f9 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.831971:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9c6f9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.831983:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9c6f9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.831998:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0e00/0x7b044d4128f9c700 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x89d48c8d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.832005:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0e00/0x7b044d4128f9c700 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.832012:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0e00/0x7b044d4128f9c700 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938442.832446:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5d:0x0], index 0: 0 00010000:00010000:3.0:1784938442.832567:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030400/0x7b044d4128f9c707 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.832577:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030400/0x7b044d4128f9c707 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.832585:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030400/0x7b044d4128f9c707 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.832613:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9c6f9 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.832620:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9c6f9 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.832627:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9c6f9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.832633:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9c6f9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.832639:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.832643:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9c6f9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.832651:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9c6f9 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.832663:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938442.832665:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.832670:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9c6f9 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.832678:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9c6f9 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938442.832692:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000251e99cc reply state 0000000067403e9f transno 8589934809 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0e00/0x7b044d4128f9c700 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.832703:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0e00/0x7b044d4128f9c700 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.832710:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x89d48c8d (ffff9f2496483c00) 00010000:00010000:3.0:1784938442.832713:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938442.832715:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938442.832741:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9c6f2 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663faf expref: 408 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.832754:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030400/0x7b044d4128f9c707 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663faf expref: 407 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.832762:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x39:0x0].0x0 (ffff9f2496483b00) 00010000:00010000:3.0:1784938442.832765:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938442.832767:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2480030400, rc 0) 00000100:00100000:3.0:1784938442.832901:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+408:17096:x1871643337442944:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1098us (1295us total) trans 8589934809 rc 0/0 00000100:00100000:3.0:1784938442.832910:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 417 00000100:00100000:0.0:1784938442.835987:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.836182:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337443072 00000100:00100000:1.0:1784938442.836191:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337443072 00000100:00100000:1.0:1784938442.836242:0:25720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 681 00000100:00100000:1.0:1784938442.836251:0:25720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7ea6e988-18ba-4c98-b179-17995571b98b+62:10960:x1871643337443072:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938442.836269:0:25720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938442.836287:0:25720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002f45a6a/0x7b044d4128f9c715 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663fb6 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938442.836311:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938442.836341:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5d:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1784938442.836346:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.836356:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002f45a6a/0x7b044d4128f9c715 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663fb6 expref: 63 pid: 25720 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.836376:0:25720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000002f45a6a/0x7b044d4128f9c715 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663fb6 expref: 63 pid: 25720 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.836390:0:25720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c9f7800, rc 0) 00000100:00100000:1.0:1784938442.836444:0:25720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7ea6e988-18ba-4c98-b179-17995571b98b+63:10960:x1871643337443072:12345-192.168.202.54@tcp:101:cp.0 Request processed in 193us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.836451:0:25720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 681 00000100:00100000:0.0:1784938442.838883:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.839531:0:25724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337443200 00000100:00100000:1.0:1784938442.839541:0:25724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337443200 00000100:00100000:1.0:1784938442.839629:0:25724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 682 00000100:00100000:1.0:1784938442.839638:0:25724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7ea6e988-18ba-4c98-b179-17995571b98b+63:17096:x1871643337443200:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938442.839657:0:25724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938442.839674:0:25724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000705d1dae/0x7b044d4128f9c71c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663fbd expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.839704:0:25724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000002f45a6a/0x7b044d4128f9c715 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663fb6 expref: 64 pid: 25720 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.839715:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.839719:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.839724:0:25724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000705d1dae/0x7b044d4128f9c71c lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5d:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663fbd expref: 64 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.839757:0:25724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000002f45a6a/0x7b044d4128f9c715 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663fb6 expref: 64 pid: 25720 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.839772:0:25724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000002f45a6a/0x7b044d4128f9c715 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663fb6 expref: 64 pid: 25720 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.839786:0:25724:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:25724:1871643350860288:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938442.839859:0:25724:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828af780 going to sleep for 11 seconds 00000100:00100000:0.0:1784938442.842748:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.842902:0:25724:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:25724:1871643350860288:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938442.842936:0:25724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000705d1dae/0x7b044d4128f9c71c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5d:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663fbd expref: 64 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.842960:0:25724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c9f7200, rc 0) 00000100:00100000:1.0:1784938442.843023:0:25724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7ea6e988-18ba-4c98-b179-17995571b98b+64:17096:x1871643337443200:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3386us (4149us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.843033:0:25724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 682 00000100:00100000:3.0:1784938442.844727:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337443328 00000100:00100000:3.0:1784938442.844741:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337443328 00010000:00010000:3.0:1784938442.844786:0:25731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000002f45a6a/0x7b044d4128f9c715 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663fb6 expref: 64 pid: 25720 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.844837:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 319 00000100:00100000:3.0:1784938442.844847:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+64:10960:x1871643337443328:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938442.844863:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938442.844886:0:25731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000002f45a6a/0x7b044d4128f9c715 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663fb6 expref: 64 pid: 25720 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.844910:0:25731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000002f45a6a/0x7b044d4128f9c715 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663fb6 expref: 64 pid: 25720 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.844933:0:25731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002f45a6a/0x7b044d4128f9c715 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663fb6 expref: 64 pid: 25720 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.844947:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.844952:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.844959:0:25731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000705d1dae/0x7b044d4128f9c71c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663fbd expref: 63 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.844968:0:25731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000705d1dae/0x7b044d4128f9c71c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663fbd expref: 63 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.845004:0:25731:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000705d1dae/0x7b044d4128f9c71c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663fbd expref: 63 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.845017:0:25731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f198700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:25731:1871643350860416:192.168.202.54@tcp:105: 00000100:00100000:3.0:1784938442.845284:0:25731:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2484c73180 going to sleep for 11 seconds 00000100:00100000:0.0:1784938442.849029:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.849193:0:25731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f198700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:25731:1871643350860416:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938442.849217:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938442.849264:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+63:10960:x1871643337443328:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 4418us (6525us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938442.849276:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 319 00000100:00100000:1.0:1784938442.849415:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337443584 00000100:00100000:1.0:1784938442.849422:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337443584 00000100:00100000:1.0:1784938442.849473:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 76 00000100:00100000:1.0:1784938442.849482:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+408:17096:x1871643337443584:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:1.0:1784938442.849728:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+409:17096:x1871643337443584:12345-192.168.202.54@tcp:35:cp.0 Request processed in 247us (717us total) trans 8589934810 rc 0/0 00000100:00100000:1.0:1784938442.849735:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 76 00000100:00100000:0.0:1784938442.852873:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.852947:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337443712 00000100:00100000:3.0:1784938442.852955:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337443712 00000100:00100000:3.0:1784938442.853010:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 418 00000100:00100000:3.0:1784938442.853019:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+409:17096:x1871643337443712:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.853049:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.853070:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031000/0x7b044d4128f9c723 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663fc4 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.853142:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030e00/0x7b044d4128f9c72a lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.853181:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030e00/0x7b044d4128f9c72a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.853195:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030e00/0x7b044d4128f9c72a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.853211:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9c731 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xa38d6329 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.853218:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9c731 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.853230:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9c731 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.853272:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030e00/0x7b044d4128f9c72a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.853278:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030e00/0x7b044d4128f9c72a lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.853286:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030e00/0x7b044d4128f9c72a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.853292:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2480030e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.853296:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030e00/0x7b044d4128f9c72a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.853303:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030e00/0x7b044d4128f9c72a lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.853314:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938442.853317:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.853321:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030e00/0x7b044d4128f9c72a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.853339:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030e00/0x7b044d4128f9c72a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.853354:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9c731 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.853360:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9c731 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.853367:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9c731 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.853373:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.853375:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9c731 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.853381:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9c731 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.853387:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xa38d6329 (ffff9f2496483300) 00010000:00010000:3.0:1784938442.853390:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.853392:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9c731 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.853398:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9c731 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.853426:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031000/0x7b044d4128f9c723 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663fc4 expref: 410 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.853436:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938442.853438:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.853442:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031000/0x7b044d4128f9c723 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663fc4 expref: 410 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.853452:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2480031000, rc 0) 00000100:00100000:3.0:1784938442.853505:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+409:17096:x1871643337443712:12345-192.168.202.54@tcp:101:cp.0 Request processed in 487us (641us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938442.853516:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 418 00000100:00100000:0.0:1784938442.856592:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.856774:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337443840 00000100:00100000:1.0:1784938442.856785:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337443840 00000100:00100000:1.0:1784938442.856841:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 419 00000100:00100000:1.0:1784938442.856850:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+409:17096:x1871643337443840:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938442.856871:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938442.856900:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6000/0x7b044d4128f9c738 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663fcb expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.856964:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c73f lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.856979:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c73f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.856990:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c73f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.857003:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c746 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xa38d6329 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.857010:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c746 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.857016:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c746 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.857073:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c73f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.857080:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c73f lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.857091:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c73f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.857098:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f6e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938442.857103:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c73f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.857110:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c73f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.857121:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938442.857345:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938442.857352:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c73f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.857360:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c73f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.857374:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c746 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.857380:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c746 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.857386:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c746 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.857392:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f6600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938442.857395:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c746 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.857405:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c746 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.857413:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xa38d6329 (ffff9f23823e0f00) 00010000:00010000:1.0:1784938442.857416:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938442.857418:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c746 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.857424:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c746 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.857454:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6000/0x7b044d4128f9c738 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663fcb expref: 410 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.857464:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938442.857467:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938442.857470:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6000/0x7b044d4128f9c738 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663fcb expref: 410 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.857479:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c9f6000, rc 0) 00000100:00100000:1.0:1784938442.857574:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+409:17096:x1871643337443840:12345-192.168.202.54@tcp:101:cp.0 Request processed in 724us (991us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938442.857582:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 419 00000100:00100000:0.0:1784938442.860771:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.860847:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337444096 00000100:00100000:3.0:1784938442.860856:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337444096 00000100:00100000:3.0:1784938442.860995:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 420 00000100:00100000:3.0:1784938442.861005:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+409:17096:x1871643337444096:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.861357:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.861381:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9c74d lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663fd2 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.861482:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9c754 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.861498:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9c754 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.861510:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9c754 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.861523:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9c75b lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0xa38d6329 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.861530:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9c75b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.861537:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9c75b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938442.861816:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5d:0x0], index 1: 0 00010000:00010000:0.0:1784938442.862456:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c600/0x7b044d4128f9c762 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.862471:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c600/0x7b044d4128f9c762 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.862482:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c600/0x7b044d4128f9c762 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.862528:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9c754 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.862537:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9c754 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.862545:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9c754 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.862551:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938442.862557:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9c754 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.862565:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9c754 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.862580:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938442.862583:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.862589:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9c754 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.862597:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9c754 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938442.862614:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000061874ba0 reply state 0000000075ae5c76 transno 8589934811 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9c75b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.862624:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9c75b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.862631:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xa38d6329 (ffff9f2496483600) 00010000:00010000:0.0:1784938442.862634:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938442.862636:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938442.862671:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9c74d lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663fd2 expref: 412 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.862686:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c600/0x7b044d4128f9c762 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663fd2 expref: 411 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.862694:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x3a:0x0].0x0 (ffff9f248390a400) 00010000:00010000:0.0:1784938442.862697:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938442.862699:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24c600, rc 0) 00000100:00100000:0.0:1784938442.862775:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+412:17096:x1871643337444096:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1771us (2011us total) trans 8589934811 rc 0/0 00000100:00100000:0.0:1784938442.862784:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 420 00000100:00100000:0.0:1784938442.871752:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.871854:0:25718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337444224 00000100:00100000:3.0:1784938442.871865:0:25718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337444224 00000100:00100000:3.0:1784938442.872032:0:25718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 683 00000100:00100000:3.0:1784938442.872042:0:25718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f243100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ea6e988-18ba-4c98-b179-17995571b98b+72:10958:x1871643337444224:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.872064:0:25718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.872084:0:25718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038131b1d/0x7b044d4128f9c770 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663fd9 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938442.872111:0:25718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938442.872136:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5d:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1784938442.872141:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.872188:0:25718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038131b1d/0x7b044d4128f9c770 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663fd9 expref: 73 pid: 25718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.872209:0:25718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000038131b1d/0x7b044d4128f9c770 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663fd9 expref: 73 pid: 25718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.872223:0:25718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf1a00, rc 0) 00000100:00100000:3.0:1784938442.872274:0:25718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f243100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ea6e988-18ba-4c98-b179-17995571b98b+73:10958:x1871643337444224:12345-192.168.202.54@tcp:101:cp.0 Request processed in 234us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938442.872282:0:25718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 683 00000100:00100000:1.0:1784938442.875452:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.875523:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337444352 00000100:00100000:0.0:1784938442.875533:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337444352 00000100:00100000:0.0:1784938442.875623:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 684 00000100:00100000:0.0:1784938442.875634:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+73:17096:x1871643337444352:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938442.875655:0:21629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938442.875674:0:21629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097a14a2c/0x7b044d4128f9c777 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663fe0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.875705:0:21629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000038131b1d/0x7b044d4128f9c770 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663fd9 expref: 74 pid: 25718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.875715:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.875719:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.875725:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097a14a2c/0x7b044d4128f9c777 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5d:0x0].0x0 rrc: 3 type: EXT [0->118783] (req 0->118783) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663fe0 expref: 74 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.875759:0:21629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000038131b1d/0x7b044d4128f9c770 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663fd9 expref: 74 pid: 25718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.875773:0:21629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000038131b1d/0x7b044d4128f9c770 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663fd9 expref: 74 pid: 25718 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.875788:0:21629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f241880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:21629:1871643350860544:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938442.875866:0:21629:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238108e600 going to sleep for 11 seconds 00000100:00100000:3.0:1784938442.878717:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.878790:0:21629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f241880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:21629:1871643350860544:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938442.878822:0:21629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000097a14a2c/0x7b044d4128f9c777 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5d:0x0].0x0 rrc: 3 type: EXT [0->118783] (req 0->118783) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663fe0 expref: 74 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.878849:0:21629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24da00, rc 0) 00000100:00100000:2.0:1784938442.878944:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337444480 00000100:00100000:2.0:1784938442.878950:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337444480 00010000:00010000:2.0:1784938442.878986:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000038131b1d/0x7b044d4128f9c770 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663fd9 expref: 75 pid: 25718 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.879036:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 320 00000100:00100000:2.0:1784938442.879045:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2488a67850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+75:10957:x1871643337444480:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938442.879057:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938442.879078:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000038131b1d/0x7b044d4128f9c770 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663fd9 expref: 75 pid: 25718 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.879092:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000038131b1d/0x7b044d4128f9c770 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663fd9 expref: 75 pid: 25718 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.879115:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038131b1d/0x7b044d4128f9c770 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663fd9 expref: 75 pid: 25718 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.879138:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.879142:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938442.879174:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000097a14a2c/0x7b044d4128f9c777 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663fe0 expref: 74 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.879185:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097a14a2c/0x7b044d4128f9c777 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663fe0 expref: 74 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.879217:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000097a14a2c/0x7b044d4128f9c777 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663fe0 expref: 74 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938442.879231:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f2c8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:19219:1871643350860672:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938442.879574:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+74:17096:x1871643337444352:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3941us (4129us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.879584:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 684 00000100:00100000:2.0:1784938442.879653:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248fb1c240 going to sleep for 11 seconds 00000100:00100000:3.0:1784938442.884129:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.884317:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337444736 00000100:00100000:0.0:1784938442.884336:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337444736 00000100:00100000:0.0:1784938442.884388:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 77 00000100:00100000:0.0:1784938442.884397:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+412:17096:x1871643337444736:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:0.0:1784938442.884660:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+413:17096:x1871643337444736:12345-192.168.202.54@tcp:35:cp.0 Request processed in 263us (539us total) trans 8589934812 rc 0/0 00000100:00100000:0.0:1784938442.884669:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 77 00000100:00100000:2.0:1784938442.884807:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f2c8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:19219:1871643350860672:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938442.884832:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938442.884853:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2488a67850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+73:10957:x1871643337444480:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 5809us (6144us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938442.884863:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 320 00000100:00100000:0.0:1784938442.888970:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.889105:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337444864 00000100:00100000:3.0:1784938442.889115:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337444864 00000100:00100000:2.0:1784938442.889367:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 421 00000100:00100000:2.0:1784938442.889378:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+413:17096:x1871643337444864:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938442.889667:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938442.889690:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245000/0x7b044d4128f9c77e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663fe7 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.889755:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c785 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.889773:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c785 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.889784:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c785 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.889799:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245c00/0x7b044d4128f9c78c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xbb599949 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.889807:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245c00/0x7b044d4128f9c78c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.889813:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245c00/0x7b044d4128f9c78c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.889850:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c785 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.889857:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c785 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.889863:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c785 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.889870:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c785 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.889876:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938442.889881:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c785 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.889888:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c785 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.889973:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938442.889976:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.889981:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c785 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.889988:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245600/0x7b044d4128f9c785 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.890001:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245c00/0x7b044d4128f9c78c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.890008:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245c00/0x7b044d4128f9c78c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.890014:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245c00/0x7b044d4128f9c78c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.890019:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938442.890082:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245c00/0x7b044d4128f9c78c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.890090:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245c00/0x7b044d4128f9c78c lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.890098:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xbb599949 (ffff9f238d49ef00) 00010000:00010000:2.0:1784938442.890100:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.890103:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245c00/0x7b044d4128f9c78c lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.890110:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245c00/0x7b044d4128f9c78c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.890291:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245000/0x7b044d4128f9c77e lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663fe7 expref: 414 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.890302:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938442.890305:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.890309:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245000/0x7b044d4128f9c77e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663fe7 expref: 414 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.890319:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f245000, rc 0) 00000100:00100000:2.0:1784938442.890433:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+413:17096:x1871643337444864:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1057us (1471us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938442.890442:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 421 00000100:00100000:1.0:1784938442.893585:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938442.893665:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337444992 00000100:00100000:2.0:1784938442.893676:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337444992 00000100:00100000:2.0:1784938442.893764:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 422 00000100:00100000:2.0:1784938442.893775:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+413:17096:x1871643337444992:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938442.893800:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938442.893824:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245200/0x7b044d4128f9c793 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663fee expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.893905:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245400/0x7b044d4128f9c79a lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.893920:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245400/0x7b044d4128f9c79a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.893931:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245400/0x7b044d4128f9c79a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.893946:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244600/0x7b044d4128f9c7a1 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xbb599949 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.893954:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244600/0x7b044d4128f9c7a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.893960:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244600/0x7b044d4128f9c7a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.893999:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245400/0x7b044d4128f9c79a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.894006:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245400/0x7b044d4128f9c79a lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.894012:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245400/0x7b044d4128f9c79a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.894018:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938442.894032:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245400/0x7b044d4128f9c79a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.894039:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245400/0x7b044d4128f9c79a lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.894051:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938442.894054:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.894058:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245400/0x7b044d4128f9c79a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.894065:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245400/0x7b044d4128f9c79a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.894079:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244600/0x7b044d4128f9c7a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.894085:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244600/0x7b044d4128f9c7a1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.894091:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244600/0x7b044d4128f9c7a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.894096:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f244600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938442.894099:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244600/0x7b044d4128f9c7a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.894105:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244600/0x7b044d4128f9c7a1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.894111:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xbb599949 (ffff9f238d49eb00) 00010000:00010000:2.0:1784938442.894113:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.894116:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244600/0x7b044d4128f9c7a1 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.894121:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244600/0x7b044d4128f9c7a1 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.894409:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245200/0x7b044d4128f9c793 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663fee expref: 414 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.894421:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938442.894424:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938442.894428:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245200/0x7b044d4128f9c793 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663fee expref: 414 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938442.894439:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f245200, rc 0) 00000100:00100000:2.0:1784938442.894533:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+413:17096:x1871643337444992:12345-192.168.202.54@tcp:101:cp.0 Request processed in 759us (959us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938442.894541:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 422 00000100:00100000:2.0:1784938442.898554:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.898662:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337445248 00000100:00100000:1.0:1784938442.898674:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337445248 00000100:00100000:1.0:1784938442.898919:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 423 00000100:00100000:1.0:1784938442.898931:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f2c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+413:17096:x1871643337445248:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938442.898953:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938442.898975:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c7a8 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663ff5 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.899275:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6a00/0x7b044d4128f9c7af lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.899291:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6a00/0x7b044d4128f9c7af lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.899303:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6a00/0x7b044d4128f9c7af lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.899317:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7600/0x7b044d4128f9c7b6 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0xbb599949 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.899324:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7600/0x7b044d4128f9c7b6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.899350:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7600/0x7b044d4128f9c7b6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938442.899675:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5e:0x0], index 0: 0 00010000:00010000:1.0:1784938442.899809:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7a00/0x7b044d4128f9c7bd lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.899820:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7a00/0x7b044d4128f9c7bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.899827:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7a00/0x7b044d4128f9c7bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.899856:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6a00/0x7b044d4128f9c7af lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.899863:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6a00/0x7b044d4128f9c7af lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.899870:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6a00/0x7b044d4128f9c7af lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.899876:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f6a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938442.899881:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6a00/0x7b044d4128f9c7af lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.899889:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6a00/0x7b044d4128f9c7af lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.900206:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938442.900210:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938442.900215:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6a00/0x7b044d4128f9c7af lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.900223:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6a00/0x7b044d4128f9c7af lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938442.900237:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cdcc2f82 reply state 00000000a9644f66 transno 8589934813 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7600/0x7b044d4128f9c7b6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.900248:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7600/0x7b044d4128f9c7b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.900254:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xbb599949 (ffff9f23823e0f00) 00010000:00010000:1.0:1784938442.900257:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938442.900260:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938442.900289:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6e00/0x7b044d4128f9c7a8 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ff5 expref: 416 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.900303:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7a00/0x7b044d4128f9c7bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ff5 expref: 415 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.900311:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x3b:0x0].0x0 (ffff9f23823e0700) 00010000:00010000:1.0:1784938442.900314:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938442.900316:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c9f7a00, rc 0) 00000100:00100000:1.0:1784938442.900427:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f2c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+416:17096:x1871643337445248:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1498us (1886us total) trans 8589934813 rc 0/0 00000100:00100000:1.0:1784938442.900435:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 423 00000100:00100000:1.0:1784938442.903884:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.904200:0:25727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337445376 00000100:00100000:3.0:1784938442.904211:0:25727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337445376 00000100:00100000:3.0:1784938442.904298:0:25727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 685 00000100:00100000:3.0:1784938442.904310:0:25727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7ea6e988-18ba-4c98-b179-17995571b98b+63:10960:x1871643337445376:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.904341:0:25727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.904366:0:25727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c7cb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947663ffc expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938442.904392:0:25727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938442.904412:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5e:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1784938442.904416:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.904427:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c7cb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ffc expref: 64 pid: 25727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.904443:0:25727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c7cb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ffc expref: 64 pid: 25727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.904457:0:25727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf1200, rc 0) 00000100:00100000:3.0:1784938442.904515:0:25727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7ea6e988-18ba-4c98-b179-17995571b98b+64:10960:x1871643337445376:12345-192.168.202.54@tcp:101:cp.0 Request processed in 207us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938442.904522:0:25727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 685 00000100:00100000:2.0:1784938442.913470:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938442.913602:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337445504 00000100:00100000:1.0:1784938442.913612:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337445504 00000100:00100000:1.0:1784938442.913672:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 686 00000100:00100000:1.0:1784938442.913681:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381363c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+64:17096:x1871643337445504:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938442.913702:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938442.913720:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004915a1de/0x7b044d4128f9c7d2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664003 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.913752:0:21151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c7cb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ffc expref: 65 pid: 25727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.913763:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.913767:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.913773:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004915a1de/0x7b044d4128f9c7d2 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5e:0x0].0x0 rrc: 3 type: EXT [0->147455] (req 0->147455) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664003 expref: 65 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.913809:0:21151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c7cb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947663ffc expref: 65 pid: 25727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.913823:0:21151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c7cb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663ffc expref: 65 pid: 25727 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.913837:0:21151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37cb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:21151:1871643350860800:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938442.913919:0:21151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828afd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938442.925880:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350860928:192.168.202.154@tcp:41:osp-pre-0-1.0 00000004:00080000:0.0:1784938442.926884:0:24226:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 709093736434ns, next at 710093733736ns, rc = 0 00000004:00080000:1.0:1784938442.927041:0:24224:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 709093894079ns, next at 710093892848ns, rc = 0 00000100:00100000:1.0:1784938442.927058:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350861056:192.168.202.154@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938442.927192:0:16390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784938442.927203:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350861184:192.168.202.154@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938442.927388:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.927478:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938442.927500:0:21153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350861056 00000100:00100000:0.0:1784938442.927506:0:21153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350861056 00000100:00100000:0.0:1784938442.927558:0:21153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 72 00000100:00100000:0.0:1784938442.927566:0:21153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:16392:x1871643350861056:12345-192.168.202.154@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1784938442.927587:0:21153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8711488 pending 0 free 313057280 avail 285245440 00000100:00100000:0.0:1784938442.927616:0:21153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:16392:x1871643350861056:12345-192.168.202.154@tcp:13:osp-pre-1-0.0 Request processed in 50us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.927623:0:21153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 72 00000100:00100000:0.0:1784938442.927657:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938442.927673:0:25714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350860928 00000100:00100000:0.0:1784938442.927676:0:25714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350860928 00000100:00100000:0.0:1784938442.927699:0:25714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 62 00000100:00100000:0.0:1784938442.927704:0:25714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:16391:x1871643350860928:12345-192.168.202.154@tcp:41:osp-pre-0-1.0 00000004:00000024:0.0:1784938442.927726:0:25714:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 218316800 avail 191291392 00000100:00100000:0.0:1784938442.927748:0:25714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:16391:x1871643350860928:12345-192.168.202.154@tcp:41:osp-pre-0-1.0 Request processed in 44us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.927754:0:25714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 62 00000100:00100000:0.0:1784938442.927831:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938442.927843:0:21153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350861184 00000100:00100000:0.0:1784938442.927846:0:21153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350861184 00000100:00100000:0.0:1784938442.927861:0:21153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 73 00000100:00100000:0.0:1784938442.927867:0:21153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:16390:x1871643350861184:12345-192.168.202.154@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1784938442.927881:0:21153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8711488 pending 0 free 313057280 avail 285245440 00000100:00100000:0.0:1784938442.927907:0:21153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:16390:x1871643350861184:12345-192.168.202.154@tcp:13:osp-pre-0-0.0 Request processed in 40us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.927913:0:21153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 73 00000100:00100000:0.0:1784938442.928014:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350861184:192.168.202.154@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938442.928575:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350861056:192.168.202.154@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938442.928604:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350860928:192.168.202.154@tcp:41:osp-pre-0-1.0 00000100:00100000:1.0:1784938442.928626:0:21151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37cb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:21151:1871643350860800:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938442.928648:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004915a1de/0x7b044d4128f9c7d2 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5e:0x0].0x0 rrc: 3 type: EXT [0->147455] (req 0->147455) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664003 expref: 65 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.928669:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c9f6e00, rc 0) 00000100:00100000:1.0:1784938442.928707:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381363c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+65:17096:x1871643337445504:12345-192.168.202.54@tcp:101:cp.0 Request processed in 15027us (15248us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.928715:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 686 00000100:00100000:1.0:1784938442.928823:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337445632 00000100:00100000:1.0:1784938442.928827:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337445632 00010000:00010000:1.0:1784938442.928846:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c7cb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663ffc expref: 65 pid: 25727 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.928880:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 321 00000100:00100000:1.0:1784938442.928887:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f241880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+65:10960:x1871643337445632:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938442.928906:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938442.928925:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c7cb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663ffc expref: 65 pid: 25727 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.928938:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c7cb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663ffc expref: 65 pid: 25727 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.928966:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9c7cb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947663ffc expref: 65 pid: 25727 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.928979:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.928983:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938442.928991:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004915a1de/0x7b044d4128f9c7d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664003 expref: 64 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.929001:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004915a1de/0x7b044d4128f9c7d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664003 expref: 64 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938442.929037:0:19220:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004915a1de/0x7b044d4128f9c7d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664003 expref: 64 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938442.929049:0:19220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37c8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:19220:1871643350861312:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938442.929084:0:19220:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828afd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938442.934422:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.934824:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337445888 00000100:00100000:3.0:1784938442.934835:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337445888 00000100:00100000:3.0:1784938442.934903:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 78 00000100:00100000:3.0:1784938442.934912:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+416:17096:x1871643337445888:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938442.935228:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+417:17096:x1871643337445888:12345-192.168.202.54@tcp:35:cp.0 Request processed in 316us (816us total) trans 8589934814 rc 0/0 00000100:00100000:3.0:1784938442.935235:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 78 00000100:00100000:3.0:1784938442.935281:0:19220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37c8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:19220:1871643350861312:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938442.935302:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938442.935321:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f241880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+64:10960:x1871643337445632:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 6434us (7934us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938442.935341:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 321 00000100:00100000:1.0:1784938442.944513:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.944617:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337446016 00000100:00100000:0.0:1784938442.944629:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337446016 00000100:00100000:0.0:1784938442.944709:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 424 00000100:00100000:0.0:1784938442.944721:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+417:17096:x1871643337446016:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938442.944749:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938442.944774:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c7d9 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766400a expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.944853:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ca00/0x7b044d4128f9c7e0 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.944871:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ca00/0x7b044d4128f9c7e0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.944900:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ca00/0x7b044d4128f9c7e0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.944921:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c000/0x7b044d4128f9c7e7 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x1a616f3f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.944929:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c000/0x7b044d4128f9c7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.944935:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c000/0x7b044d4128f9c7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.944979:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ca00/0x7b044d4128f9c7e0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.944986:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ca00/0x7b044d4128f9c7e0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.944993:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ca00/0x7b044d4128f9c7e0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.945000:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24ca00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938442.945004:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ca00/0x7b044d4128f9c7e0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.945012:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ca00/0x7b044d4128f9c7e0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.945038:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938442.945042:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.945048:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ca00/0x7b044d4128f9c7e0 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.945059:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ca00/0x7b044d4128f9c7e0 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.945075:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c000/0x7b044d4128f9c7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.945081:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c000/0x7b044d4128f9c7e7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.945086:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c000/0x7b044d4128f9c7e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.945090:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24c000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938442.945093:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c000/0x7b044d4128f9c7e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.945098:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c000/0x7b044d4128f9c7e7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.945104:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x1a616f3f (ffff9f248390a900) 00010000:00010000:0.0:1784938442.945107:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.945110:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c000/0x7b044d4128f9c7e7 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.945116:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c000/0x7b044d4128f9c7e7 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.945284:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c7d9 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766400a expref: 418 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.945303:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938442.945305:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.945309:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c7d9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766400a expref: 418 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.945319:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24d800, rc 0) 00000100:00100000:0.0:1784938442.945392:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+417:17096:x1871643337446016:12345-192.168.202.54@tcp:101:cp.0 Request processed in 674us (892us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938442.945400:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 424 00000100:00100000:0.0:1784938442.948647:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.948831:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337446144 00000100:00100000:3.0:1784938442.948846:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337446144 00000100:00100000:3.0:1784938442.948950:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 425 00000100:00100000:3.0:1784938442.948964:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+417:17096:x1871643337446144:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938442.948993:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938442.949609:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c7ee lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664011 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.949676:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c7f5 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.949690:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c7f5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.949701:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c7f5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.949716:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c7fc lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x1a616f3f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.949722:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c7fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.949729:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c7fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.949775:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c7f5 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.949782:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c7f5 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.949788:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c7f5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.949794:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c7f5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.949800:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf0a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.949804:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c7f5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.949811:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c7f5 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.949825:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938442.949829:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.949834:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c7f5 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.949841:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c7f5 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.949857:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c7fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.949863:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c7fc lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.949870:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c7fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.949874:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938442.949877:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c7fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.949882:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c7fc lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.949887:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x1a616f3f (ffff9f2496483000) 00010000:00010000:3.0:1784938442.949889:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.949892:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c7fc lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.949897:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c7fc lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.949928:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c7ee lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664011 expref: 418 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.949938:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938442.949940:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938442.949944:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c7ee lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664011 expref: 418 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.949952:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf0400, rc 0) 00000100:00100000:3.0:1784938442.950062:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+417:17096:x1871643337446144:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1100us (1432us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938442.950074:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 425 00000100:00100000:3.0:1784938442.961642:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.961718:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337446400 00000100:00100000:0.0:1784938442.961729:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337446400 00000100:00100000:0.0:1784938442.961786:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 426 00000100:00100000:0.0:1784938442.961797:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+417:17096:x1871643337446400:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938442.961817:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938442.961837:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24cc00/0x7b044d4128f9c803 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664018 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.961946:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d600/0x7b044d4128f9c80a lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.961964:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d600/0x7b044d4128f9c80a lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.961977:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d600/0x7b044d4128f9c80a lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.961996:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d400/0x7b044d4128f9c811 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x1a616f3f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.962003:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d400/0x7b044d4128f9c811 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.962010:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d400/0x7b044d4128f9c811 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938442.962429:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5e:0x0], index 1: 0 00010000:00010000:0.0:1784938442.962593:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24de00/0x7b044d4128f9c818 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.962603:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24de00/0x7b044d4128f9c818 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.962611:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24de00/0x7b044d4128f9c818 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.962645:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d600/0x7b044d4128f9c80a lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.962651:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d600/0x7b044d4128f9c80a lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.962658:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d600/0x7b044d4128f9c80a lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.962663:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24d600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938442.962668:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d600/0x7b044d4128f9c80a lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.962679:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d600/0x7b044d4128f9c80a lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.962690:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938442.962693:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938442.962697:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d600/0x7b044d4128f9c80a lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.962702:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d600/0x7b044d4128f9c80a lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938442.962716:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000051bedb73 reply state 00000000cd175eb4 transno 8589934815 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d400/0x7b044d4128f9c811 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.962726:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d400/0x7b044d4128f9c811 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.962732:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x1a616f3f (ffff9f248390a800) 00010000:00010000:0.0:1784938442.962734:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938442.962736:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938442.962762:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24cc00/0x7b044d4128f9c803 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664018 expref: 420 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.962776:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24de00/0x7b044d4128f9c818 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664018 expref: 419 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.962783:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x3c:0x0].0x0 (ffff9f248390ae00) 00010000:00010000:0.0:1784938442.962785:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938442.962787:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24de00, rc 0) 00000100:00100000:0.0:1784938442.962847:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+420:17096:x1871643337446400:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1052us (1214us total) trans 8589934815 rc 0/0 00000100:00100000:0.0:1784938442.962855:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 426 00000100:00100000:1.0:1784938442.966246:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.966398:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337446528 00000100:00100000:0.0:1784938442.966409:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337446528 00000100:00100000:0.0:1784938442.966468:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 687 00000100:00100000:0.0:1784938442.966478:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+73:10958:x1871643337446528:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938442.966500:0:21149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938442.966520:0:21149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c826 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766401f expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938442.966545:0:21149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938442.966564:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5e:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1784938442.966569:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.966577:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c826 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766401f expref: 74 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.966595:0:21149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c826 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766401f expref: 74 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.966608:0:21149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24d800, rc 0) 00000100:00100000:0.0:1784938442.966660:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+74:10958:x1871643337446528:12345-192.168.202.54@tcp:101:cp.0 Request processed in 184us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.966668:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 687 00000100:00100000:2.0:1784938442.969715:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938442.969784:0:25719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337446656 00000100:00100000:0.0:1784938442.969793:0:25719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337446656 00000100:00100000:0.0:1784938442.969848:0:25719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 688 00000100:00100000:0.0:1784938442.969857:0:25719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f2ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7ea6e988-18ba-4c98-b179-17995571b98b+74:17096:x1871643337446656:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938442.969874:0:25719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938442.969898:0:25719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c746802/0x7b044d4128f9c82d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664026 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.969927:0:25719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c826 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766401f expref: 75 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.969937:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.969941:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938442.969946:0:25719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c746802/0x7b044d4128f9c82d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5e:0x0].0x0 rrc: 3 type: EXT [0->172031] (req 0->172031) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664026 expref: 75 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.969976:0:25719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c826 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e94766401f expref: 75 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.969990:0:25719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c826 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766401f expref: 75 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938442.970005:0:25719:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387dac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:25719:1871643350861440:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938442.970086:0:25719:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238108ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938442.980050:0:25719:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387dac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:25719:1871643350861440:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938442.980104:0:25719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c746802/0x7b044d4128f9c82d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5e:0x0].0x0 rrc: 3 type: EXT [0->172031] (req 0->172031) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664026 expref: 75 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938442.980137:0:25719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24c400, rc 0) 00000100:00100000:0.0:1784938442.980258:0:25719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f2ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7ea6e988-18ba-4c98-b179-17995571b98b+75:17096:x1871643337446656:12345-192.168.202.54@tcp:101:cp.0 Request processed in 10401us (10550us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.980267:0:25719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 688 00000100:00100000:2.0:1784938442.982804:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938442.982918:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337446784 00000100:00100000:3.0:1784938442.982932:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337446784 00010000:00010000:3.0:1784938442.982987:0:25731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c826 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766401f expref: 75 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.983047:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 322 00000100:00100000:3.0:1784938442.983059:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f2c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+75:10957:x1871643337446784:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938442.983079:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938442.983109:0:25731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c826 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766401f expref: 75 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.983140:0:25731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c826 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766401f expref: 75 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.983230:0:25731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca51f3c2/0x7b044d4128f9c826 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766401f expref: 75 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.983255:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.983260:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938442.983269:0:25731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c746802/0x7b044d4128f9c82d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664026 expref: 74 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.983280:0:25731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c746802/0x7b044d4128f9c82d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664026 expref: 74 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938442.983337:0:25731:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002c746802/0x7b044d4128f9c82d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664026 expref: 74 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938442.983354:0:25731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f199f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:25731:1871643350861568:192.168.202.54@tcp:105: 00000100:00100000:3.0:1784938442.983447:0:25731:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2484c73240 going to sleep for 11 seconds 00000100:00100000:3.0:1784938442.989427:0:25731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f199f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:25731:1871643350861568:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938442.989473:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938442.989556:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f2c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+74:10957:x1871643337446784:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 6497us (6766us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938442.989571:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 322 00000100:00100000:0.0:1784938443.006738:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.006820:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337447040 00000100:00100000:3.0:1784938443.006831:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337447040 00000100:00100000:3.0:1784938443.006911:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 79 00000100:00100000:3.0:1784938443.006920:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+420:17096:x1871643337447040:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938443.007257:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+421:17096:x1871643337447040:12345-192.168.202.54@tcp:35:cp.0 Request processed in 337us (529us total) trans 8589934816 rc 0/0 00000100:00100000:3.0:1784938443.007264:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 79 00000100:00080000:0.0:1784938443.009667:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938443.013122:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.013264:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337447168 00000100:00100000:1.0:1784938443.013274:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337447168 00000100:00100000:1.0:1784938443.013342:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 427 00000100:00100000:1.0:1784938443.013351:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f2c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+421:17096:x1871643337447168:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938443.013374:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938443.013396:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7400/0x7b044d4128f9c834 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766402d expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.013467:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6200/0x7b044d4128f9c83b lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.013480:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6200/0x7b044d4128f9c83b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.013491:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6200/0x7b044d4128f9c83b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.013503:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c842 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x6d38f012 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.013508:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c842 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.013513:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c842 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.013551:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6200/0x7b044d4128f9c83b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.013556:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6200/0x7b044d4128f9c83b lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.013561:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6200/0x7b044d4128f9c83b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.013567:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f6200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938443.013571:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6200/0x7b044d4128f9c83b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.013581:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6200/0x7b044d4128f9c83b lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.013592:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938443.013604:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.013608:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6200/0x7b044d4128f9c83b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.013614:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6200/0x7b044d4128f9c83b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.013625:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c842 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.013629:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c842 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.013634:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c842 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.013638:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f6c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938443.013640:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c842 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.013645:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c842 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.013650:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x6d38f012 (ffff9f23823e0300) 00010000:00010000:1.0:1784938443.013651:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.013653:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c842 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.013661:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c842 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.013689:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7400/0x7b044d4128f9c834 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766402d expref: 422 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.013698:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938443.013699:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.013702:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7400/0x7b044d4128f9c834 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766402d expref: 422 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.013709:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c9f7400, rc 0) 00000100:00100000:1.0:1784938443.013757:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f2c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+421:17096:x1871643337447168:12345-192.168.202.54@tcp:101:cp.0 Request processed in 408us (645us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938443.013764:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 427 00000100:00100000:2.0:1784938443.017058:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.017180:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337447296 00000100:00100000:0.0:1784938443.017191:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337447296 00000100:00100000:0.0:1784938443.017238:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 428 00000100:00100000:0.0:1784938443.017246:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f2c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+421:17096:x1871643337447296:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938443.017268:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938443.017290:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c000/0x7b044d4128f9c849 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664034 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.017364:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ca00/0x7b044d4128f9c850 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.017378:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ca00/0x7b044d4128f9c850 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.017388:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ca00/0x7b044d4128f9c850 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.017402:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d600/0x7b044d4128f9c857 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x6d38f012 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.017407:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d600/0x7b044d4128f9c857 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.017413:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d600/0x7b044d4128f9c857 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.017456:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ca00/0x7b044d4128f9c850 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.017462:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ca00/0x7b044d4128f9c850 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.017468:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ca00/0x7b044d4128f9c850 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.017472:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24ca00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.017476:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ca00/0x7b044d4128f9c850 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.017482:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ca00/0x7b044d4128f9c850 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.017491:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938443.017494:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.017497:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ca00/0x7b044d4128f9c850 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.017508:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ca00/0x7b044d4128f9c850 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.017519:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d600/0x7b044d4128f9c857 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.017524:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d600/0x7b044d4128f9c857 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.017530:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d600/0x7b044d4128f9c857 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.017534:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24d600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.017536:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d600/0x7b044d4128f9c857 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.017541:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d600/0x7b044d4128f9c857 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.017545:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x6d38f012 (ffff9f24985e9400) 00010000:00010000:0.0:1784938443.017548:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.017550:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d600/0x7b044d4128f9c857 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.017554:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d600/0x7b044d4128f9c857 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.017582:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c000/0x7b044d4128f9c849 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664034 expref: 422 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.017590:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938443.017592:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.017725:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c000/0x7b044d4128f9c849 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664034 expref: 422 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.017736:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24c000, rc 0) 00000100:00100000:0.0:1784938443.017789:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f2c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+421:17096:x1871643337447296:12345-192.168.202.54@tcp:101:cp.0 Request processed in 543us (740us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938443.017798:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 428 00000100:00100000:0.0:1784938443.022090:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.023081:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337447552 00000100:00100000:1.0:1784938443.023093:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337447552 00000100:00100000:1.0:1784938443.023230:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 429 00000100:00100000:1.0:1784938443.023255:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387daea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+421:17096:x1871643337447552:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938443.023284:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938443.023311:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7400/0x7b044d4128f9c85e lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766403b expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.023445:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c865 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.023460:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c865 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.023473:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c865 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.023487:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6200/0x7b044d4128f9c86c lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x6d38f012 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.023493:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6200/0x7b044d4128f9c86c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.023500:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6200/0x7b044d4128f9c86c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938443.024459:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5f:0x0], index 0: 0 00010000:00010000:1.0:1784938443.024678:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6a00/0x7b044d4128f9c873 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.024691:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6a00/0x7b044d4128f9c873 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.024700:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6a00/0x7b044d4128f9c873 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.024732:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c865 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.024739:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c865 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.024747:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c865 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.024752:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f6c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938443.024757:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c865 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.024764:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c865 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.024776:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938443.024779:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.024783:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c865 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.024790:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c865 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938443.024857:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006838eaea reply state 000000008f295dd0 transno 8589934817 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6200/0x7b044d4128f9c86c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.024869:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6200/0x7b044d4128f9c86c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.024877:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x6d38f012 (ffff9f23823e0300) 00010000:00010000:1.0:1784938443.024879:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938443.024882:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938443.024980:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7400/0x7b044d4128f9c85e lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766403b expref: 424 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.024997:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6a00/0x7b044d4128f9c873 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766403b expref: 423 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.025005:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x3d:0x0].0x0 (ffff9f23823e0900) 00010000:00010000:1.0:1784938443.025007:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938443.025010:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c9f6a00, rc 0) 00000100:00100000:1.0:1784938443.025503:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387daea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+424:17096:x1871643337447552:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2260us (3420us total) trans 8589934817 rc 0/0 00000100:00100000:1.0:1784938443.025513:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 429 00000100:00100000:2.0:1784938443.035052:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.035133:0:25725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337447680 00000100:00100000:3.0:1784938443.035141:0:25725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337447680 00000100:00100000:3.0:1784938443.035228:0:25725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 689 00000100:00100000:3.0:1784938443.035237:0:25725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f2caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7ea6e988-18ba-4c98-b179-17995571b98b+64:10959:x1871643337447680:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938443.035264:0:25725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938443.035285:0:25725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9c881 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664042 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938443.035312:0:25725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938443.035341:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5f:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1784938443.035346:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.035356:0:25725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9c881 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664042 expref: 65 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.035374:0:25725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9c881 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664042 expref: 65 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.035387:0:25725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf0400, rc 0) 00000100:00080000:0.0:1784938443.035528:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938443.035737:0:25725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f2caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7ea6e988-18ba-4c98-b179-17995571b98b+65:10959:x1871643337447680:12345-192.168.202.54@tcp:101:cp.0 Request processed in 500us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938443.035746:0:25725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 689 00000100:00100000:2.0:1784938443.043082:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.043447:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337447808 00000100:00100000:0.0:1784938443.043458:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337447808 00000100:00100000:0.0:1784938443.043530:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 690 00000100:00100000:0.0:1784938443.043541:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f2c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+65:17096:x1871643337447808:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938443.043560:0:25722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938443.043578:0:25722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4a6658/0x7b044d4128f9c888 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664049 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.043794:0:25722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9c881 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664042 expref: 66 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.043805:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.043809:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.043815:0:25722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4a6658/0x7b044d4128f9c888 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5f:0x0].0x0 rrc: 3 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664049 expref: 66 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.043855:0:25722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9c881 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664042 expref: 66 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.043871:0:25722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9c881 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664042 expref: 66 pid: 25725 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.043961:0:25722:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387daf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25722:1871643350861696:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938443.044099:0:25722:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238108ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938443.054583:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.054815:0:25722:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387daf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25722:1871643350861696:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938443.054850:0:25722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4a6658/0x7b044d4128f9c888 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5f:0x0].0x0 rrc: 3 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664049 expref: 66 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.054871:0:25722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24c000, rc 0) 00000100:00100000:2.0:1784938443.054995:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f2c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+66:17096:x1871643337447808:12345-192.168.202.54@tcp:101:cp.0 Request processed in 11455us (11923us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938443.055006:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 690 00000100:00100000:1.0:1784938443.055186:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337447936 00000100:00100000:1.0:1784938443.055196:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337447936 00010000:00010000:1.0:1784938443.055243:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9c881 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664042 expref: 66 pid: 25725 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.055508:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 323 00000100:00100000:1.0:1784938443.055520:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387daed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+66:10960:x1871643337447936:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.055537:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.055560:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9c881 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664042 expref: 66 pid: 25725 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.055574:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9c881 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664042 expref: 66 pid: 25725 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.055813:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9c881 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664042 expref: 66 pid: 25725 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.055829:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.055834:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.055843:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4a6658/0x7b044d4128f9c888 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664049 expref: 65 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.055860:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4a6658/0x7b044d4128f9c888 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664049 expref: 65 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.055972:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001c4a6658/0x7b044d4128f9c888 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664049 expref: 65 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.055989:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37ca300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350861824:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938443.057167:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828afd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938443.070638:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37ca300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350861824:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938443.070675:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938443.070741:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387daed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+65:10960:x1871643337447936:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 15224us (16167us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938443.070752:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 323 00000100:00100000:0.0:1784938443.075402:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.075654:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337448192 00000100:00100000:1.0:1784938443.075665:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337448192 00000100:00100000:1.0:1784938443.075778:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 80 00000100:00100000:1.0:1784938443.075788:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+424:17096:x1871643337448192:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:1.0:1784938443.076103:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+425:17096:x1871643337448192:12345-192.168.202.54@tcp:35:cp.0 Request processed in 315us (710us total) trans 8589934818 rc 0/0 00000100:00100000:1.0:1784938443.076111:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 80 00000100:00100000:0.0:1784938443.084390:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.084576:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337448320 00000100:00100000:2.0:1784938443.084585:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337448320 00000100:00100000:2.0:1784938443.084646:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 430 00000100:00100000:2.0:1784938443.084656:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387daf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+425:17096:x1871643337448320:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938443.084681:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938443.084702:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9c88f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664050 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.084767:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27de00/0x7b044d4128f9c896 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.084782:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27de00/0x7b044d4128f9c896 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.084794:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27de00/0x7b044d4128f9c896 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.084808:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9c89d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x52815b39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.084816:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9c89d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.084822:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9c89d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.084861:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27de00/0x7b044d4128f9c896 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.084869:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27de00/0x7b044d4128f9c896 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.084876:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27de00/0x7b044d4128f9c896 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.084882:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27de00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938443.084887:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27de00/0x7b044d4128f9c896 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.084895:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27de00/0x7b044d4128f9c896 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.084906:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938443.084909:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.084913:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27de00/0x7b044d4128f9c896 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.084920:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27de00/0x7b044d4128f9c896 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.084932:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9c89d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.084938:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9c89d lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.084944:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9c89d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.084949:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27d600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938443.084952:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9c89d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.084958:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9c89d lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.084964:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x52815b39 (ffff9f238d49eb00) 00010000:00010000:2.0:1784938443.084966:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.084969:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9c89d lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.084975:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9c89d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.085008:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9c88f lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664050 expref: 426 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.085017:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938443.085020:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.085024:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9c88f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664050 expref: 426 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.085032:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d27cc00, rc 0) 00000100:00100000:2.0:1784938443.085247:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387daf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+425:17096:x1871643337448320:12345-192.168.202.54@tcp:101:cp.0 Request processed in 592us (869us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938443.085324:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 430 00000100:00100000:2.0:1784938443.093885:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.094311:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337448448 00000100:00100000:3.0:1784938443.094321:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337448448 00000100:00100000:3.0:1784938443.094447:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 431 00000100:00100000:3.0:1784938443.094458:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f2c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+425:17096:x1871643337448448:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938443.094479:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938443.094500:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c8a4 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664057 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.094561:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c8ab lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.094575:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c8ab lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.094586:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c8ab lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.094599:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c8b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x52815b39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.094604:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.094610:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.094648:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c8ab lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.094654:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c8ab lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.094660:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c8ab lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.094667:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c8ab lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.094673:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf0a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938443.094679:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c8ab lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.094687:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c8ab lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.094698:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938443.094701:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.094706:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c8ab lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.094712:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c8ab lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.094728:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.094734:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c8b2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.094740:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c8b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.094744:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf0400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938443.094747:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c8b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.094752:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c8b2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.094758:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x52815b39 (ffff9f2496483500) 00010000:00010000:3.0:1784938443.094761:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.094764:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c8b2 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.094769:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c8b2 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.094797:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c8a4 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664057 expref: 426 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.094805:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938443.094807:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.094809:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9c8a4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664057 expref: 426 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.094817:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf1600, rc 0) 00000100:00100000:3.0:1784938443.094940:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f2c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+425:17096:x1871643337448448:12345-192.168.202.54@tcp:101:cp.0 Request processed in 483us (1063us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938443.094946:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 431 00000100:00100000:0.0:1784938443.106509:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.109545:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337448704 00000100:00100000:1.0:1784938443.109560:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337448704 00000100:00100000:1.0:1784938443.109635:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 432 00000100:00100000:1.0:1784938443.109645:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+425:17096:x1871643337448704:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938443.109667:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938443.109687:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7400/0x7b044d4128f9c8b9 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766405e expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.109790:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c8c0 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.109805:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c8c0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.109816:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c8c0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.109828:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c8c7 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x52815b39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.109834:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c8c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.109840:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c8c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938443.110787:0:24203:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5f:0x0], index 1: 0 00010000:00010000:1.0:1784938443.111298:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6000/0x7b044d4128f9c8ce lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.111312:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6000/0x7b044d4128f9c8ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.111321:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6000/0x7b044d4128f9c8ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.111366:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c8c0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.111373:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c8c0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.111379:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c8c0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.111386:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f6c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938443.111390:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c8c0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.111397:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c8c0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.111408:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938443.111411:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.111415:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c8c0 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.111421:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c8c0 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938443.111442:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006e008c78 reply state 000000004e790b14 transno 8589934819 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c8c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.111452:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c8c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.111458:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x52815b39 (ffff9f23823e0c00) 00010000:00010000:1.0:1784938443.111460:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938443.111463:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938443.111493:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7400/0x7b044d4128f9c8b9 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766405e expref: 428 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.111506:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6000/0x7b044d4128f9c8ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766405e expref: 427 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.111518:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x3e:0x0].0x0 (ffff9f23823e0e00) 00010000:00010000:1.0:1784938443.111520:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938443.111522:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c9f6000, rc 0) 00000100:00100000:1.0:1784938443.111595:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+428:17096:x1871643337448704:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1950us (5095us total) trans 8589934819 rc 0/0 00000100:00100000:1.0:1784938443.111602:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 432 00000100:00100000:0.0:1784938443.114416:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.114553:0:25721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337448832 00000100:00100000:3.0:1784938443.114562:0:25721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337448832 00000100:00100000:3.0:1784938443.114625:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 691 00000100:00100000:3.0:1784938443.114634:0:25721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387daf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7ea6e988-18ba-4c98-b179-17995571b98b+74:10958:x1871643337448832:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938443.114650:0:25721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938443.114670:0:25721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9c8dc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664065 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938443.114693:0:25721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938443.114710:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5f:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1784938443.114715:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.114723:0:25721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9c8dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664065 expref: 75 pid: 25721 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.114738:0:25721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9c8dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664065 expref: 75 pid: 25721 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.114749:0:25721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf1600, rc 0) 00000100:00100000:3.0:1784938443.114837:0:25721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387daf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7ea6e988-18ba-4c98-b179-17995571b98b+75:10958:x1871643337448832:12345-192.168.202.54@tcp:101:cp.0 Request processed in 203us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938443.114843:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 691 00000100:00080000:0.0:1784938443.114909:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784938443.121269:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.121372:0:25724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337448960 00000100:00100000:1.0:1784938443.121382:0:25724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337448960 00000100:00100000:1.0:1784938443.121446:0:25724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 692 00000100:00100000:1.0:1784938443.121455:0:25724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f2c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7ea6e988-18ba-4c98-b179-17995571b98b+75:17096:x1871643337448960:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938443.121474:0:25724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938443.121491:0:25724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010729705/0x7b044d4128f9c8e3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766406c expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.121523:0:25724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9c8dc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664065 expref: 76 pid: 25721 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.121531:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.121536:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.121540:0:25724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010729705/0x7b044d4128f9c8e3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5f:0x0].0x0 rrc: 3 type: EXT [0->217087] (req 0->217087) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766406c expref: 76 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.121733:0:25724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9c8dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664065 expref: 76 pid: 25721 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.121753:0:25724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9c8dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664065 expref: 76 pid: 25721 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.121769:0:25724:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:25724:1871643350861952:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938443.121845:0:25724:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24917d6900 going to sleep for 11 seconds 00000100:00100000:2.0:1784938443.124691:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.125551:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337449088 00000100:00100000:3.0:1784938443.125563:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337449088 00010000:00010000:3.0:1784938443.125614:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9c8dc lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664065 expref: 77 pid: 25721 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.125662:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 324 00000100:00100000:3.0:1784938443.125671:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f2c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+77:10958:x1871643337449088:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938443.125689:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938443.125712:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9c8dc lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664065 expref: 77 pid: 25721 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.125725:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9c8dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664065 expref: 77 pid: 25721 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.125751:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.125757:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.125766:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000010729705/0x7b044d4128f9c8e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766406c expref: 77 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.125777:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010729705/0x7b044d4128f9c8e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766406c expref: 77 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.125816:0:19220:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000010729705/0x7b044d4128f9c8e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766406c expref: 77 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.125830:0:19220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f199f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:19220:1871643350862080:192.168.202.54@tcp:105: 00000100:00100000:3.0:1784938443.125921:0:19220:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2484c73240 going to sleep for 11 seconds 00010000:00010000:1.0:1784938443.126071:0:25724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9c8dc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664065 expref: 77 pid: 25721 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.126089:0:25724:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:25724:1871643350861952:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938443.126115:0:25724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000010729705/0x7b044d4128f9c8e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766406c expref: 76 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.126125:0:25724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c9f7400, rc 0) 00000100:00100000:1.0:1784938443.126223:0:25724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f2c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7ea6e988-18ba-4c98-b179-17995571b98b+76:17096:x1871643337448960:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4768us (4963us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.126231:0:25724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 692 00000100:00100000:0.0:1784938443.140850:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.141005:0:19220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f199f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:19220:1871643350862080:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938443.141043:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938443.141112:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f2c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+75:10958:x1871643337449088:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 15440us (16429us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938443.141124:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 324 00000100:00100000:1.0:1784938443.141788:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337449344 00000100:00100000:1.0:1784938443.141797:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337449344 00000100:00100000:1.0:1784938443.141844:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 81 00000100:00100000:1.0:1784938443.141853:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24857f8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+428:17096:x1871643337449344:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:1.0:1784938443.142720:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24857f8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+429:17096:x1871643337449344:12345-192.168.202.54@tcp:35:cp.0 Request processed in 864us (1876us total) trans 8589934820 rc 0/0 00000100:00100000:1.0:1784938443.142729:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 81 00000100:00100000:0.0:1784938443.149927:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.150437:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337449472 00000100:00100000:1.0:1784938443.150448:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337449472 00000100:00100000:1.0:1784938443.150512:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 433 00000100:00100000:1.0:1784938443.150522:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+429:17096:x1871643337449472:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938443.150548:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938443.150571:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c8ea lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664073 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.150645:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9c8f1 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.150660:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9c8f1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.150672:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9c8f1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.150686:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7800/0x7b044d4128f9c8f8 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x9cfce7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.150694:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7800/0x7b044d4128f9c8f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.150700:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7800/0x7b044d4128f9c8f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.150739:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9c8f1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.150747:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9c8f1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.150758:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9c8f1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.150764:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f7e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938443.150769:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9c8f1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.150776:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9c8f1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.150788:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938443.150792:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.150796:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9c8f1 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.150803:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9c8f1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.150816:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7800/0x7b044d4128f9c8f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.150823:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7800/0x7b044d4128f9c8f8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.150828:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7800/0x7b044d4128f9c8f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.150834:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f7800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938443.150837:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7800/0x7b044d4128f9c8f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.150848:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7800/0x7b044d4128f9c8f8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.150855:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x9cfce7b5 (ffff9f23823e0500) 00010000:00010000:1.0:1784938443.150858:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.150860:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7800/0x7b044d4128f9c8f8 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.150866:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7800/0x7b044d4128f9c8f8 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.150911:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c8ea lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664073 expref: 430 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.150921:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938443.150924:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.150928:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c8ea lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664073 expref: 430 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.150937:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c9f6c00, rc 0) 00000100:00100000:1.0:1784938443.151071:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+429:17096:x1871643337449472:12345-192.168.202.54@tcp:101:cp.0 Request processed in 550us (1155us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938443.151079:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 433 00000100:00100000:2.0:1784938443.161809:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.166387:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337449600 00000100:00100000:0.0:1784938443.166405:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337449600 00000100:00100000:0.0:1784938443.166597:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 434 00000100:00100000:0.0:1784938443.166609:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+429:17096:x1871643337449600:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938443.166630:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938443.166654:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d600/0x7b044d4128f9c8ff lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766407a expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.166720:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c906 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.166734:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c906 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.166745:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c906 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.166759:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ca00/0x7b044d4128f9c90d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x9cfce7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.166767:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ca00/0x7b044d4128f9c90d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.166773:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ca00/0x7b044d4128f9c90d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.166811:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c906 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.166817:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c906 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.166823:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c906 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.166828:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24d800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.166833:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c906 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.166840:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c906 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.166852:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938443.166855:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.166859:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c906 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.166865:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d800/0x7b044d4128f9c906 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.166878:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ca00/0x7b044d4128f9c90d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.166884:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ca00/0x7b044d4128f9c90d lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.166903:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ca00/0x7b044d4128f9c90d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.166908:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24ca00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.166911:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ca00/0x7b044d4128f9c90d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.166917:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ca00/0x7b044d4128f9c90d lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.166925:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x9cfce7b5 (ffff9f24985e9400) 00010000:00010000:0.0:1784938443.166927:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.166930:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ca00/0x7b044d4128f9c90d lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.166936:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ca00/0x7b044d4128f9c90d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.166969:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d600/0x7b044d4128f9c8ff lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766407a expref: 430 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.166979:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938443.166981:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.166985:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d600/0x7b044d4128f9c8ff lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766407a expref: 430 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.166993:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24d600, rc 0) 00000100:00100000:0.0:1784938443.167081:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+429:17096:x1871643337449600:12345-192.168.202.54@tcp:101:cp.0 Request processed in 474us (5279us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938443.167092:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 434 00000100:00100000:2.0:1784938443.172799:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.172902:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337449856 00000100:00100000:1.0:1784938443.172913:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337449856 00000100:00100000:1.0:1784938443.172968:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 435 00000100:00100000:1.0:1784938443.172977:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386360e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+429:17096:x1871643337449856:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938443.173001:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938443.173021:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c914 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664081 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.173129:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7800/0x7b044d4128f9c91b lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.173397:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7800/0x7b044d4128f9c91b lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.173412:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7800/0x7b044d4128f9c91b lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.173430:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9c922 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x9cfce7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.173438:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9c922 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.173444:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9c922 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938443.173748:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x60:0x0], index 0: 0 00010000:00010000:1.0:1784938443.173873:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9c929 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.173883:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9c929 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.173906:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9c929 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.173943:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7800/0x7b044d4128f9c91b lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.173951:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7800/0x7b044d4128f9c91b lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.173957:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7800/0x7b044d4128f9c91b lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.173964:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f7800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938443.173968:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7800/0x7b044d4128f9c91b lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.173976:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7800/0x7b044d4128f9c91b lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.173987:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938443.173991:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.173995:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7800/0x7b044d4128f9c91b lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.174001:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7800/0x7b044d4128f9c91b lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938443.174014:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000077c4f48 reply state 0000000055ba3182 transno 8589934821 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9c922 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.174025:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9c922 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.174031:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x9cfce7b5 (ffff9f23823e0500) 00010000:00010000:1.0:1784938443.174034:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938443.174037:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938443.174066:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c914 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664081 expref: 432 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.174080:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9c929 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664081 expref: 431 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.174088:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x3f:0x0].0x0 (ffff9f23823e0100) 00010000:00010000:1.0:1784938443.174090:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938443.174093:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b34000, rc 0) 00000100:00100000:1.0:1784938443.177832:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386360e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+432:17096:x1871643337449856:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4843us (5029us total) trans 8589934821 rc 0/0 00000100:00100000:1.0:1784938443.177845:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 435 00000100:00100000:3.0:1784938443.182320:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.182409:0:25718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337449984 00000100:00100000:1.0:1784938443.182419:0:25718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337449984 00000100:00100000:1.0:1784938443.182469:0:25718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 693 00000100:00100000:1.0:1784938443.182477:0:25718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f199f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ea6e988-18ba-4c98-b179-17995571b98b+65:10960:x1871643337449984:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938443.182495:0:25718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938443.182514:0:25718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0567aa1/0x7b044d4128f9c937 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x60:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664088 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938443.182538:0:25718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x60:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938443.182558:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x60:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1784938443.182563:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x60:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.182571:0:25718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0567aa1/0x7b044d4128f9c937 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664088 expref: 66 pid: 25718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.182594:0:25718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0567aa1/0x7b044d4128f9c937 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664088 expref: 66 pid: 25718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.182618:0:25718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b35400, rc 0) 00000100:00100000:1.0:1784938443.182679:0:25718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f199f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ea6e988-18ba-4c98-b179-17995571b98b+66:10960:x1871643337449984:12345-192.168.202.54@tcp:101:cp.0 Request processed in 203us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.182686:0:25718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 693 00000100:00100000:2.0:1784938443.189460:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.189650:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337450112 00000100:00100000:1.0:1784938443.189661:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337450112 00000100:00100000:1.0:1784938443.189725:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 694 00000100:00100000:1.0:1784938443.189734:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+66:17096:x1871643337450112:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938443.189752:0:21629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938443.189769:0:21629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027f9ef8c/0x7b044d4128f9c93e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x60:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766408f expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.189801:0:21629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0567aa1/0x7b044d4128f9c937 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664088 expref: 67 pid: 25718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.189810:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x60:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.189814:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x60:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.189820:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027f9ef8c/0x7b044d4128f9c93e lrc: 4/0,0 mode: --/PW res: [0x280000401:0x60:0x0].0x0 rrc: 3 type: EXT [0->200703] (req 0->200703) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766408f expref: 67 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.189854:0:21629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f0567aa1/0x7b044d4128f9c937 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664088 expref: 67 pid: 25718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.189869:0:21629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f0567aa1/0x7b044d4128f9c937 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664088 expref: 67 pid: 25718 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.189881:0:21629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:21629:1871643350862208:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938443.190001:0:21629:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828e7480 going to sleep for 11 seconds 00000100:00100000:1.0:1784938443.199617:0:21629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:21629:1871643350862208:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938443.199659:0:21629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027f9ef8c/0x7b044d4128f9c93e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x60:0x0].0x0 rrc: 3 type: EXT [0->200703] (req 0->200703) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766408f expref: 67 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.199682:0:21629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b35e00, rc 0) 00000100:00100000:1.0:1784938443.200002:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+67:17096:x1871643337450112:12345-192.168.202.54@tcp:101:cp.0 Request processed in 10267us (10548us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.200012:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 694 00000100:00100000:0.0:1784938443.201997:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.202519:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337450240 00000100:00100000:3.0:1784938443.202529:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337450240 00010000:00010000:3.0:1784938443.202568:0:25731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f0567aa1/0x7b044d4128f9c937 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664088 expref: 67 pid: 25718 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.202615:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 325 00000100:00100000:3.0:1784938443.202625:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387daca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+67:10960:x1871643337450240:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938443.202642:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938443.202666:0:25731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f0567aa1/0x7b044d4128f9c937 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664088 expref: 67 pid: 25718 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.202681:0:25731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f0567aa1/0x7b044d4128f9c937 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664088 expref: 67 pid: 25718 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.202703:0:25731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0567aa1/0x7b044d4128f9c937 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664088 expref: 67 pid: 25718 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.202722:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x60:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.202727:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x60:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.202737:0:25731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027f9ef8c/0x7b044d4128f9c93e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766408f expref: 66 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.202748:0:25731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027f9ef8c/0x7b044d4128f9c93e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766408f expref: 66 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.202788:0:25731:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000027f9ef8c/0x7b044d4128f9c93e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766408f expref: 66 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.202804:0:25731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f199880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:25731:1871643350862336:192.168.202.54@tcp:105: 00000100:00100000:3.0:1784938443.202903:0:25731:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2484c73240 going to sleep for 11 seconds 00000100:00100000:3.0:1784938443.208002:0:25731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f199880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:25731:1871643350862336:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938443.208029:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938443.208088:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387daca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+66:10960:x1871643337450240:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 5463us (6097us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938443.208102:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 325 00000100:00100000:2.0:1784938443.216463:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.216771:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337450496 00000100:00100000:1.0:1784938443.216782:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337450496 00000100:00100000:1.0:1784938443.216897:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 82 00000100:00100000:1.0:1784938443.216906:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+432:17096:x1871643337450496:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:1.0:1784938443.217236:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+433:17096:x1871643337450496:12345-192.168.202.54@tcp:35:cp.0 Request processed in 330us (781us total) trans 8589934822 rc 0/0 00000100:00100000:1.0:1784938443.217255:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 82 00000100:00100000:1.0:1784938443.221063:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.222445:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337450624 00000100:00100000:2.0:1784938443.222457:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337450624 00000100:00100000:2.0:1784938443.222514:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 436 00000100:00100000:2.0:1784938443.222523:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+433:17096:x1871643337450624:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938443.222548:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938443.222568:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ca00/0x7b044d4128f9c945 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664096 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.222636:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d200/0x7b044d4128f9c94c lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.222651:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d200/0x7b044d4128f9c94c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.222662:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d200/0x7b044d4128f9c94c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.222677:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9c953 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe708c894 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.222683:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9c953 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.222689:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9c953 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.222728:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d200/0x7b044d4128f9c94c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.222735:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d200/0x7b044d4128f9c94c lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.222742:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d200/0x7b044d4128f9c94c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.222748:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27d200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938443.222752:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d200/0x7b044d4128f9c94c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.222759:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d200/0x7b044d4128f9c94c lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.222771:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938443.222774:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.222778:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d200/0x7b044d4128f9c94c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.222784:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d200/0x7b044d4128f9c94c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.222796:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9c953 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.222802:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9c953 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.222808:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9c953 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.222813:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27d000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938443.222816:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9c953 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.222822:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9c953 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.222829:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xe708c894 (ffff9f238d49eb00) 00010000:00010000:2.0:1784938443.222831:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.222835:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9c953 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.222840:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9c953 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.222876:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ca00/0x7b044d4128f9c945 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664096 expref: 434 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.223744:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938443.223750:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.223757:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ca00/0x7b044d4128f9c945 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664096 expref: 434 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.223772:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d27ca00, rc 0) 00000100:00100000:2.0:1784938443.223849:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+433:17096:x1871643337450624:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1326us (2794us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938443.223858:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 436 00000100:00100000:0.0:1784938443.228848:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.228938:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337450752 00000100:00100000:3.0:1784938443.228948:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337450752 00000100:00100000:3.0:1784938443.229011:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 437 00000100:00100000:3.0:1784938443.229032:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+433:17096:x1871643337450752:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938443.229056:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938443.229078:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c95a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766409d expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.229191:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c961 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.229205:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c961 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.229216:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c961 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.229230:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9c968 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe708c894 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.229237:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9c968 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.229470:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9c968 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.229512:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c961 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.229524:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c961 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.229530:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c961 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.229536:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c961 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.229542:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf0a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938443.229547:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c961 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.229555:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c961 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.229567:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938443.229570:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.229575:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c961 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.229582:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9c961 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.229598:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9c968 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.229604:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9c968 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.229610:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9c968 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.229615:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938443.229618:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9c968 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.229623:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9c968 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.229630:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xe708c894 (ffff9f2484afda00) 00010000:00010000:3.0:1784938443.229632:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.229635:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9c968 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.229640:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9c968 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.229677:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c95a lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766409d expref: 434 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.229686:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938443.229689:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.229692:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9c95a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766409d expref: 434 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.229702:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf0400, rc 0) 00000100:00100000:3.0:1784938443.229769:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+433:17096:x1871643337450752:12345-192.168.202.54@tcp:101:cp.0 Request processed in 748us (929us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938443.229777:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 437 00000100:00100000:0.0:1784938443.239255:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.239409:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337451008 00000100:00100000:2.0:1784938443.239418:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337451008 00000100:00100000:2.0:1784938443.239473:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 438 00000100:00100000:2.0:1784938443.239482:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+433:17096:x1871643337451008:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938443.239504:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938443.239525:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ca00/0x7b044d4128f9c96f lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476640a4 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.239621:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9c976 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.239640:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9c976 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.239651:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9c976 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.239665:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d200/0x7b044d4128f9c97d lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0xe708c894 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.239673:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d200/0x7b044d4128f9c97d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.239680:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d200/0x7b044d4128f9c97d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938443.240567:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x60:0x0], index 1: 0 00010000:00010000:2.0:1784938443.240717:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d400/0x7b044d4128f9c984 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.240729:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d400/0x7b044d4128f9c984 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.240739:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d400/0x7b044d4128f9c984 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.240773:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9c976 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.240781:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9c976 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.240788:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9c976 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.240795:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27d000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938443.240799:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9c976 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.240807:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9c976 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.240820:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938443.240823:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.240827:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9c976 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.240833:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9c976 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938443.240847:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001d29845c reply state 00000000bf3558fe transno 8589934823 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d200/0x7b044d4128f9c97d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.240857:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d200/0x7b044d4128f9c97d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.240863:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xe708c894 (ffff9f238d49eb00) 00010000:00010000:2.0:1784938443.240866:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938443.240868:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938443.242620:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ca00/0x7b044d4128f9c96f lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476640a4 expref: 436 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.242649:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d400/0x7b044d4128f9c984 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476640a4 expref: 435 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.242664:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x40:0x0].0x0 (ffff9f238d49ef00) 00010000:00010000:2.0:1784938443.242667:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938443.242670:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d27d400, rc 0) 00000100:00100000:2.0:1784938443.242855:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+436:17096:x1871643337451008:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3372us (3619us total) trans 8589934823 rc 0/0 00000100:00100000:2.0:1784938443.242864:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 438 00000100:00100000:1.0:1784938443.251581:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.251765:0:25726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337451136 00000100:00100000:0.0:1784938443.251773:0:25726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337451136 00000100:00100000:0.0:1784938443.251821:0:25726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 695 00000100:00100000:0.0:1784938443.251829:0:25726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7ea6e988-18ba-4c98-b179-17995571b98b+75:10957:x1871643337451136:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938443.251847:0:25726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938443.251869:0:25726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc902b02/0x7b044d4128f9c992 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x60:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476640ab expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938443.251999:0:25726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x60:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938443.252018:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x60:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1784938443.252021:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x60:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.252031:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc902b02/0x7b044d4128f9c992 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476640ab expref: 76 pid: 25726 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.252048:0:25726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fc902b02/0x7b044d4128f9c992 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476640ab expref: 76 pid: 25726 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.252063:0:25726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24d200, rc 0) 00000100:00100000:0.0:1784938443.252116:0:25726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7ea6e988-18ba-4c98-b179-17995571b98b+76:10957:x1871643337451136:12345-192.168.202.54@tcp:101:cp.0 Request processed in 288us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.252121:0:25726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 695 00000100:00100000:2.0:1784938443.257795:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.257980:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337451264 00000100:00100000:1.0:1784938443.257990:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337451264 00000100:00100000:1.0:1784938443.258093:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 696 00000100:00100000:1.0:1784938443.258101:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+76:17096:x1871643337451264:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938443.258118:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938443.258138:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0567aa1/0x7b044d4128f9c999 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x60:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476640b2 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.258219:0:21151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc902b02/0x7b044d4128f9c992 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476640ab expref: 77 pid: 25726 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.258229:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x60:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.258233:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x60:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.258238:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0567aa1/0x7b044d4128f9c999 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x60:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476640b2 expref: 77 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.258283:0:21151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fc902b02/0x7b044d4128f9c992 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e9476640ab expref: 77 pid: 25726 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.258294:0:21151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fc902b02/0x7b044d4128f9c992 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476640ab expref: 77 pid: 25726 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.258304:0:21151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:21151:1871643350862464:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938443.258398:0:21151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828e7240 going to sleep for 11 seconds 00000100:00100000:1.0:1784938443.262026:0:21151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:21151:1871643350862464:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938443.262066:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f0567aa1/0x7b044d4128f9c999 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x60:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476640b2 expref: 77 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.262093:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b35400, rc 0) 00000100:00100000:1.0:1784938443.262295:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+77:17096:x1871643337451264:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4192us (4507us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.262303:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 696 00000100:00100000:2.0:1784938443.263054:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.264314:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337451392 00000100:00100000:3.0:1784938443.264335:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337451392 00010000:00010000:1.0:1784938443.264471:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fc902b02/0x7b044d4128f9c992 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476640ab expref: 77 pid: 25726 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.264557:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 326 00000100:00100000:1.0:1784938443.264578:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d3ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+77:10958:x1871643337451392:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.264593:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.264615:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fc902b02/0x7b044d4128f9c992 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476640ab expref: 77 pid: 25726 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.264629:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fc902b02/0x7b044d4128f9c992 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476640ab expref: 77 pid: 25726 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.264651:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc902b02/0x7b044d4128f9c992 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476640ab expref: 77 pid: 25726 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.264669:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x60:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.264674:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x60:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.264682:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0567aa1/0x7b044d4128f9c999 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476640b2 expref: 76 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.264699:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0567aa1/0x7b044d4128f9c999 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476640b2 expref: 76 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.264738:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f0567aa1/0x7b044d4128f9c999 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476640b2 expref: 76 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.264753:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37c9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:19219:1871643350862592:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938443.264841:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828e7240 going to sleep for 11 seconds 00000100:00100000:2.0:1784938443.269310:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.269491:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37c9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:19219:1871643350862592:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938443.269518:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.269595:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d3ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+76:10958:x1871643337451392:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 5018us (6542us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.269606:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 326 00000100:00100000:3.0:1784938443.271549:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337451648 00000100:00100000:3.0:1784938443.271571:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337451648 00000100:00100000:3.0:1784938443.271641:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 83 00000100:00100000:3.0:1784938443.271651:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d3adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+436:17096:x1871643337451648:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938443.272410:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d3adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+437:17096:x1871643337451648:12345-192.168.202.54@tcp:35:cp.0 Request processed in 758us (3106us total) trans 8589934824 rc 0/0 00000100:00100000:3.0:1784938443.272420:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 83 00000100:00100000:2.0:1784938443.279680:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.279868:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337451776 00000100:00100000:1.0:1784938443.279879:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337451776 00000100:00100000:1.0:1784938443.279954:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 439 00000100:00100000:1.0:1784938443.279964:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d3af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+437:17096:x1871643337451776:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938443.279987:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938443.280008:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9c9a0 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476640b9 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.280089:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9c9a7 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.280105:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9c9a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.280116:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9c9a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.280131:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c9ae lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xd13f1037 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.280137:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c9ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.280143:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c9ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.280225:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9c9a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.280233:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9c9a7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.280239:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9c9a7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.280495:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938443.280499:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9c9a7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.280507:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9c9a7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.280520:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938443.280523:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.280528:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9c9a7 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.280535:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9c9a7 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.280551:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c9ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.280557:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c9ae lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.280575:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c9ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.280580:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f6c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938443.280583:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c9ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.280588:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c9ae lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.280595:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xd13f1037 (ffff9f23823e0000) 00010000:00010000:1.0:1784938443.280597:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.280600:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c9ae lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.280605:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c9ae lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.280641:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9c9a0 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476640b9 expref: 438 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.280656:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938443.280658:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.280662:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9c9a0 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476640b9 expref: 438 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.280672:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b34a00, rc 0) 00000100:00100000:1.0:1784938443.280739:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d3af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+437:17096:x1871643337451776:12345-192.168.202.54@tcp:101:cp.0 Request processed in 776us (1068us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938443.280747:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 439 00000100:00100000:2.0:1784938443.290269:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.290375:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337451904 00000100:00100000:1.0:1784938443.290385:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337451904 00000100:00100000:1.0:1784938443.290447:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 440 00000100:00100000:1.0:1784938443.290457:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d3ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+437:17096:x1871643337451904:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938443.290477:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938443.290499:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c9b5 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476640c0 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.290563:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7800/0x7b044d4128f9c9bc lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.290578:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7800/0x7b044d4128f9c9bc lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.290588:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7800/0x7b044d4128f9c9bc lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.290604:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9c9c3 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xd13f1037 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.290611:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9c9c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.290617:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9c9c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.290655:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7800/0x7b044d4128f9c9bc lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.290661:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7800/0x7b044d4128f9c9bc lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.290668:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7800/0x7b044d4128f9c9bc lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.290674:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f7800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938443.290679:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7800/0x7b044d4128f9c9bc lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.290686:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7800/0x7b044d4128f9c9bc lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.290698:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938443.290702:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.290706:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7800/0x7b044d4128f9c9bc lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.290712:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7800/0x7b044d4128f9c9bc lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.290725:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9c9c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.290731:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9c9c3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.290735:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9c9c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.290739:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b34a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938443.290742:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9c9c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.290747:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9c9c3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.290752:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xd13f1037 (ffff9f23823e0000) 00010000:00010000:1.0:1784938443.290755:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.290757:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9c9c3 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.290762:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9c9c3 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.290794:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c9b5 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476640c0 expref: 438 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.290804:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938443.290807:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.290811:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9c9b5 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476640c0 expref: 438 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.290824:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c9f6c00, rc 0) 00000100:00100000:1.0:1784938443.290879:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d3ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+437:17096:x1871643337451904:12345-192.168.202.54@tcp:101:cp.0 Request processed in 424us (619us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938443.290901:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 440 00000100:00100000:2.0:1784938443.294989:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.295084:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337452160 00000100:00100000:1.0:1784938443.295094:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337452160 00000100:00100000:1.0:1784938443.295188:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 441 00000100:00100000:1.0:1784938443.295199:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d3aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+437:17096:x1871643337452160:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938443.295220:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938443.295251:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9c9ca lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476640c7 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.295375:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29800/0x7b044d4128f9c9d1 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.295390:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29800/0x7b044d4128f9c9d1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.295402:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29800/0x7b044d4128f9c9d1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.295415:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29200/0x7b044d4128f9c9d8 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0xd13f1037 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.295422:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29200/0x7b044d4128f9c9d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.295428:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29200/0x7b044d4128f9c9d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938443.295734:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x61:0x0], index 0: 0 00010000:00010000:1.0:1784938443.295869:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29e00/0x7b044d4128f9c9df lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.295878:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29e00/0x7b044d4128f9c9df lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.295885:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29e00/0x7b044d4128f9c9df lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.295916:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29800/0x7b044d4128f9c9d1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.295924:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29800/0x7b044d4128f9c9d1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.295930:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29800/0x7b044d4128f9c9d1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.295937:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b29800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938443.295941:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29800/0x7b044d4128f9c9d1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.295949:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29800/0x7b044d4128f9c9d1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.295961:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938443.295964:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.295968:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29800/0x7b044d4128f9c9d1 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.295977:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29800/0x7b044d4128f9c9d1 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938443.295991:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000812a0e6b reply state 0000000036261106 transno 8589934825 ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29200/0x7b044d4128f9c9d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.296001:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29200/0x7b044d4128f9c9d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.296006:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xd13f1037 (ffff9f23823e0200) 00010000:00010000:1.0:1784938443.296008:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938443.296009:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938443.296036:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9c9ca lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476640c7 expref: 440 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.296051:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29e00/0x7b044d4128f9c9df lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476640c7 expref: 439 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.296059:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x41:0x0].0x0 (ffff9f24898e2200) 00010000:00010000:1.0:1784938443.296061:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938443.296064:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24c5b29e00, rc 0) 00000100:00100000:1.0:1784938443.296123:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d3aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+440:17096:x1871643337452160:12345-192.168.202.54@tcp:101:cp.0 Request processed in 927us (1144us total) trans 8589934825 rc 0/0 00000100:00100000:1.0:1784938443.296131:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 441 00000100:00100000:0.0:1784938443.299069:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.299163:0:25723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337452288 00000100:00100000:2.0:1784938443.299171:0:25723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337452288 00000100:00100000:2.0:1784938443.299215:0:25723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 697 00000100:00100000:2.0:1784938443.299224:0:25723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7ea6e988-18ba-4c98-b179-17995571b98b+66:10959:x1871643337452288:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938443.299253:0:25723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938443.299275:0:25723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000605418bd/0x7b044d4128f9c9ed lrc: 2/0,0 mode: --/PR res: [0x280000401:0x61:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476640ce expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938443.299299:0:25723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x61:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938443.299315:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x61:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1784938443.299318:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x61:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.299338:0:25723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000605418bd/0x7b044d4128f9c9ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476640ce expref: 67 pid: 25723 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.299366:0:25723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000605418bd/0x7b044d4128f9c9ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476640ce expref: 67 pid: 25723 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.299380:0:25723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d27c600, rc 0) 00000100:00100000:2.0:1784938443.299435:0:25723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7ea6e988-18ba-4c98-b179-17995571b98b+67:10959:x1871643337452288:12345-192.168.202.54@tcp:101:cp.0 Request processed in 212us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938443.299443:0:25723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 697 00000100:00100000:2.0:1784938443.301797:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.301912:0:25719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337452416 00000100:00100000:0.0:1784938443.301922:0:25719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337452416 00000100:00100000:0.0:1784938443.302017:0:25719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 698 00000100:00100000:0.0:1784938443.302038:0:25719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d3ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7ea6e988-18ba-4c98-b179-17995571b98b+67:17096:x1871643337452416:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938443.302056:0:25719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938443.302075:0:25719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac59fab1/0x7b044d4128f9c9f4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x61:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476640d5 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.302111:0:25719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000605418bd/0x7b044d4128f9c9ed lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476640ce expref: 68 pid: 25723 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.302120:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x61:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.302125:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x61:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.302130:0:25719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac59fab1/0x7b044d4128f9c9f4 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x61:0x0].0x0 rrc: 3 type: EXT [0->229375] (req 0->229375) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476640d5 expref: 68 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.302192:0:25719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000605418bd/0x7b044d4128f9c9ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e9476640ce expref: 68 pid: 25723 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.302206:0:25719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000605418bd/0x7b044d4128f9c9ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476640ce expref: 68 pid: 25723 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.302222:0:25719:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387dae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:25719:1871643350862720:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938443.302313:0:25719:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238108ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938443.305504:0:25719:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387dae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:25719:1871643350862720:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938443.305542:0:25719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ac59fab1/0x7b044d4128f9c9f4 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x61:0x0].0x0 rrc: 3 type: EXT [0->229375] (req 0->229375) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476640d5 expref: 68 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.305563:0:25719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24d600, rc 0) 00000100:00100000:0.0:1784938443.305627:0:25719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d3ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7ea6e988-18ba-4c98-b179-17995571b98b+68:17096:x1871643337452416:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3601us (3837us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.305646:0:25719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 698 00000100:00100000:1.0:1784938443.307575:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.307649:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337452544 00000100:00100000:3.0:1784938443.307659:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337452544 00010000:00010000:3.0:1784938443.307696:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000605418bd/0x7b044d4128f9c9ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476640ce expref: 68 pid: 25723 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.307734:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 327 00000100:00100000:3.0:1784938443.307745:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2488a64450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+68:10960:x1871643337452544:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938443.307763:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938443.307787:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000605418bd/0x7b044d4128f9c9ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x61:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476640ce expref: 68 pid: 25723 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.307801:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000605418bd/0x7b044d4128f9c9ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x61:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476640ce expref: 68 pid: 25723 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.307825:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000605418bd/0x7b044d4128f9c9ed lrc: 0/0,0 mode: --/PR res: [0x280000401:0x61:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476640ce expref: 68 pid: 25723 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.307843:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x61:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.307848:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x61:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.307857:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac59fab1/0x7b044d4128f9c9f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476640d5 expref: 67 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.307867:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac59fab1/0x7b044d4128f9c9f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476640d5 expref: 67 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.307919:0:19220:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ac59fab1/0x7b044d4128f9c9f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476640d5 expref: 67 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.307934:0:19220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f199880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:19220:1871643350862848:192.168.202.54@tcp:105: 00000100:00100000:3.0:1784938443.308011:0:19220:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2484c73180 going to sleep for 11 seconds 00000100:00100000:1.0:1784938443.311415:0:19220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f199880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:19220:1871643350862848:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938443.311442:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.311507:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2488a64450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+67:10960:x1871643337452544:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3763us (3937us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.311519:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 327 00000100:00100000:2.0:1784938443.318696:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.319104:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337452800 00000100:00100000:1.0:1784938443.319115:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337452800 00000100:00100000:1.0:1784938443.319231:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 84 00000100:00100000:1.0:1784938443.319463:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d3afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+440:17096:x1871643337452800:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:1.0:1784938443.319907:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d3afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+441:17096:x1871643337452800:12345-192.168.202.54@tcp:35:cp.0 Request processed in 666us (1220us total) trans 8589934826 rc 0/0 00000100:00100000:1.0:1784938443.319915:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 84 00000100:00100000:2.0:1784938443.324537:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.324619:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337452928 00000100:00100000:1.0:1784938443.324629:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337452928 00000100:00100000:1.0:1784938443.324694:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 442 00000100:00100000:1.0:1784938443.324705:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d3ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+441:17096:x1871643337452928:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938443.324733:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938443.324756:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29800/0x7b044d4128f9c9fb lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476640dc expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.324818:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9ca02 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.324832:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9ca02 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.324844:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9ca02 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.324859:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9ca09 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xc701cb36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.324868:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9ca09 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.324875:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9ca09 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.324930:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9ca02 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.324938:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9ca02 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.324944:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9ca02 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.324951:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b29c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938443.324955:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9ca02 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.324963:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9ca02 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.324975:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938443.324978:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.324982:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9ca02 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.324989:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9ca02 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.325002:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9ca09 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.325009:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9ca09 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.325014:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9ca09 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.325031:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b29a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938443.325035:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9ca09 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.325041:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9ca09 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.325048:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xc701cb36 (ffff9f23823e0000) 00010000:00010000:1.0:1784938443.325051:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.325053:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9ca09 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.325058:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9ca09 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.325089:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29800/0x7b044d4128f9c9fb lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476640dc expref: 442 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.325100:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938443.325102:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.325106:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29800/0x7b044d4128f9c9fb lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476640dc expref: 442 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.325119:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24c5b29800, rc 0) 00000100:00100000:1.0:1784938443.325609:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d3ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+441:17096:x1871643337452928:12345-192.168.202.54@tcp:101:cp.0 Request processed in 904us (1080us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938443.325619:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 442 00000100:00100000:2.0:1784938443.328835:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.329984:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337453056 00000100:00100000:1.0:1784938443.329998:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337453056 00000100:00100000:1.0:1784938443.330486:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 443 00000100:00100000:1.0:1784938443.330499:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+441:17096:x1871643337453056:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938443.330525:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938443.330549:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28c00/0x7b044d4128f9ca10 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476640e3 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.330621:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9ca17 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.330637:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9ca17 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.330649:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9ca17 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.330666:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9ca1e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xc701cb36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.330673:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9ca1e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.330679:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9ca1e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.330723:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9ca17 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.330731:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9ca17 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.330736:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9ca17 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.330742:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938443.330746:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9ca17 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.330754:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9ca17 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.330765:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938443.330768:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.330773:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9ca17 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.330779:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9ca17 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.330793:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9ca1e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.330798:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9ca1e lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.330804:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9ca1e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.330809:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b34a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938443.330811:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9ca1e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.330816:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9ca1e lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.330824:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xc701cb36 (ffff9f2485cb4800) 00010000:00010000:1.0:1784938443.330826:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.330829:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9ca1e lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.330834:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9ca1e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.330872:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28c00/0x7b044d4128f9ca10 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476640e3 expref: 442 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.330882:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938443.330973:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.330981:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28c00/0x7b044d4128f9ca10 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476640e3 expref: 442 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.330990:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24c5b28c00, rc 0) 00000100:00100000:1.0:1784938443.331336:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+441:17096:x1871643337453056:12345-192.168.202.54@tcp:101:cp.0 Request processed in 830us (2502us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938443.331344:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 443 00000100:00100000:0.0:1784938443.334852:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.334988:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337453312 00000100:00100000:3.0:1784938443.335000:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337453312 00000100:00100000:3.0:1784938443.335086:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 444 00000100:00100000:3.0:1784938443.335100:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+441:17096:x1871643337453312:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938443.335122:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938443.335182:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9ca25 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476640ea expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.335447:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9ca2c lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.335464:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9ca2c lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.335477:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9ca2c lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.335498:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9ca33 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0xc701cb36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.335505:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9ca33 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.335512:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9ca33 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938443.336312:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x61:0x0], index 1: 0 00010000:00010000:3.0:1784938443.336505:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1a00/0x7b044d4128f9ca3a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.336518:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1a00/0x7b044d4128f9ca3a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.336527:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1a00/0x7b044d4128f9ca3a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.336560:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9ca2c lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.336568:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9ca2c lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.336577:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9ca2c lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.336584:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938443.336590:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9ca2c lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.336603:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9ca2c lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.336618:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938443.336621:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.336626:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9ca2c lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.336633:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9ca2c lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938443.336649:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b1d6f01d reply state 000000008c728932 transno 8589934827 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9ca33 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.336659:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9ca33 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.336664:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xc701cb36 (ffff9f2484afda00) 00010000:00010000:3.0:1784938443.336666:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938443.336669:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938443.336707:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9ca25 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476640ea expref: 444 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.336725:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1a00/0x7b044d4128f9ca3a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476640ea expref: 443 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.336733:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x42:0x0].0x0 (ffff9f2484afdb00) 00010000:00010000:3.0:1784938443.336735:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938443.336737:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf1a00, rc 0) 00000100:00100000:3.0:1784938443.336910:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+444:17096:x1871643337453312:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1813us (2068us total) trans 8589934827 rc 0/0 00000100:00100000:3.0:1784938443.336920:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 444 00000100:00100000:2.0:1784938443.341882:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.342094:0:25725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337453440 00000100:00100000:3.0:1784938443.342107:0:25725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337453440 00000100:00100000:2.0:1784938443.342470:0:25725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 699 00000100:00100000:2.0:1784938443.342485:0:25725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7ea6e988-18ba-4c98-b179-17995571b98b+76:10957:x1871643337453440:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938443.342507:0:25725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938443.342532:0:25725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000607bdb42/0x7b044d4128f9ca48 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x61:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476640f1 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938443.342563:0:25725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x61:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938443.342591:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x61:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1784938443.342596:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x61:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.342609:0:25725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000607bdb42/0x7b044d4128f9ca48 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476640f1 expref: 77 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.342634:0:25725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000607bdb42/0x7b044d4128f9ca48 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476640f1 expref: 77 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.342649:0:25725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d27ca00, rc 0) 00000100:00100000:2.0:1784938443.342734:0:25725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7ea6e988-18ba-4c98-b179-17995571b98b+77:10957:x1871643337453440:12345-192.168.202.54@tcp:101:cp.0 Request processed in 251us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938443.342742:0:25725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 699 00000100:00100000:2.0:1784938443.347236:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.347354:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337453568 00000100:00100000:0.0:1784938443.347364:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337453568 00000100:00100000:0.0:1784938443.347430:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 700 00000100:00100000:0.0:1784938443.347442:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+77:17096:x1871643337453568:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938443.347461:0:25722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938443.347480:0:25722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc902b02/0x7b044d4128f9ca4f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x61:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476640f8 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.347514:0:25722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000607bdb42/0x7b044d4128f9ca48 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476640f1 expref: 78 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.347523:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x61:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.347527:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x61:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.347532:0:25722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc902b02/0x7b044d4128f9ca4f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x61:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476640f8 expref: 78 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.347566:0:25722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000607bdb42/0x7b044d4128f9ca48 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e9476640f1 expref: 78 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.347584:0:25722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000607bdb42/0x7b044d4128f9ca48 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476640f1 expref: 78 pid: 25725 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.347597:0:25722:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387daf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25722:1871643350862976:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938443.347682:0:25722:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238108ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938443.351747:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.351986:0:25722:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387daf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25722:1871643350862976:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938443.352055:0:25722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fc902b02/0x7b044d4128f9ca4f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x61:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476640f8 expref: 78 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.352087:0:25722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24d200, rc 0) 00000100:00100000:2.0:1784938443.352576:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+78:17096:x1871643337453568:12345-192.168.202.54@tcp:101:cp.0 Request processed in 5133us (5347us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938443.352589:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 700 00000100:00100000:3.0:1784938443.353439:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337453696 00000100:00100000:3.0:1784938443.353457:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337453696 00010000:00010000:3.0:1784938443.353527:0:25731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000607bdb42/0x7b044d4128f9ca48 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476640f1 expref: 78 pid: 25725 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.353582:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 328 00000100:00100000:3.0:1784938443.353594:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387daed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+78:10958:x1871643337453696:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938443.353616:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938443.353653:0:25731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000607bdb42/0x7b044d4128f9ca48 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x61:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476640f1 expref: 78 pid: 25725 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.353670:0:25731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000607bdb42/0x7b044d4128f9ca48 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x61:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476640f1 expref: 78 pid: 25725 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.353705:0:25731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000607bdb42/0x7b044d4128f9ca48 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x61:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476640f1 expref: 78 pid: 25725 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.353729:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x61:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.353734:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x61:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.353744:0:25731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc902b02/0x7b044d4128f9ca4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476640f8 expref: 77 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.353764:0:25731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc902b02/0x7b044d4128f9ca4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476640f8 expref: 77 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.353820:0:25731:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fc902b02/0x7b044d4128f9ca4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476640f8 expref: 77 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.353843:0:25731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f19a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:25731:1871643350863104:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938443.356546:0:25731:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbeb40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938443.365836:0:25731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f19a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:25731:1871643350863104:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938443.365882:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938443.367040:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.367197:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337453952 00000100:00100000:1.0:1784938443.367206:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337453952 00000100:00100000:1.0:1784938443.367273:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 85 00000100:00100000:1.0:1784938443.367283:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f19a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+444:17096:x1871643337453952:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:1.0:1784938443.367617:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f19a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+445:17096:x1871643337453952:12345-192.168.202.54@tcp:35:cp.0 Request processed in 334us (584us total) trans 8589934828 rc 0/0 00000100:00100000:1.0:1784938443.367626:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 85 00000100:00100000:0.0:1784938443.368867:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387daed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+77:10958:x1871643337453696:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 15266us (17131us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.368880:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 328 00000100:00100000:3.0:1784938443.373933:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.374201:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337454080 00000100:00100000:2.0:1784938443.374212:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337454080 00000100:00100000:2.0:1784938443.374286:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 445 00000100:00100000:2.0:1784938443.374296:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+445:17096:x1871643337454080:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938443.374333:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938443.374357:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27de00/0x7b044d4128f9ca56 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476640ff expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.374428:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9ca5d lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.374444:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9ca5d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.374455:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9ca5d lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.374472:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9ca64 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x322afea2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.374478:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9ca64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.374484:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9ca64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.374526:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9ca5d lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.374533:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9ca5d lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.374540:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9ca5d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.374545:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9ca5d lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.374551:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27d600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938443.374556:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9ca5d lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.374563:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9ca5d lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.374575:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938443.374578:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.374583:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9ca5d lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.374590:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9ca5d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.374605:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9ca64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.374611:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9ca64 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.374616:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9ca64 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.374621:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27d000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938443.374624:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9ca64 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.374630:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9ca64 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.374637:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x322afea2 (ffff9f24898e0000) 00010000:00010000:2.0:1784938443.374639:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.374642:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9ca64 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.374647:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9ca64 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.374684:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27de00/0x7b044d4128f9ca56 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476640ff expref: 446 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.374694:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938443.374697:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.374700:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27de00/0x7b044d4128f9ca56 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476640ff expref: 446 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.374709:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d27de00, rc 0) 00000100:00100000:2.0:1784938443.374775:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+445:17096:x1871643337454080:12345-192.168.202.54@tcp:101:cp.0 Request processed in 479us (851us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938443.374782:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 445 00000100:00100000:1.0:1784938443.378227:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.378518:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337454208 00000100:00100000:3.0:1784938443.378528:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337454208 00000100:00100000:3.0:1784938443.378589:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 446 00000100:00100000:3.0:1784938443.378599:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+445:17096:x1871643337454208:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938443.378625:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938443.378648:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9ca6b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664106 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.378726:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9ca72 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.378741:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9ca72 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.378752:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9ca72 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.378770:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9ca79 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x322afea2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.378776:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9ca79 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.378783:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9ca79 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.378829:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9ca72 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.378837:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9ca72 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.378844:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9ca72 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.378851:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938443.378856:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9ca72 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.378864:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9ca72 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.378877:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938443.378880:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.378885:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9ca72 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.378890:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9ca72 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.378904:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9ca79 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.378911:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9ca79 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.378916:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9ca79 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.378922:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938443.378924:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9ca79 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.378931:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9ca79 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.378938:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x322afea2 (ffff9f2484afd700) 00010000:00010000:3.0:1784938443.378940:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.378943:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9ca79 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.378950:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9ca79 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.378983:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9ca6b lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664106 expref: 446 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.378994:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938443.378997:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.379002:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9ca6b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664106 expref: 446 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.379012:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf0400, rc 0) 00000100:00100000:3.0:1784938443.379077:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+445:17096:x1871643337454208:12345-192.168.202.54@tcp:101:cp.0 Request processed in 479us (858us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938443.379084:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 446 00000100:00100000:3.0:1784938443.382870:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.383019:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337454464 00000100:00100000:2.0:1784938443.383028:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337454464 00000100:00100000:2.0:1784938443.383093:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 447 00000100:00100000:2.0:1784938443.383103:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+445:17096:x1871643337454464:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938443.383123:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938443.383195:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27de00/0x7b044d4128f9ca80 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766410d expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.383438:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9ca87 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.383459:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9ca87 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.383473:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9ca87 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.383487:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9ca8e lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x322afea2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.383494:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9ca8e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.383513:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9ca8e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938443.383805:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x62:0x0], index 0: 0 00010000:00010000:2.0:1784938443.384498:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c600/0x7b044d4128f9ca95 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.384511:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c600/0x7b044d4128f9ca95 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.384520:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c600/0x7b044d4128f9ca95 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.384563:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9ca87 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.384570:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9ca87 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.384576:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9ca87 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.384583:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9ca87 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.384590:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27d000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938443.384594:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9ca87 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.384602:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9ca87 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.384615:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938443.384617:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.384622:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9ca87 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.384629:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9ca87 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938443.384644:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e4750a2b reply state 000000002881e8e7 transno 8589934829 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9ca8e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.384655:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9ca8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.384661:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x322afea2 (ffff9f24898e0000) 00010000:00010000:2.0:1784938443.384663:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938443.384666:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938443.384702:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27de00/0x7b044d4128f9ca80 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766410d expref: 448 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.384717:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c600/0x7b044d4128f9ca95 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766410d expref: 447 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.384725:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x43:0x0].0x0 (ffff9f24898e0c00) 00010000:00010000:2.0:1784938443.384727:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938443.384730:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d27c600, rc 0) 00000100:00100000:2.0:1784938443.384853:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+448:17096:x1871643337454464:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1750us (1993us total) trans 8589934829 rc 0/0 00000100:00100000:2.0:1784938443.384862:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 447 00000100:00100000:2.0:1784938443.389608:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.389698:0:25728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337454592 00000100:00100000:0.0:1784938443.389707:0:25728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337454592 00000100:00100000:0.0:1784938443.389771:0:25728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 701 00000100:00100000:0.0:1784938443.389783:0:25728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:7ea6e988-18ba-4c98-b179-17995571b98b+67:10959:x1871643337454592:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938443.389802:0:25728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938443.389825:0:25728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9caa3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x62:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664114 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938443.389854:0:25728:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x62:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938443.389875:0:25728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x62:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1784938443.389879:0:25728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.389898:0:25728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9caa3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664114 expref: 68 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.389920:0:25728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9caa3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664114 expref: 68 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.389932:0:25728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24d800, rc 0) 00000100:00100000:0.0:1784938443.389993:0:25728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:7ea6e988-18ba-4c98-b179-17995571b98b+68:10959:x1871643337454592:12345-192.168.202.54@tcp:101:cp.0 Request processed in 213us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.390000:0:25728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 701 00000100:00100000:1.0:1784938443.393968:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.394118:0:25724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337454720 00000100:00100000:2.0:1784938443.394141:0:25724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337454720 00000100:00100000:2.0:1784938443.394255:0:25724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 702 00000100:00100000:2.0:1784938443.394268:0:25724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7ea6e988-18ba-4c98-b179-17995571b98b+68:17096:x1871643337454720:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938443.394289:0:25724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938443.394309:0:25724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd3706f6/0x7b044d4128f9caaa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x62:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766411b expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.394352:0:25724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9caa3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664114 expref: 69 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.394362:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.394366:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.394371:0:25724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd3706f6/0x7b044d4128f9caaa lrc: 4/0,0 mode: --/PW res: [0x280000401:0x62:0x0].0x0 rrc: 3 type: EXT [0->90111] (req 0->90111) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766411b expref: 69 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.394405:0:25724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9caa3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664114 expref: 69 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.394424:0:25724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9caa3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664114 expref: 69 pid: 25728 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.394438:0:25724:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f181880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:25724:1871643350863232:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938443.394519:0:25724:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248fb1c900 going to sleep for 11 seconds 00000100:00100000:2.0:1784938443.397872:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.397989:0:25724:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f181880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:25724:1871643350863232:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938443.398036:0:25724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bd3706f6/0x7b044d4128f9caaa lrc: 3/0,0 mode: --/PW res: [0x280000401:0x62:0x0].0x0 rrc: 3 type: EXT [0->90111] (req 0->90111) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766411b expref: 69 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.398059:0:25724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d27de00, rc 0) 00000100:00100000:1.0:1784938443.398125:0:25724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7ea6e988-18ba-4c98-b179-17995571b98b+69:17096:x1871643337454720:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3859us (4166us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.398133:0:25724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 702 00000100:00100000:3.0:1784938443.398591:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337454848 00000100:00100000:3.0:1784938443.398599:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337454848 00010000:00010000:3.0:1784938443.398630:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9caa3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664114 expref: 69 pid: 25728 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.398669:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 329 00000100:00100000:3.0:1784938443.398678:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f180e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+69:10959:x1871643337454848:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938443.398691:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938443.398713:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9caa3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664114 expref: 69 pid: 25728 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.398728:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9caa3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664114 expref: 69 pid: 25728 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.398752:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca51f3c2/0x7b044d4128f9caa3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664114 expref: 69 pid: 25728 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.398767:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.398772:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.398779:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd3706f6/0x7b044d4128f9caaa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766411b expref: 68 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.398788:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd3706f6/0x7b044d4128f9caaa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766411b expref: 68 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.398821:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bd3706f6/0x7b044d4128f9caaa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766411b expref: 68 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.398834:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2381d2ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350863360:192.168.202.54@tcp:105: 00000100:00100000:3.0:1784938443.398897:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbef00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938443.402536:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2381d2ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350863360:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938443.402562:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938443.402622:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f180e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+68:10959:x1871643337454848:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3944us (4759us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938443.402633:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 329 00000100:00100000:2.0:1784938443.407641:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.407756:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337455104 00000100:00100000:1.0:1784938443.407766:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337455104 00000100:00100000:1.0:1784938443.407835:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 86 00000100:00100000:1.0:1784938443.407845:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+448:17096:x1871643337455104:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:1.0:1784938443.408221:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+449:17096:x1871643337455104:12345-192.168.202.54@tcp:35:cp.0 Request processed in 375us (589us total) trans 8589934830 rc 0/0 00000100:00100000:1.0:1784938443.408229:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 86 00000100:00100000:0.0:1784938443.412651:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.412763:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337455232 00000100:00100000:3.0:1784938443.412775:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337455232 00000100:00100000:3.0:1784938443.413028:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 448 00000100:00100000:3.0:1784938443.413040:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387daca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+449:17096:x1871643337455232:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938443.413066:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938443.413089:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9cab1 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664122 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.413202:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9cab8 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.413218:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9cab8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.413228:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9cab8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.413374:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9cabf lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xaa0c2c16 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.413384:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9cabf lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.413391:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9cabf lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.413432:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9cab8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.413438:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9cab8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.413445:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9cab8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.413451:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938443.413455:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9cab8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.413463:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9cab8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.413473:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938443.413477:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.413482:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9cab8 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.413488:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9cab8 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.413502:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9cabf lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.413508:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9cabf lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.413513:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9cabf lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.413518:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938443.413520:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9cabf lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.413526:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9cabf lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.413532:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xaa0c2c16 (ffff9f2484afd700) 00010000:00010000:3.0:1784938443.413534:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.413537:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9cabf lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.413542:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9cabf lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.413572:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9cab1 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664122 expref: 450 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.413583:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938443.413586:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.413590:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9cab1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664122 expref: 450 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.413600:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf0400, rc 0) 00000100:00100000:3.0:1784938443.413668:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387daca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+449:17096:x1871643337455232:12345-192.168.202.54@tcp:101:cp.0 Request processed in 630us (1026us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938443.413676:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 448 00000100:00100000:2.0:1784938443.417521:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.417609:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337455360 00000100:00100000:1.0:1784938443.417619:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337455360 00000100:00100000:1.0:1784938443.417679:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 449 00000100:00100000:1.0:1784938443.417689:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+449:17096:x1871643337455360:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938443.417713:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938443.417736:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9cac6 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664129 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.417803:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9cacd lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.417818:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9cacd lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.417832:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9cacd lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.418102:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28c00/0x7b044d4128f9cad4 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xaa0c2c16 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.418109:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28c00/0x7b044d4128f9cad4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.418118:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28c00/0x7b044d4128f9cad4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.418602:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9cacd lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.418611:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9cacd lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.418618:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9cacd lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.418623:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b34a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.418627:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9cacd lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.418634:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9cacd lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.418647:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938443.418650:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.418655:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9cacd lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.418667:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9cacd lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.418683:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28c00/0x7b044d4128f9cad4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.418690:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28c00/0x7b044d4128f9cad4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.418696:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28c00/0x7b044d4128f9cad4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.418700:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b28c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.418703:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28c00/0x7b044d4128f9cad4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.418708:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28c00/0x7b044d4128f9cad4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.418715:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xaa0c2c16 (ffff9f2485cb4800) 00010000:00010000:0.0:1784938443.418717:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.418720:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28c00/0x7b044d4128f9cad4 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.418725:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28c00/0x7b044d4128f9cad4 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.418766:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9cac6 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664129 expref: 450 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.418781:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938443.418783:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.418787:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9cac6 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664129 expref: 450 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.418796:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b35800, rc 0) 00000100:00100000:0.0:1784938443.419034:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+449:17096:x1871643337455360:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1344us (1521us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938443.419043:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 449 00000100:00100000:2.0:1784938443.422787:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.422988:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337455616 00000100:00100000:1.0:1784938443.422997:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337455616 00000100:00100000:1.0:1784938443.423419:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 450 00000100:00100000:1.0:1784938443.423432:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+449:17096:x1871643337455616:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938443.423454:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938443.423477:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9cadb lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664130 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.423594:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9cae2 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.423611:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9cae2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.423622:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9cae2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.423639:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29800/0x7b044d4128f9cae9 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0xaa0c2c16 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.423646:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29800/0x7b044d4128f9cae9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.423654:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29800/0x7b044d4128f9cae9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938443.424417:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x62:0x0], index 1: 0 00010000:00010000:1.0:1784938443.424562:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9caf0 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.424574:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9caf0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.424582:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9caf0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.424613:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9cae2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.424625:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9cae2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.424632:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9cae2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.424638:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b29c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938443.424643:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9cae2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.424649:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9cae2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.424662:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938443.424665:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.424669:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9cae2 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.424675:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9cae2 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938443.424687:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002fd3b88b reply state 00000000ffc9b5d4 transno 8589934831 ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29800/0x7b044d4128f9cae9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.424698:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29800/0x7b044d4128f9cae9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.424704:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xaa0c2c16 (ffff9f2485cb4000) 00010000:00010000:1.0:1784938443.424706:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938443.424708:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938443.424739:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9cadb lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664130 expref: 452 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.424755:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9caf0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664130 expref: 451 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.424761:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x44:0x0].0x0 (ffff9f2485cb4d00) 00010000:00010000:1.0:1784938443.424764:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938443.424766:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c9f6c00, rc 0) 00000100:00100000:1.0:1784938443.424845:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+452:17096:x1871643337455616:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1416us (2067us total) trans 8589934831 rc 0/0 00000100:00100000:1.0:1784938443.424853:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 450 00000100:00100000:1.0:1784938443.428920:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.428994:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337455744 00000100:00100000:2.0:1784938443.429002:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337455744 00000100:00100000:2.0:1784938443.429058:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 703 00000100:00100000:2.0:1784938443.429067:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+77:10957:x1871643337455744:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938443.429087:0:25715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938443.429106:0:25715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000607bdb42/0x7b044d4128f9cafe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x62:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664137 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938443.429137:0:25715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x62:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938443.429173:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x62:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1784938443.429177:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.429186:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000607bdb42/0x7b044d4128f9cafe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664137 expref: 78 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.429204:0:25715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000607bdb42/0x7b044d4128f9cafe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664137 expref: 78 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.429217:0:25715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d27ca00, rc 0) 00000100:00100000:2.0:1784938443.429401:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+78:10957:x1871643337455744:12345-192.168.202.54@tcp:101:cp.0 Request processed in 333us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938443.429408:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 703 00000100:00100000:2.0:1784938443.431912:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.431987:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337455872 00000100:00100000:1.0:1784938443.431995:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337455872 00000100:00100000:1.0:1784938443.432089:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 704 00000100:00100000:1.0:1784938443.432100:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+78:17096:x1871643337455872:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938443.432118:0:21629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938443.432137:0:21629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002f45a6a/0x7b044d4128f9cb05 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x62:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766413e expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.432522:0:21629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000607bdb42/0x7b044d4128f9cafe lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664137 expref: 79 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.432530:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.432533:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.432537:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002f45a6a/0x7b044d4128f9cb05 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x62:0x0].0x0 rrc: 3 type: EXT [0->258047] (req 0->258047) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766413e expref: 79 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.432568:0:21629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000607bdb42/0x7b044d4128f9cafe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664137 expref: 79 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.432579:0:21629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000607bdb42/0x7b044d4128f9cafe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664137 expref: 79 pid: 25715 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.432591:0:21629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387daf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:21629:1871643350863488:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938443.432678:0:21629:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238108e480 going to sleep for 11 seconds 00000100:00100000:3.0:1784938443.435399:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.435462:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337456000 00000100:00100000:1.0:1784938443.435472:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337456000 00010000:00010000:1.0:1784938443.435509:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000607bdb42/0x7b044d4128f9cafe lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664137 expref: 80 pid: 25715 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.435540:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 330 00000100:00100000:1.0:1784938443.435547:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+80:10958:x1871643337456000:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.435563:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.435584:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000607bdb42/0x7b044d4128f9cafe lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664137 expref: 80 pid: 25715 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.435596:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000607bdb42/0x7b044d4128f9cafe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664137 expref: 80 pid: 25715 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.435619:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.435623:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.435630:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000002f45a6a/0x7b044d4128f9cb05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766413e expref: 80 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.435640:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002f45a6a/0x7b044d4128f9cb05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766413e expref: 80 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.435670:0:19220:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000002f45a6a/0x7b044d4128f9cb05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766413e expref: 80 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.435683:0:19220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37c8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:19220:1871643350863616:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938443.435762:0:19220:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b2d2c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938443.438191:0:19220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37c8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:19220:1871643350863616:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938443.438215:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938443.438614:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+80:10958:x1871643337456000:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3064us (3222us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938443.438626:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 330 00010000:00010000:0.0:1784938443.441470:0:21629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000607bdb42/0x7b044d4128f9cafe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664137 expref: 79 pid: 25715 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.441495:0:21629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387daf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:21629:1871643350863488:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938443.441530:0:21629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000002f45a6a/0x7b044d4128f9cb05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766413e expref: 78 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.441546:0:21629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c9f7800, rc 0) 00000100:00100000:0.0:1784938443.441622:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+78:17096:x1871643337455872:12345-192.168.202.54@tcp:101:cp.0 Request processed in 9523us (9717us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.441631:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 704 00000100:00100000:1.0:1784938443.449455:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.449587:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337456256 00000100:00100000:3.0:1784938443.449596:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337456256 00000100:00100000:3.0:1784938443.449663:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 87 00000100:00100000:3.0:1784938443.449672:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24857fb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+452:17096:x1871643337456256:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938443.449979:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24857fb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+453:17096:x1871643337456256:12345-192.168.202.54@tcp:35:cp.0 Request processed in 306us (532us total) trans 8589934832 rc 0/0 00000100:00100000:3.0:1784938443.449987:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 87 00000100:00100000:3.0:1784938443.453989:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.454098:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337456384 00000100:00100000:2.0:1784938443.454107:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337456384 00000100:00100000:2.0:1784938443.454175:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 451 00000100:00100000:2.0:1784938443.454185:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+453:17096:x1871643337456384:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938443.454212:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938443.454233:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d800/0x7b044d4128f9cb0c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664145 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.454312:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cb13 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.454338:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cb13 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.454349:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cb13 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.454365:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9cb1a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xd47b514a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.454372:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9cb1a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.454377:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9cb1a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.454417:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cb13 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.454424:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cb13 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.454428:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cb13 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.454432:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cb13 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.454436:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27d000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938443.454439:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cb13 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.454444:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cb13 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.454452:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938443.454454:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.454457:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cb13 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.454461:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cb13 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.454470:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9cb1a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.454474:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9cb1a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.454477:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9cb1a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.454480:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27cc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938443.454481:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9cb1a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.454484:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9cb1a lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.454488:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xd47b514a (ffff9f24898e0400) 00010000:00010000:2.0:1784938443.454489:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.454490:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9cb1a lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.454493:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9cb1a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.454517:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d800/0x7b044d4128f9cb0c lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664145 expref: 454 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.454523:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938443.454524:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.454527:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d800/0x7b044d4128f9cb0c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664145 expref: 454 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.454532:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d27d800, rc 0) 00000100:00100000:2.0:1784938443.454578:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+453:17096:x1871643337456384:12345-192.168.202.54@tcp:101:cp.0 Request processed in 396us (597us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938443.454582:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 451 00000100:00100000:2.0:1784938443.458254:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.458442:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337456512 00000100:00100000:3.0:1784938443.458451:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337456512 00000100:00100000:3.0:1784938443.458514:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 452 00000100:00100000:3.0:1784938443.458524:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+453:17096:x1871643337456512:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938443.458547:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938443.458568:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9cb21 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766414c expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.458629:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9cb28 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.458644:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9cb28 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.458655:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9cb28 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.458669:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9cb2f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xd47b514a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.458676:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9cb2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.458682:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9cb2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.458724:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9cb28 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.458732:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9cb28 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.458739:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9cb28 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.458745:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf0400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938443.458750:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9cb28 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.458756:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9cb28 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.458767:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938443.458770:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.458774:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9cb28 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.458780:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9cb28 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.458793:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9cb2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.458799:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9cb2f lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.458805:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9cb2f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.458809:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938443.458812:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9cb2f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.458818:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9cb2f lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.458825:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xd47b514a (ffff9f2484afd700) 00010000:00010000:3.0:1784938443.458827:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.458831:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9cb2f lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.458836:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9cb2f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.458870:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9cb21 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766414c expref: 454 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.458880:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938443.459015:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.459083:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9cb21 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766414c expref: 454 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.459096:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf1200, rc 0) 00000100:00100000:3.0:1784938443.459195:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+453:17096:x1871643337456512:12345-192.168.202.54@tcp:101:cp.0 Request processed in 671us (959us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938443.459203:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 452 00000100:00100000:1.0:1784938443.465461:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.465632:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337456768 00000100:00100000:3.0:1784938443.465642:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337456768 00000100:00100000:3.0:1784938443.465707:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 453 00000100:00100000:3.0:1784938443.465716:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+453:17096:x1871643337456768:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938443.465739:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938443.465762:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9cb36 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664153 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.465870:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9cb3d lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.465902:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9cb3d lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.465913:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9cb3d lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.465930:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031000/0x7b044d4128f9cb44 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0xd47b514a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.465938:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031000/0x7b044d4128f9cb44 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.465944:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031000/0x7b044d4128f9cb44 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938443.466874:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x63:0x0], index 0: 0 00010000:00010000:2.0:1784938443.467194:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d800/0x7b044d4128f9cb4b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.467207:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d800/0x7b044d4128f9cb4b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.467216:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d800/0x7b044d4128f9cb4b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.467378:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9cb3d lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.467386:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9cb3d lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.467393:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9cb3d lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.467399:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9cb3d lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.467405:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938443.467410:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9cb3d lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.467418:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9cb3d lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.467430:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938443.467433:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.467438:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9cb3d lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.467445:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9cb3d lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938443.467462:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000086f929e0 reply state 0000000041d650f6 transno 8589934833 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031000/0x7b044d4128f9cb44 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.467473:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031000/0x7b044d4128f9cb44 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.467479:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xd47b514a (ffff9f2484afd600) 00010000:00010000:2.0:1784938443.467481:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938443.467484:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938443.467523:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9cb36 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664153 expref: 456 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.467540:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d800/0x7b044d4128f9cb4b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664153 expref: 455 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.467547:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x45:0x0].0x0 (ffff9f24898e0400) 00010000:00010000:2.0:1784938443.467550:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938443.467552:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d27d800, rc 0) 00000100:00100000:2.0:1784938443.467626:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+456:17096:x1871643337456768:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1910us (2485us total) trans 8589934833 rc 0/0 00000100:00100000:2.0:1784938443.467635:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 453 00000100:00100000:2.0:1784938443.472714:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.472846:0:25726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337456896 00000100:00100000:0.0:1784938443.472856:0:25726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337456896 00000100:00100000:0.0:1784938443.472988:0:25726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 705 00000100:00100000:0.0:1784938443.472999:0:25726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7ea6e988-18ba-4c98-b179-17995571b98b+68:10959:x1871643337456896:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938443.473018:0:25726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938443.473050:0:25726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051f4609e/0x7b044d4128f9cb59 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x63:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766415a expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938443.473077:0:25726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x63:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938443.473098:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x63:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1784938443.473103:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.473114:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051f4609e/0x7b044d4128f9cb59 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766415a expref: 69 pid: 25726 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.473428:0:25726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000051f4609e/0x7b044d4128f9cb59 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766415a expref: 69 pid: 25726 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.473443:0:25726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24cc00, rc 0) 00000100:00100000:0.0:1784938443.473599:0:25726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7ea6e988-18ba-4c98-b179-17995571b98b+69:10959:x1871643337456896:12345-192.168.202.54@tcp:101:cp.0 Request processed in 601us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.473607:0:25726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 705 00000100:00100000:2.0:1784938443.477000:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.477450:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337457024 00000100:00100000:1.0:1784938443.477461:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337457024 00000100:00100000:1.0:1784938443.477554:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 706 00000100:00100000:1.0:1784938443.477565:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+69:17096:x1871643337457024:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938443.477584:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938443.477606:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000164ff879/0x7b044d4128f9cb60 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x63:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664161 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.477639:0:21151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000051f4609e/0x7b044d4128f9cb59 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766415a expref: 70 pid: 25726 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.477649:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.477653:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.477657:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000164ff879/0x7b044d4128f9cb60 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x63:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664161 expref: 70 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.477691:0:21151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000051f4609e/0x7b044d4128f9cb59 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e94766415a expref: 70 pid: 25726 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.477706:0:21151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000051f4609e/0x7b044d4128f9cb59 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766415a expref: 70 pid: 25726 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.477721:0:21151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:21151:1871643350863744:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938443.477851:0:21151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b2d2c900 going to sleep for 11 seconds 00000100:00100000:3.0:1784938443.481756:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.481896:0:21151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:21151:1871643350863744:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938443.481930:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000164ff879/0x7b044d4128f9cb60 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x63:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664161 expref: 70 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.481953:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61be00, rc 0) 00000100:00100000:1.0:1784938443.482014:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+70:17096:x1871643337457024:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4452us (5025us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.482032:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 706 00000100:00100000:2.0:1784938443.482384:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337457152 00000100:00100000:2.0:1784938443.482393:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337457152 00010000:00010000:2.0:1784938443.482429:0:25731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000051f4609e/0x7b044d4128f9cb59 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766415a expref: 70 pid: 25726 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.482465:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 331 00000100:00100000:2.0:1784938443.482474:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+70:10959:x1871643337457152:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938443.482487:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938443.482509:0:25731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000051f4609e/0x7b044d4128f9cb59 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766415a expref: 70 pid: 25726 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.482522:0:25731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000051f4609e/0x7b044d4128f9cb59 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766415a expref: 70 pid: 25726 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.482543:0:25731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051f4609e/0x7b044d4128f9cb59 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766415a expref: 70 pid: 25726 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.482558:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.482561:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.482569:0:25731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000164ff879/0x7b044d4128f9cb60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664161 expref: 69 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.482582:0:25731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000164ff879/0x7b044d4128f9cb60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664161 expref: 69 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.482616:0:25731:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000164ff879/0x7b044d4128f9cb60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664161 expref: 69 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.482628:0:25731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f183800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:25731:1871643350863872:192.168.202.54@tcp:105: 00000100:00100000:2.0:1784938443.482682:0:25731:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248fb1cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938443.489551:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.489620:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337457408 00000100:00100000:3.0:1784938443.489630:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337457408 00000100:00100000:3.0:1784938443.489692:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 88 00000100:00100000:3.0:1784938443.489703:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387daf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+456:17096:x1871643337457408:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938443.490086:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387daf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+457:17096:x1871643337457408:12345-192.168.202.54@tcp:35:cp.0 Request processed in 383us (541us total) trans 8589934834 rc 0/0 00000100:00100000:3.0:1784938443.490095:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 88 00000100:00100000:2.0:1784938443.490506:0:25731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f183800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:25731:1871643350863872:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938443.490528:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938443.490553:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+69:10959:x1871643337457152:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 8081us (8808us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938443.490563:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 331 00000100:00100000:3.0:1784938443.494476:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.494571:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337457536 00000100:00100000:1.0:1784938443.494583:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337457536 00000100:00100000:1.0:1784938443.494644:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 454 00000100:00100000:1.0:1784938443.494655:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+457:17096:x1871643337457536:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938443.494682:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938443.494709:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61aa00/0x7b044d4128f9cb67 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664168 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.494774:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a200/0x7b044d4128f9cb6e lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.494790:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a200/0x7b044d4128f9cb6e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.494801:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a200/0x7b044d4128f9cb6e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.494819:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b200/0x7b044d4128f9cb75 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x7772308b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.494826:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b200/0x7b044d4128f9cb75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.494833:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b200/0x7b044d4128f9cb75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.494876:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a200/0x7b044d4128f9cb6e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.494897:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a200/0x7b044d4128f9cb6e lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.494904:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a200/0x7b044d4128f9cb6e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.494910:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61a200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938443.494915:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a200/0x7b044d4128f9cb6e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.494922:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a200/0x7b044d4128f9cb6e lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.494934:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938443.494937:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.494942:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a200/0x7b044d4128f9cb6e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.494948:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a200/0x7b044d4128f9cb6e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.494962:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b200/0x7b044d4128f9cb75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.494968:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b200/0x7b044d4128f9cb75 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.494973:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b200/0x7b044d4128f9cb75 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.494978:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61b200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938443.494982:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b200/0x7b044d4128f9cb75 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.494988:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b200/0x7b044d4128f9cb75 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.494995:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x7772308b (ffff9f2485cb4800) 00010000:00010000:1.0:1784938443.494998:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.495001:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b200/0x7b044d4128f9cb75 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.495006:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b200/0x7b044d4128f9cb75 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.495118:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61aa00/0x7b044d4128f9cb67 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664168 expref: 458 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.495445:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938443.495448:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.495453:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61aa00/0x7b044d4128f9cb67 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664168 expref: 458 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.495465:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61aa00, rc 0) 00000100:00100000:1.0:1784938443.495522:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+457:17096:x1871643337457536:12345-192.168.202.54@tcp:101:cp.0 Request processed in 870us (1056us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938443.495530:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 454 00010000:00010000:0.0:1784938443.496374:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938443.499523:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.499635:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337457664 00000100:00100000:2.0:1784938443.499648:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337457664 00000100:00100000:2.0:1784938443.499742:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 455 00000100:00100000:2.0:1784938443.499753:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23880a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+457:17096:x1871643337457664:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938443.499774:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938443.499797:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9cb7c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766416f expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.499864:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cb83 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.499879:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cb83 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.499903:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cb83 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.499920:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ca00/0x7b044d4128f9cb8a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x7772308b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.499928:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ca00/0x7b044d4128f9cb8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.499935:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ca00/0x7b044d4128f9cb8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.499973:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cb83 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.499980:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cb83 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.499987:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cb83 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.499992:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27d000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938443.499997:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cb83 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.500003:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cb83 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.500014:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938443.500084:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.500091:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cb83 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.500099:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cb83 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.500114:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ca00/0x7b044d4128f9cb8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.500120:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ca00/0x7b044d4128f9cb8a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.500137:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ca00/0x7b044d4128f9cb8a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.500142:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27ca00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938443.500218:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ca00/0x7b044d4128f9cb8a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.500225:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ca00/0x7b044d4128f9cb8a lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.500233:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x7772308b (ffff9f24898e0500) 00010000:00010000:2.0:1784938443.500235:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.500395:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ca00/0x7b044d4128f9cb8a lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.500402:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ca00/0x7b044d4128f9cb8a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.500443:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9cb7c lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766416f expref: 458 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.500457:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938443.500460:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.500463:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9cb7c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766416f expref: 458 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.500471:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d27cc00, rc 0) 00000100:00100000:2.0:1784938443.500592:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23880a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+457:17096:x1871643337457664:12345-192.168.202.54@tcp:101:cp.0 Request processed in 840us (1079us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938443.500600:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 455 00000100:00100000:3.0:1784938443.503770:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.503966:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337457920 00000100:00100000:1.0:1784938443.503975:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337457920 00000100:00100000:1.0:1784938443.504040:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 456 00000100:00100000:1.0:1784938443.504051:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+457:17096:x1871643337457920:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938443.504073:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938443.504093:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61ae00/0x7b044d4128f9cb91 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664176 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.504496:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b400/0x7b044d4128f9cb98 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.504514:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b400/0x7b044d4128f9cb98 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.504526:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b400/0x7b044d4128f9cb98 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.504543:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61ba00/0x7b044d4128f9cb9f lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x7772308b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.504550:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61ba00/0x7b044d4128f9cb9f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.504557:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61ba00/0x7b044d4128f9cb9f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938443.504873:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x63:0x0], index 1: 0 00010000:00010000:1.0:1784938443.505026:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a600/0x7b044d4128f9cba6 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x46:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.505036:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a600/0x7b044d4128f9cba6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.505043:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a600/0x7b044d4128f9cba6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.505079:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b400/0x7b044d4128f9cb98 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.505086:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b400/0x7b044d4128f9cb98 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.505093:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b400/0x7b044d4128f9cb98 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.505099:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61b400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938443.505103:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b400/0x7b044d4128f9cb98 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.505111:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b400/0x7b044d4128f9cb98 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.505138:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938443.505142:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.507612:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b400/0x7b044d4128f9cb98 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.507628:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b400/0x7b044d4128f9cb98 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938443.507651:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003fc6fccd reply state 000000003383283a transno 8589934835 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61ba00/0x7b044d4128f9cb9f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.507669:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61ba00/0x7b044d4128f9cb9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.507678:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x7772308b (ffff9f23823e0000) 00010000:00010000:1.0:1784938443.507682:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938443.507686:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938443.507740:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61ae00/0x7b044d4128f9cb91 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664176 expref: 460 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.507758:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a600/0x7b044d4128f9cba6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664176 expref: 459 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.507766:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x46:0x0].0x0 (ffff9f2491e62500) 00010000:00010000:1.0:1784938443.507769:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938443.507771:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61a600, rc 0) 00000100:00100000:1.0:1784938443.507847:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+460:17096:x1871643337457920:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3797us (4088us total) trans 8589934835 rc 0/0 00000100:00100000:1.0:1784938443.507857:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 456 00000100:00100000:3.0:1784938443.512264:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.512434:0:25730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337458048 00000100:00100000:1.0:1784938443.512446:0:25730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337458048 00000100:00100000:1.0:1784938443.512500:0:25730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 707 00000100:00100000:1.0:1784938443.512510:0:25730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:7ea6e988-18ba-4c98-b179-17995571b98b+78:10957:x1871643337458048:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938443.512528:0:25730:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938443.512548:0:25730:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc245ddc/0x7b044d4128f9cbb4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x63:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766417d expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938443.512572:0:25730:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x63:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938443.512592:0:25730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x63:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1784938443.512597:0:25730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.512607:0:25730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc245ddc/0x7b044d4128f9cbb4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766417d expref: 79 pid: 25730 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.512629:0:25730:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fc245ddc/0x7b044d4128f9cbb4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766417d expref: 79 pid: 25730 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.512643:0:25730:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61aa00, rc 0) 00000100:00100000:1.0:1784938443.512697:0:25730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:7ea6e988-18ba-4c98-b179-17995571b98b+79:10957:x1871643337458048:12345-192.168.202.54@tcp:101:cp.0 Request processed in 188us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.512704:0:25730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 707 00000100:00100000:1.0:1784938443.517603:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.517699:0:25719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337458176 00000100:00100000:0.0:1784938443.517710:0:25719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337458176 00000100:00100000:0.0:1784938443.517775:0:25719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 708 00000100:00100000:0.0:1784938443.517785:0:25719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7ea6e988-18ba-4c98-b179-17995571b98b+79:17096:x1871643337458176:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938443.517806:0:25719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938443.517825:0:25719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca51f3c2/0x7b044d4128f9cbbb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x63:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664184 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.517861:0:25719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc245ddc/0x7b044d4128f9cbb4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766417d expref: 80 pid: 25730 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.517869:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.517873:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.517878:0:25719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca51f3c2/0x7b044d4128f9cbbb lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x63:0x0].0x0 rrc: 3 type: EXT [0->430079] (req 0->430079) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664184 expref: 80 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.517929:0:25719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fc245ddc/0x7b044d4128f9cbb4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e94766417d expref: 80 pid: 25730 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.517943:0:25719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fc245ddc/0x7b044d4128f9cbb4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766417d expref: 80 pid: 25730 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.517958:0:25719:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23880a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:25719:1871643350864000:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938443.518043:0:25719:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238108e480 going to sleep for 11 seconds 00000100:00100000:0.0:1784938443.523539:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.523654:0:25719:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23880a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:25719:1871643350864000:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938443.523690:0:25719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ca51f3c2/0x7b044d4128f9cbbb lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x63:0x0].0x0 rrc: 3 type: EXT [0->430079] (req 0->430079) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664184 expref: 80 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.523713:0:25719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24d800, rc 0) 00000100:00100000:2.0:1784938443.523783:0:25719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7ea6e988-18ba-4c98-b179-17995571b98b+80:17096:x1871643337458176:12345-192.168.202.54@tcp:101:cp.0 Request processed in 5998us (6190us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938443.523793:0:25719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 708 00000100:00100000:3.0:1784938443.523928:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337458304 00000100:00100000:3.0:1784938443.523936:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337458304 00010000:00010000:3.0:1784938443.523966:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fc245ddc/0x7b044d4128f9cbb4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766417d expref: 80 pid: 25730 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.524003:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 332 00000100:00100000:3.0:1784938443.524020:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23880a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+80:10958:x1871643337458304:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938443.524034:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938443.524055:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fc245ddc/0x7b044d4128f9cbb4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766417d expref: 80 pid: 25730 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.524068:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fc245ddc/0x7b044d4128f9cbb4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766417d expref: 80 pid: 25730 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.524090:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc245ddc/0x7b044d4128f9cbb4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766417d expref: 80 pid: 25730 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.524106:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.524111:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.524119:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca51f3c2/0x7b044d4128f9cbbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664184 expref: 79 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.524140:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca51f3c2/0x7b044d4128f9cbbb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664184 expref: 79 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.524227:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ca51f3c2/0x7b044d4128f9cbbb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664184 expref: 79 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.524586:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2381d2b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:19219:1871643350864128:192.168.202.54@tcp:105: 00000100:00100000:3.0:1784938443.524653:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2487fb16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938443.533049:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2381d2b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:19219:1871643350864128:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938443.533078:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.533143:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23880a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+79:10958:x1871643337458304:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 9130us (9612us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.533194:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 332 00000100:00100000:1.0:1784938443.535027:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.535174:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337458560 00000100:00100000:0.0:1784938443.535184:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337458560 00000100:00100000:0.0:1784938443.535239:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 89 00000100:00100000:0.0:1784938443.535249:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+460:17096:x1871643337458560:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:0.0:1784938443.535552:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+461:17096:x1871643337458560:12345-192.168.202.54@tcp:35:cp.0 Request processed in 303us (543us total) trans 8589934836 rc 0/0 00000100:00100000:0.0:1784938443.535559:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 89 00000100:00100000:0.0:1784938443.538493:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.538593:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337458688 00000100:00100000:2.0:1784938443.538602:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337458688 00000100:00100000:2.0:1784938443.538665:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 457 00000100:00100000:2.0:1784938443.538676:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23880a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+461:17096:x1871643337458688:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938443.538701:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938443.538723:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ca00/0x7b044d4128f9cbc2 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766418b expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.538798:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cbc9 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.538813:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cbc9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.538823:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cbc9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.538838:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9cbd0 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe087ee79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.538845:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9cbd0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.538851:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9cbd0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.538907:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cbc9 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.538915:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cbc9 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.538922:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cbc9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.538929:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cbc9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.538935:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27d000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938443.538939:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cbc9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.538947:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cbc9 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.538959:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938443.538962:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.538966:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cbc9 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.538973:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cbc9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.538986:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9cbd0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.538992:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9cbd0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.538997:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9cbd0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.539002:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27cc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938443.539005:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9cbd0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.539011:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9cbd0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.539027:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xe087ee79 (ffff9f24898e0500) 00010000:00010000:2.0:1784938443.539029:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.539033:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9cbd0 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.539039:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9cbd0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.539073:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ca00/0x7b044d4128f9cbc2 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766418b expref: 462 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.539084:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938443.539086:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.539090:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ca00/0x7b044d4128f9cbc2 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766418b expref: 462 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.539099:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d27ca00, rc 0) 00000100:00100000:2.0:1784938443.539319:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23880a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+461:17096:x1871643337458688:12345-192.168.202.54@tcp:101:cp.0 Request processed in 643us (833us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938443.539337:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 457 00000100:00100000:2.0:1784938443.542339:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.542513:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337458816 00000100:00100000:3.0:1784938443.542522:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337458816 00000100:00100000:3.0:1784938443.542582:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 458 00000100:00100000:3.0:1784938443.542591:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+461:17096:x1871643337458816:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938443.542610:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938443.542630:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030e00/0x7b044d4128f9cbd7 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664192 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.542694:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9cbde lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.542708:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9cbde lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.542719:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9cbde lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.542734:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9cbe5 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe087ee79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.542742:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9cbe5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.542748:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9cbe5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.542792:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9cbde lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.542799:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9cbde lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.542805:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9cbde lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.542811:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938443.542815:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9cbde lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.542822:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9cbde lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.542833:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938443.542836:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.542840:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9cbde lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.542847:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9cbde lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.542861:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9cbe5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.542867:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9cbe5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.542873:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9cbe5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.542879:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938443.542882:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9cbe5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.543302:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9cbe5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.543312:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xe087ee79 (ffff9f2484afd700) 00010000:00010000:3.0:1784938443.543315:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.543318:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9cbe5 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.543335:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1600/0x7b044d4128f9cbe5 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.543375:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030e00/0x7b044d4128f9cbd7 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664192 expref: 462 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.543385:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938443.543387:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.543391:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030e00/0x7b044d4128f9cbd7 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664192 expref: 462 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.543400:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2480030e00, rc 0) 00000100:00100000:3.0:1784938443.543498:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+461:17096:x1871643337458816:12345-192.168.202.54@tcp:101:cp.0 Request processed in 908us (1179us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938443.543506:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 458 00000100:00100000:0.0:1784938443.550395:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.550642:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337459072 00000100:00100000:2.0:1784938443.550652:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337459072 00000100:00100000:2.0:1784938443.550747:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 459 00000100:00100000:2.0:1784938443.550757:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23880a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+461:17096:x1871643337459072:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938443.550781:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938443.550802:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ca00/0x7b044d4128f9cbec lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664199 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.550919:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9cbf3 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.550938:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9cbf3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.550948:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9cbf3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.550962:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cbfa lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0xe087ee79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.550969:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cbfa lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.550975:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cbfa lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938443.551561:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x64:0x0], index 0: 0 00010000:00010000:2.0:1784938443.551695:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245200/0x7b044d4128f9cc01 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.551707:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245200/0x7b044d4128f9cc01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.551714:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245200/0x7b044d4128f9cc01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.551749:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9cbf3 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.551756:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9cbf3 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.551761:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9cbf3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.551768:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9cbf3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.551774:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27cc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938443.551778:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9cbf3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.551786:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9cbf3 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.551798:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938443.551802:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.551806:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9cbf3 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.551813:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9cbf3 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938443.551826:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008e72aa85 reply state 00000000f89d4a5f transno 8589934837 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cbfa lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.551837:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cbfa lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.551844:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xe087ee79 (ffff9f24898e0500) 00010000:00010000:2.0:1784938443.551846:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938443.551849:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938443.551881:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ca00/0x7b044d4128f9cbec lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664199 expref: 464 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.551896:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245200/0x7b044d4128f9cc01 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664199 expref: 463 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.551904:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x47:0x0].0x0 (ffff9f24898e0600) 00010000:00010000:2.0:1784938443.551906:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938443.551908:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f245200, rc 0) 00000100:00100000:2.0:1784938443.551974:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23880a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+464:17096:x1871643337459072:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1218us (1588us total) trans 8589934837 rc 0/0 00000100:00100000:2.0:1784938443.551982:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 459 00000100:00100000:0.0:1784938443.555122:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.555348:0:25725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337459200 00000100:00100000:3.0:1784938443.555358:0:25725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337459200 00000100:00100000:3.0:1784938443.555408:0:25725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 709 00000100:00100000:3.0:1784938443.555417:0:25725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23880a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7ea6e988-18ba-4c98-b179-17995571b98b+69:10960:x1871643337459200:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938443.555435:0:25725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938443.555457:0:25725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9cc0f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x64:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476641a0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938443.555483:0:25725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x64:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938443.555503:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x64:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1784938443.555507:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x64:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.555518:0:25725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9cc0f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641a0 expref: 70 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.555534:0:25725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9cc0f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641a0 expref: 70 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.555547:0:25725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf1200, rc 0) 00000100:00100000:3.0:1784938443.555602:0:25725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23880a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7ea6e988-18ba-4c98-b179-17995571b98b+70:10960:x1871643337459200:12345-192.168.202.54@tcp:101:cp.0 Request processed in 185us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938443.555609:0:25725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 709 00000100:00100000:3.0:1784938443.558880:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.558971:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337459328 00000100:00100000:2.0:1784938443.558979:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337459328 00000100:00100000:2.0:1784938443.559041:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 710 00000100:00100000:2.0:1784938443.559051:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+70:17096:x1871643337459328:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938443.559069:0:25722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938443.559087:0:25722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9cc16 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x64:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476641a7 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.559119:0:25722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9cc0f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641a0 expref: 71 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.559128:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x64:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.559134:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x64:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.559139:0:25722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9cc16 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x64:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641a7 expref: 71 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.559208:0:25722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9cc0f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e9476641a0 expref: 71 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.559228:0:25722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9cc0f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476641a0 expref: 71 pid: 25725 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.559243:0:25722:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f181500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25722:1871643350864256:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938443.559332:0:25722:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248fb1c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938443.561907:0:25722:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f181500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25722:1871643350864256:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938443.561942:0:25722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9cc16 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x64:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476641a7 expref: 71 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.561964:0:25722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f244600, rc 0) 00000100:00100000:2.0:1784938443.562027:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+71:17096:x1871643337459328:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2977us (3159us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938443.562036:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 710 00000100:00100000:1.0:1784938443.563312:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.563521:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337459456 00000100:00100000:2.0:1784938443.563529:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337459456 00010000:00010000:2.0:1784938443.563569:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9cc0f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476641a0 expref: 71 pid: 25725 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.563602:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 333 00000100:00100000:2.0:1784938443.563611:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+71:10959:x1871643337459456:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938443.563626:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938443.563654:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9cc0f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476641a0 expref: 71 pid: 25725 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.563671:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9cc0f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476641a0 expref: 71 pid: 25725 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.563694:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9cc0f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476641a0 expref: 71 pid: 25725 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.563710:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x64:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.563713:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x64:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.563721:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9cc16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476641a7 expref: 70 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.563731:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9cc16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476641a7 expref: 70 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.563766:0:19220:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9cc16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476641a7 expref: 70 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.563781:0:19220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f181500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:19220:1871643350864384:192.168.202.54@tcp:105: 00000100:00100000:2.0:1784938443.563866:0:19220:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248fb1c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938443.566991:0:19220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f181500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:19220:1871643350864384:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938443.567026:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938443.567087:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+70:10959:x1871643337459456:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3477us (3779us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938443.567099:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 333 00000100:00100000:1.0:1784938443.572261:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.572360:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337459712 00000100:00100000:3.0:1784938443.572370:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337459712 00000100:00100000:3.0:1784938443.572418:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 90 00000100:00100000:3.0:1784938443.572428:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+464:17096:x1871643337459712:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938443.572743:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+465:17096:x1871643337459712:12345-192.168.202.54@tcp:35:cp.0 Request processed in 315us (489us total) trans 8589934838 rc 0/0 00000100:00100000:3.0:1784938443.572751:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 90 00000001:00080000:1.0:1784938443.575630:0:24188:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934838 is committed 00000004:00080000:1.0:1784938443.575686:0:24188:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:1.0:1784938443.575713:0:24188:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:1.0:1784938443.575922:0:24188:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:1.0:1784938443.575934:0:24188:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:3.0:1784938443.576289:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2381d2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350864896:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:3.0:1784938443.576381:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f19a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350865408:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:3.0:1784938443.576419:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784938443.576426:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2381d29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350864512:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:3.0:1784938443.576448:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350865024:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:3.0:1784938443.576481:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2381d2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350864640:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:3.0:1784938443.576508:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d3adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350865152:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:3.0:1784938443.576527:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784938443.576533:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2381d28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350864768:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:3.0:1784938443.576551:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d3afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350865280:192.168.202.154@tcp:6:osp-syn-1-0.0 00000004:00080000:1.0:1784938443.576806:0:24188:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1784938443.576882:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350865792:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:3.0:1784938443.576909:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f24b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350866304:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:3.0:1784938443.576928:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1784938443.576934:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350865664:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:3.0:1784938443.576957:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350866176:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:3.0:1784938443.576986:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350865920:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:3.0:1784938443.577005:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f249180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350866432:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:3.0:1784938443.577037:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784938443.577043:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350865536:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:3.0:1784938443.577060:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350866048:192.168.202.154@tcp:6:osp-syn-0-0.0 00000004:00080000:1.0:1784938443.577135:0:24188:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1784938443.577179:0:24188:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934605 is committed 00000100:00100000:1.0:1784938443.577474:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.577542:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.577566:0:25718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350864896 00000100:00100000:1.0:1784938443.577572:0:25718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350864896 00000100:00100000:1.0:1784938443.577623:0:25718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350865408 00000100:00100000:1.0:1784938443.577626:0:25718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350865408 00000100:00100000:1.0:1784938443.577645:0:25718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 711 00000100:00100000:1.0:1784938443.577654:0:25718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:16389:x1871643350864896:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1784938443.577681:0:25718:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:34 count 1 00002000:00010000:1.0:1784938443.577713:0:25718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 88087, mtime: 0x6a63ff74, atime: 0x0, ctime: 0x6a63ff74, blocks: 0xb0 00010000:00010000:1.0:1784938443.577722:0:25718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fcd2670/0x7b044d4128f9cc1d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.577739:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1784938443.577743:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.577749:0:25718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fcd2670/0x7b044d4128f9cc1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.577763:0:25718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fcd2670/0x7b044d4128f9cc1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.577773:0:25718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fcd2670/0x7b044d4128f9cc1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.577781:0:25718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fcd2670/0x7b044d4128f9cc1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.577799:0:25718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938443.577947:0:25718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:16389:x1871643350864896:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 293us (473us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1784938443.577955:0:25718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 711 00000100:00100000:1.0:1784938443.577973:0:25718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 712 00000100:00100000:1.0:1784938443.577979:0:25718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:16389:x1871643350865408:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1784938443.577991:0:25718:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:20 count 1 00010000:00010000:1.0:1784938443.578003:0:25718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea074bdc/0x7b044d4128f9cc24 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.578015:0:25718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7577f35/0x7b044d4128f9a087 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766348e expref: 78 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.578022:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1784938443.578025:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.578029:0:25718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea074bdc/0x7b044d4128f9cc24 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.578061:0:25718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c7577f35/0x7b044d4128f9a087 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e94766348e expref: 78 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.578075:0:25718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c7577f35/0x7b044d4128f9a087 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766348e expref: 78 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.578086:0:25718:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f2c8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25718:1871643350866560:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938443.578129:0:25718:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b2d2cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938443.578185:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.578247:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.578319:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.578358:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.578374:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350864512 00000100:00100000:1.0:1784938443.578378:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350864512 00000100:00100000:1.0:1784938443.578401:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350865024 00000100:00100000:1.0:1784938443.578403:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350865024 00000100:00100000:1.0:1784938443.578417:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350864640 00000100:00100000:1.0:1784938443.578420:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350864640 00000100:00100000:1.0:1784938443.578434:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350865152 00000100:00100000:1.0:1784938443.578437:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350865152 00000100:00100000:1.0:1784938443.578454:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 713 00000100:00100000:1.0:1784938443.578460:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f2c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:16389:x1871643350864512:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1784938443.578473:0:21149:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:1.0:1784938443.578490:0:21149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 39343, mtime: 0x6a63ff71, atime: 0x0, ctime: 0x6a63ff71, blocks: 0x50 00010000:00010000:1.0:1784938443.578496:0:21149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c885a3e3/0x7b044d4128f9cc2b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.578504:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1784938443.578507:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.578510:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c885a3e3/0x7b044d4128f9cc2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.578520:0:21149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c885a3e3/0x7b044d4128f9cc2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.578528:0:21149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c885a3e3/0x7b044d4128f9cc2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.578541:0:21149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c885a3e3/0x7b044d4128f9cc2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.578555:0:21149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1784938443.578626:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f2c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:16389:x1871643350864512:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 165us (440us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1784938443.578633:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 713 00000100:00100000:1.0:1784938443.578645:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 714 00000100:00100000:1.0:1784938443.578653:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:16389:x1871643350865024:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1784938443.578665:0:21149:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:36 count 1 00002000:00010000:1.0:1784938443.578681:0:21149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 26716, mtime: 0x6a63ff74, atime: 0x0, ctime: 0x6a63ff74, blocks: 0x38 00010000:00010000:1.0:1784938443.578686:0:21149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062c58f3a/0x7b044d4128f9cc32 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.578694:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1784938443.578697:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.578701:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062c58f3a/0x7b044d4128f9cc32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.578709:0:21149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062c58f3a/0x7b044d4128f9cc32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.578717:0:21149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062c58f3a/0x7b044d4128f9cc32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.578729:0:21149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062c58f3a/0x7b044d4128f9cc32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.578752:0:21149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1784938443.578807:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:16389:x1871643350865024:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 154us (558us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1784938443.578813:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 714 00000100:00100000:1.0:1784938443.578825:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 715 00000100:00100000:1.0:1784938443.578832:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f243100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:16391:x1871643350864640:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1784938443.578843:0:21149:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:30 count 1 00002000:00010000:1.0:1784938443.578857:0:21149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 143467, mtime: 0x6a63ff73, atime: 0x0, ctime: 0x6a63ff73, blocks: 0x120 00010000:00010000:1.0:1784938443.578862:0:21149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b7dca5e/0x7b044d4128f9cc39 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.578870:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1784938443.578873:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.578877:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b7dca5e/0x7b044d4128f9cc39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.578886:0:21149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b7dca5e/0x7b044d4128f9cc39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.578894:0:21149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b7dca5e/0x7b044d4128f9cc39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.578905:0:21149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b7dca5e/0x7b044d4128f9cc39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.578915:0:21149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1784938443.578974:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f243100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:16391:x1871643350864640:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 142us (653us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1784938443.578980:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 715 00000100:00100000:1.0:1784938443.578993:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 716 00000100:00100000:1.0:1784938443.578999:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:16391:x1871643350865152:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1784938443.579011:0:21149:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:41 count 1 00002000:00010000:1.0:1784938443.579028:0:21149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 1048576, mtime: 0x6a63ff75, atime: 0x0, ctime: 0x6a63ff75, blocks: 0x800 00010000:00010000:1.0:1784938443.579034:0:21149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a6a8420/0x7b044d4128f9cc40 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.579042:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1784938443.579045:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.579049:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a6a8420/0x7b044d4128f9cc40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.579057:0:21149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a6a8420/0x7b044d4128f9cc40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.579066:0:21149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a6a8420/0x7b044d4128f9cc40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.579078:0:21149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a6a8420/0x7b044d4128f9cc40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.579087:0:21149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:1.0:1784938443.579141:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:16391:x1871643350865152:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 140us (781us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1784938443.579174:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 716 00010000:00010000:1.0:1784938443.579196:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1784938443.579204:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fcd2670/0x7b044d4128f9cc1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.579212:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61b400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938443.579217:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fcd2670/0x7b044d4128f9cc1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.579227:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fcd2670/0x7b044d4128f9cc1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.579246:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fcd2670/0x7b044d4128f9cc1d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.579254:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fcd2670/0x7b044d4128f9cc1d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.579275:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1784938443.579279:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c885a3e3/0x7b044d4128f9cc2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.579286:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5dba00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938443.579289:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c885a3e3/0x7b044d4128f9cc2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.579297:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c885a3e3/0x7b044d4128f9cc2b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.579307:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c885a3e3/0x7b044d4128f9cc2b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.579313:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c885a3e3/0x7b044d4128f9cc2b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.584014:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784938443.584036:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062c58f3a/0x7b044d4128f9cc32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.584049:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5da600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938443.584054:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062c58f3a/0x7b044d4128f9cc32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.584064:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062c58f3a/0x7b044d4128f9cc32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.584086:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062c58f3a/0x7b044d4128f9cc32 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.584094:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062c58f3a/0x7b044d4128f9cc32 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.584192:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784938443.584199:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b7dca5e/0x7b044d4128f9cc39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.584207:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5da800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938443.584210:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b7dca5e/0x7b044d4128f9cc39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.584218:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b7dca5e/0x7b044d4128f9cc39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.584235:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b7dca5e/0x7b044d4128f9cc39 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.584242:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b7dca5e/0x7b044d4128f9cc39 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.585549:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938443.585631:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938443.585702:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938443.585727:0:25719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350864768 00000100:00100000:2.0:1784938443.585735:0:25719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350864768 00000100:00100000:2.0:1784938443.585778:0:25719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350865280 00000100:00100000:2.0:1784938443.585781:0:25719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350865280 00000100:00100000:2.0:1784938443.585798:0:25719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350866304 00000100:00100000:2.0:1784938443.585800:0:25719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350866304 00000100:00100000:2.0:1784938443.585827:0:25719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 717 00000100:00100000:2.0:1784938443.585837:0:25719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f248e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:16391:x1871643350864768:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:2.0:1784938443.585871:0:25719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:8 count 1 00002000:00010000:2.0:1784938443.585918:0:25719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 28245, mtime: 0x6a63ff72, atime: 0x0, ctime: 0x6a63ff72, blocks: 0x38 00010000:00010000:2.0:1784938443.585925:0:25719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9cc47 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.585940:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1784938443.585943:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.585950:0:25719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9cc47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.585963:0:25719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9cc47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.585972:0:25719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9cc47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.585979:0:25719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9cc47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.585991:0:25719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1784938443.586218:0:25719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f248e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:16391:x1871643350864768:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 381us (675us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1784938443.586227:0:25719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 717 00000100:00100000:2.0:1784938443.586247:0:25719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 718 00000100:00100000:2.0:1784938443.586253:0:25719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f248700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:16391:x1871643350865280:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:2.0:1784938443.586265:0:25719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:13 count 1 00010000:00010000:2.0:1784938443.586277:0:25719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae3830fe/0x7b044d4128f9cc4e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.586290:0:25719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000af2a948/0x7b044d4128f9a08e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663487 expref: 78 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.586297:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784938443.586300:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.586304:0:25719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae3830fe/0x7b044d4128f9cc4e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.586346:0:25719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000af2a948/0x7b044d4128f9a08e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663487 expref: 78 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.586359:0:25719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000af2a948/0x7b044d4128f9a08e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663487 expref: 78 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.586380:0:25719:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f24b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:25719:1871643350866688:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938443.586449:0:25719:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248fb1c900 going to sleep for 11 seconds 00000100:00100000:2.0:1784938443.586479:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 719 00000100:00100000:2.0:1784938443.586491:0:25721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f24a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:16392:x1871643350866304:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:2.0:1784938443.586505:0:25721:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:34 count 1 00002000:00010000:2.0:1784938443.586524:0:25721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 254129, mtime: 0x6a63ff74, atime: 0x0, ctime: 0x6a63ff74, blocks: 0x1f8 00010000:00010000:2.0:1784938443.586530:0:25721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012221821/0x7b044d4128f9cc55 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.586538:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1784938443.586541:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.586545:0:25721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012221821/0x7b044d4128f9cc55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.586554:0:25721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012221821/0x7b044d4128f9cc55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.586562:0:25721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012221821/0x7b044d4128f9cc55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.586569:0:25721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012221821/0x7b044d4128f9cc55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.586578:0:25721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1784938443.586654:0:25721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f24a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:16392:x1871643350866304:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 166us (952us total) trans 4294967445 rc 0/0 00000100:00100000:2.0:1784938443.586661:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 719 00000100:00100000:2.0:1784938443.586773:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938443.586795:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350865792 00000100:00100000:2.0:1784938443.586800:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350865792 00000100:00100000:2.0:1784938443.586826:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 720 00000100:00100000:2.0:1784938443.586833:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:16392:x1871643350865792:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:2.0:1784938443.586845:0:25722:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:12 count 1 00002000:00010000:2.0:1784938443.586861:0:25722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 4218, mtime: 0x6a63ff72, atime: 0x0, ctime: 0x6a63ff72, blocks: 0x10 00010000:00010000:2.0:1784938443.586867:0:25722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000607bdb42/0x7b044d4128f9cc5c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.586875:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1784938443.586878:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.586881:0:25722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000607bdb42/0x7b044d4128f9cc5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.586889:0:25722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000607bdb42/0x7b044d4128f9cc5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.586897:0:25722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000607bdb42/0x7b044d4128f9cc5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.586903:0:25722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000607bdb42/0x7b044d4128f9cc5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.586917:0:25722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1784938443.586985:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:16392:x1871643350865792:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 152us (211us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1784938443.586992:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 720 00000100:00100000:2.0:1784938443.587051:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.587073:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337459840 00000100:00100000:2.0:1784938443.587076:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337459840 00010000:00010000:2.0:1784938443.587096:0:25731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c7577f35/0x7b044d4128f9a087 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766348e expref: 79 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.587120:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 334 00000100:00100000:2.0:1784938443.587126:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2488a67c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+79:10958:x1871643337459840:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938443.587137:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938443.587142:0:25731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c7577f35/0x7b044d4128f9a087 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766348e expref: 79 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.587176:0:25731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c7577f35/0x7b044d4128f9a087 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766348e expref: 79 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.587192:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.587195:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.587199:0:25731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea074bdc/0x7b044d4128f9cc24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.587212:0:25731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea074bdc/0x7b044d4128f9cc24 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.587229:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938443.587248:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2488a67c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+79:10958:x1871643337459840:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 122us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938443.587254:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 334 00000100:00100000:2.0:1784938443.587351:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938443.587384:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938443.587403:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350865664 00000100:00100000:2.0:1784938443.587406:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350865664 00000100:00100000:2.0:1784938443.587424:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 721 00000100:00100000:2.0:1784938443.587430:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:16392:x1871643350865664:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:2.0:1784938443.587442:0:21151:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:2.0:1784938443.587458:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 15476, mtime: 0x6a63ff71, atime: 0x0, ctime: 0x6a63ff71, blocks: 0x20 00010000:00010000:2.0:1784938443.587464:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060acc40f/0x7b044d4128f9cc63 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.587472:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1784938443.587475:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.587478:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060acc40f/0x7b044d4128f9cc63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.587487:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060acc40f/0x7b044d4128f9cc63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.587500:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060acc40f/0x7b044d4128f9cc63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.587508:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060acc40f/0x7b044d4128f9cc63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.587518:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1784938443.587584:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:16392:x1871643350865664:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 153us (232us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1784938443.587591:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 721 00000100:00100000:2.0:1784938443.587602:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350866176 00000100:00100000:2.0:1784938443.587605:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350866176 00000100:00100000:2.0:1784938443.587623:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 722 00000100:00100000:2.0:1784938443.587629:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:16392:x1871643350866176:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:2.0:1784938443.587640:0:21151:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:37 count 1 00002000:00010000:2.0:1784938443.587653:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 2475, mtime: 0x6a63ff74, atime: 0x0, ctime: 0x6a63ff74, blocks: 0x8 00010000:00010000:2.0:1784938443.587657:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090d9f1fe/0x7b044d4128f9cc6a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.587664:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1784938443.587667:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.587671:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090d9f1fe/0x7b044d4128f9cc6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.587678:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090d9f1fe/0x7b044d4128f9cc6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.587686:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090d9f1fe/0x7b044d4128f9cc6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.587693:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090d9f1fe/0x7b044d4128f9cc6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.587701:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:2.0:1784938443.587751:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:16392:x1871643350866176:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 121us (365us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1784938443.587759:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 722 00000100:00100000:2.0:1784938443.587853:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.587875:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337459968 00000100:00100000:2.0:1784938443.587878:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337459968 00000100:00100000:2.0:1784938443.587903:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 460 00000100:00100000:2.0:1784938443.587909:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+232:17096:x1871643337459968:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938443.587923:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938443.587938:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39a00/0x7b044d4128f9cc71 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476641ae expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.587990:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39e00/0x7b044d4128f9cc78 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.588002:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39e00/0x7b044d4128f9cc78 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.588011:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39e00/0x7b044d4128f9cc78 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.588024:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38a00/0x7b044d4128f9cc7f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x4d2290fc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.588031:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38a00/0x7b044d4128f9cc7f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.588038:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38a00/0x7b044d4128f9cc7f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.588075:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39e00/0x7b044d4128f9cc78 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.588080:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39e00/0x7b044d4128f9cc78 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.588086:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39e00/0x7b044d4128f9cc78 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.588091:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938443.588096:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39e00/0x7b044d4128f9cc78 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.588102:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39e00/0x7b044d4128f9cc78 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.588111:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938443.588114:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.588117:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39e00/0x7b044d4128f9cc78 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.588123:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39e00/0x7b044d4128f9cc78 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.588136:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38a00/0x7b044d4128f9cc7f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.588141:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38a00/0x7b044d4128f9cc7f lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.588175:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38a00/0x7b044d4128f9cc7f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.588180:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db38a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938443.588184:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38a00/0x7b044d4128f9cc7f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.588190:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38a00/0x7b044d4128f9cc7f lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.588197:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x4d2290fc (ffff9f23861f4800) 00010000:00010000:2.0:1784938443.588200:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.588203:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38a00/0x7b044d4128f9cc7f lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.588208:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38a00/0x7b044d4128f9cc7f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.588241:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39a00/0x7b044d4128f9cc71 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641ae expref: 233 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.588251:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938443.588254:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.588257:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39a00/0x7b044d4128f9cc71 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641ae expref: 233 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.588265:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238db39a00, rc 0) 00000100:00100000:2.0:1784938443.588288:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+232:17096:x1871643337459968:12345-192.168.202.54@tcp:101:cp.0 Request processed in 379us (436us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938443.588295:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 460 00010000:00010000:3.0:1784938443.590787:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00000100:00080000:3.0:1784938443.590821:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784938443.590827:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784938443.591058:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1784938443.591070:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a6a8420/0x7b044d4128f9cc40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.591081:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5daa00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938443.591086:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a6a8420/0x7b044d4128f9cc40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.591097:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a6a8420/0x7b044d4128f9cc40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.591118:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a6a8420/0x7b044d4128f9cc40 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.591135:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a6a8420/0x7b044d4128f9cc40 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.591173:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784938443.591178:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012221821/0x7b044d4128f9cc55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.591192:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938443.591195:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012221821/0x7b044d4128f9cc55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.591202:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012221821/0x7b044d4128f9cc55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.591213:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012221821/0x7b044d4128f9cc55 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.591220:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012221821/0x7b044d4128f9cc55 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.591234:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784938443.591238:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000607bdb42/0x7b044d4128f9cc5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.591245:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27ca00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938443.591248:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000607bdb42/0x7b044d4128f9cc5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.591256:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000607bdb42/0x7b044d4128f9cc5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.591265:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000607bdb42/0x7b044d4128f9cc5c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.591272:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000607bdb42/0x7b044d4128f9cc5c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.591284:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938443.591288:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060acc40f/0x7b044d4128f9cc63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.591293:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dc65400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938443.591296:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060acc40f/0x7b044d4128f9cc63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.591305:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060acc40f/0x7b044d4128f9cc63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.591314:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060acc40f/0x7b044d4128f9cc63 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.591331:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060acc40f/0x7b044d4128f9cc63 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.591344:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938443.591348:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090d9f1fe/0x7b044d4128f9cc6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.591354:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dc65e00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938443.591358:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090d9f1fe/0x7b044d4128f9cc6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.591365:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090d9f1fe/0x7b044d4128f9cc6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.591374:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090d9f1fe/0x7b044d4128f9cc6a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.591380:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090d9f1fe/0x7b044d4128f9cc6a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.591391:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938443.591392:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938443.591394:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.591842:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.591845:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.591847:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.591898:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625e200/0x7b044d4128f99cc1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.591908:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625e200/0x7b044d4128f99cc1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.591914:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625e200/0x7b044d4128f99cc1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.591920:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c625e200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.591923:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625e200/0x7b044d4128f99cc1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.591931:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625e200/0x7b044d4128f99cc1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.591943:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x151c8ac3 (ffff9f2490bf2800) 00010000:00010000:0.0:1784938443.591946:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.591950:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625e200/0x7b044d4128f99cc1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.591956:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625e200/0x7b044d4128f99cc1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.591985:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c000/0x7b044d4128f99cf9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.591992:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c000/0x7b044d4128f99cf9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.591999:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c000/0x7b044d4128f99cf9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592004:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42c000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.592007:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c000/0x7b044d4128f99cf9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592020:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c000/0x7b044d4128f99cf9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592029:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x130f79e0 (ffff9f2484afd800) 00010000:00010000:0.0:1784938443.592032:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.592035:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c000/0x7b044d4128f99cf9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592041:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c000/0x7b044d4128f99cf9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592059:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c200/0x7b044d4128f99d31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592065:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c200/0x7b044d4128f99d31 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592071:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c200/0x7b044d4128f99d31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592077:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27c200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.592080:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c200/0x7b044d4128f99d31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592086:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c200/0x7b044d4128f99d31 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592093:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x15c8a56e (ffff9f24975b2f00) 00010000:00010000:0.0:1784938443.592095:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.592099:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c200/0x7b044d4128f99d31 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592104:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c200/0x7b044d4128f99d31 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592119:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f99d69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592365:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f99d69 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592373:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f99d69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592379:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27dc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.592382:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f99d69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592389:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f99d69 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592398:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xd946e4d2 (ffff9f24975b2e00) 00010000:00010000:0.0:1784938443.592401:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.592404:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f99d69 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592410:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f99d69 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592428:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42de00/0x7b044d4128f99da1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592435:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42de00/0x7b044d4128f99da1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592442:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42de00/0x7b044d4128f99da1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592447:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42de00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.592449:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42de00/0x7b044d4128f99da1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592455:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42de00/0x7b044d4128f99da1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592467:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xbb599949 (ffff9f23861e3700) 00010000:00010000:0.0:1784938443.592470:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.592473:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42de00/0x7b044d4128f99da1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592479:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42de00/0x7b044d4128f99da1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592495:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42cc00/0x7b044d4128f99dd9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592501:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42cc00/0x7b044d4128f99dd9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592507:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42cc00/0x7b044d4128f99dd9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592512:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42cc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.592516:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42cc00/0x7b044d4128f99dd9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592522:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42cc00/0x7b044d4128f99dd9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592530:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x4d2290fc (ffff9f23861e3500) 00010000:00010000:0.0:1784938443.592532:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.592534:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42cc00/0x7b044d4128f99dd9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592539:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42cc00/0x7b044d4128f99dd9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592554:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99e11 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592560:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99e11 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592565:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99e11 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592570:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42da00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.592573:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99e11 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592578:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99e11 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592585:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xf0a46efb (ffff9f23861e3b00) 00010000:00010000:0.0:1784938443.592587:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.592590:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99e11 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592596:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42da00/0x7b044d4128f99e11 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592611:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99e49 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592617:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99e49 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592623:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99e49 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592628:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42d400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.592631:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99e49 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592637:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99e49 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592645:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xf2ca543e (ffff9f23861e3100) 00010000:00010000:0.0:1784938443.592648:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.592650:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99e49 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592656:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42d400/0x7b044d4128f99e49 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592686:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dc65800/0x7b044d4128f99e81 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592693:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dc65800/0x7b044d4128f99e81 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592699:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dc65800/0x7b044d4128f99e81 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592704:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dc65800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.592708:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dc65800/0x7b044d4128f99e81 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592714:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dc65800/0x7b044d4128f99e81 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592727:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xaa0c2c16 (ffff9f23861e3e00) 00010000:00010000:0.0:1784938443.592730:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.592732:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dc65800/0x7b044d4128f99e81 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592738:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dc65800/0x7b044d4128f99e81 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592755:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b800/0x7b044d4128f99eb9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592761:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b800/0x7b044d4128f99eb9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592767:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b800/0x7b044d4128f99eb9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592772:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61b800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.592775:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b800/0x7b044d4128f99eb9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592781:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b800/0x7b044d4128f99eb9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592788:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xb34b709f (ffff9f24b67c7900) 00010000:00010000:0.0:1784938443.592790:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.592793:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b800/0x7b044d4128f99eb9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592799:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61b800/0x7b044d4128f99eb9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592815:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f99ef1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592822:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f99ef1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592828:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f99ef1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592833:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27c000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.592836:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f99ef1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592842:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f99ef1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592848:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x322afea2 (ffff9f24975b2d00) 00010000:00010000:0.0:1784938443.592851:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.592854:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f99ef1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592859:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f99ef1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592872:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27da00/0x7b044d4128f99f29 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.592878:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27da00/0x7b044d4128f99f29 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.594120:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938443.594311:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00010000:00010000:0.0:1784938443.596738:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27da00/0x7b044d4128f99f29 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.596749:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27da00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.596755:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27da00/0x7b044d4128f99f29 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.596765:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27da00/0x7b044d4128f99f29 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.596783:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xbf79d746 (ffff9f24975b2200) 00010000:00010000:0.0:1784938443.596787:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.596792:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27da00/0x7b044d4128f99f29 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.596799:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27da00/0x7b044d4128f99f29 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.596836:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c400/0x7b044d4128f99f61 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.596843:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c400/0x7b044d4128f99f61 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.596848:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c400/0x7b044d4128f99f61 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.596853:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27c400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.596856:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c400/0x7b044d4128f99f61 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.596862:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c400/0x7b044d4128f99f61 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.596873:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xe087ee79 (ffff9f24975b2c00) 00010000:00010000:0.0:1784938443.596876:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.596878:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c400/0x7b044d4128f99f61 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.596885:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c400/0x7b044d4128f99f61 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.596903:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db800/0x7b044d4128f9a0f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.596909:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db800/0x7b044d4128f9a0f7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.596916:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db800/0x7b044d4128f9a0f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.596921:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5db800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.596924:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db800/0x7b044d4128f9a0f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.596930:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db800/0x7b044d4128f9a0f7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.596938:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x50:0x0].0x45fac828 (ffff9f238dbbf900) 00010000:00010000:0.0:1784938443.596941:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.596944:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db800/0x7b044d4128f9a0f7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.596950:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db800/0x7b044d4128f9a0f7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.596973:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db000/0x7b044d4128f9a12f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.596980:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db000/0x7b044d4128f9a12f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.596986:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db000/0x7b044d4128f9a12f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.596991:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5db000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.596995:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db000/0x7b044d4128f9a12f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597001:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db000/0x7b044d4128f9a12f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597008:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x50:0x0].0x1cda55a (ffff9f238dbbf000) 00010000:00010000:0.0:1784938443.597010:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.597013:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db000/0x7b044d4128f9a12f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597033:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db000/0x7b044d4128f9a12f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597049:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5da000/0x7b044d4128f9a167 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x7026f06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597056:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5da000/0x7b044d4128f9a167 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x7026f06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597062:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5da000/0x7b044d4128f9a167 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x7026f06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597068:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5da000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.597071:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5da000/0x7b044d4128f9a167 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x7026f06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597077:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5da000/0x7b044d4128f9a167 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x7026f06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597084:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x7026f06f (ffff9f24975b2700) 00010000:00010000:0.0:1784938443.597087:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.597089:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5da000/0x7b044d4128f9a167 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x7026f06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597095:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5da000/0x7b044d4128f9a167 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x7026f06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597110:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625e000/0x7b044d4128f9a17c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597116:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625e000/0x7b044d4128f9a17c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597122:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625e000/0x7b044d4128f9a17c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597159:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c625e000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.597162:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625e000/0x7b044d4128f9a17c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597168:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625e000/0x7b044d4128f9a17c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597181:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x7584afcd (ffff9f2490bf2500) 00010000:00010000:0.0:1784938443.597183:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.597186:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625e000/0x7b044d4128f9a17c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597193:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625e000/0x7b044d4128f9a17c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597214:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c000/0x7b044d4128f9a25c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597220:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c000/0x7b044d4128f9a25c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597226:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c000/0x7b044d4128f9a25c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597231:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c95c000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.597233:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c000/0x7b044d4128f9a25c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597239:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c000/0x7b044d4128f9a25c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597246:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x9e90f16b (ffff9f24b67c7e00) 00010000:00010000:0.0:1784938443.597248:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.597251:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c000/0x7b044d4128f9a25c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597257:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c000/0x7b044d4128f9a25c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597272:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057600/0x7b044d4128f9a2be lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597279:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057600/0x7b044d4128f9a2be lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597284:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057600/0x7b044d4128f9a2be lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597288:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.597290:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057600/0x7b044d4128f9a2be lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597296:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057600/0x7b044d4128f9a2be lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597303:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x2fbacb41 (ffff9f23861e4d00) 00010000:00010000:0.0:1784938443.597305:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.597308:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057600/0x7b044d4128f9a2be lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597314:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057600/0x7b044d4128f9a2be lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597340:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95da00/0x7b044d4128f9a503 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597346:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95da00/0x7b044d4128f9a503 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597352:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95da00/0x7b044d4128f9a503 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597357:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c95da00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.597359:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95da00/0x7b044d4128f9a503 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597365:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95da00/0x7b044d4128f9a503 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597373:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xd06bcd9f (ffff9f24b67c7700) 00010000:00010000:0.0:1784938443.597376:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.597379:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95da00/0x7b044d4128f9a503 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597385:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95da00/0x7b044d4128f9a503 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597400:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01a00/0x7b044d4128f9a684 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597407:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01a00/0x7b044d4128f9a684 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597413:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01a00/0x7b044d4128f9a684 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597419:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e01a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.597421:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01a00/0x7b044d4128f9a684 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597427:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01a00/0x7b044d4128f9a684 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597439:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xc025ca7 (ffff9f248300aa00) 00010000:00010000:0.0:1784938443.597441:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.597444:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01a00/0x7b044d4128f9a684 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597449:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01a00/0x7b044d4128f9a684 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597468:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9a8c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597474:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9a8c2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597480:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9a8c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597484:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17b400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.597487:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9a8c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597493:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9a8c2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597499:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x6d38f012 (ffff9f24b67c7300) 00010000:00010000:0.0:1784938443.597502:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.597505:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9a8c2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597511:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9a8c2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597524:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95ce00/0x7b044d4128f9a924 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597531:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95ce00/0x7b044d4128f9a924 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597536:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95ce00/0x7b044d4128f9a924 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597540:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c95ce00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.597542:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95ce00/0x7b044d4128f9a924 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597548:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95ce00/0x7b044d4128f9a924 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597555:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x610aa076 (ffff9f238cf4a700) 00010000:00010000:0.0:1784938443.597557:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.597560:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95ce00/0x7b044d4128f9a924 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597565:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95ce00/0x7b044d4128f9a924 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597585:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fda00/0x7b044d4128f9a940 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597591:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fda00/0x7b044d4128f9a940 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597597:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fda00/0x7b044d4128f9a940 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597602:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fda00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.597605:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fda00/0x7b044d4128f9a940 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597611:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fda00/0x7b044d4128f9a940 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597619:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xa4bfea24 (ffff9f2387231100) 00010000:00010000:0.0:1784938443.597621:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.597624:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fda00/0x7b044d4128f9a940 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597630:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fda00/0x7b044d4128f9a940 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597645:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c600/0x7b044d4128f9a9e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597650:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c600/0x7b044d4128f9a9e1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597656:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c600/0x7b044d4128f9a9e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597661:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c95c600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.597664:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c600/0x7b044d4128f9a9e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597670:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c600/0x7b044d4128f9a9e1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597681:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x489b8eb2 (ffff9f238cf4ac00) 00010000:00010000:0.0:1784938443.597683:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.597686:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c600/0x7b044d4128f9a9e1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597692:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95c600/0x7b044d4128f9a9e1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597707:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8b200/0x7b044d4128f9a9fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597713:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8b200/0x7b044d4128f9a9fd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597718:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8b200/0x7b044d4128f9a9fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597723:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b6b8b200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.597725:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8b200/0x7b044d4128f9a9fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597731:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8b200/0x7b044d4128f9a9fd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597739:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x48840fb6 (ffff9f248fb6a800) 00010000:00010000:0.0:1784938443.597741:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.597744:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8b200/0x7b044d4128f9a9fd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597749:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8b200/0x7b044d4128f9a9fd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597767:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395a00/0x7b044d4128f9aa19 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597773:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395a00/0x7b044d4128f9aa19 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597779:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395a00/0x7b044d4128f9aa19 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597784:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382395a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.597786:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395a00/0x7b044d4128f9aa19 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597791:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395a00/0x7b044d4128f9aa19 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597798:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x45c0cf9c (ffff9f248fb6c300) 00010000:00010000:0.0:1784938443.597800:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.597803:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395a00/0x7b044d4128f9aa19 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597808:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395a00/0x7b044d4128f9aa19 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597822:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00e00/0x7b044d4128f9aa35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597828:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00e00/0x7b044d4128f9aa35 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597834:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00e00/0x7b044d4128f9aa35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597838:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d00e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.597840:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00e00/0x7b044d4128f9aa35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597845:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00e00/0x7b044d4128f9aa35 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597852:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x21aa2247 (ffff9f249863ba00) 00010000:00010000:0.0:1784938443.597854:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.597856:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00e00/0x7b044d4128f9aa35 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597861:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00e00/0x7b044d4128f9aa35 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597875:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8ae00/0x7b044d4128f9aa51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597881:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8ae00/0x7b044d4128f9aa51 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597887:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8ae00/0x7b044d4128f9aa51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597892:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b6b8ae00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.597895:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8ae00/0x7b044d4128f9aa51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597900:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8ae00/0x7b044d4128f9aa51 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597911:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x7772308b (ffff9f248aad5800) 00010000:00010000:0.0:1784938443.597914:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.597916:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8ae00/0x7b044d4128f9aa51 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597922:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8ae00/0x7b044d4128f9aa51 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597941:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01000/0x7b044d4128f9aa6d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597947:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01000/0x7b044d4128f9aa6d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597953:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01000/0x7b044d4128f9aa6d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597958:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d01000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.597961:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01000/0x7b044d4128f9aa6d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597967:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01000/0x7b044d4128f9aa6d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597974:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xbf580d0c (ffff9f24898df500) 00010000:00010000:0.0:1784938443.597976:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.597979:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01000/0x7b044d4128f9aa6d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.597984:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01000/0x7b044d4128f9aa6d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598001:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395c00/0x7b044d4128f9aa89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598008:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395c00/0x7b044d4128f9aa89 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598014:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395c00/0x7b044d4128f9aa89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598019:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382395c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.598022:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395c00/0x7b044d4128f9aa89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598027:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395c00/0x7b044d4128f9aa89 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598035:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x868dff87 (ffff9f248fb6c400) 00010000:00010000:0.0:1784938443.598037:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.598040:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395c00/0x7b044d4128f9aa89 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598046:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395c00/0x7b044d4128f9aa89 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598060:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d000/0x7b044d4128f9aaa5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598066:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d000/0x7b044d4128f9aaa5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598072:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d000/0x7b044d4128f9aaa5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598077:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217d000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.598080:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d000/0x7b044d4128f9aaa5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598085:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d000/0x7b044d4128f9aaa5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598092:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x4c7a76ee (ffff9f248aad5d00) 00010000:00010000:0.0:1784938443.598094:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.598097:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d000/0x7b044d4128f9aaa5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598103:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d000/0x7b044d4128f9aaa5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598117:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394400/0x7b044d4128f9aac1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598124:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394400/0x7b044d4128f9aac1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598130:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394400/0x7b044d4128f9aac1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598135:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.598137:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394400/0x7b044d4128f9aac1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598166:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394400/0x7b044d4128f9aac1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598178:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xb2d5a33e (ffff9f248fb6c000) 00010000:00010000:0.0:1784938443.598181:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.598183:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394400/0x7b044d4128f9aac1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598190:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394400/0x7b044d4128f9aac1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598206:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6200/0x7b044d4128f9aadd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598212:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6200/0x7b044d4128f9aadd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598217:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6200/0x7b044d4128f9aadd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598223:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c6200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.598226:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6200/0x7b044d4128f9aadd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598231:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6200/0x7b044d4128f9aadd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598238:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x1a616f3f (ffff9f24898df700) 00010000:00010000:0.0:1784938443.598240:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.598243:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6200/0x7b044d4128f9aadd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598248:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6200/0x7b044d4128f9aadd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598263:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c200/0x7b044d4128f9aaf9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598269:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c200/0x7b044d4128f9aaf9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598275:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c200/0x7b044d4128f9aaf9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598280:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217c200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.598284:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c200/0x7b044d4128f9aaf9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598290:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c200/0x7b044d4128f9aaf9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598297:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xff118af2 (ffff9f248aad5400) 00010000:00010000:0.0:1784938443.598300:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.598303:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c200/0x7b044d4128f9aaf9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598308:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c200/0x7b044d4128f9aaf9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598336:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6800/0x7b044d4128f9ab15 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598343:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6800/0x7b044d4128f9ab15 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598348:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6800/0x7b044d4128f9ab15 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598354:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c6800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.598357:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6800/0x7b044d4128f9ab15 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598363:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6800/0x7b044d4128f9ab15 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598371:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x9b815f19 (ffff9f24898df600) 00010000:00010000:0.0:1784938443.598373:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.598375:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6800/0x7b044d4128f9ab15 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598380:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6800/0x7b044d4128f9ab15 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598397:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c400/0x7b044d4128f9ab31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598403:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c400/0x7b044d4128f9ab31 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598409:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c400/0x7b044d4128f9ab31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598414:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217c400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.598417:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c400/0x7b044d4128f9ab31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598423:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c400/0x7b044d4128f9ab31 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598434:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x37dcc2d3 (ffff9f248aad5f00) 00010000:00010000:0.0:1784938443.598436:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.598439:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c400/0x7b044d4128f9ab31 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598446:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c400/0x7b044d4128f9ab31 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598465:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01400/0x7b044d4128f9ab4d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598471:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01400/0x7b044d4128f9ab4d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598475:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01400/0x7b044d4128f9ab4d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598480:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d01400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.598482:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01400/0x7b044d4128f9ab4d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598487:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01400/0x7b044d4128f9ab4d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598494:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xe00215d9 (ffff9f24898df300) 00010000:00010000:0.0:1784938443.598496:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.598499:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01400/0x7b044d4128f9ab4d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598504:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01400/0x7b044d4128f9ab4d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598521:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394800/0x7b044d4128f9ab69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598526:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394800/0x7b044d4128f9ab69 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598532:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394800/0x7b044d4128f9ab69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598537:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.598540:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394800/0x7b044d4128f9ab69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598545:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394800/0x7b044d4128f9ab69 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598552:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xa38d6329 (ffff9f248fb6ca00) 00010000:00010000:0.0:1784938443.598555:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.598557:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394800/0x7b044d4128f9ab69 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598563:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394800/0x7b044d4128f9ab69 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598595:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d000/0x7b044d4128f9ab85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598602:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d000/0x7b044d4128f9ab85 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598609:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d000/0x7b044d4128f9ab85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598614:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c95d000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.598617:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d000/0x7b044d4128f9ab85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598623:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d000/0x7b044d4128f9ab85 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598632:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xd47b514a (ffff9f2485293500) 00010000:00010000:0.0:1784938443.598634:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.598637:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d000/0x7b044d4128f9ab85 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598643:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c95d000/0x7b044d4128f9ab85 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598660:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01200/0x7b044d4128f9aba1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598665:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01200/0x7b044d4128f9aba1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598671:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01200/0x7b044d4128f9aba1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598676:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d01200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.598679:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01200/0x7b044d4128f9aba1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598685:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01200/0x7b044d4128f9aba1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598697:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x48e4a31f (ffff9f24898df200) 00010000:00010000:0.0:1784938443.598699:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.598701:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01200/0x7b044d4128f9aba1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598706:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01200/0x7b044d4128f9aba1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598732:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c600/0x7b044d4128f9abbd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598738:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c600/0x7b044d4128f9abbd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598743:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c600/0x7b044d4128f9abbd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598749:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3c600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.598752:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c600/0x7b044d4128f9abbd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598758:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c600/0x7b044d4128f9abbd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598766:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x10fe8da8 (ffff9f24898df100) 00010000:00010000:0.0:1784938443.598769:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.598772:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c600/0x7b044d4128f9abbd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598777:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c600/0x7b044d4128f9abbd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598793:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00800/0x7b044d4128f9abd9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598799:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00800/0x7b044d4128f9abd9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598805:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00800/0x7b044d4128f9abd9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598809:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.598812:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00800/0x7b044d4128f9abd9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598816:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00800/0x7b044d4128f9abd9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598824:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x9fe9a331 (ffff9f2485293d00) 00010000:00010000:0.0:1784938443.598826:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.598829:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00800/0x7b044d4128f9abd9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598835:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00800/0x7b044d4128f9abd9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598849:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c400/0x7b044d4128f9abf5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598854:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c400/0x7b044d4128f9abf5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598859:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c400/0x7b044d4128f9abf5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598864:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3c400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.598867:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c400/0x7b044d4128f9abf5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598872:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c400/0x7b044d4128f9abf5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598880:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x9cfce7b5 (ffff9f24898df800) 00010000:00010000:0.0:1784938443.598882:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.598885:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c400/0x7b044d4128f9abf5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598891:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c400/0x7b044d4128f9abf5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598907:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9ac11 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598912:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9ac11 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598918:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9ac11 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598923:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382395200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.598926:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9ac11 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598931:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9ac11 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598943:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xe708c894 (ffff9f248fb6cf00) 00010000:00010000:0.0:1784938443.598945:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.598948:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9ac11 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598953:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395200/0x7b044d4128f9ac11 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598969:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c800/0x7b044d4128f9ac2d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598975:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c800/0x7b044d4128f9ac2d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598981:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c800/0x7b044d4128f9ac2d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598986:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3c800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.598989:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c800/0x7b044d4128f9ac2d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.598994:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c800/0x7b044d4128f9ac2d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599001:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x839e9634 (ffff9f24898df900) 00010000:00010000:0.0:1784938443.599003:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.599006:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c800/0x7b044d4128f9ac2d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599011:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c800/0x7b044d4128f9ac2d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599025:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9ac49 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599031:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9ac49 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599037:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9ac49 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599042:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382395000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.599044:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9ac49 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599050:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9ac49 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599057:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x9ce4d69c (ffff9f248fb6c800) 00010000:00010000:0.0:1784938443.599060:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.599062:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9ac49 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599068:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395000/0x7b044d4128f9ac49 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599082:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395800/0x7b044d4128f9ac65 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599089:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395800/0x7b044d4128f9ac65 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599094:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395800/0x7b044d4128f9ac65 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599099:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382395800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.599102:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395800/0x7b044d4128f9ac65 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599107:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395800/0x7b044d4128f9ac65 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599114:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x2893e4db (ffff9f248fb6b800) 00010000:00010000:0.0:1784938443.599117:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.599120:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395800/0x7b044d4128f9ac65 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599126:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395800/0x7b044d4128f9ac65 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599141:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc000/0x7b044d4128f9ac81 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599172:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc000/0x7b044d4128f9ac81 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599178:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc000/0x7b044d4128f9ac81 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599184:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fc000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.599187:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc000/0x7b044d4128f9ac81 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599195:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc000/0x7b044d4128f9ac81 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599206:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xecc4f14 (ffff9f248fb6ba00) 00010000:00010000:0.0:1784938443.599208:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.599211:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc000/0x7b044d4128f9ac81 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599217:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc000/0x7b044d4128f9ac81 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599232:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02400/0x7b044d4128f9ac9d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599238:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02400/0x7b044d4128f9ac9d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599244:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02400/0x7b044d4128f9ac9d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599249:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e02400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.599252:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02400/0x7b044d4128f9ac9d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599257:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02400/0x7b044d4128f9ac9d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599264:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x4ee593e6 (ffff9f248fb6bc00) 00010000:00010000:0.0:1784938443.599266:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.599269:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02400/0x7b044d4128f9ac9d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599275:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02400/0x7b044d4128f9ac9d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599289:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02a00/0x7b044d4128f9acb9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599295:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02a00/0x7b044d4128f9acb9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599301:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02a00/0x7b044d4128f9acb9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599306:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e02a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.599309:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02a00/0x7b044d4128f9acb9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.599315:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02a00/0x7b044d4128f9acb9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.599518:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938443.599523:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938443.599552:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350865920 00000100:00100000:1.0:1784938443.599563:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350865920 00000100:00100000:1.0:1784938443.599628:0:25720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 723 00000100:00100000:1.0:1784938443.599638:0:25720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:16389:x1871643350865920:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1784938443.599677:0:25720:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:36 count 1 00002000:00010000:1.0:1784938443.599712:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 1179443, mtime: 0x6a63ff74, atime: 0x0, ctime: 0x6a63ff74, blocks: 0x900 00010000:00010000:1.0:1784938443.599719:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f2d18e0/0x7b044d4128f9cc86 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.599734:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1784938443.599738:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.599744:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f2d18e0/0x7b044d4128f9cc86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.599756:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f2d18e0/0x7b044d4128f9cc86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.599771:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f2d18e0/0x7b044d4128f9cc86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.599777:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f2d18e0/0x7b044d4128f9cc86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.599795:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938443.599961:0:25720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:16389:x1871643350865920:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 323us (5654us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1784938443.599969:0:25720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 723 00010000:00010000:1.0:1784938443.599997:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938443.600003:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f2d18e0/0x7b044d4128f9cc86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.600011:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5dbc00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938443.600015:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f2d18e0/0x7b044d4128f9cc86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.600023:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f2d18e0/0x7b044d4128f9cc86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.600035:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f2d18e0/0x7b044d4128f9cc86 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.600042:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f2d18e0/0x7b044d4128f9cc86 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.600057:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938443.600059:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938443.600061:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938443.600097:0:25718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7577f35/0x7b044d4128f9a087 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766348e expref: 78 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.600110:0:25718:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f2c8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25718:1871643350866560:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938443.600129:0:25718:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ea074bdc/0x7b044d4128f9cc24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.600138:0:25718:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ea074bdc/0x7b044d4128f9cc24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.600176:0:25718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea074bdc/0x7b044d4128f9cc24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.600185:0:25718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea074bdc/0x7b044d4128f9cc24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.600192:0:25718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea074bdc/0x7b044d4128f9cc24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.600214:0:25718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938443.600298:0:25718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:16389:x1871643350865408:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 22317us (22754us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1784938443.600309:0:25718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 712 00000100:00100000:1.0:1784938443.600547:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.600622:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.600711:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00010000:00010000:1.0:1784938443.601379:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938443.601388:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea074bdc/0x7b044d4128f9cc24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.601398:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61ae00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938443.601403:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea074bdc/0x7b044d4128f9cc24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.601413:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea074bdc/0x7b044d4128f9cc24 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.601429:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea074bdc/0x7b044d4128f9cc24 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.601437:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea074bdc/0x7b044d4128f9cc24 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.601454:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938443.601456:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938443.601458:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938443.601562:0:25723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350866432 00000100:00100000:2.0:1784938443.601571:0:25723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350866432 00000100:00100000:2.0:1784938443.601606:0:25723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350865536 00000100:00100000:2.0:1784938443.601609:0:25723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350865536 00000100:00100000:2.0:1784938443.601623:0:25723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350866048 00000100:00100000:2.0:1784938443.601625:0:25723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350866048 00000100:00100000:2.0:1784938443.601645:0:25723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 724 00000100:00100000:2.0:1784938443.601653:0:25723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381362c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+16:16389:x1871643350866432:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:2.0:1784938443.601677:0:25723:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:7 count 1 00002000:00010000:2.0:1784938443.601705:0:25723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 4207, mtime: 0x6a63ff72, atime: 0x0, ctime: 0x6a63ff72, blocks: 0x10 00010000:00010000:2.0:1784938443.601712:0:25723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097541b4a/0x7b044d4128f9cc8d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.601724:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1784938443.601728:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.601734:0:25723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097541b4a/0x7b044d4128f9cc8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.601745:0:25723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097541b4a/0x7b044d4128f9cc8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.601759:0:25723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097541b4a/0x7b044d4128f9cc8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.601767:0:25723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097541b4a/0x7b044d4128f9cc8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.601780:0:25723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784938443.601897:0:25723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381362c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+17:16389:x1871643350866432:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 232us (1338us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1784938443.601906:0:25723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 724 00000100:00100000:2.0:1784938443.601924:0:25723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 725 00000100:00100000:2.0:1784938443.601931:0:25723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f2c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+16:16389:x1871643350865536:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:2.0:1784938443.601942:0:25723:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:26 count 1 00002000:00010000:2.0:1784938443.601955:0:25723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 1408, mtime: 0x6a63ff73, atime: 0x0, ctime: 0x6a63ff73, blocks: 0x8 00010000:00010000:2.0:1784938443.601960:0:25723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f832e683/0x7b044d4128f9cc94 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.601968:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1784938443.601971:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.601976:0:25723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f832e683/0x7b044d4128f9cc94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.601985:0:25723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f832e683/0x7b044d4128f9cc94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.601997:0:25723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f832e683/0x7b044d4128f9cc94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.602005:0:25723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f832e683/0x7b044d4128f9cc94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.602025:0:25723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1784938443.602088:0:25723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f2c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+17:16389:x1871643350865536:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 157us (1465us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1784938443.602095:0:25723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 725 00000100:00100000:2.0:1784938443.602107:0:25723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 726 00000100:00100000:2.0:1784938443.602113:0:25723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+16:16389:x1871643350866048:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:2.0:1784938443.602137:0:25723:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:11 count 1 00002000:00010000:2.0:1784938443.602170:0:25723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 2858, mtime: 0x6a63ff72, atime: 0x0, ctime: 0x6a63ff72, blocks: 0x8 00010000:00010000:2.0:1784938443.602176:0:25723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1d7f9cb/0x7b044d4128f9cc9b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.602185:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1784938443.602188:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.602191:0:25723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d7f9cb/0x7b044d4128f9cc9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.602200:0:25723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1d7f9cb/0x7b044d4128f9cc9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.602213:0:25723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1d7f9cb/0x7b044d4128f9cc9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.602221:0:25723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d7f9cb/0x7b044d4128f9cc9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.602233:0:25723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1784938443.602286:0:25723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+17:16389:x1871643350866048:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 172us (1574us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1784938443.602293:0:25723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 726 00010000:00010000:1.0:1784938443.602737:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784938443.602745:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097541b4a/0x7b044d4128f9cc8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.602754:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938443.602757:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097541b4a/0x7b044d4128f9cc8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.602766:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097541b4a/0x7b044d4128f9cc8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.602781:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097541b4a/0x7b044d4128f9cc8d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.602788:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097541b4a/0x7b044d4128f9cc8d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.602806:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784938443.602809:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f832e683/0x7b044d4128f9cc94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.602815:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db38400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938443.602818:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f832e683/0x7b044d4128f9cc94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.602824:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f832e683/0x7b044d4128f9cc94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.602833:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f832e683/0x7b044d4128f9cc94 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.602840:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f832e683/0x7b044d4128f9cc94 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.602850:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938443.602853:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1d7f9cb/0x7b044d4128f9cc9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.602859:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db38600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938443.602862:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1d7f9cb/0x7b044d4128f9cc9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.602869:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1d7f9cb/0x7b044d4128f9cc9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.602938:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1d7f9cb/0x7b044d4128f9cc9b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.602948:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1d7f9cb/0x7b044d4128f9cc9b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.602961:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938443.602963:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938443.602964:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938443.602970:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938443.602974:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938443.603094:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.603117:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337460096 00000100:00100000:1.0:1784938443.603201:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337460096 00010000:00010000:1.0:1784938443.603232:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000af2a948/0x7b044d4128f9a08e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663487 expref: 78 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.603264:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 335 00000100:00100000:1.0:1784938443.603272:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+78:10958:x1871643337460096:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.603282:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.603287:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000af2a948/0x7b044d4128f9a08e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663487 expref: 78 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.603300:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000af2a948/0x7b044d4128f9a08e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663487 expref: 78 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.603318:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.603335:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.603340:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae3830fe/0x7b044d4128f9cc4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.603347:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae3830fe/0x7b044d4128f9cc4e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.603362:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.603394:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+78:10958:x1871643337460096:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 123us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.603400:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 335 00000004:00080000:3.0:1784938443.603815:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f181500/2, rc 0, transno 4294967451 00000100:00100000:3.0:1784938443.603827:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350865536:192.168.202.154@tcp:6:osp-syn-0-0.0 00000004:00080000:3.0:1784938443.603839:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f180380/2, rc 0, transno 4294967452 00000100:00100000:3.0:1784938443.603844:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350866048:192.168.202.154@tcp:6:osp-syn-0-0.0 00000004:00080000:3.0:1784938443.603854:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f181180/2, rc 0, transno 4294967449 00000100:00100000:3.0:1784938443.603858:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350865920:192.168.202.154@tcp:6:osp-syn-0-0.0 00000004:00080000:3.0:1784938443.603866:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f249180/2, rc 0, transno 4294967450 00000100:00100000:3.0:1784938443.603870:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f249180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350866432:192.168.202.154@tcp:6:osp-syn-0-0.0 00000004:00080000:3.0:1784938443.603881:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f2381d29500/2, rc 0, transno 4294967439 00000100:00100000:3.0:1784938443.604001:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2381d29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350864512:192.168.202.154@tcp:6:osp-syn-1-0.0 00000004:00080000:3.0:1784938443.604086:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f2386363100/2, rc 0, transno 4294967440 00000100:00100000:3.0:1784938443.604092:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350865024:192.168.202.154@tcp:6:osp-syn-1-0.0 00000004:00080000:3.0:1784938443.604105:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f2381d2b100/2, rc 0, transno 4294967438 00000100:00100000:3.0:1784938443.604108:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2381d2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350864896:192.168.202.154@tcp:6:osp-syn-1-0.0 00000004:00080000:3.0:1784938443.604116:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f19a300/2, rc 0, transno 4294967444 00000100:00100000:3.0:1784938443.604119:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f19a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350865408:192.168.202.154@tcp:6:osp-syn-1-0.0 00010000:00010000:2.0:1784938443.604251:0:25719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000af2a948/0x7b044d4128f9a08e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663487 expref: 77 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.604265:0:25719:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f24b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:25719:1871643350866688:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938443.604283:0:25719:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ae3830fe/0x7b044d4128f9cc4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.604293:0:25719:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ae3830fe/0x7b044d4128f9cc4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.604300:0:25719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae3830fe/0x7b044d4128f9cc4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.604311:0:25719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae3830fe/0x7b044d4128f9cc4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.604319:0:25719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae3830fe/0x7b044d4128f9cc4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.604344:0:25719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784938443.604479:0:25719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f248700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:16391:x1871643350865280:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 18225us (18847us total) trans 4294967445 rc 0/0 00000100:00100000:2.0:1784938443.604488:0:25719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 718 00000100:00100000:3.0:1784938443.605839:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350867200:192.168.202.154@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1784938443.606196:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938443.606206:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae3830fe/0x7b044d4128f9cc4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.606217:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938443.606222:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae3830fe/0x7b044d4128f9cc4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.606232:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae3830fe/0x7b044d4128f9cc4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.606249:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae3830fe/0x7b044d4128f9cc4e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.606256:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae3830fe/0x7b044d4128f9cc4e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.606275:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938443.606277:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938443.606279:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938443.606320:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.606362:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337460224 00000100:00100000:1.0:1784938443.606369:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337460224 00000100:00100000:1.0:1784938443.606416:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 461 00000100:00100000:1.0:1784938443.606424:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b35f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+182:17096:x1871643337460224:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938443.606441:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938443.606459:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245000/0x7b044d4128f9cca2 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476641b5 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.606525:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7600/0x7b044d4128f9cca9 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.606538:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7600/0x7b044d4128f9cca9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.606548:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7600/0x7b044d4128f9cca9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.606561:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6c00/0x7b044d4128f9ccb0 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x4d2290fc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.606568:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6c00/0x7b044d4128f9ccb0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.606574:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6c00/0x7b044d4128f9ccb0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.606615:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7600/0x7b044d4128f9cca9 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.606622:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7600/0x7b044d4128f9cca9 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.606628:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7600/0x7b044d4128f9cca9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.606634:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7600/0x7b044d4128f9cca9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.606640:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c7600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938443.606645:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7600/0x7b044d4128f9cca9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.606652:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7600/0x7b044d4128f9cca9 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.606662:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938443.606665:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.606668:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7600/0x7b044d4128f9cca9 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.606674:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c7600/0x7b044d4128f9cca9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.606686:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6c00/0x7b044d4128f9ccb0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.606691:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6c00/0x7b044d4128f9ccb0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.606696:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6c00/0x7b044d4128f9ccb0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.606701:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c6c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938443.606704:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6c00/0x7b044d4128f9ccb0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.606710:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6c00/0x7b044d4128f9ccb0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.606717:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x4d2290fc (ffff9f24898dd700) 00010000:00010000:1.0:1784938443.606719:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.606723:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6c00/0x7b044d4128f9ccb0 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.606728:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6c00/0x7b044d4128f9ccb0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.606761:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245000/0x7b044d4128f9cca2 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641b5 expref: 183 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.606772:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938443.606774:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.606777:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245000/0x7b044d4128f9cca2 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641b5 expref: 183 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.606786:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f245000, rc 0) 00000100:00100000:1.0:1784938443.606827:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b35f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+182:17096:x1871643337460224:12345-192.168.202.54@tcp:101:cp.0 Request processed in 403us (507us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938443.606834:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 461 00000100:00100000:3.0:1784938443.607011:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2489ae6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350867712:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:3.0:1784938443.607120:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784938443.607211:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350866816:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:3.0:1784938443.607240:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350867328:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:3.0:1784938443.607278:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350866944:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:3.0:1784938443.607301:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2489ae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350867456:192.168.202.154@tcp:6:osp-syn-1-0.0 00000004:00080000:3.0:1784938443.607352:0:16391:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f2381d28a80/2, rc 0, transno 4294967443 00000100:00100000:3.0:1784938443.607370:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2381d28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350864768:192.168.202.154@tcp:6:osp-syn-1-0.0 00000004:00080000:3.0:1784938443.607381:0:16391:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238d3afb80/2, rc 0, transno 4294967445 00000100:00100000:3.0:1784938443.607386:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d3afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350865280:192.168.202.154@tcp:6:osp-syn-1-0.0 00000004:00080000:3.0:1784938443.607395:0:16391:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f2381d2a680/2, rc 0, transno 4294967441 00000100:00100000:3.0:1784938443.607398:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2381d2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350864640:192.168.202.154@tcp:6:osp-syn-1-0.0 00000004:00080000:3.0:1784938443.607406:0:16391:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238d3adf80/2, rc 0, transno 4294967442 00000100:00100000:3.0:1784938443.607410:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d3adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350865152:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:3.0:1784938443.607420:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784938443.607426:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350867072:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:3.0:1784938443.607450:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2489ae7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350867584:192.168.202.154@tcp:6:osp-syn-1-0.0 00000004:00080000:3.0:1784938443.607486:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f180000/2, rc 0, transno 4294967447 00000100:00100000:3.0:1784938443.607495:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350865664:192.168.202.154@tcp:6:osp-syn-0-0.0 00000004:00080000:3.0:1784938443.607505:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f181880/2, rc 0, transno 4294967448 00000100:00100000:3.0:1784938443.607509:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350866176:192.168.202.154@tcp:6:osp-syn-0-0.0 00000004:00080000:3.0:1784938443.607518:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f182d80/2, rc 0, transno 4294967446 00000100:00100000:3.0:1784938443.607521:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350865792:192.168.202.154@tcp:6:osp-syn-0-0.0 00000004:00080000:3.0:1784938443.607529:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f24b800/2, rc 0, transno 4294967445 00000100:00100000:3.0:1784938443.607532:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f24b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350866304:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:2.0:1784938443.607780:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d3ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350868224:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:2.0:1784938443.607808:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784938443.607814:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350867840:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:2.0:1784938443.607836:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386360a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350867968:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:2.0:1784938443.607855:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938443.607860:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386360700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350868096:192.168.202.154@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1784938443.608003:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xf4c8ca43 (ffff9f248fb6bf00) 00010000:00010000:0.0:1784938443.608007:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.608012:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02a00/0x7b044d4128f9acb9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608031:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02a00/0x7b044d4128f9acb9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608059:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03e00/0x7b044d4128f9acd5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608065:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03e00/0x7b044d4128f9acd5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608071:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03e00/0x7b044d4128f9acd5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608078:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e03e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.608081:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03e00/0x7b044d4128f9acd5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608088:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03e00/0x7b044d4128f9acd5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608097:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xe7eb4718 (ffff9f248fb6b400) 00010000:00010000:0.0:1784938443.608100:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.608102:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03e00/0x7b044d4128f9acd5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608108:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03e00/0x7b044d4128f9acd5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608123:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3de00/0x7b044d4128f9acf1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608266:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3de00/0x7b044d4128f9acf1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608272:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3de00/0x7b044d4128f9acf1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608277:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3de00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.608280:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3de00/0x7b044d4128f9acf1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608286:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3de00/0x7b044d4128f9acf1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608299:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x49aa722d (ffff9f24898df000) 00010000:00010000:0.0:1784938443.608302:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.608305:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3de00/0x7b044d4128f9acf1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608310:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3de00/0x7b044d4128f9acf1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608342:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03000/0x7b044d4128f9ad0d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608348:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03000/0x7b044d4128f9ad0d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608353:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03000/0x7b044d4128f9ad0d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608358:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e03000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.608360:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03000/0x7b044d4128f9ad0d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608366:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03000/0x7b044d4128f9ad0d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608374:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x22eacdcf (ffff9f24975b2600) 00010000:00010000:0.0:1784938443.608376:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.608379:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03000/0x7b044d4128f9ad0d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608385:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03000/0x7b044d4128f9ad0d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608405:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03400/0x7b044d4128f9ad29 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608411:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03400/0x7b044d4128f9ad29 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608416:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03400/0x7b044d4128f9ad29 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608421:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e03400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.608423:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03400/0x7b044d4128f9ad29 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608429:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03400/0x7b044d4128f9ad29 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608436:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x57ba1cca (ffff9f2381d78200) 00010000:00010000:0.0:1784938443.608439:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.608441:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03400/0x7b044d4128f9ad29 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608446:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03400/0x7b044d4128f9ad29 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608477:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9ad45 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608483:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9ad45 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608490:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9ad45 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608495:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3dc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.608497:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9ad45 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608503:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9ad45 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608512:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x52815b39 (ffff9f24898dff00) 00010000:00010000:0.0:1784938443.608514:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.608517:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9ad45 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608523:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9ad45 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608541:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01e00/0x7b044d4128f9ad61 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608547:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01e00/0x7b044d4128f9ad61 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608553:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01e00/0x7b044d4128f9ad61 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608558:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e01e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.608560:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01e00/0x7b044d4128f9ad61 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608567:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01e00/0x7b044d4128f9ad61 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608579:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x89d48c8d (ffff9f2485293800) 00010000:00010000:0.0:1784938443.608582:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.608585:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01e00/0x7b044d4128f9ad61 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608591:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01e00/0x7b044d4128f9ad61 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608607:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d200/0x7b044d4128f9ad7d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608614:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d200/0x7b044d4128f9ad7d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608620:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d200/0x7b044d4128f9ad7d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608626:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3d200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.608629:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d200/0x7b044d4128f9ad7d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608635:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d200/0x7b044d4128f9ad7d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608642:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xa6e7eec (ffff9f24898dfa00) 00010000:00010000:0.0:1784938443.608645:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.608647:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d200/0x7b044d4128f9ad7d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608653:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d200/0x7b044d4128f9ad7d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608668:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9ad99 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608674:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9ad99 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608680:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9ad99 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608685:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e03200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.608688:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9ad99 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608693:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9ad99 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608701:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xd13f1037 (ffff9f2381d78b00) 00010000:00010000:0.0:1784938443.608703:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.608706:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9ad99 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608711:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03200/0x7b044d4128f9ad99 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608724:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c200/0x7b044d4128f9adb5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608731:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c200/0x7b044d4128f9adb5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608737:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c200/0x7b044d4128f9adb5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608743:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3c200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.608746:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c200/0x7b044d4128f9adb5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608752:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c200/0x7b044d4128f9adb5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608759:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xe3541c1d (ffff9f24898df400) 00010000:00010000:0.0:1784938443.608762:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.608765:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c200/0x7b044d4128f9adb5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608770:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3c200/0x7b044d4128f9adb5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608786:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d800/0x7b044d4128f9add1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608793:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d800/0x7b044d4128f9add1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608799:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d800/0x7b044d4128f9add1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608804:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3d800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.608807:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d800/0x7b044d4128f9add1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608813:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d800/0x7b044d4128f9add1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608824:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x267dbf88 (ffff9f24898dfe00) 00010000:00010000:0.0:1784938443.608826:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.608830:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d800/0x7b044d4128f9add1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608836:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3d800/0x7b044d4128f9add1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608863:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9aded lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608869:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9aded lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608875:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9aded lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.608881:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3cc00 already unused, calling callback (ffffffffc19a14f0) 00000100:00100000:2.0:1784938443.609374:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938443.609410:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350867328 00000100:00100000:2.0:1784938443.609417:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350867328 00000100:00100000:2.0:1784938443.609460:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 727 00000100:00100000:2.0:1784938443.609469:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:16389:x1871643350867328:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:2.0:1784938443.609497:0:25716:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:23 count 1 00010000:00010000:2.0:1784938443.609520:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec2e81e1/0x7b044d4128f9ccb7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.609538:0:25716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce6ccfc3/0x7b044d4128f9a0a3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663495 expref: 76 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.609546:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784938443.609550:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.609554:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec2e81e1/0x7b044d4128f9ccb7 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.609585:0:25716:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ce6ccfc3/0x7b044d4128f9a0a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663495 expref: 76 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.609599:0:25716:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ce6ccfc3/0x7b044d4128f9a0a3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663495 expref: 76 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.609612:0:25716:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd5a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25716:1871643350868352:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938443.609662:0:25716:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248fb1c900 going to sleep for 11 seconds 00000100:00100000:2.0:1784938443.609706:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938443.609726:0:25729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350867456 00000100:00100000:2.0:1784938443.609730:0:25729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350867456 00000100:00100000:2.0:1784938443.609754:0:25729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 728 00000100:00100000:2.0:1784938443.609760:0:25729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+18:16391:x1871643350867456:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:2.0:1784938443.609773:0:25729:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:38 count 1 00010000:00010000:2.0:1784938443.609786:0:25729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067784924/0x7b044d4128f9ccbe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.609798:0:25729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006839d5f0/0x7b044d4128f9a0b8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766349c expref: 76 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.609810:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784938443.609813:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.609817:0:25729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067784924/0x7b044d4128f9ccbe lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.609838:0:25729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006839d5f0/0x7b044d4128f9a0b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e94766349c expref: 76 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.609848:0:25729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006839d5f0/0x7b044d4128f9a0b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766349c expref: 76 pid: 25715 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.609857:0:25729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f2ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:25729:1871643350868480:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938443.609881:0:25729:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d3a4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938443.612528:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b35f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350868608:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1784938443.612600:0:16390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784938443.612607:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b3f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350868992:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1784938443.612648:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b3f3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350868736:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1784938443.612676:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784938443.612682:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b3f3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350868864:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1784938443.612748:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.612815:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.612839:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350867584 00000100:00100000:1.0:1784938443.612846:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350867584 00000100:00100000:1.0:1784938443.612884:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350868224 00000100:00100000:3.0:1784938443.613079:0:25726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 729 00000100:00100000:3.0:1784938443.613091:0:25726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+19:16391:x1871643350867584:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:3.0:1784938443.613118:0:25726:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:31 count 1 00010000:00010000:3.0:1784938443.613142:0:25726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9ccc5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.614670:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9aded lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.614688:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9aded lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.614708:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x72a71b3d (ffff9f24898dfd00) 00010000:00010000:0.0:1784938443.614711:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.614716:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9aded lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.614723:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9aded lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.614770:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03800/0x7b044d4128f9ae09 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.614779:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03800/0x7b044d4128f9ae09 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.614785:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03800/0x7b044d4128f9ae09 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.614791:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e03800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.614794:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03800/0x7b044d4128f9ae09 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.614799:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03800/0x7b044d4128f9ae09 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.614807:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xc2bba7e5 (ffff9f2381d78400) 00010000:00010000:0.0:1784938443.614809:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.614812:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03800/0x7b044d4128f9ae09 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.614817:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03800/0x7b044d4128f9ae09 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.614833:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ae25 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.614839:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ae25 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.614845:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ae25 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.614850:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.614853:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ae25 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.614858:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ae25 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.614865:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xe6b34bd0 (ffff9f248fb6cb00) 00010000:00010000:0.0:1784938443.614867:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.614870:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ae25 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.614876:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394200/0x7b044d4128f9ae25 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.616065:0:25726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003d7ba9d5/0x7b044d4128f9a0aa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476634aa expref: 76 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.616074:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1784938443.616078:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.616083:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9ccc5 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616255:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9ae41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616264:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9ae41 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616270:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9ae41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616275:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382395400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.616280:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9ae41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616286:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9ae41 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616301:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xc701cb36 (ffff9f248fb6c200) 00010000:00010000:0.0:1784938443.616304:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.616308:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9ae41 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616314:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382395400/0x7b044d4128f9ae41 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616342:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217dc00/0x7b044d4128f9ae5d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616349:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217dc00/0x7b044d4128f9ae5d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616354:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217dc00/0x7b044d4128f9ae5d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616358:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217dc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.616361:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217dc00/0x7b044d4128f9ae5d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616366:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217dc00/0x7b044d4128f9ae5d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616374:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xc735cef4 (ffff9f248aad5b00) 00010000:00010000:0.0:1784938443.616376:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.616379:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217dc00/0x7b044d4128f9ae5d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616385:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217dc00/0x7b044d4128f9ae5d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616436:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00600/0x7b044d4128f9ae79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616444:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00600/0x7b044d4128f9ae79 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616449:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00600/0x7b044d4128f9ae79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616454:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d00600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.616457:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00600/0x7b044d4128f9ae79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616463:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00600/0x7b044d4128f9ae79 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616471:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x6caa4986 (ffff9f248fb6c900) 00010000:00010000:0.0:1784938443.616473:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.616476:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00600/0x7b044d4128f9ae79 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616482:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00600/0x7b044d4128f9ae79 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616498:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02e00/0x7b044d4128f9ae95 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616504:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02e00/0x7b044d4128f9ae95 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616509:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02e00/0x7b044d4128f9ae95 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616514:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e02e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.616517:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02e00/0x7b044d4128f9ae95 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616522:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02e00/0x7b044d4128f9ae95 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616529:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x47a21a83 (ffff9f2381d78f00) 00010000:00010000:0.0:1784938443.616531:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.616534:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02e00/0x7b044d4128f9ae95 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616541:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02e00/0x7b044d4128f9ae95 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616556:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02800/0x7b044d4128f9aeb1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616562:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02800/0x7b044d4128f9aeb1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616567:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02800/0x7b044d4128f9aeb1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616572:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e02800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.616575:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02800/0x7b044d4128f9aeb1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616581:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02800/0x7b044d4128f9aeb1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616592:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x4958ff4 (ffff9f2381d78300) 00010000:00010000:0.0:1784938443.616595:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.616598:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02800/0x7b044d4128f9aeb1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616604:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02800/0x7b044d4128f9aeb1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616618:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28600/0x7b044d4128f9aecd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616624:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28600/0x7b044d4128f9aecd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616630:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28600/0x7b044d4128f9aecd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616636:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b28600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.616639:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28600/0x7b044d4128f9aecd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616645:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28600/0x7b044d4128f9aecd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616652:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x5b30f298 (ffff9f248fb6c700) 00010000:00010000:0.0:1784938443.616654:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.616657:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28600/0x7b044d4128f9aecd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616662:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28600/0x7b044d4128f9aecd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616677:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039e00/0x7b044d4128f9aee9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616683:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039e00/0x7b044d4128f9aee9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616689:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039e00/0x7b044d4128f9aee9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616694:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382039e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.616696:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039e00/0x7b044d4128f9aee9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616702:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039e00/0x7b044d4128f9aee9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616709:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x6b7bd7c (ffff9f248fb6c600) 00010000:00010000:0.0:1784938443.616711:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.616714:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039e00/0x7b044d4128f9aee9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616719:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039e00/0x7b044d4128f9aee9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616733:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217de00/0x7b044d4128f9af05 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616739:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217de00/0x7b044d4128f9af05 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616745:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217de00/0x7b044d4128f9af05 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616750:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217de00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.616753:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217de00/0x7b044d4128f9af05 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616759:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217de00/0x7b044d4128f9af05 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616766:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x56569231 (ffff9f24898dfb00) 00010000:00010000:0.0:1784938443.616768:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.616771:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217de00/0x7b044d4128f9af05 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616777:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217de00/0x7b044d4128f9af05 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616795:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02000/0x7b044d4128f9af21 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616801:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02000/0x7b044d4128f9af21 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616807:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02000/0x7b044d4128f9af21 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616813:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e02000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.616815:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02000/0x7b044d4128f9af21 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616820:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02000/0x7b044d4128f9af21 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616831:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x712be7d1 (ffff9f2381d78c00) 00010000:00010000:0.0:1784938443.616834:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.616836:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02000/0x7b044d4128f9af21 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616842:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02000/0x7b044d4128f9af21 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616857:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038600/0x7b044d4128f9af3d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616864:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038600/0x7b044d4128f9af3d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616869:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038600/0x7b044d4128f9af3d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616874:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382038600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.616876:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038600/0x7b044d4128f9af3d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616894:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038600/0x7b044d4128f9af3d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616903:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x239dea14 (ffff9f248fb6ce00) 00010000:00010000:0.0:1784938443.616906:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.616909:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038600/0x7b044d4128f9af3d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616916:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038600/0x7b044d4128f9af3d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616933:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9af59 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616940:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9af59 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616945:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9af59 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616951:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e03600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.616953:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9af59 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616960:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9af59 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616967:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x39c3d8fe (ffff9f2381d78500) 00010000:00010000:0.0:1784938443.616969:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.616971:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9af59 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616978:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03600/0x7b044d4128f9af59 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616992:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ce00/0x7b044d4128f9af75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.616998:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ce00/0x7b044d4128f9af75 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617004:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ce00/0x7b044d4128f9af75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617009:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217ce00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.617012:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ce00/0x7b044d4128f9af75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617019:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ce00/0x7b044d4128f9af75 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617026:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x9ca112ae (ffff9f248fb6bb00) 00010000:00010000:0.0:1784938443.617028:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.617031:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ce00/0x7b044d4128f9af75 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617037:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217ce00/0x7b044d4128f9af75 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617053:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01400/0x7b044d4128f9af91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617059:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01400/0x7b044d4128f9af91 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617065:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01400/0x7b044d4128f9af91 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617070:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e01400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.617073:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01400/0x7b044d4128f9af91 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617079:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01400/0x7b044d4128f9af91 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617089:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xa9dd9870 (ffff9f2485293400) 00010000:00010000:0.0:1784938443.617091:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.617094:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01400/0x7b044d4128f9af91 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617101:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01400/0x7b044d4128f9af91 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617116:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038c00/0x7b044d4128f9afad lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617122:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038c00/0x7b044d4128f9afad lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617164:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038c00/0x7b044d4128f9afad lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617171:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382038c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.617174:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038c00/0x7b044d4128f9afad lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617180:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038c00/0x7b044d4128f9afad lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617188:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x130bf32a (ffff9f248fb6cd00) 00010000:00010000:0.0:1784938443.617190:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.617194:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038c00/0x7b044d4128f9afad lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617199:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038c00/0x7b044d4128f9afad lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617215:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038000/0x7b044d4128f9afc9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617222:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038000/0x7b044d4128f9afc9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617228:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038000/0x7b044d4128f9afc9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617232:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382038000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.617235:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038000/0x7b044d4128f9afc9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617241:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038000/0x7b044d4128f9afc9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617248:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xe9fa0db8 (ffff9f24898ddb00) 00010000:00010000:0.0:1784938443.617250:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.617253:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038000/0x7b044d4128f9afc9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617258:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038000/0x7b044d4128f9afc9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617283:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d800/0x7b044d4128f9afe5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617290:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d800/0x7b044d4128f9afe5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617296:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d800/0x7b044d4128f9afe5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617301:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217d800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.617304:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d800/0x7b044d4128f9afe5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617310:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d800/0x7b044d4128f9afe5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617318:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x407c6222 (ffff9f248fb6b600) 00010000:00010000:0.0:1784938443.617331:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.617334:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d800/0x7b044d4128f9afe5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617340:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d800/0x7b044d4128f9afe5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617357:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9b01d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617364:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9b01d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617370:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9b01d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617375:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e03c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.617378:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9b01d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617384:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9b01d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617395:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa1c75412 (ffff9f2381d78a00) 00010000:00010000:0.0:1784938443.617397:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.617400:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9b01d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617406:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e03c00/0x7b044d4128f9b01d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617427:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00c00/0x7b044d4128f9b04e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb51c27aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617434:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00c00/0x7b044d4128f9b04e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb51c27aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617440:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00c00/0x7b044d4128f9b04e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb51c27aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617445:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.617448:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00c00/0x7b044d4128f9b04e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb51c27aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617454:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00c00/0x7b044d4128f9b04e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb51c27aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617462:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb51c27aa (ffff9f2485293200) 00010000:00010000:0.0:1784938443.617464:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.617467:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00c00/0x7b044d4128f9b04e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb51c27aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617472:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00c00/0x7b044d4128f9b04e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb51c27aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617487:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038a00/0x7b044d4128f9b086 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617493:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038a00/0x7b044d4128f9b086 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617499:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038a00/0x7b044d4128f9b086 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617503:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382038a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.617505:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038a00/0x7b044d4128f9b086 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617510:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038a00/0x7b044d4128f9b086 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617516:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf7e027e9 (ffff9f2387231c00) 00010000:00010000:0.0:1784938443.617519:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.617521:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038a00/0x7b044d4128f9b086 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617526:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038a00/0x7b044d4128f9b086 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf7e027e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617536:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039400/0x7b044d4128f9b08d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617542:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039400/0x7b044d4128f9b08d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617547:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039400/0x7b044d4128f9b08d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617551:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382039400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.617554:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039400/0x7b044d4128f9b08d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617559:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039400/0x7b044d4128f9b08d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617567:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1:0x0].0x0 (ffff9f2387231d00) 00010000:00010000:0.0:1784938443.617569:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.617571:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039400/0x7b044d4128f9b08d lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617576:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039400/0x7b044d4128f9b08d lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617588:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9b14a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617594:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9b14a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617600:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9b14a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617605:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e02200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.617608:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9b14a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617613:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9b14a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617624:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1:0x0].0xa1c75412 (ffff9f2381d78000) 00010000:00010000:0.0:1784938443.617627:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.617629:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9b14a lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617635:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02200/0x7b044d4128f9b14a lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617647:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b151 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617654:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b151 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617660:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b151 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617664:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e02600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.617667:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b151 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617674:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b151 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617680:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938443.617683:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.617686:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b151 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617691:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02600/0x7b044d4128f9b151 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617709:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fec00/0x7b044d4128f9b1b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617715:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fec00/0x7b044d4128f9b1b3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617720:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fec00/0x7b044d4128f9b1b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617725:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fec00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.617728:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fec00/0x7b044d4128f9b1b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617734:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fec00/0x7b044d4128f9b1b3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617741:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x45c0cf9c (ffff9f2381d78700) 00010000:00010000:0.0:1784938443.617744:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.617747:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fec00/0x7b044d4128f9b1b3 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617752:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fec00/0x7b044d4128f9b1b3 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617767:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b22a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617774:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b22a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617780:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b22a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617786:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823ff000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.617789:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b22a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617794:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b22a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617802:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x56569231 (ffff9f238dcb4a00) 00010000:00010000:0.0:1784938443.617804:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.617807:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b22a lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617814:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff000/0x7b044d4128f9b22a lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617828:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9b285 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617835:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9b285 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617840:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9b285 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617845:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217c800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.617847:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9b285 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617852:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9b285 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617863:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xa6e7eec (ffff9f248fb6be00) 00010000:00010000:0.0:1784938443.617865:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.617868:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9b285 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617874:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217c800/0x7b044d4128f9b285 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617890:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038200/0x7b044d4128f9b2e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617896:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038200/0x7b044d4128f9b2e0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617902:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038200/0x7b044d4128f9b2e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617907:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382038200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.617910:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038200/0x7b044d4128f9b2e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617916:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038200/0x7b044d4128f9b2e0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617922:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xe6b34bd0 (ffff9f248300af00) 00010000:00010000:0.0:1784938443.617924:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.617928:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038200/0x7b044d4128f9b2e0 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617933:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038200/0x7b044d4128f9b2e0 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617951:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe600/0x7b044d4128f9b33b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617958:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe600/0x7b044d4128f9b33b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617965:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe600/0x7b044d4128f9b33b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617969:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fe600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.617971:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe600/0x7b044d4128f9b33b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617977:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe600/0x7b044d4128f9b33b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617984:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x9ca112ae (ffff9f23823e3d00) 00010000:00010000:0.0:1784938443.617986:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.617989:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe600/0x7b044d4128f9b33b lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.617994:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe600/0x7b044d4128f9b33b lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618007:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b396 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618013:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b396 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618019:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b396 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618024:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823ff600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.618027:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b396 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618033:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b396 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618040:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x9fe9a331 (ffff9f23823e3400) 00010000:00010000:0.0:1784938443.618042:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.618045:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b396 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618051:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff600/0x7b044d4128f9b396 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618064:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b3f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618070:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b3f1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618076:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b3f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618082:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fea00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.618085:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b3f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618091:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b3f1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618102:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x151c8ac3 (ffff9f23823e3c00) 00010000:00010000:0.0:1784938443.618104:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.618107:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b3f1 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618114:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fea00/0x7b044d4128f9b3f1 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618128:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01800/0x7b044d4128f9b44c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618134:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01800/0x7b044d4128f9b44c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618141:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01800/0x7b044d4128f9b44c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618172:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e01800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.618175:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01800/0x7b044d4128f9b44c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618180:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01800/0x7b044d4128f9b44c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618188:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x15c8a56e (ffff9f2485293900) 00010000:00010000:0.0:1784938443.618190:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.618193:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01800/0x7b044d4128f9b44c lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618198:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01800/0x7b044d4128f9b44c lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618216:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b4a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618221:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b4a7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618226:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b4a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618231:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.618233:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b4a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618239:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b4a7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618246:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xe7eb4718 (ffff9f2485293f00) 00010000:00010000:0.0:1784938443.618248:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.618251:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b4a7 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618256:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00a00/0x7b044d4128f9b4a7 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618270:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b502 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618276:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b502 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618281:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b502 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618287:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823ffa00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.618290:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b502 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618296:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b502 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618303:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x48840fb6 (ffff9f23823e3a00) 00010000:00010000:0.0:1784938443.618305:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.618307:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b502 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.618313:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffa00/0x7b044d4128f9b502 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.618551:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938443.618657:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.618682:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337460480 00000100:00100000:2.0:1784938443.618690:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337460480 00000100:00100000:2.0:1784938443.618740:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 462 00000100:00100000:2.0:1784938443.618749:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f2c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+139:17096:x1871643337460480:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938443.618770:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938443.618788:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39400/0x7b044d4128f9cccc lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476641bc expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.618890:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9ccd3 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.618903:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9ccd3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.618912:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9ccd3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.618926:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42ce00/0x7b044d4128f9ccda lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x4d2290fc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.618932:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42ce00/0x7b044d4128f9ccda lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.618939:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42ce00/0x7b044d4128f9ccda lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938443.619289:0:24203:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x64:0x0], index 1: 0 00010000:00010000:2.0:1784938443.619452:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c800/0x7b044d4128f9cce1 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.619463:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c800/0x7b044d4128f9cce1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.619470:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c800/0x7b044d4128f9cce1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.619502:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9ccd3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.619508:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9ccd3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.619516:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9ccd3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.619522:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27cc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938443.619526:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9ccd3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.619532:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9ccd3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.619543:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938443.619546:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.619550:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9ccd3 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.619555:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9ccd3 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938443.619567:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002a708ddd reply state 00000000cfc2fc49 transno 8589934839 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42ce00/0x7b044d4128f9ccda lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.619579:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42ce00/0x7b044d4128f9ccda lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.619584:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x4d2290fc (ffff9f23861f4300) 00010000:00010000:2.0:1784938443.619587:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938443.619589:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938443.619619:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39400/0x7b044d4128f9cccc lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641bc expref: 142 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.619632:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c800/0x7b044d4128f9cce1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641bc expref: 141 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.619643:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x48:0x0].0x0 (ffff9f23861f4a00) 00010000:00010000:2.0:1784938443.619645:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938443.619648:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d42c800, rc 0) 00000100:00100000:2.0:1784938443.619702:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f2c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+142:17096:x1871643337460480:12345-192.168.202.54@tcp:101:cp.0 Request processed in 953us (1043us total) trans 8589934839 rc 0/0 00000100:00100000:2.0:1784938443.619709:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 462 00000100:00100000:2.0:1784938443.619869:0:25716:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd5a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25716:1871643350868352:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938443.619891:0:25716:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ec2e81e1/0x7b044d4128f9ccb7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.619970:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.619991:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337460608 00000100:00100000:2.0:1784938443.619998:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337460608 00010000:00010000:2.0:1784938443.620017:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ce6ccfc3/0x7b044d4128f9a0a3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663495 expref: 77 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.620042:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 336 00000100:00100000:2.0:1784938443.620048:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f2c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+77:10960:x1871643337460608:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938443.620061:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938443.620065:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ce6ccfc3/0x7b044d4128f9a0a3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663495 expref: 77 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.620076:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ce6ccfc3/0x7b044d4128f9a0a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663495 expref: 77 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.620098:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce6ccfc3/0x7b044d4128f9a0a3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663495 expref: 77 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.620111:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.620115:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.620121:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec2e81e1/0x7b044d4128f9ccb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.620130:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec2e81e1/0x7b044d4128f9ccb7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.620172:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938443.620194:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f2c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+76:10960:x1871643337460608:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 146us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938443.620200:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 336 00010000:00010000:2.0:1784938443.620221:0:25716:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ec2e81e1/0x7b044d4128f9ccb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.620229:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec2e81e1/0x7b044d4128f9ccb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.620238:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec2e81e1/0x7b044d4128f9ccb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.620245:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec2e81e1/0x7b044d4128f9ccb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.620264:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938443.620383:0:25726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003d7ba9d5/0x7b044d4128f9a0aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476634aa expref: 75 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.620397:0:25726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003d7ba9d5/0x7b044d4128f9a0aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476634aa expref: 75 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.620413:0:25726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f199f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:25726:1871643350869120:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938443.620466:0:25726:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2488eeccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938443.620622:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350868224 00000100:00100000:1.0:1784938443.620637:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350868096 00000100:00100000:1.0:1784938443.620639:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350868096 00000100:00100000:1.0:1784938443.620682:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 730 00000100:00100000:1.0:1784938443.620690:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f2caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:16391:x1871643350868096:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1784938443.620710:0:25715:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:30 count 1 00010000:00010000:1.0:1784938443.620729:0:25715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061bd733a/0x7b044d4128f9ccef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.620742:0:25715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000026699c1b/0x7b044d4128f9a75d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766369b expref: 69 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.620750:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1784938443.620753:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.620756:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061bd733a/0x7b044d4128f9ccef lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.620780:0:25715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000026699c1b/0x7b044d4128f9a75d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e94766369b expref: 69 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.620790:0:25715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000026699c1b/0x7b044d4128f9a75d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766369b expref: 69 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.620800:0:25715:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388245880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25715:1871643350869248:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938443.620830:0:25715:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485023b40 going to sleep for 11 seconds 00010000:00010000:1.0:1784938443.620848:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938443.620854:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec2e81e1/0x7b044d4128f9ccb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.620862:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db38000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938443.620866:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec2e81e1/0x7b044d4128f9ccb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.620875:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec2e81e1/0x7b044d4128f9ccb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.620887:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec2e81e1/0x7b044d4128f9ccb7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.620894:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec2e81e1/0x7b044d4128f9ccb7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.620913:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938443.620915:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938443.620916:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938443.620947:0:25718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 731 00000100:00100000:1.0:1784938443.620954:0:25718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:16389:x1871643350868224:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1784938443.620967:0:25718:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:23 count 1 00010000:00010000:1.0:1784938443.620978:0:25718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f9ccf6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.620989:0:25718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008ea8d30f/0x7b044d4128f9a772 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636a2 expref: 69 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.620997:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1784938443.620999:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.621003:0:25718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f9ccf6 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.621020:0:25718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008ea8d30f/0x7b044d4128f9a772 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636a2 expref: 69 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.621030:0:25718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008ea8d30f/0x7b044d4128f9a772 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636a2 expref: 69 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.621040:0:25718:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388246680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25718:1871643350869376:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938443.621064:0:25718:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d077cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938443.621128:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.621170:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350867200 00000100:00100000:1.0:1784938443.621174:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350867200 00000100:00100000:1.0:1784938443.621199:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 732 00000100:00100000:1.0:1784938443.621206:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388245500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:16389:x1871643350867200:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1784938443.621218:0:21149:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:27 count 1 00010000:00010000:1.0:1784938443.621231:0:21149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4ff9adf/0x7b044d4128f9ccfd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.621243:0:21149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f74bf49c/0x7b044d4128f9a400 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663671 expref: 69 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.621256:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1784938443.621259:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.621262:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4ff9adf/0x7b044d4128f9ccfd lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.621281:0:21149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f74bf49c/0x7b044d4128f9a400 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663671 expref: 69 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.621291:0:21149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f74bf49c/0x7b044d4128f9a400 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663671 expref: 69 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.621300:0:21149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388247b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:21149:1871643350869504:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938443.621342:0:21149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d077180 going to sleep for 11 seconds 00000100:00100000:1.0:1784938443.621453:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.621483:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.621506:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.621529:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.621553:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.621570:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.621584:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.621601:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.621617:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.621637:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.621650:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350867712 00000100:00100000:1.0:1784938443.621655:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350867712 00000100:00100000:1.0:1784938443.621674:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350868992 00000100:00100000:1.0:1784938443.621677:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350868992 00000100:00100000:1.0:1784938443.621685:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350866816 00000100:00100000:1.0:1784938443.621687:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350866816 00000100:00100000:1.0:1784938443.621695:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350868864 00000100:00100000:1.0:1784938443.621697:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350868864 00000100:00100000:1.0:1784938443.621704:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350866944 00000100:00100000:1.0:1784938443.621705:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350866944 00000100:00100000:1.0:1784938443.621729:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350867072 00000100:00100000:1.0:1784938443.621733:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350867072 00000100:00100000:1.0:1784938443.621742:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350867840 00000100:00100000:1.0:1784938443.621744:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350867840 00000100:00100000:1.0:1784938443.621751:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350867968 00000100:00100000:1.0:1784938443.621753:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350867968 00000100:00100000:1.0:1784938443.621761:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350868608 00000100:00100000:1.0:1784938443.621763:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350868608 00000100:00100000:1.0:1784938443.621770:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350868736 00000100:00100000:1.0:1784938443.621772:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350868736 00000100:00100000:1.0:1784938443.621782:0:25720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 733 00000100:00100000:1.0:1784938443.621788:0:25720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388246a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:16389:x1871643350867712:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1784938443.621801:0:25720:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:18 count 1 00010000:00010000:1.0:1784938443.621815:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba5ff4a4/0x7b044d4128f9cd04 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.621827:0:25720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000016aac480/0x7b044d4128f9a0b1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476634b1 expref: 75 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.621834:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1784938443.621837:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.621840:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba5ff4a4/0x7b044d4128f9cd04 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.621861:0:25720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000016aac480/0x7b044d4128f9a0b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476634b1 expref: 75 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.621871:0:25720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000016aac480/0x7b044d4128f9a0b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476634b1 expref: 75 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.621881:0:25720:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388246d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:25720:1871643350869632:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938443.621910:0:25720:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d077b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938443.621925:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 734 00000100:00100000:1.0:1784938443.621932:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:16390:x1871643350868992:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1784938443.621943:0:21629:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:28 count 1 00010000:00010000:1.0:1784938443.621954:0:21629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9bb6f8e/0x7b044d4128f9cd0b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.621965:0:21629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000038d84e22/0x7b044d4128f9a446 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766367f expref: 75 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.621971:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1784938443.621974:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.621977:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9bb6f8e/0x7b044d4128f9cd0b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.621995:0:21629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000038d84e22/0x7b044d4128f9a446 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e94766367f expref: 75 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.622008:0:21629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000038d84e22/0x7b044d4128f9a446 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766367f expref: 75 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.622017:0:21629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388247800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:21629:1871643350869760:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938443.622039:0:21629:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24917e70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938443.622811:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 735 00000100:00100000:3.0:1784938443.622825:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388245180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:16389:x1871643350866816:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:3.0:1784938443.622843:0:21152:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:40 count 1 00002000:00010000:3.0:1784938443.622869:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x6a63ff75, atime: 0x6a63ff75, ctime: 0x6a63ff75, blocks: 0x0 00010000:00010000:3.0:1784938443.622875:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000216039b/0x7b044d4128f9cd12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.622885:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1784938443.622888:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.622906:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000216039b/0x7b044d4128f9cd12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.622918:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000216039b/0x7b044d4128f9cd12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.622932:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000216039b/0x7b044d4128f9cd12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.622939:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000216039b/0x7b044d4128f9cd12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.622954:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784938443.623119:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388245180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:16389:x1871643350866816:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 297us (1610us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1784938443.623141:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 735 00000100:00100000:3.0:1784938443.623181:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 736 00000100:00100000:3.0:1784938443.623188:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:16391:x1871643350868864:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:3.0:1784938443.623200:0:21152:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00010000:00010000:3.0:1784938443.623212:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017474f15/0x7b044d4128f9cd19 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.623223:0:21152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000018dca04/0x7b044d4128f9a3f9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766366a expref: 75 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.623230:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1784938443.623233:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.623236:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017474f15/0x7b044d4128f9cd19 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.623261:0:21152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000018dca04/0x7b044d4128f9a3f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e94766366a expref: 75 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.623273:0:21152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000018dca04/0x7b044d4128f9a3f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766366a expref: 75 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.623285:0:21152:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd55ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:21152:1871643350869888:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938443.623332:0:21152:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238cd3fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938443.623359:0:25730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 737 00000100:00100000:3.0:1784938443.623367:0:25730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+24:16391:x1871643350866944:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:3.0:1784938443.623381:0:25730:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:9 count 1 00010000:00010000:3.0:1784938443.623392:0:25730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9cd20 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.623406:0:25730:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8fceeb1/0x7b044d4128f9a095 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476634a3 expref: 69 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.623413:0:25730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1784938443.623416:0:25730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.623419:0:25730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9cd20 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.623440:0:25730:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d8fceeb1/0x7b044d4128f9a095 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476634a3 expref: 69 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.623448:0:25730:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d8fceeb1/0x7b044d4128f9a095 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476634a3 expref: 69 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.623464:0:25730:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd55d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:25730:1871643350870016:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938443.623488:0:25730:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f249d7bab40 going to sleep for 11 seconds 00010000:00010000:1.0:1784938443.628869:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938443.628883:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000216039b/0x7b044d4128f9cd12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.628907:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938443.628912:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000216039b/0x7b044d4128f9cd12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.628924:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000216039b/0x7b044d4128f9cd12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.628946:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000216039b/0x7b044d4128f9cd12 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.628953:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000216039b/0x7b044d4128f9cd12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.628976:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938443.628978:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938443.628981:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938443.629228:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000004:00080000:1.0:1784938443.629345:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24b68d8380/2, rc 0, transno 4294967453 00000100:00100000:1.0:1784938443.629360:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350866816:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1784938443.629437:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350870144:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1784938443.629643:0:25715:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388245880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25715:1871643350869248:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938443.629664:0:25715:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000061bd733a/0x7b044d4128f9ccef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.629698:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.629732:0:25718:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388246680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25718:1871643350869376:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938443.629746:0:25718:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f9ccf6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.629791:0:21149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388247b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:21149:1871643350869504:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938443.629804:0:21149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4ff9adf/0x7b044d4128f9ccfd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.629844:0:25720:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388246d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:25720:1871643350869632:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938443.629858:0:25720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ba5ff4a4/0x7b044d4128f9cd04 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.629899:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.629921:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337460736 00000100:00100000:1.0:1784938443.629926:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337460736 00010000:00010000:1.0:1784938443.629955:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006839d5f0/0x7b044d4128f9a0b8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766349c expref: 76 pid: 25715 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.629980:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337461120 00000100:00100000:1.0:1784938443.629983:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337461120 00010000:00010000:1.0:1784938443.629995:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008ea8d30f/0x7b044d4128f9a772 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636a2 expref: 70 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.630015:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 337 00000100:00100000:1.0:1784938443.630023:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388244700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+76:10959:x1871643337460736:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.630035:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.630041:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006839d5f0/0x7b044d4128f9a0b8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766349c expref: 76 pid: 25715 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.630053:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006839d5f0/0x7b044d4128f9a0b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766349c expref: 76 pid: 25715 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.630075:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.630080:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.630087:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000067784924/0x7b044d4128f9ccbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.630096:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067784924/0x7b044d4128f9ccbe lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.630111:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.630135:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388244700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+76:10959:x1871643337460736:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 112us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.630165:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 337 00000100:00100000:1.0:1784938443.630184:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 338 00000100:00100000:1.0:1784938443.630191:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd256300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+70:10959:x1871643337461120:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.630198:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.630203:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008ea8d30f/0x7b044d4128f9a772 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636a2 expref: 70 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.630212:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008ea8d30f/0x7b044d4128f9a772 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636a2 expref: 70 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.630226:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ea8d30f/0x7b044d4128f9a772 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636a2 expref: 70 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.630236:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.630239:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.630243:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f9ccf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.630251:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f9ccf6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.630267:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.630286:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd256300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+69:10959:x1871643337461120:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 96us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.630296:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 338 00010000:00010000:1.0:1784938443.630318:0:25718:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f9ccf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.630339:0:25718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f9ccf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.630349:0:25718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f9ccf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.630356:0:25718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f9ccf6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.630371:0:25718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938443.630518:0:25718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:16389:x1871643350868224:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 9563us (17702us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1784938443.630526:0:25718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 731 00000100:00100000:1.0:1784938443.630539:0:25718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350870144 00000100:00100000:1.0:1784938443.630542:0:25718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350870144 00000100:00100000:1.0:1784938443.630558:0:25718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 738 00000100:00100000:1.0:1784938443.630565:0:25718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:16391:x1871643350867072:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1784938443.630585:0:25718:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:6 count 1 00010000:00010000:1.0:1784938443.630603:0:25718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9acc545/0x7b044d4128f9cd27 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.630616:0:25718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000077eceeb9/0x7b044d4128f9a415 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663663 expref: 68 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.630623:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1784938443.630627:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.630630:0:25718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9acc545/0x7b044d4128f9cd27 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.630651:0:25718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000077eceeb9/0x7b044d4128f9a415 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663663 expref: 68 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.630663:0:25718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000077eceeb9/0x7b044d4128f9a415 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663663 expref: 68 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.630675:0:25718:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd256d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25718:1871643350870272:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938443.630713:0:25718:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d077180 going to sleep for 11 seconds 00010000:00010000:1.0:1784938443.630725:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938443.630731:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f9ccf6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.630739:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c7400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938443.630743:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f9ccf6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.630753:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f9ccf6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.630771:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f9ccf6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.630779:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f9ccf6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.630796:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938443.630798:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938443.630800:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938443.630822:0:21629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388247800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:21629:1871643350869760:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938443.630836:0:21629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b9bb6f8e/0x7b044d4128f9cd0b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.630874:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.630893:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337461248 00000100:00100000:1.0:1784938443.630897:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337461248 00010000:00010000:1.0:1784938443.630912:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f74bf49c/0x7b044d4128f9a400 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663671 expref: 69 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.630932:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 339 00000100:00100000:1.0:1784938443.630938:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd257480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+69:10959:x1871643337461248:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.630946:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.630951:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f74bf49c/0x7b044d4128f9a400 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663671 expref: 69 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.630968:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f74bf49c/0x7b044d4128f9a400 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663671 expref: 69 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.630981:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f74bf49c/0x7b044d4128f9a400 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663671 expref: 69 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.630992:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.630996:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.631001:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4ff9adf/0x7b044d4128f9ccfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.631009:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4ff9adf/0x7b044d4128f9ccfd lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.631026:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.631044:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd257480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+68:10959:x1871643337461248:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 106us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.631051:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 339 00010000:00010000:1.0:1784938443.631072:0:21149:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4ff9adf/0x7b044d4128f9ccfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.631080:0:21149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4ff9adf/0x7b044d4128f9ccfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.631088:0:21149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4ff9adf/0x7b044d4128f9ccfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.631095:0:21149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4ff9adf/0x7b044d4128f9ccfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.631107:0:21149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938443.631204:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388245500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:16389:x1871643350867200:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 9998us (10075us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1784938443.631212:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 732 00000100:00100000:1.0:1784938443.631227:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 739 00000100:00100000:1.0:1784938443.631233:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388247100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:16389:x1871643350867840:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1784938443.631247:0:21149:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:35 count 1 00010000:00010000:1.0:1784938443.631259:0:21149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9cd2e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.631269:0:21149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b01e28b4/0x7b044d4128f9a423 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663678 expref: 67 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.631276:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1784938443.631279:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.631282:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9cd2e lrc: 4/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.631301:0:21149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b01e28b4/0x7b044d4128f9a423 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663678 expref: 67 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.631317:0:21149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b01e28b4/0x7b044d4128f9a423 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663678 expref: 67 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.631339:0:21149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd255500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:21149:1871643350870400:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938443.631370:0:21149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d077cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1784938443.631382:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938443.631386:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4ff9adf/0x7b044d4128f9ccfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.631394:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c7c00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938443.631397:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4ff9adf/0x7b044d4128f9ccfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.631404:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4ff9adf/0x7b044d4128f9ccfd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.631416:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4ff9adf/0x7b044d4128f9ccfd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.631422:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4ff9adf/0x7b044d4128f9ccfd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.631436:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938443.631438:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938443.631441:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938443.631485:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.631501:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337460992 00000100:00100000:1.0:1784938443.631505:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337460992 00010000:00010000:1.0:1784938443.631523:0:25731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000026699c1b/0x7b044d4128f9a75d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766369b expref: 68 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.631543:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 340 00000100:00100000:1.0:1784938443.631549:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd254e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+68:10958:x1871643337460992:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.631557:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.631561:0:25731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000026699c1b/0x7b044d4128f9a75d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766369b expref: 68 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.631570:0:25731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000026699c1b/0x7b044d4128f9a75d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766369b expref: 68 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.631582:0:25731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026699c1b/0x7b044d4128f9a75d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766369b expref: 68 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.631591:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.631594:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.631599:0:25731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000061bd733a/0x7b044d4128f9ccef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.631607:0:25731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061bd733a/0x7b044d4128f9ccef lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.631628:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.631648:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd254e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+67:10958:x1871643337460992:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 99us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.631654:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 340 00010000:00010000:1.0:1784938443.631673:0:25715:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000061bd733a/0x7b044d4128f9ccef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.631681:0:25715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061bd733a/0x7b044d4128f9ccef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.631689:0:25715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061bd733a/0x7b044d4128f9ccef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.631696:0:25715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061bd733a/0x7b044d4128f9ccef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.631709:0:25715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938443.631773:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f2caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+26:16391:x1871643350868096:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 11084us (13225us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1784938443.631780:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 730 00000100:00100000:1.0:1784938443.631797:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 740 00000100:00100000:1.0:1784938443.631802:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+25:16391:x1871643350867968:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1784938443.631816:0:25715:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:17 count 1 00010000:00010000:1.0:1784938443.631827:0:25715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049f52d48/0x7b044d4128f9cd35 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.631839:0:25715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000016494a26/0x7b044d4128f9a40e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766368d expref: 66 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.631846:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1784938443.631849:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.631852:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049f52d48/0x7b044d4128f9cd35 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.631871:0:25715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000016494a26/0x7b044d4128f9a40e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e94766368d expref: 66 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.631879:0:25715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000016494a26/0x7b044d4128f9a40e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766368d expref: 66 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.631889:0:25715:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd254380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25715:1871643350870528:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938443.631914:0:25715:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24917e70c0 going to sleep for 11 seconds 00010000:00010000:1.0:1784938443.631927:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938443.631931:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061bd733a/0x7b044d4128f9ccef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.631938:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c7a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938443.631941:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061bd733a/0x7b044d4128f9ccef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.631952:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061bd733a/0x7b044d4128f9ccef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.631961:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061bd733a/0x7b044d4128f9ccef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.631968:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061bd733a/0x7b044d4128f9ccef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.631982:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938443.631984:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938443.631985:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938443.632030:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.632047:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337461504 00000100:00100000:1.0:1784938443.632051:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337461504 00010000:00010000:1.0:1784938443.632067:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000038d84e22/0x7b044d4128f9a446 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766367f expref: 76 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.632087:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 341 00000100:00100000:1.0:1784938443.632093:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2488a65050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+76:10958:x1871643337461504:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.632101:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.632106:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000038d84e22/0x7b044d4128f9a446 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766367f expref: 76 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.632116:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000038d84e22/0x7b044d4128f9a446 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766367f expref: 76 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.632130:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038d84e22/0x7b044d4128f9a446 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766367f expref: 76 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.632142:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.632185:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.632189:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b9bb6f8e/0x7b044d4128f9cd0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.632197:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9bb6f8e/0x7b044d4128f9cd0b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.632214:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.632234:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2488a65050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+75:10958:x1871643337461504:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 140us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.632241:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 341 00010000:00010000:1.0:1784938443.632288:0:21629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b9bb6f8e/0x7b044d4128f9cd0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.632296:0:21629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9bb6f8e/0x7b044d4128f9cd0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.632303:0:21629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9bb6f8e/0x7b044d4128f9cd0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.632309:0:21629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9bb6f8e/0x7b044d4128f9cd0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.632858:0:25723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 741 00000100:00100000:2.0:1784938443.632869:0:25723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+24:16390:x1871643350868608:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:2.0:1784938443.632898:0:25723:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:22 count 1 00010000:00010000:2.0:1784938443.632915:0:25723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c44d6e18/0x7b044d4128f9cd3c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.632929:0:25723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000031260482/0x7b044d4128f9a09c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476634b8 expref: 74 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.632937:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784938443.632939:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.632943:0:25723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c44d6e18/0x7b044d4128f9cd3c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.632966:0:25723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000031260482/0x7b044d4128f9a09c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476634b8 expref: 74 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.632976:0:25723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000031260482/0x7b044d4128f9a09c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476634b8 expref: 74 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.632988:0:25723:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f2c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:25723:1871643350870656:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938443.633037:0:25723:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d3a4180 going to sleep for 11 seconds 00000100:00100000:2.0:1784938443.633055:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 742 00000100:00100000:2.0:1784938443.633062:0:25721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388246300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+24:16391:x1871643350868736:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:2.0:1784938443.633097:0:25721:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:37 count 1 00010000:00010000:2.0:1784938443.633109:0:25721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d1223b5/0x7b044d4128f9cd43 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.633120:0:25721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005979dcbb/0x7b044d4128f9a41c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766365c expref: 74 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.633141:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784938443.633159:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.633162:0:25721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d1223b5/0x7b044d4128f9cd43 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.633184:0:25721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005979dcbb/0x7b044d4128f9a41c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e94766365c expref: 74 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.633194:0:25721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005979dcbb/0x7b044d4128f9a41c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766365c expref: 74 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.633205:0:25721:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f2c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:25721:1871643350870784:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938443.633225:0:25721:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d3a4900 going to sleep for 11 seconds 00000100:00100000:2.0:1784938443.633244:0:25728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 743 00000100:00100000:2.0:1784938443.633253:0:25728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+25:16390:x1871643350870144:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:2.0:1784938443.633266:0:25728:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:8 count 1 00010000:00010000:2.0:1784938443.633279:0:25728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfc96367/0x7b044d4128f9cd4a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.633292:0:25728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000986122ce/0x7b044d4128f9a748 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636a9 expref: 66 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.633299:0:25728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784938443.633301:0:25728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.633305:0:25728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfc96367/0x7b044d4128f9cd4a lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.633335:0:25728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000986122ce/0x7b044d4128f9a748 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636a9 expref: 66 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.633345:0:25728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000986122ce/0x7b044d4128f9a748 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636a9 expref: 66 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.633355:0:25728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd5a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:25728:1871643350870912:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938443.633376:0:25728:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d3a4480 going to sleep for 11 seconds 00000100:00100000:2.0:1784938443.633446:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.633500:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.633676:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+25:16389:x1871643350867328:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 24207us (24305us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1784938443.633684:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 727 00010000:00010000:2.0:1784938443.633814:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938443.633819:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9bb6f8e/0x7b044d4128f9cd0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.633833:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938443.633837:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9bb6f8e/0x7b044d4128f9cd0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.633845:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9bb6f8e/0x7b044d4128f9cd0b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.633860:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9bb6f8e/0x7b044d4128f9cd0b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.633868:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938443.633869:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.634187:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b55d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634197:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b55d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634203:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b55d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634208:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e01200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.634213:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b55d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634219:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b55d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634234:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x48e4a31f (ffff9f2485293300) 00010000:00010000:0.0:1784938443.634237:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.634240:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b55d lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634246:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01200/0x7b044d4128f9b55d lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634270:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4e00/0x7b044d4128f9b5b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634276:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4e00/0x7b044d4128f9b5b8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634282:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4e00/0x7b044d4128f9b5b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634287:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9e4e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.634290:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4e00/0x7b044d4128f9b5b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634297:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4e00/0x7b044d4128f9b5b8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634304:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xbf79d746 (ffff9f23823e3000) 00010000:00010000:0.0:1784938443.634307:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.634309:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4e00/0x7b044d4128f9b5b8 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634314:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4e00/0x7b044d4128f9b5b8 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634342:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4400/0x7b044d4128f9b613 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634349:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4400/0x7b044d4128f9b613 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634355:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4400/0x7b044d4128f9b613 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634360:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9e4400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.634363:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4400/0x7b044d4128f9b613 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634370:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4400/0x7b044d4128f9b613 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634377:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xb34b709f (ffff9f23823e2000) 00010000:00010000:0.0:1784938443.634380:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.634383:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4400/0x7b044d4128f9b613 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634388:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4400/0x7b044d4128f9b613 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634402:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039600/0x7b044d4128f9b66e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634408:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039600/0x7b044d4128f9b66e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634413:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039600/0x7b044d4128f9b66e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634419:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382039600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.634421:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039600/0x7b044d4128f9b66e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634427:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039600/0x7b044d4128f9b66e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634435:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x9b815f19 (ffff9f23861f4000) 00010000:00010000:0.0:1784938443.634437:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.634440:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039600/0x7b044d4128f9b66e lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634446:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039600/0x7b044d4128f9b66e lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634464:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039c00/0x7b044d4128f9b6c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634470:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039c00/0x7b044d4128f9b6c9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634476:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039c00/0x7b044d4128f9b6c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634481:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382039c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.634483:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039c00/0x7b044d4128f9b6c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634488:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039c00/0x7b044d4128f9b6c9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634499:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xe9fa0db8 (ffff9f23861f4200) 00010000:00010000:0.0:1784938443.634502:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.634505:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039c00/0x7b044d4128f9b6c9 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634510:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039c00/0x7b044d4128f9b6c9 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634524:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9b724 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634530:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9b724 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634536:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9b724 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634541:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5db400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.634543:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9b724 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634549:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9b724 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634556:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xc025ca7 (ffff9f23823e2400) 00010000:00010000:0.0:1784938443.634558:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.634561:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9b724 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634567:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5db400/0x7b044d4128f9b724 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634582:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031400/0x7b044d4128f9b77f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634588:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031400/0x7b044d4128f9b77f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634593:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031400/0x7b044d4128f9b77f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634598:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2480031400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.634601:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031400/0x7b044d4128f9b77f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634606:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031400/0x7b044d4128f9b77f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634613:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xecc4f14 (ffff9f23823e2d00) 00010000:00010000:0.0:1784938443.634615:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.634618:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031400/0x7b044d4128f9b77f lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634623:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031400/0x7b044d4128f9b77f lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634638:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b7da lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634644:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b7da lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634649:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b7da lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634654:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.634657:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b7da lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634662:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b7da lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634669:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x712be7d1 (ffff9f238dd49900) 00010000:00010000:0.0:1784938443.634671:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.634674:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b7da lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634680:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00000/0x7b044d4128f9b7da lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634695:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9b835 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634701:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9b835 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634706:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9b835 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634710:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27c800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.634713:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9b835 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634718:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9b835 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634730:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x4ee593e6 (ffff9f23823e2700) 00010000:00010000:0.0:1784938443.634732:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.634735:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9b835 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634741:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9b835 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634758:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b890 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634764:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b890 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634769:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b890 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634774:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d00c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.634777:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b890 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634783:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b890 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634790:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xf0a46efb (ffff9f238dd49300) 00010000:00010000:0.0:1784938443.634792:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.634795:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b890 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634800:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00c00/0x7b044d4128f9b890 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634815:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ae00/0x7b044d4128f9b8eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634821:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ae00/0x7b044d4128f9b8eb lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634827:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ae00/0x7b044d4128f9b8eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634832:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db7ae00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.634834:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ae00/0x7b044d4128f9b8eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634840:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ae00/0x7b044d4128f9b8eb lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634848:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x267dbf88 (ffff9f24898dc100) 00010000:00010000:0.0:1784938443.634850:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.634853:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ae00/0x7b044d4128f9b8eb lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634858:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ae00/0x7b044d4128f9b8eb lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634872:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039a00/0x7b044d4128f9b946 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634879:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039a00/0x7b044d4128f9b946 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634898:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039a00/0x7b044d4128f9b946 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634903:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382039a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.634906:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039a00/0x7b044d4128f9b946 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634911:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039a00/0x7b044d4128f9b946 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634918:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xd946e4d2 (ffff9f24898dc700) 00010000:00010000:0.0:1784938443.634920:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.634923:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039a00/0x7b044d4128f9b946 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634929:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039a00/0x7b044d4128f9b946 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634944:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ac00/0x7b044d4128f9b9a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634950:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ac00/0x7b044d4128f9b9a1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634957:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ac00/0x7b044d4128f9b9a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634961:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db7ac00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.634964:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ac00/0x7b044d4128f9b9a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634969:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ac00/0x7b044d4128f9b9a1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634979:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x7584afcd (ffff9f24898dc900) 00010000:00010000:0.0:1784938443.634982:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.634984:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ac00/0x7b044d4128f9b9a1 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.634989:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7ac00/0x7b044d4128f9b9a1 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635005:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379c000/0x7b044d4128f9b9fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635011:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379c000/0x7b044d4128f9b9fc lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635261:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379c000/0x7b044d4128f9b9fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635267:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b379c000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.635271:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379c000/0x7b044d4128f9b9fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635278:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379c000/0x7b044d4128f9b9fc lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635287:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xf4c8ca43 (ffff9f24898dcc00) 00010000:00010000:0.0:1784938443.635289:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.635292:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379c000/0x7b044d4128f9b9fc lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635298:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379c000/0x7b044d4128f9b9fc lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635317:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394c00/0x7b044d4128f9ba57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635334:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394c00/0x7b044d4128f9ba57 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635341:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394c00/0x7b044d4128f9ba57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635346:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.635349:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394c00/0x7b044d4128f9ba57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635356:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394c00/0x7b044d4128f9ba57 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635363:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x130bf32a (ffff9f248fb6bd00) 00010000:00010000:0.0:1784938443.635366:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.635369:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394c00/0x7b044d4128f9ba57 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635375:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394c00/0x7b044d4128f9ba57 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635393:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9bab2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635399:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9bab2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635405:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9bab2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635410:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fc800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.635412:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9bab2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635417:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9bab2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635423:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xe00215d9 (ffff9f238dd49000) 00010000:00010000:0.0:1784938443.635425:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.635428:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9bab2 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635434:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fc800/0x7b044d4128f9bab2 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635448:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625fa00/0x7b044d4128f9bb0d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635455:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625fa00/0x7b044d4128f9bb0d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635461:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625fa00/0x7b044d4128f9bb0d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635465:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c625fa00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.635468:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625fa00/0x7b044d4128f9bb0d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635473:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625fa00/0x7b044d4128f9bb0d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635482:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x868dff87 (ffff9f24898dc800) 00010000:00010000:0.0:1784938443.635485:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.635487:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625fa00/0x7b044d4128f9bb0d lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635492:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625fa00/0x7b044d4128f9bb0d lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635505:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7400/0x7b044d4128f9bb68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635510:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7400/0x7b044d4128f9bb68 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635516:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7400/0x7b044d4128f9bb68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635520:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a7400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.635523:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7400/0x7b044d4128f9bb68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635528:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7400/0x7b044d4128f9bb68 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635533:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x39c3d8fe (ffff9f2487e3a400) 00010000:00010000:0.0:1784938443.635535:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.635538:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7400/0x7b044d4128f9bb68 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635544:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7400/0x7b044d4128f9bb68 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635557:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9bbc3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635563:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9bbc3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635570:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9bbc3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635573:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.635576:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9bbc3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635582:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9bbc3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635588:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x5b30f298 (ffff9f23823e2c00) 00010000:00010000:0.0:1784938443.635590:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.635593:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9bbc3 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635598:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35000/0x7b044d4128f9bbc3 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635610:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9bc1e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635617:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9bc1e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635622:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9bc1e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635627:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a6a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.635630:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9bc1e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635635:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9bc1e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635642:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x2893e4db (ffff9f2487e3a100) 00010000:00010000:0.0:1784938443.635644:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.635647:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9bc1e lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635653:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9bc1e lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635666:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9bc79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635672:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9bc79 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635679:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9bc79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635683:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.635686:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9bc79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635693:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9bc79 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635704:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x49aa722d (ffff9f23872e6000) 00010000:00010000:0.0:1784938443.635706:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.635709:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9bc79 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635715:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394000/0x7b044d4128f9bc79 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635728:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9bcd4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635735:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9bcd4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635741:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9bcd4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635747:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b34200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.635749:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9bcd4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635755:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9bcd4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635763:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x4c7a76ee (ffff9f23823e1f00) 00010000:00010000:0.0:1784938443.635765:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.635768:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9bcd4 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635774:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9bcd4 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635789:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9bd2f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635795:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9bd2f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635802:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9bd2f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635807:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238238a000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.635810:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9bd2f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635816:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9bd2f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635823:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x610aa076 (ffff9f248fb6aa00) 00010000:00010000:0.0:1784938443.635825:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.635828:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9bd2f lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635833:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238238a000/0x7b044d4128f9bd2f lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635847:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9bd8a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635853:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9bd8a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635858:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9bd8a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635863:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d01800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.635866:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9bd8a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635872:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9bd8a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.635879:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x72a71b3d (ffff9f238dd4a200) 00010000:00010000:0.0:1784938443.636004:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.636009:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9bd8a lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636081:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d01800/0x7b044d4128f9bd8a lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636103:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9bde5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636110:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9bde5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636117:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9bde5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636122:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2480030800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.636215:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9bde5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636224:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9bde5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636236:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xa9dd9870 (ffff9f23823e1300) 00010000:00010000:0.0:1784938443.636238:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.636241:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9bde5 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636247:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030800/0x7b044d4128f9bde5 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636264:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9be40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636271:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9be40 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636277:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9be40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636282:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.636285:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9be40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636292:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9be40 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636299:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x839e9634 (ffff9f248fb6a400) 00010000:00010000:0.0:1784938443.636301:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.636304:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9be40 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636309:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394a00/0x7b044d4128f9be40 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636336:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9be9b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636343:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9be9b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636348:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9be9b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636352:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a6400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.636354:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9be9b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636359:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9be9b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636366:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x9e90f16b (ffff9f2487e3ae00) 00010000:00010000:0.0:1784938443.636368:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.636371:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9be9b lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636376:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9be9b lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636391:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9bef6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636396:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9bef6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636401:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9bef6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636406:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3da00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.636409:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9bef6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636414:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9bef6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636421:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x10fe8da8 (ffff9f23823dc800) 00010000:00010000:0.0:1784938443.636423:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.636426:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9bef6 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636430:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3da00/0x7b044d4128f9bef6 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636446:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bf51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636452:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bf51 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636457:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bf51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636462:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fcc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.636464:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bf51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636469:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bf51 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636477:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x6b7bd7c (ffff9f238dd4a900) 00010000:00010000:0.0:1784938443.636480:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.636482:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bf51 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636487:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fcc00/0x7b044d4128f9bf51 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636499:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8aa00/0x7b044d4128f9bfac lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636504:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8aa00/0x7b044d4128f9bfac lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636510:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8aa00/0x7b044d4128f9bfac lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636514:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b6b8aa00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.636516:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8aa00/0x7b044d4128f9bfac lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636522:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8aa00/0x7b044d4128f9bfac lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636528:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x37dcc2d3 (ffff9f23823dc400) 00010000:00010000:0.0:1784938443.636530:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.636533:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8aa00/0x7b044d4128f9bfac lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636538:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8aa00/0x7b044d4128f9bfac lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636556:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9c007 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636562:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9c007 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636567:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9c007 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636571:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3ec00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.636573:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9c007 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636577:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9c007 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636584:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xa4bfea24 (ffff9f238dd4a000) 00010000:00010000:0.0:1784938443.636585:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.636587:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9c007 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636592:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9c007 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636604:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9c062 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636609:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9c062 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636613:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9c062 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636618:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3f000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.636620:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9c062 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636625:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9c062 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636631:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xc2bba7e5 (ffff9f238727c700) 00010000:00010000:0.0:1784938443.636633:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.636635:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9c062 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636640:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9c062 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636653:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9c0bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636659:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9c0bd lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636664:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9c0bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636669:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a7a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.636672:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9c0bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636678:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9c0bd lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636689:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x2fbacb41 (ffff9f2487e3a500) 00010000:00010000:0.0:1784938443.636691:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.636694:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9c0bd lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636699:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9c0bd lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636713:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20be00/0x7b044d4128f9c118 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636719:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20be00/0x7b044d4128f9c118 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636724:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20be00/0x7b044d4128f9c118 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636729:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f20be00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.636732:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20be00/0x7b044d4128f9c118 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636739:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20be00/0x7b044d4128f9c118 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636746:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xff118af2 (ffff9f23823e1100) 00010000:00010000:0.0:1784938443.636748:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.636750:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20be00/0x7b044d4128f9c118 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636755:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20be00/0x7b044d4128f9c118 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636770:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9c173 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636777:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9c173 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636783:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9c173 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636787:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b379ca00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.636790:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9c173 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636796:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9c173 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636803:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xb2d5a33e (ffff9f24898dc300) 00010000:00010000:0.0:1784938443.636805:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.636808:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9c173 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636814:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379ca00/0x7b044d4128f9c173 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636826:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9c1ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636832:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9c1ce lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636837:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9c1ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636843:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.636845:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9c1ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636850:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9c1ce lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636856:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x4958ff4 (ffff9f238727c100) 00010000:00010000:0.0:1784938443.636858:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.636861:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9c1ce lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636867:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9c1ce lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636881:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0000/0x7b044d4128f9c229 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636899:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0000/0x7b044d4128f9c229 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636905:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0000/0x7b044d4128f9c229 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636912:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf0000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.636914:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0000/0x7b044d4128f9c229 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636921:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0000/0x7b044d4128f9c229 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636932:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x57ba1cca (ffff9f238727c500) 00010000:00010000:0.0:1784938443.636935:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.636938:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0000/0x7b044d4128f9c229 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636943:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0000/0x7b044d4128f9c229 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636958:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244c00/0x7b044d4128f9c379 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636965:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244c00/0x7b044d4128f9c379 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636972:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244c00/0x7b044d4128f9c379 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636976:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f244c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.636979:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244c00/0x7b044d4128f9c379 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636985:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244c00/0x7b044d4128f9c379 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.636992:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x407c6222 (ffff9f238d49e800) 00010000:00010000:0.0:1784938443.636994:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.636997:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244c00/0x7b044d4128f9c379 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.637002:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244c00/0x7b044d4128f9c379 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.640696:0:25729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006839d5f0/0x7b044d4128f9a0b8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766349c expref: 74 pid: 25715 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.640724:0:25729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f2ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:25729:1871643350868480:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938443.640750:0:25729:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000067784924/0x7b044d4128f9ccbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.640763:0:25729:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000067784924/0x7b044d4128f9ccbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.640771:0:25729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067784924/0x7b044d4128f9ccbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.640784:0:25729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067784924/0x7b044d4128f9ccbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.640791:0:25729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067784924/0x7b044d4128f9ccbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.640860:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d000/0x7b044d4128f9c4de lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.640872:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d000/0x7b044d4128f9c4de lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.640878:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d000/0x7b044d4128f9c4de lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.640890:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24d000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.640895:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d000/0x7b044d4128f9c4de lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.640904:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d000/0x7b044d4128f9c4de lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.640918:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x239dea14 (ffff9f248390a700) 00010000:00010000:0.0:1784938443.640922:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.640927:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d000/0x7b044d4128f9c4de lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.640934:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d000/0x7b044d4128f9c4de lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.640964:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244a00/0x7b044d4128f9c539 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.640970:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244a00/0x7b044d4128f9c539 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.640976:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244a00/0x7b044d4128f9c539 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.640981:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f244a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.640984:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244a00/0x7b044d4128f9c539 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.640990:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244a00/0x7b044d4128f9c539 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.640998:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x130f79e0 (ffff9f238d49e500) 00010000:00010000:0.0:1784938443.641001:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.641003:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244a00/0x7b044d4128f9c539 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641008:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244a00/0x7b044d4128f9c539 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641285:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0600/0x7b044d4128f9c594 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641294:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0600/0x7b044d4128f9c594 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641300:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0600/0x7b044d4128f9c594 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641305:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf0600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.641308:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0600/0x7b044d4128f9c594 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641314:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0600/0x7b044d4128f9c594 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641337:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xc735cef4 (ffff9f238727c300) 00010000:00010000:0.0:1784938443.641340:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.641343:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0600/0x7b044d4128f9c594 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641349:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0600/0x7b044d4128f9c594 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641369:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24dc00/0x7b044d4128f9c5ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641375:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24dc00/0x7b044d4128f9c5ef lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641380:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24dc00/0x7b044d4128f9c5ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641385:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24dc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.641388:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24dc00/0x7b044d4128f9c5ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641395:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24dc00/0x7b044d4128f9c5ef lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641402:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x21aa2247 (ffff9f248390aa00) 00010000:00010000:0.0:1784938443.641405:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.641408:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24dc00/0x7b044d4128f9c5ef lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641414:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24dc00/0x7b044d4128f9c5ef lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641428:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6400/0x7b044d4128f9c64a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641434:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6400/0x7b044d4128f9c64a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641439:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6400/0x7b044d4128f9c64a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641443:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f6400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.641446:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6400/0x7b044d4128f9c64a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641451:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6400/0x7b044d4128f9c64a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641458:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xbf580d0c (ffff9f23823e0400) 00010000:00010000:0.0:1784938443.641460:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.641463:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6400/0x7b044d4128f9c64a lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641468:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6400/0x7b044d4128f9c64a lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641480:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1800/0x7b044d4128f9c6a5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641485:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1800/0x7b044d4128f9c6a5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641490:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1800/0x7b044d4128f9c6a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641495:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.641498:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1800/0x7b044d4128f9c6a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641503:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1800/0x7b044d4128f9c6a5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641509:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xe3541c1d (ffff9f238727cb00) 00010000:00010000:0.0:1784938443.641512:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.641514:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1800/0x7b044d4128f9c6a5 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641520:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1800/0x7b044d4128f9c6a5 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641533:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0e00/0x7b044d4128f9c700 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641540:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0e00/0x7b044d4128f9c700 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641546:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0e00/0x7b044d4128f9c700 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641550:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf0e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.641553:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0e00/0x7b044d4128f9c700 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641560:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0e00/0x7b044d4128f9c700 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641571:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x89d48c8d (ffff9f2496483c00) 00010000:00010000:0.0:1784938443.641573:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.641577:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0e00/0x7b044d4128f9c700 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641582:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0e00/0x7b044d4128f9c700 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641595:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9c75b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641601:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9c75b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641606:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9c75b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641611:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.641614:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9c75b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641619:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9c75b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641625:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xa38d6329 (ffff9f2496483600) 00010000:00010000:0.0:1784938443.641627:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.641630:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9c75b lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641635:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9c75b lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641648:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7600/0x7b044d4128f9c7b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641654:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7600/0x7b044d4128f9c7b6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641659:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7600/0x7b044d4128f9c7b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641665:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f7600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.641667:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7600/0x7b044d4128f9c7b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641673:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7600/0x7b044d4128f9c7b6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641680:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xbb599949 (ffff9f23823e0f00) 00010000:00010000:0.0:1784938443.641682:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.641685:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7600/0x7b044d4128f9c7b6 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641691:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7600/0x7b044d4128f9c7b6 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641704:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d400/0x7b044d4128f9c811 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641709:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d400/0x7b044d4128f9c811 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641714:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d400/0x7b044d4128f9c811 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641720:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24d400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.641722:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d400/0x7b044d4128f9c811 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641728:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d400/0x7b044d4128f9c811 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641736:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x1a616f3f (ffff9f248390a800) 00010000:00010000:0.0:1784938443.641738:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.641741:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d400/0x7b044d4128f9c811 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641747:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24d400/0x7b044d4128f9c811 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641760:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6200/0x7b044d4128f9c86c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641766:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6200/0x7b044d4128f9c86c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641771:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6200/0x7b044d4128f9c86c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641776:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f6200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.641778:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6200/0x7b044d4128f9c86c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641782:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6200/0x7b044d4128f9c86c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641792:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x6d38f012 (ffff9f23823e0300) 00010000:00010000:0.0:1784938443.641795:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.641797:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6200/0x7b044d4128f9c86c lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641802:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6200/0x7b044d4128f9c86c lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641814:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c8c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641819:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c8c7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641824:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c8c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641829:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f6600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.641831:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c8c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641837:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c8c7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641843:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x52815b39 (ffff9f23823e0c00) 00010000:00010000:0.0:1784938443.641845:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.641848:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c8c7 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641852:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9c8c7 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641865:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9c922 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641870:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9c922 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641876:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9c922 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641881:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f7e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.641883:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9c922 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641890:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9c922 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641897:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x9cfce7b5 (ffff9f23823e0500) 00010000:00010000:0.0:1784938443.641899:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.641901:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9c922 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641907:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9c922 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641920:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d200/0x7b044d4128f9c97d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641925:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d200/0x7b044d4128f9c97d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641931:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d200/0x7b044d4128f9c97d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641936:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27d200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.641939:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d200/0x7b044d4128f9c97d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641944:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d200/0x7b044d4128f9c97d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641950:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xe708c894 (ffff9f238d49eb00) 00010000:00010000:0.0:1784938443.641952:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.641955:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d200/0x7b044d4128f9c97d lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641960:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d200/0x7b044d4128f9c97d lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641977:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29200/0x7b044d4128f9c9d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641983:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29200/0x7b044d4128f9c9d8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641988:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29200/0x7b044d4128f9c9d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.641993:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b29200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.641995:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29200/0x7b044d4128f9c9d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.642001:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29200/0x7b044d4128f9c9d8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.642010:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xd13f1037 (ffff9f23823e0200) 00010000:00010000:0.0:1784938443.642013:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.642413:0:21629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938443.642421:0:21629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9bb6f8e/0x7b044d4128f9cd0b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.642469:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337460864 00000100:00100000:1.0:1784938443.642477:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337460864 00010000:00010000:1.0:1784938443.642517:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003d7ba9d5/0x7b044d4128f9a0aa lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476634aa expref: 74 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.642543:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337461376 00000100:00100000:1.0:1784938443.642546:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337461376 00010000:00010000:1.0:1784938443.642558:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000016aac480/0x7b044d4128f9a0b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476634b1 expref: 75 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.642581:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 342 00000100:00100000:1.0:1784938443.642590:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f241880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+75:10958:x1871643337460864:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.642604:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.642610:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003d7ba9d5/0x7b044d4128f9a0aa lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476634aa expref: 75 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.642622:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003d7ba9d5/0x7b044d4128f9a0aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476634aa expref: 75 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.642643:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.642647:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.642653:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9ccc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.642663:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9ccc5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.642682:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.642722:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f241880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+75:10958:x1871643337460864:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 132us (9274us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.642730:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 342 00000100:00100000:1.0:1784938443.642748:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 343 00000100:00100000:1.0:1784938443.642754:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f243100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+74:10958:x1871643337461376:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.642761:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.642766:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000016aac480/0x7b044d4128f9a0b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476634b1 expref: 74 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.642776:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000016aac480/0x7b044d4128f9a0b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476634b1 expref: 74 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.642789:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016aac480/0x7b044d4128f9a0b1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476634b1 expref: 74 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.642798:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.642801:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.642806:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba5ff4a4/0x7b044d4128f9cd04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.642819:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba5ff4a4/0x7b044d4128f9cd04 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.642835:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.642851:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f243100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+73:10958:x1871643337461376:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 97us (9350us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.642856:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 343 00000004:00080000:1.0:1784938443.642923:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238d3ad180/2, rc 0, transno 4294967454 00000100:00100000:1.0:1784938443.642935:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d3ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350868224:192.168.202.154@tcp:6:osp-syn-0-0.0 00000004:00080000:1.0:1784938443.642951:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f1b5c00/2, rc 0, transno 4294967446 00000100:00100000:1.0:1784938443.642959:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350867328:192.168.202.154@tcp:6:osp-syn-1-0.0 00000004:00080000:1.0:1784938443.642969:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24b68d8a80/2, rc 0, transno 4294967455 00000100:00100000:1.0:1784938443.642973:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350867200:192.168.202.154@tcp:6:osp-syn-0-0.0 00000004:00080000:1.0:1784938443.642996:0:16391:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f2386360700/2, rc 0, transno 4294967456 00000100:00100000:1.0:1784938443.643000:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386360700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350868096:192.168.202.154@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1784938443.643624:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29200/0x7b044d4128f9c9d8 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.643637:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29200/0x7b044d4128f9c9d8 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.643660:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9ca33 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.643667:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9ca33 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.643673:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9ca33 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.643679:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf0a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.643683:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9ca33 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.643691:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9ca33 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.643702:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xc701cb36 (ffff9f2484afda00) 00010000:00010000:0.0:1784938443.643704:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.643708:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9ca33 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.643713:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9ca33 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.643730:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9ca8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.643736:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9ca8e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.643742:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9ca8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.643747:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27d600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.643750:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9ca8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.643756:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9ca8e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.643764:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x322afea2 (ffff9f24898e0000) 00010000:00010000:0.0:1784938443.643766:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.643769:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9ca8e lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.643775:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9ca8e lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.643791:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29800/0x7b044d4128f9cae9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.643798:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29800/0x7b044d4128f9cae9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.643804:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29800/0x7b044d4128f9cae9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.643809:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b29800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.643812:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29800/0x7b044d4128f9cae9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.643818:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29800/0x7b044d4128f9cae9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.643825:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xaa0c2c16 (ffff9f2485cb4000) 00010000:00010000:0.0:1784938443.643827:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.643830:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29800/0x7b044d4128f9cae9 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.643835:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29800/0x7b044d4128f9cae9 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.643852:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031000/0x7b044d4128f9cb44 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.643857:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031000/0x7b044d4128f9cb44 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.643863:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031000/0x7b044d4128f9cb44 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.643868:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2480031000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.643870:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031000/0x7b044d4128f9cb44 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.643877:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031000/0x7b044d4128f9cb44 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.643963:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938443.643973:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067784924/0x7b044d4128f9ccbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.643982:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39c00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938443.643986:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067784924/0x7b044d4128f9ccbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.643995:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067784924/0x7b044d4128f9ccbe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.644008:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067784924/0x7b044d4128f9ccbe lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.644032:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938443.644033:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938443.644035:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938443.644142:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.644180:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.644225:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.644250:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337461888 00000100:00100000:2.0:1784938443.644258:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337461888 00000100:00100000:2.0:1784938443.644291:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 744 00000100:00100000:2.0:1784938443.644298:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f24a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+73:10958:x1871643337461888:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938443.644312:0:25722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938443.644341:0:25722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091814461/0x7b044d4128f9cd51 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x64:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476641c3 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938443.644365:0:25722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x64:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938443.644382:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x64:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1784938443.644385:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x64:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.644392:0:25722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091814461/0x7b044d4128f9cd51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641c3 expref: 74 pid: 25722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.644405:0:25722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000091814461/0x7b044d4128f9cd51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641c3 expref: 74 pid: 25722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.644415:0:25722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17a800, rc 0) 00000100:00100000:2.0:1784938443.644440:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f24a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+74:10958:x1871643337461888:12345-192.168.202.54@tcp:101:cp.0 Request processed in 143us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938443.644447:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 744 00010000:00010000:0.0:1784938443.644711:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xd47b514a (ffff9f2484afd600) 00010000:00010000:0.0:1784938443.644713:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.644716:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031000/0x7b044d4128f9cb44 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.644723:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031000/0x7b044d4128f9cb44 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.644744:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61ba00/0x7b044d4128f9cb9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.644751:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61ba00/0x7b044d4128f9cb9f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.644757:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61ba00/0x7b044d4128f9cb9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.644763:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61ba00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.644765:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61ba00/0x7b044d4128f9cb9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.644771:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61ba00/0x7b044d4128f9cb9f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.644779:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x7772308b (ffff9f23823e0000) 00010000:00010000:0.0:1784938443.644781:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.644784:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61ba00/0x7b044d4128f9cb9f lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.644790:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61ba00/0x7b044d4128f9cb9f lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.644806:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cbfa lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.644813:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cbfa lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.644819:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cbfa lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.644824:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27d000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.644827:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cbfa lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.644833:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cbfa lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.644840:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xe087ee79 (ffff9f24898e0500) 00010000:00010000:0.0:1784938443.644842:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.644844:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cbfa lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.644849:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9cbfa lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.644873:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337461760 00000100:00100000:0.0:1784938443.644877:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337461760 00010000:00010000:0.0:1784938443.644913:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d8fceeb1/0x7b044d4128f9a095 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476634a3 expref: 67 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.644930:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337461632 00000100:00100000:0.0:1784938443.644933:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337461632 00010000:00010000:0.0:1784938443.644946:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000018dca04/0x7b044d4128f9a3f9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766366a expref: 74 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.644958:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 344 00000100:00100000:0.0:1784938443.644964:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f243480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+67:10960:x1871643337461760:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938443.644975:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938443.644980:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d8fceeb1/0x7b044d4128f9a095 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476634a3 expref: 67 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.644991:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d8fceeb1/0x7b044d4128f9a095 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476634a3 expref: 67 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.645006:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.645010:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.645123:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9cd20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.645130:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9cd20 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.645171:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938443.645191:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f243480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+67:10960:x1871643337461760:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 227us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.645198:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 344 00000100:00100000:0.0:1784938443.645214:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 345 00000100:00100000:0.0:1784938443.645220:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f248e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+74:10960:x1871643337461632:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938443.645228:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938443.645233:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000018dca04/0x7b044d4128f9a3f9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766366a expref: 74 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.645243:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000018dca04/0x7b044d4128f9a3f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766366a expref: 74 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.645256:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.645259:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.645263:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000017474f15/0x7b044d4128f9cd19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.645271:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017474f15/0x7b044d4128f9cd19 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.645283:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938443.645296:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f248e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+74:10960:x1871643337461632:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 77us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.645303:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 345 00010000:00010000:0.0:1784938443.650210:0:25720:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ba5ff4a4/0x7b044d4128f9cd04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.650230:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba5ff4a4/0x7b044d4128f9cd04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.650242:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba5ff4a4/0x7b044d4128f9cd04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.650250:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba5ff4a4/0x7b044d4128f9cd04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.650283:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784938443.650487:0:25720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388246a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:16389:x1871643350867712:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 28694us (29030us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1784938443.650494:0:25720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 733 00000100:00100000:0.0:1784938443.650584:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:16390:x1871643350868992:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 28654us (29102us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1784938443.650589:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 734 00010000:00010000:3.0:1784938443.651398:0:25729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938443.651405:0:25729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067784924/0x7b044d4128f9ccbe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.651492:0:25729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+25:16391:x1871643350867456:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 41732us (41786us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1784938443.651497:0:25729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 728 00010000:00010000:3.0:1784938443.651541:0:25726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d7ba9d5/0x7b044d4128f9a0aa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476634aa expref: 73 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.651550:0:25726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f199f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:25726:1871643350869120:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938443.651567:0:25726:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9ccc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.651573:0:25726:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9ccc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.651578:0:25726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9ccc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.651584:0:25726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9ccc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.651588:0:25726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9ccc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.651597:0:25726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1784938443.651641:0:25726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+25:16391:x1871643350867584:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 38554us (38894us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1784938443.651646:0:25726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 729 00010000:00010000:3.0:1784938443.651673:0:21152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000018dca04/0x7b044d4128f9a3f9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766366a expref: 72 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.651682:0:21152:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd55ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:21152:1871643350869888:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938443.651697:0:21152:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000017474f15/0x7b044d4128f9cd19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.651704:0:21152:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000017474f15/0x7b044d4128f9cd19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.651710:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017474f15/0x7b044d4128f9cd19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.651718:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017474f15/0x7b044d4128f9cd19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.651725:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017474f15/0x7b044d4128f9cd19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.651734:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1784938443.651785:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:16391:x1871643350868864:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 28599us (30255us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1784938443.651790:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 736 00010000:00010000:3.0:1784938443.651812:0:25730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8fceeb1/0x7b044d4128f9a095 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476634a3 expref: 66 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.651820:0:25730:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd55d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:25730:1871643350870016:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938443.651832:0:25730:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9cd20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.651839:0:25730:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9cd20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.651845:0:25730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9cd20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.651853:0:25730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9cd20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.651860:0:25730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9cd20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.651868:0:25730:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:3.0:1784938443.651950:0:25730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+26:16391:x1871643350866944:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 28584us (30396us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1784938443.651954:0:25730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 737 00010000:00010000:0.0:1784938443.652511:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1784938443.652517:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba5ff4a4/0x7b044d4128f9cd04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.652523:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c6000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938443.652527:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba5ff4a4/0x7b044d4128f9cd04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.652533:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba5ff4a4/0x7b044d4128f9cd04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.652548:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba5ff4a4/0x7b044d4128f9cd04 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.652553:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba5ff4a4/0x7b044d4128f9cd04 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.652565:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784938443.652567:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9ccc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.652571:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938443.652573:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9ccc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.652577:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9ccc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.652581:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9ccc5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.652585:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9ccc5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.652593:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938443.652594:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017474f15/0x7b044d4128f9cd19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.652598:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1c00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938443.652599:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017474f15/0x7b044d4128f9cd19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.652607:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017474f15/0x7b044d4128f9cd19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.652612:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017474f15/0x7b044d4128f9cd19 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.652615:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017474f15/0x7b044d4128f9cd19 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.652622:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938443.652624:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9cd20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.652628:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf0400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938443.652629:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9cd20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.652633:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9cd20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.652639:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9cd20 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.652643:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9cd20 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.652654:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.652655:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.652656:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938443.653004:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.653174:0:25723:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f2c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:25723:1871643350870656:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938443.653191:0:25723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c44d6e18/0x7b044d4128f9cd3c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.653218:0:25721:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f2c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:25721:1871643350870784:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938443.653229:0:25721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008d1223b5/0x7b044d4128f9cd43 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.653251:0:25728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd5a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:25728:1871643350870912:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938443.653262:0:25728:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cfc96367/0x7b044d4128f9cd4a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.653281:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337462016 00000100:00100000:2.0:1784938443.653287:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337462016 00000100:00100000:2.0:1784938443.653336:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 745 00000100:00100000:2.0:1784938443.653345:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23880a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+72:17096:x1871643337462016:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938443.653361:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938443.653375:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000247bc25a/0x7b044d4128f9cd58 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x64:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476641ca expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.653398:0:21151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000091814461/0x7b044d4128f9cd51 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641c3 expref: 73 pid: 25722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.653411:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x64:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.653415:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x64:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.653420:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000247bc25a/0x7b044d4128f9cd58 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x64:0x0].0x0 rrc: 3 type: EXT [0->1179647] (req 0->1179647) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641ca expref: 73 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.653447:0:21151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000091814461/0x7b044d4128f9cd51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e9476641c3 expref: 73 pid: 25722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.653459:0:21151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000091814461/0x7b044d4128f9cd51 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476641c3 expref: 73 pid: 25722 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.653472:0:21151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f248700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:21151:1871643350871040:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938443.653522:0:21151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d3a4480 going to sleep for 11 seconds 00010000:00010000:2.0:1784938443.653537:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938443.653560:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.653646:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.653664:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.653680:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.653692:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.653705:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:2.0:1784938443.653715:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938443.654113:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337462272 00000100:00100000:0.0:1784938443.654118:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337462272 00010000:00010000:3.0:1784938443.654284:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9cc47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.654295:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245c00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938443.654300:0:25732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9cc47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.654308:0:25732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9cc47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.654333:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9cc47 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.654340:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d379049d/0x7b044d4128f9cc47 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.654358:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938443.654359:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938443.654361:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.654420:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b01e28b4/0x7b044d4128f9a423 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663678 expref: 66 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.654439:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337462784 00000100:00100000:0.0:1784938443.654443:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337462784 00010000:00010000:0.0:1784938443.654455:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000986122ce/0x7b044d4128f9a748 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636a9 expref: 67 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.654467:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337462400 00000100:00100000:0.0:1784938443.654469:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337462400 00010000:00010000:0.0:1784938443.654480:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000016494a26/0x7b044d4128f9a40e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766368d expref: 68 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.654489:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337462528 00000100:00100000:0.0:1784938443.654491:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337462528 00010000:00010000:0.0:1784938443.654503:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000031260482/0x7b044d4128f9a09c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476634b8 expref: 74 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.654513:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337462144 00000100:00100000:0.0:1784938443.654515:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337462144 00010000:00010000:0.0:1784938443.654525:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000077eceeb9/0x7b044d4128f9a415 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663663 expref: 69 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.654534:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337462656 00000100:00100000:0.0:1784938443.654536:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337462656 00010000:00010000:0.0:1784938443.654544:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005979dcbb/0x7b044d4128f9a41c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766365c expref: 75 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.654558:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 346 00000100:00100000:0.0:1784938443.654565:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f24b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+69:10959:x1871643337462272:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938443.654576:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938443.654580:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b01e28b4/0x7b044d4128f9a423 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663678 expref: 69 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.654591:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b01e28b4/0x7b044d4128f9a423 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663678 expref: 69 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.654607:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.654611:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.654616:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9cd2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.654625:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9cd2e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.654641:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938443.654682:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f24b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+69:10959:x1871643337462272:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 116us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.654690:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 346 00000100:00100000:0.0:1784938443.654709:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 347 00000100:00100000:0.0:1784938443.654716:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+68:10959:x1871643337462784:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938443.654723:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938443.654728:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000986122ce/0x7b044d4128f9a748 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636a9 expref: 68 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.654737:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000986122ce/0x7b044d4128f9a748 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636a9 expref: 68 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.654750:0:22955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000986122ce/0x7b044d4128f9a748 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636a9 expref: 68 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.654762:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.654765:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.654769:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cfc96367/0x7b044d4128f9cd4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.654777:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfc96367/0x7b044d4128f9cd4a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.654801:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938443.654818:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+67:10959:x1871643337462784:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 103us (1172us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.654825:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 347 00000100:00100000:0.0:1784938443.654838:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 348 00000100:00100000:0.0:1784938443.654844:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2488a66450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+66:10959:x1871643337462400:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938443.654851:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938443.654856:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000016494a26/0x7b044d4128f9a40e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766368d expref: 66 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.654866:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000016494a26/0x7b044d4128f9a40e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766368d expref: 66 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.654878:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.654881:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.654886:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000049f52d48/0x7b044d4128f9cd35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.654894:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049f52d48/0x7b044d4128f9cd35 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.654905:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938443.654921:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2488a66450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+66:10959:x1871643337462400:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 77us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.654927:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 348 00000100:00100000:0.0:1784938443.654962:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 349 00000100:00100000:0.0:1784938443.654967:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387daf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+75:10957:x1871643337462528:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938443.654974:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938443.654979:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000031260482/0x7b044d4128f9a09c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476634b8 expref: 75 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.654994:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000031260482/0x7b044d4128f9a09c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476634b8 expref: 75 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.655006:0:22955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031260482/0x7b044d4128f9a09c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476634b8 expref: 75 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.655910:0:25728:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cfc96367/0x7b044d4128f9cd4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.655925:0:25728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfc96367/0x7b044d4128f9cd4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.655936:0:25728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfc96367/0x7b044d4128f9cd4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.655944:0:25728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfc96367/0x7b044d4128f9cd4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.655969:0:25728:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938443.656803:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938443.656813:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfc96367/0x7b044d4128f9cd4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.656828:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17be00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938443.656833:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfc96367/0x7b044d4128f9cd4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.656842:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfc96367/0x7b044d4128f9cd4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.656859:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfc96367/0x7b044d4128f9cd4a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.656866:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfc96367/0x7b044d4128f9cd4a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.656901:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938443.656903:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938443.656905:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938443.658077:0:25728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+26:16390:x1871643350870144:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 24818us (28371us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1784938443.658089:0:25728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 743 00000004:00080000:3.0:1784938443.658231:0:16391:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24b3f3c380/2, rc 0, transno 4294967451 00000100:00100000:3.0:1784938443.658238:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b3f3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350868864:192.168.202.154@tcp:6:osp-syn-1-0.0 00000004:00080000:3.0:1784938443.658254:0:16391:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f2489ae7b80/2, rc 0, transno 4294967450 00000100:00100000:3.0:1784938443.658257:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2489ae7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350867584:192.168.202.154@tcp:6:osp-syn-1-0.0 00000004:00080000:3.0:1784938443.658269:0:16391:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24b68db480/2, rc 0, transno 4294967457 00000100:00100000:3.0:1784938443.658273:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350866944:192.168.202.154@tcp:6:osp-syn-0-0.0 00000004:00080000:3.0:1784938443.658282:0:16391:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f2489ae5f80/2, rc 0, transno 4294967449 00000100:00100000:3.0:1784938443.658285:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2489ae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350867456:192.168.202.154@tcp:6:osp-syn-1-0.0 00010000:00010000:3.0:1784938443.658317:0:25715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016494a26/0x7b044d4128f9a40e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766368d expref: 65 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.658343:0:25715:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd254380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25715:1871643350870528:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938443.658363:0:25715:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000049f52d48/0x7b044d4128f9cd35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.658374:0:25715:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000049f52d48/0x7b044d4128f9cd35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.658387:0:25715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049f52d48/0x7b044d4128f9cd35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.658397:0:25715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049f52d48/0x7b044d4128f9cd35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.658405:0:25715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049f52d48/0x7b044d4128f9cd35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.658421:0:25715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784938443.658500:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+26:16391:x1871643350867968:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 26697us (36897us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1784938443.658507:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 740 00000100:00100000:3.0:1784938443.658534:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 350 00000100:00100000:3.0:1784938443.658545:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+64:10957:x1871643337462144:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938443.658562:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938443.658569:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000077eceeb9/0x7b044d4128f9a415 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663663 expref: 64 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.658582:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000077eceeb9/0x7b044d4128f9a415 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663663 expref: 64 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.658602:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.658607:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.658613:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9acc545/0x7b044d4128f9cd27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.658623:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9acc545/0x7b044d4128f9cd27 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.658638:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938443.658655:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+64:10957:x1871643337462144:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 114us (4962us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938443.658661:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 350 00000100:00100000:3.0:1784938443.658679:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 351 00000100:00100000:3.0:1784938443.658685:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387daed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+74:10957:x1871643337462656:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938443.658694:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938443.658699:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005979dcbb/0x7b044d4128f9a41c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766365c expref: 74 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.658712:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005979dcbb/0x7b044d4128f9a41c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766365c expref: 74 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.658723:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005979dcbb/0x7b044d4128f9a41c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766365c expref: 74 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.658734:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.658737:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.658741:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008d1223b5/0x7b044d4128f9cd43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.658754:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d1223b5/0x7b044d4128f9cd43 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.658769:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938443.658788:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387daed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+73:10957:x1871643337462656:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 102us (5081us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938443.658793:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 351 00000100:00100000:3.0:1784938443.658921:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd55d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350871168:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:3.0:1784938443.658962:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f2c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350871680:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:3.0:1784938443.658984:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784938443.658990:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd55ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350871296:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:3.0:1784938443.659009:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f2ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350871808:192.168.202.154@tcp:6:osp-syn-0-0.0 00010000:00010000:3.0:1784938443.659050:0:25718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077eceeb9/0x7b044d4128f9a415 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663663 expref: 63 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.659061:0:25718:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd256d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25718:1871643350870272:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938443.659075:0:25718:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9acc545/0x7b044d4128f9cd27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.659084:0:25718:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9acc545/0x7b044d4128f9cd27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.659095:0:25718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9acc545/0x7b044d4128f9cd27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.659104:0:25718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9acc545/0x7b044d4128f9cd27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.659110:0:25718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9acc545/0x7b044d4128f9cd27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.659122:0:25718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1784938443.659219:0:25718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:16391:x1871643350867072:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 28652us (37646us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1784938443.659226:0:25718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 738 00010000:00010000:3.0:1784938443.659260:0:21149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b01e28b4/0x7b044d4128f9a423 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663678 expref: 62 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.659270:0:21149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd255500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:21149:1871643350870400:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938443.659283:0:21149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9cd2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.659291:0:21149:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9cd2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.659298:0:21149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9cd2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.659305:0:21149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9cd2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.659311:0:21149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9cd2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.659372:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.659377:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.659382:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c44d6e18/0x7b044d4128f9cd3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.659390:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c44d6e18/0x7b044d4128f9cd3c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.659414:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938443.659438:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387daf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+72:10957:x1871643337462528:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 4471us (5757us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.659446:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 349 00010000:00010000:0.0:1784938443.659467:0:25723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c44d6e18/0x7b044d4128f9cd3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.659476:0:25723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c44d6e18/0x7b044d4128f9cd3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.659484:0:25723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c44d6e18/0x7b044d4128f9cd3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.659492:0:25723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c44d6e18/0x7b044d4128f9cd3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.659567:0:25721:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008d1223b5/0x7b044d4128f9cd43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.659577:0:25721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d1223b5/0x7b044d4128f9cd43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.659584:0:25721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d1223b5/0x7b044d4128f9cd43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.659596:0:25721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d1223b5/0x7b044d4128f9cd43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.660450:0:21149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:3.0:1784938443.660571:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388247100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:16389:x1871643350867840:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 29335us (38983us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1784938443.660579:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 739 00010000:00010000:1.0:1784938443.660691:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1784938443.660699:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049f52d48/0x7b044d4128f9cd35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.660708:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c558800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938443.660713:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049f52d48/0x7b044d4128f9cd35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.660729:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049f52d48/0x7b044d4128f9cd35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.660745:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049f52d48/0x7b044d4128f9cd35 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.660754:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049f52d48/0x7b044d4128f9cd35 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.660792:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350871424:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1784938443.660833:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d145c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350871936:192.168.202.154@tcp:6:osp-syn-0-0.0 00000004:00080000:1.0:1784938443.660869:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f2489ae6680/2, rc 0, transno 4294967447 00010000:00010000:0.0:1784938443.661308:0:25723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1784938443.661414:0:25723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+25:16390:x1871643350868608:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 28546us (39794us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1784938443.661422:0:25723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 741 00010000:00010000:0.0:1784938443.661465:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1784938443.661471:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9acc545/0x7b044d4128f9cd27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.661479:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c558a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938443.661482:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9acc545/0x7b044d4128f9cd27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.661489:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9acc545/0x7b044d4128f9cd27 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.661501:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9acc545/0x7b044d4128f9cd27 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.661507:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9acc545/0x7b044d4128f9cd27 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.661524:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784938443.661528:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9cd2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.661534:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c558e00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938443.661536:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9cd2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.661543:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9cd2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.661552:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9cd2e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.661558:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9cd2e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.661571:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938443.661574:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c44d6e18/0x7b044d4128f9cd3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.661581:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42dc00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938443.661584:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c44d6e18/0x7b044d4128f9cd3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.661591:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c44d6e18/0x7b044d4128f9cd3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.661604:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c44d6e18/0x7b044d4128f9cd3c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.661610:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c44d6e18/0x7b044d4128f9cd3c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.661626:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938443.661629:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d1223b5/0x7b044d4128f9cd43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.661635:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17b800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938443.661638:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d1223b5/0x7b044d4128f9cd43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.661645:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d1223b5/0x7b044d4128f9cd43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.661654:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d1223b5/0x7b044d4128f9cd43 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.661662:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.661663:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.661665:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938443.661783:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.661804:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337462912 00000100:00100000:0.0:1784938443.661811:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337462912 00010000:00010000:0.0:1784938443.661838:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000091814461/0x7b044d4128f9cd51 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476641c3 expref: 72 pid: 25722 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.661865:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 352 00000100:00100000:0.0:1784938443.661875:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23880a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+72:10960:x1871643337462912:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938443.661898:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938443.661916:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000091814461/0x7b044d4128f9cd51 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476641c3 expref: 72 pid: 25722 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.661929:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000091814461/0x7b044d4128f9cd51 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476641c3 expref: 72 pid: 25722 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.661947:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x64:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.661951:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x64:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.661959:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000247bc25a/0x7b044d4128f9cd58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1179647) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641ca expref: 72 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.661968:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000247bc25a/0x7b044d4128f9cd58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1179647) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641ca expref: 72 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.661998:0:19220:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000247bc25a/0x7b044d4128f9cd58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1179647) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641ca expref: 72 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.662010:0:19220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23880a5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:19220:1871643350872192:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938443.662061:0:19220:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238108ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938443.662622:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938443.662793:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938443.662810:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938443.662827:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938443.662846:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938443.662870:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938443.662896:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350871424 00000100:00100000:0.0:1784938443.662902:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350871424 00000100:00100000:0.0:1784938443.662928:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350871168 00000100:00100000:0.0:1784938443.662932:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350871168 00000100:00100000:0.0:1784938443.662947:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350871680 00000100:00100000:0.0:1784938443.662949:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350871680 00000100:00100000:0.0:1784938443.662963:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350871296 00000100:00100000:0.0:1784938443.662965:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350871296 00000100:00100000:0.0:1784938443.662978:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350871808 00000100:00100000:0.0:1784938443.662981:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350871808 00000100:00100000:0.0:1784938443.662993:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350871936 00000100:00100000:0.0:1784938443.662996:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350871936 00000100:00100000:0.0:1784938443.663022:0:25720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 746 00000100:00100000:0.0:1784938443.663029:0:25720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:16389:x1871643350871424:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1784938443.663054:0:25720:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:35 count 1 00010000:00010000:0.0:1784938443.663073:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000208c6716/0x7b044d4128f9cd5f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.663088:0:25720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000074ea0a07/0x7b044d4128f9a756 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636c5 expref: 72 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.663097:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1784938443.663101:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.663105:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000208c6716/0x7b044d4128f9cd5f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.663450:0:25720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000074ea0a07/0x7b044d4128f9a756 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636c5 expref: 72 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.663466:0:25720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000074ea0a07/0x7b044d4128f9a756 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636c5 expref: 72 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.663479:0:25720:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388125c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:25720:1871643350872320:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938443.663522:0:25720:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238108e240 going to sleep for 11 seconds 00000100:00100000:0.0:1784938443.663543:0:25729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 747 00000100:00100000:0.0:1784938443.663551:0:25729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f243100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+27:16391:x1871643350871168:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1784938443.663565:0:25729:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:15 count 1 00010000:00010000:0.0:1784938443.663577:0:25729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c9e6d5b/0x7b044d4128f9cd66 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.663590:0:25729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006336c443/0x7b044d4128f9a407 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663686 expref: 72 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.663597:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1784938443.663600:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.663604:0:25729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c9e6d5b/0x7b044d4128f9cd66 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.663623:0:25729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006336c443/0x7b044d4128f9a407 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663686 expref: 72 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.663639:0:25729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006336c443/0x7b044d4128f9a407 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663686 expref: 72 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.663648:0:25729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388125880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:25729:1871643350872448:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938443.663670:0:25729:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238108e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938443.663688:0:25726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 748 00000100:00100000:0.0:1784938443.663695:0:25726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+28:16391:x1871643350871680:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1784938443.663709:0:25726:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:21 count 1 00010000:00010000:0.0:1784938443.663724:0:25726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000180f7329/0x7b044d4128f9cd6d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.663737:0:25726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9585a08/0x7b044d4128f9a76b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636b0 expref: 61 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.663744:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1784938443.663748:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.663752:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000180f7329/0x7b044d4128f9cd6d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.663771:0:25726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d9585a08/0x7b044d4128f9a76b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636b0 expref: 61 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.663780:0:25726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d9585a08/0x7b044d4128f9a76b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636b0 expref: 61 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.663796:0:25726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388125f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:25726:1871643350872576:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938443.663817:0:25726:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238108e600 going to sleep for 11 seconds 00000100:00100000:0.0:1784938443.663835:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 749 00000100:00100000:0.0:1784938443.663842:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f248e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:16391:x1871643350871296:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1784938443.663854:0:21152:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:24 count 1 00010000:00010000:0.0:1784938443.663866:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4d7eeea/0x7b044d4128f9cd74 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.663878:0:21152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000134d7650/0x7b044d4128f9a42a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663694 expref: 72 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.663897:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1784938443.663900:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.663903:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4d7eeea/0x7b044d4128f9cd74 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.663922:0:21152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000134d7650/0x7b044d4128f9a42a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663694 expref: 72 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.663931:0:21152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000134d7650/0x7b044d4128f9a42a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663694 expref: 72 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.663941:0:21152:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388124380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:21152:1871643350872704:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938443.663964:0:21152:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238108e480 going to sleep for 11 seconds 00000100:00100000:0.0:1784938443.663981:0:25719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 750 00000100:00100000:0.0:1784938443.663989:0:25719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f24b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:16391:x1871643350871808:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1784938443.664002:0:25719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:14 count 1 00010000:00010000:0.0:1784938443.664019:0:25719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf7e7655/0x7b044d4128f9cd7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.664030:0:25719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088ff705f/0x7b044d4128f9a764 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636b7 expref: 61 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.664037:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1784938443.664040:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.664043:0:25719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf7e7655/0x7b044d4128f9cd7b lrc: 4/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.664062:0:25719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000088ff705f/0x7b044d4128f9a764 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636b7 expref: 61 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.664071:0:25719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000088ff705f/0x7b044d4128f9a764 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636b7 expref: 61 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.664081:0:25719:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388126300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:25719:1871643350872832:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938443.664104:0:25719:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f249164b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938443.664123:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 751 00000100:00100000:0.0:1784938443.665872:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:16389:x1871643350871936:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1784938443.665998:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2489ae6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350867712:192.168.202.154@tcp:6:osp-syn-1-0.0 00000004:00080000:1.0:1784938443.666064:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24b68d9500/2, rc 0, transno 4294967461 00000100:00100000:1.0:1784938443.666078:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350867840:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1784938443.666085:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784938443.666094:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f2c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350871552:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1784938443.666180:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d147800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350872064:192.168.202.154@tcp:6:osp-syn-0-0.0 00000004:00080000:1.0:1784938443.666231:0:16390:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24bd256680/2, rc 0, transno 4294967458 00000100:00100000:1.0:1784938443.666236:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350870144:192.168.202.154@tcp:6:osp-syn-0-0.0 00000004:00080000:1.0:1784938443.666248:0:16390:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24b3f3e680/2, rc 0, transno 4294967448 00000100:00100000:1.0:1784938443.666253:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b3f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350868992:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1784938443.666368:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350873216:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1784938443.666394:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938443.666400:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350873344:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1784938443.666431:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350873088:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1784938443.666454:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784938443.666459:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd256300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350872960:192.168.202.154@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1784938443.666486:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938443.666489:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938443.666492:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1784938443.667330:0:16390:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24b35f3480/2, rc 0, transno 4294967452 00000100:00100000:1.0:1784938443.667343:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b35f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350868608:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1784938443.667410:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784938443.667419:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350873472:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1784938443.670639:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.670670:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.670690:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.670709:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.670725:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.670753:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.670765:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938443.670858:0:25723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350871552 00000100:00100000:0.0:1784938443.670868:0:25723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350871552 00010000:00010000:3.0:1784938443.671217:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784938443.671262:0:16391:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f2386360a80/2, rc 0, transno 4294967459 00000100:00100000:3.0:1784938443.671275:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386360a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350867968:192.168.202.154@tcp:6:osp-syn-0-0.0 00000004:00080000:3.0:1784938443.671287:0:16391:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24b68da300/2, rc 0, transno 4294967460 00000100:00100000:3.0:1784938443.671291:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350867072:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:3.0:1784938443.671309:0:25728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350872064 00000100:00100000:3.0:1784938443.671312:0:25728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350872064 00000100:00100000:3.0:1784938443.671441:0:25728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350873216 00000100:00100000:3.0:1784938443.671444:0:25728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350873216 00000100:00100000:3.0:1784938443.671455:0:25728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350873344 00000100:00100000:3.0:1784938443.671457:0:25728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350873344 00000100:00100000:3.0:1784938443.671466:0:25728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350873088 00000100:00100000:3.0:1784938443.671467:0:25728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350873088 00000100:00100000:3.0:1784938443.671476:0:25728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350872960 00000100:00100000:3.0:1784938443.671478:0:25728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350872960 00000100:00100000:3.0:1784938443.671484:0:25728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350873472 00000100:00100000:3.0:1784938443.671487:0:25728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350873472 00000100:00100000:3.0:1784938443.671503:0:25728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 752 00000100:00100000:3.0:1784938443.671510:0:25728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+31:16389:x1871643350872064:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:3.0:1784938443.671564:0:25728:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:20 count 1 00010000:00010000:3.0:1784938443.671589:0:25728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d72bda27/0x7b044d4128f9cd82 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.671610:0:25728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009eea06dc/0x7b044d4128f9a7db lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636d3 expref: 61 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.671618:0:25728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1784938443.671622:0:25728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.671626:0:25728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d72bda27/0x7b044d4128f9cd82 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.671663:0:25728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009eea06dc/0x7b044d4128f9a7db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636d3 expref: 61 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.671675:0:25728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009eea06dc/0x7b044d4128f9a7db lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636d3 expref: 61 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.671691:0:25728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:25728:1871643350873600:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938443.671762:0:25728:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f249d7bae40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938443.671780:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 753 00000100:00100000:3.0:1784938443.671788:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381360050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:16389:x1871643350873216:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:3.0:1784938443.671802:0:25715:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00010000:00010000:3.0:1784938443.671813:0:25715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000480c0a41/0x7b044d4128f9cd89 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.671826:0:25715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000062c9d3db/0x7b044d4128f9a84b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636da expref: 61 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.671833:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1784938443.671836:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.671840:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000480c0a41/0x7b044d4128f9cd89 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.671860:0:25715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000062c9d3db/0x7b044d4128f9a84b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636da expref: 61 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.671869:0:25715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000062c9d3db/0x7b044d4128f9a84b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636da expref: 61 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.671880:0:25715:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d146d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25715:1871643350873728:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938443.672012:0:25721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784938443.672086:0:25721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d1223b5/0x7b044d4128f9cd43 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.672262:0:25721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388246300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:16391:x1871643350868736:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 39199us (50622us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1784938443.672271:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 742 00000100:00100000:2.0:1784938443.672293:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 754 00000100:00100000:2.0:1784938443.672301:0:25721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:16389:x1871643350873344:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:2.0:1784938443.672313:0:25721:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:32 count 1 00010000:00010000:2.0:1784938443.672335:0:25721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086e06a59/0x7b044d4128f9cd90 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.672347:0:25721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c64a00d9/0x7b044d4128f9a7f0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636e8 expref: 61 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.672355:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784938443.672358:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.672362:0:25721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086e06a59/0x7b044d4128f9cd90 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.672382:0:25721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c64a00d9/0x7b044d4128f9a7f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636e8 expref: 61 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.672392:0:25721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c64a00d9/0x7b044d4128f9a7f0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636e8 expref: 61 pid: 25715 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.672402:0:25721:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f180700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:25721:1871643350873856:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938443.672427:0:25721:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d3a4180 going to sleep for 11 seconds 00010000:00010000:2.0:1784938443.672458:0:21151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091814461/0x7b044d4128f9cd51 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476641c3 expref: 72 pid: 25722 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.672468:0:21151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f248700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:21151:1871643350871040:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938443.672488:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000247bc25a/0x7b044d4128f9cd58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1179647) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476641ca expref: 71 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.672501:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17b200, rc 0) 00000100:00100000:2.0:1784938443.672520:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23880a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+71:17096:x1871643337462016:12345-192.168.202.54@tcp:101:cp.0 Request processed in 19177us (19518us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938443.672527:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 745 00000100:00100000:2.0:1784938443.672542:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 755 00000100:00100000:2.0:1784938443.672549:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:16392:x1871643350873088:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:2.0:1784938443.672560:0:21151:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:39 count 1 00010000:00010000:2.0:1784938443.672572:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fe810d2/0x7b044d4128f9cd97 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.672583:0:21151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a04ce4d5/0x7b044d4128f9a852 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636f6 expref: 70 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.672590:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784938443.672593:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.672596:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fe810d2/0x7b044d4128f9cd97 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.672613:0:21151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a04ce4d5/0x7b044d4128f9a852 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636f6 expref: 70 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.672622:0:21151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a04ce4d5/0x7b044d4128f9a852 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636f6 expref: 70 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.672632:0:21151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f183480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:21151:1871643350873984:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938443.672654:0:21151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d3a4480 going to sleep for 11 seconds 00000100:00100000:2.0:1784938443.672672:0:25727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 756 00000100:00100000:2.0:1784938443.672680:0:25727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+31:16392:x1871643350872960:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:2.0:1784938443.672691:0:25727:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:32 count 1 00010000:00010000:2.0:1784938443.672703:0:25727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9cd9e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.672714:0:25727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000545a8b07/0x7b044d4128f9a859 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636e1 expref: 70 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.672721:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784938443.672724:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.672728:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9cd9e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.672745:0:25727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000545a8b07/0x7b044d4128f9a859 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636e1 expref: 70 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.672755:0:25727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000545a8b07/0x7b044d4128f9a859 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636e1 expref: 70 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.672764:0:25727:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f182a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:25727:1871643350874112:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938443.672788:0:25727:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d3a49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938443.672808:0:25725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 757 00000100:00100000:2.0:1784938443.672816:0:25725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+31:16392:x1871643350873472:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:2.0:1784938443.672829:0:25725:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:10 count 1 00010000:00010000:2.0:1784938443.672841:0:25725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9cda5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.672852:0:25725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000039cfb67e/0x7b044d4128f9a805 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663704 expref: 70 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.672859:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784938443.672861:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.672864:0:25725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9cda5 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.673250:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350874368:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1784938443.673309:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350874496:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1784938443.673696:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000004:00080000:1.0:1784938443.673752:0:16391:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24b3f3d880/2, rc 0, transno 4294967453 00000100:00100000:1.0:1784938443.673763:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b3f3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350868736:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1784938443.673805:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350874624:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1784938443.680546:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.680666:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.680681:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.680707:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337463424 00000100:00100000:1.0:1784938443.680716:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337463424 00010000:00010000:1.0:1784938443.680755:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000134d7650/0x7b044d4128f9a42a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663694 expref: 71 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.680789:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337463296 00000100:00100000:1.0:1784938443.680792:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337463296 00010000:00010000:1.0:1784938443.680806:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d9585a08/0x7b044d4128f9a76b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636b0 expref: 62 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.680818:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337463168 00000100:00100000:1.0:1784938443.680820:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337463168 00010000:00010000:1.0:1784938443.680831:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006336c443/0x7b044d4128f9a407 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663686 expref: 72 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.680845:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 353 00000100:00100000:1.0:1784938443.680853:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd256d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+72:10960:x1871643337463424:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.680868:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.680875:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000134d7650/0x7b044d4128f9a42a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663694 expref: 72 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.680899:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000134d7650/0x7b044d4128f9a42a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663694 expref: 72 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.680925:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.680930:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.680936:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4d7eeea/0x7b044d4128f9cd74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.680945:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4d7eeea/0x7b044d4128f9cd74 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.680966:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.681005:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd256d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+72:10960:x1871643337463424:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 151us (7309us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.681012:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 353 00000100:00100000:1.0:1784938443.681029:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 354 00000100:00100000:1.0:1784938443.681036:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+62:10960:x1871643337463296:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.681044:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.681049:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d9585a08/0x7b044d4128f9a76b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636b0 expref: 62 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.681059:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d9585a08/0x7b044d4128f9a76b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636b0 expref: 62 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.681079:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.681082:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.681086:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000180f7329/0x7b044d4128f9cd6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.681095:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000180f7329/0x7b044d4128f9cd6d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.681106:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.681123:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+62:10960:x1871643337463296:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 87us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.681164:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 354 00000100:00100000:1.0:1784938443.681177:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 355 00000100:00100000:1.0:1784938443.681183:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2488a64c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+71:10958:x1871643337463168:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.681191:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.681196:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006336c443/0x7b044d4128f9a407 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663686 expref: 71 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.681208:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006336c443/0x7b044d4128f9a407 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663686 expref: 71 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.681220:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.681223:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.681226:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008c9e6d5b/0x7b044d4128f9cd66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.681234:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c9e6d5b/0x7b044d4128f9cd66 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.681246:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.681264:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2488a64c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+71:10958:x1871643337463168:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 81us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.681270:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 355 00000100:00100000:1.0:1784938443.681311:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.681358:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.681377:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.681391:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337463040 00000100:00100000:1.0:1784938443.681395:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337463040 00010000:00010000:1.0:1784938443.681409:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000074ea0a07/0x7b044d4128f9a756 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636c5 expref: 71 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.681427:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 356 00000100:00100000:1.0:1784938443.681433:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388247b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+71:10958:x1871643337463040:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.681440:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.681444:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000074ea0a07/0x7b044d4128f9a756 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636c5 expref: 71 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.681454:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000074ea0a07/0x7b044d4128f9a756 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636c5 expref: 71 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.681467:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.681471:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.681475:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000208c6716/0x7b044d4128f9cd5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.681483:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000208c6716/0x7b044d4128f9cd5f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.681494:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.681511:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388247b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+71:10958:x1871643337463040:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 78us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.681518:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 356 00000100:00100000:1.0:1784938443.681564:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.681575:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337463552 00000100:00100000:1.0:1784938443.681579:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337463552 00010000:00010000:1.0:1784938443.681592:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000088ff705f/0x7b044d4128f9a764 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636b7 expref: 62 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.681609:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 357 00000100:00100000:1.0:1784938443.681615:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388246680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+62:10958:x1871643337463552:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.681623:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.681627:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000088ff705f/0x7b044d4128f9a764 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636b7 expref: 62 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.681637:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000088ff705f/0x7b044d4128f9a764 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636b7 expref: 62 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.681651:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.681654:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.681659:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf7e7655/0x7b044d4128f9cd7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.681667:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf7e7655/0x7b044d4128f9cd7b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.681678:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.681695:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388246680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+62:10958:x1871643337463552:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 80us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.681701:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 357 00010000:00010000:2.0:1784938443.681885:0:25725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000039cfb67e/0x7b044d4128f9a805 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663704 expref: 70 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.681902:0:25725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000039cfb67e/0x7b044d4128f9a805 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663704 expref: 70 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.681919:0:25725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f180e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:25725:1871643350874240:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938443.681969:0:25725:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d3a4900 going to sleep for 11 seconds 00000100:00100000:2.0:1784938443.681988:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350874368 00000100:00100000:2.0:1784938443.681991:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350874368 00000100:00100000:2.0:1784938443.682022:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350874624 00000100:00100000:2.0:1784938443.682024:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350874624 00000100:00100000:2.0:1784938443.682035:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350874496 00000100:00100000:2.0:1784938443.682037:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350874496 00000100:00100000:2.0:1784938443.682048:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 758 00000100:00100000:2.0:1784938443.682054:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+33:16392:x1871643350874368:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:2.0:1784938443.682075:0:25722:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:19 count 1 00010000:00010000:2.0:1784938443.682096:0:25722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b9ed1c8/0x7b044d4128f9cdac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.682110:0:25722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000caa17f53/0x7b044d4128f9a7e2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636ef expref: 61 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.682118:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784938443.682121:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.682125:0:25722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b9ed1c8/0x7b044d4128f9cdac lrc: 4/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.682175:0:25722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000caa17f53/0x7b044d4128f9a7e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636ef expref: 61 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.682185:0:25722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000caa17f53/0x7b044d4128f9a7e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636ef expref: 61 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.682196:0:25722:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f248700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25722:1871643350874752:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938443.682219:0:25722:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d3a4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938443.682235:0:25724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 759 00000100:00100000:2.0:1784938443.682242:0:25724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388247800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+32:16390:x1871643350874624:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:2.0:1784938443.682255:0:25724:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:11 count 1 00010000:00010000:2.0:1784938443.682269:0:25724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9cdb3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.682281:0:25724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd5af998/0x7b044d4128f9a7e9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766370b expref: 70 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.682288:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784938443.682291:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.682295:0:25724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9cdb3 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.682315:0:25724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bd5af998/0x7b044d4128f9a7e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e94766370b expref: 70 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.682341:0:25724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bd5af998/0x7b044d4128f9a7e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766370b expref: 70 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.682351:0:25724:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2381d2bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:25724:1871643350874880:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938443.682373:0:25724:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d3a4240 going to sleep for 11 seconds 00010000:00010000:2.0:1784938443.682386:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.682663:0:25719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088ff705f/0x7b044d4128f9a764 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636b7 expref: 61 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.682678:0:25719:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388126300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:25719:1871643350872832:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938443.682703:0:25719:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bf7e7655/0x7b044d4128f9cd7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.682712:0:25719:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bf7e7655/0x7b044d4128f9cd7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.682719:0:25719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf7e7655/0x7b044d4128f9cd7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.682729:0:25719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf7e7655/0x7b044d4128f9cd7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.682737:0:25719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf7e7655/0x7b044d4128f9cd7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.682752:0:25719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784938443.682927:0:25719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f24b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:16391:x1871643350871808:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 18938us (20079us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1784938443.682936:0:25719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 750 00000100:00100000:0.0:1784938443.682956:0:25719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 760 00000100:00100000:0.0:1784938443.682963:0:25719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388246d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+33:16389:x1871643350874496:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1784938443.682977:0:25719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:16 count 1 00010000:00010000:0.0:1784938443.682989:0:25719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9cdba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683001:0:25719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000320d80b3/0x7b044d4128f9a860 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636fd expref: 60 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683008:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1784938443.683011:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.683027:0:25719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9cdba lrc: 4/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683047:0:25719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000320d80b3/0x7b044d4128f9a860 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636fd expref: 60 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683057:0:25719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000320d80b3/0x7b044d4128f9a860 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636fd expref: 60 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.683068:0:25719:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388126300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:25719:1871643350875008:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938443.683091:0:25719:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbe480 going to sleep for 11 seconds 00010000:00010000:0.0:1784938443.683117:0:25729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006336c443/0x7b044d4128f9a407 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663686 expref: 70 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.683142:0:25729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388125880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:25729:1871643350872448:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938443.683171:0:25729:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008c9e6d5b/0x7b044d4128f9cd66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683180:0:25729:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008c9e6d5b/0x7b044d4128f9cd66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683187:0:25729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c9e6d5b/0x7b044d4128f9cd66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683195:0:25729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c9e6d5b/0x7b044d4128f9cd66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683202:0:25729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c9e6d5b/0x7b044d4128f9cd66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683219:0:25729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1784938443.683296:0:25729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f243100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+33:16391:x1871643350871168:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 19745us (20502us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1784938443.683303:0:25729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 747 00010000:00010000:0.0:1784938443.683355:0:21152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000134d7650/0x7b044d4128f9a42a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663694 expref: 69 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.683366:0:21152:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388124380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:21152:1871643350872704:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938443.683376:0:21152:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d4d7eeea/0x7b044d4128f9cd74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683388:0:21152:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d4d7eeea/0x7b044d4128f9cd74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683395:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4d7eeea/0x7b044d4128f9cd74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683402:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4d7eeea/0x7b044d4128f9cd74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683408:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4d7eeea/0x7b044d4128f9cd74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683422:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1784938443.683488:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f248e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:16391:x1871643350871296:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 19646us (20659us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1784938443.683494:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 749 00010000:00010000:0.0:1784938443.683524:0:25726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9585a08/0x7b044d4128f9a76b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636b0 expref: 60 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.683533:0:25726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388125f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:25726:1871643350872576:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938443.683546:0:25726:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000180f7329/0x7b044d4128f9cd6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683553:0:25726:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000180f7329/0x7b044d4128f9cd6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683560:0:25726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000180f7329/0x7b044d4128f9cd6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683569:0:25726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000180f7329/0x7b044d4128f9cd6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683576:0:25726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000180f7329/0x7b044d4128f9cd6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683585:0:25726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1784938443.683640:0:25726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+34:16391:x1871643350871680:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 19945us (20828us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1784938443.683647:0:25726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 748 00000100:00100000:0.0:1784938443.683679:0:19220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23880a5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:19220:1871643350872192:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938443.683690:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938443.683709:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23880a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+68:10960:x1871643337462912:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 21835us (21927us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.683717:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 352 00010000:00010000:0.0:1784938443.683762:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1784938443.683768:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf7e7655/0x7b044d4128f9cd7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683776:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938443.683781:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf7e7655/0x7b044d4128f9cd7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683791:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf7e7655/0x7b044d4128f9cd7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683805:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf7e7655/0x7b044d4128f9cd7b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683813:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf7e7655/0x7b044d4128f9cd7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683829:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784938443.683832:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c9e6d5b/0x7b044d4128f9cd66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683839:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b29c00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938443.683842:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c9e6d5b/0x7b044d4128f9cd66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683848:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c9e6d5b/0x7b044d4128f9cd66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683857:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c9e6d5b/0x7b044d4128f9cd66 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683864:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c9e6d5b/0x7b044d4128f9cd66 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683883:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938443.683887:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4d7eeea/0x7b044d4128f9cd74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683894:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24ca00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938443.683897:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4d7eeea/0x7b044d4128f9cd74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683905:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4d7eeea/0x7b044d4128f9cd74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683914:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4d7eeea/0x7b044d4128f9cd74 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683921:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4d7eeea/0x7b044d4128f9cd74 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683932:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938443.683936:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000180f7329/0x7b044d4128f9cd6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683942:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b28c00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938443.683946:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000180f7329/0x7b044d4128f9cd6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683958:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000180f7329/0x7b044d4128f9cd6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683966:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000180f7329/0x7b044d4128f9cd6d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683973:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000180f7329/0x7b044d4128f9cd6d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.683984:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.683985:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.683987:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.684006:0:25720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074ea0a07/0x7b044d4128f9a756 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636c5 expref: 67 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.684016:0:25720:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388125c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:25720:1871643350872320:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938443.684025:0:25720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000208c6716/0x7b044d4128f9cd5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.684033:0:25720:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000208c6716/0x7b044d4128f9cd5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.684040:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000208c6716/0x7b044d4128f9cd5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.684054:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000208c6716/0x7b044d4128f9cd5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.684061:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000208c6716/0x7b044d4128f9cd5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.684073:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784938443.684127:0:25720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+33:16389:x1871643350871424:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 21098us (21506us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1784938443.684133:0:25720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 746 00010000:00010000:0.0:1784938443.684166:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938443.684170:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000208c6716/0x7b044d4128f9cd5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.684177:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b29a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938443.684181:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000208c6716/0x7b044d4128f9cd5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.684189:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000208c6716/0x7b044d4128f9cd5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.684199:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000208c6716/0x7b044d4128f9cd5f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.684206:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000208c6716/0x7b044d4128f9cd5f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.684220:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.684222:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.684223:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.684229:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938443.684265:0:25729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 761 00000100:00100000:0.0:1784938443.684273:0:25729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+32:16389:x1871643350871552:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1784938443.684291:0:25729:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:7 count 1 00010000:00010000:0.0:1784938443.684305:0:25729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015b67b51/0x7b044d4128f9cdc1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.684318:0:25729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000e788d2b/0x7b044d4128f9a779 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636cc expref: 66 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.684338:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1784938443.684342:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.684346:0:25729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015b67b51/0x7b044d4128f9cdc1 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.684372:0:25729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000e788d2b/0x7b044d4128f9a779 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636cc expref: 66 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.684382:0:25729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000e788d2b/0x7b044d4128f9a779 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636cc expref: 66 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.684392:0:25729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388125c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:25729:1871643350875136:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938443.684421:0:25729:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbe300 going to sleep for 11 seconds 00002000:00080000:0.0:1784938443.684443:0:21629:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:29 count 1 00010000:00010000:0.0:1784938443.684456:0:21629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077b8fdcf/0x7b044d4128f9cdc8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.684467:0:21629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002ff6aa56/0x7b044d4128f9a74f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476636be expref: 59 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.684475:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1784938443.684478:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.684481:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077b8fdcf/0x7b044d4128f9cdc8 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.684500:0:21629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002ff6aa56/0x7b044d4128f9a74f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636be expref: 59 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.684509:0:21629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002ff6aa56/0x7b044d4128f9a74f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636be expref: 59 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.684519:0:21629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388125f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:21629:1871643350875264:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938443.684541:0:21629:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbe780 going to sleep for 11 seconds 00000004:00080000:1.0:1784938443.685480:0:16391:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f2ca300/2, rc 0, transno 4294967462 00000100:00100000:1.0:1784938443.685494:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f2ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350871808:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1784938443.685548:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350875392:192.168.202.154@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1784938443.685596:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1784938443.685628:0:16391:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24bd55d880/2, rc 0, transno 4294967454 00000100:00100000:1.0:1784938443.685636:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd55d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350871168:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1784938443.685669:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350875520:192.168.202.154@tcp:6:osp-syn-1-0.0 00000004:00080000:1.0:1784938443.685746:0:16391:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24bd55ce00/2, rc 0, transno 4294967455 00000100:00100000:1.0:1784938443.685754:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd55ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350871296:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1784938443.685784:0:16390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784938443.685792:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350875648:192.168.202.154@tcp:6:osp-syn-1-0.0 00000004:00080000:1.0:1784938443.685884:0:16391:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f2c9880/2, rc 0, transno 4294967463 00000100:00100000:1.0:1784938443.685892:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f2c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350871680:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1784938443.685924:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350875776:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1784938443.686011:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938443.686231:0:25715:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f249d7baf00 going to sleep for 11 seconds 00000100:00100000:1.0:1784938443.686330:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000004:00080000:0.0:1784938443.686409:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f199f80/2, rc 0, transno 4294967456 00000100:00100000:0.0:1784938443.686427:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350871424:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:2.0:1784938443.686647:0:25721:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f180700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:25721:1871643350873856:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938443.686668:0:25721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000086e06a59/0x7b044d4128f9cd90 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.686729:0:21151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f183480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:21151:1871643350873984:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938443.686741:0:21151:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004fe810d2/0x7b044d4128f9cd97 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.686795:0:25727:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f182a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:25727:1871643350874112:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938443.686808:0:25727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9cd9e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.686846:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.686878:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.686894:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.686929:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.695458:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337463808 00000100:00100000:1.0:1784938443.695468:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337463808 00010000:00010000:1.0:1784938443.695510:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c64a00d9/0x7b044d4128f9a7f0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636e8 expref: 60 pid: 25715 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.695543:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337463936 00000100:00100000:1.0:1784938443.695546:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337463936 00010000:00010000:1.0:1784938443.695560:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a04ce4d5/0x7b044d4128f9a852 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636f6 expref: 67 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.695572:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337463680 00000100:00100000:1.0:1784938443.695575:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337463680 00010000:00010000:1.0:1784938443.695585:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009eea06dc/0x7b044d4128f9a7db lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636d3 expref: 61 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.695595:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337464064 00000100:00100000:1.0:1784938443.695598:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337464064 00010000:00010000:1.0:1784938443.695607:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000545a8b07/0x7b044d4128f9a859 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636e1 expref: 68 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.695620:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 358 00000100:00100000:1.0:1784938443.695628:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+61:10959:x1871643337463808:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.695642:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.695648:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c64a00d9/0x7b044d4128f9a7f0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636e8 expref: 61 pid: 25715 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.695660:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c64a00d9/0x7b044d4128f9a7f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636e8 expref: 61 pid: 25715 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.695685:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c64a00d9/0x7b044d4128f9a7f0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636e8 expref: 61 pid: 25715 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.695704:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.695708:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.695715:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000086e06a59/0x7b044d4128f9cd90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.695725:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086e06a59/0x7b044d4128f9cd90 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.695760:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.695812:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+60:10959:x1871643337463808:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 183us (8964us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.695820:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 358 00000100:00100000:1.0:1784938443.695837:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 359 00000100:00100000:1.0:1784938443.695842:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+68:10959:x1871643337463936:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.695851:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.695856:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a04ce4d5/0x7b044d4128f9a852 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636f6 expref: 68 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.695871:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a04ce4d5/0x7b044d4128f9a852 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636f6 expref: 68 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.696441:0:25730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350875392 00000100:00100000:3.0:1784938443.696448:0:25730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350875392 00000100:00100000:3.0:1784938443.696487:0:25730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350875520 00000100:00100000:3.0:1784938443.696491:0:25730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350875520 00000100:00100000:3.0:1784938443.696512:0:25730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 762 00000100:00100000:3.0:1784938443.696519:0:25730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+34:16391:x1871643350875392:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:3.0:1784938443.696545:0:25730:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:13 count 1 00010000:00010000:3.0:1784938443.696565:0:25730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9033458/0x7b044d4128f9cdcf lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.696582:0:25730:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000096447157/0x7b044d4128f9a8f3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663712 expref: 59 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.696590:0:25730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1784938443.696593:0:25730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.696596:0:25730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9033458/0x7b044d4128f9cdcf lrc: 4/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.696622:0:25730:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000096447157/0x7b044d4128f9a8f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663712 expref: 59 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.696634:0:25730:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000096447157/0x7b044d4128f9a8f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663712 expref: 59 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.696648:0:25730:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d147b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:25730:1871643350876032:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938443.696708:0:25730:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f249d7ba780 going to sleep for 11 seconds 00000100:00100000:3.0:1784938443.696753:0:25728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:25728:1871643350873600:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938443.696771:0:25728:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d72bda27/0x7b044d4128f9cd82 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.696794:0:25718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 763 00000100:00100000:3.0:1784938443.696801:0:25718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+33:16392:x1871643350875520:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:3.0:1784938443.696815:0:25718:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:6 count 1 00010000:00010000:3.0:1784938443.696828:0:25718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5a6dfda/0x7b044d4128f9cdd6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.696840:0:25718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d310ee32/0x7b044d4128f9a908 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663719 expref: 68 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.696847:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1784938443.696849:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.696852:0:25718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5a6dfda/0x7b044d4128f9cdd6 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.696871:0:25718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d310ee32/0x7b044d4128f9a908 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663719 expref: 68 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.696881:0:25718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d310ee32/0x7b044d4128f9a908 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663719 expref: 68 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.697006:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 360 00000100:00100000:0.0:1784938443.697027:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+59:10958:x1871643337463680:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938443.697039:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938443.697045:0:25731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009eea06dc/0x7b044d4128f9a7db lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636d3 expref: 59 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.697057:0:25731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009eea06dc/0x7b044d4128f9a7db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636d3 expref: 59 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.697072:0:25731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009eea06dc/0x7b044d4128f9a7db lrc: 0/0,0 mode: --/PR res: [0x280000401:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636d3 expref: 59 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.697085:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.697088:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.697093:0:25731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d72bda27/0x7b044d4128f9cd82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.697101:0:25731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d72bda27/0x7b044d4128f9cd82 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.697122:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938443.697175:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+58:10958:x1871643337463680:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 161us (10279us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.697182:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 360 00000100:00100000:0.0:1784938443.697201:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 361 00000100:00100000:0.0:1784938443.697207:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f182a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+68:10958:x1871643337464064:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938443.697216:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938443.697222:0:25731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000545a8b07/0x7b044d4128f9a859 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636e1 expref: 68 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.697233:0:25731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000545a8b07/0x7b044d4128f9a859 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636e1 expref: 68 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.697246:0:25731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000545a8b07/0x7b044d4128f9a859 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636e1 expref: 68 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.697256:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.697259:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.697263:0:25731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9cd9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.697270:0:25731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9cd9e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.697289:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938443.697311:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f182a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+67:10958:x1871643337464064:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 104us (10381us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.697317:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 361 00010000:00010000:0.0:1784938443.697347:0:25728:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d72bda27/0x7b044d4128f9cd82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.697355:0:25728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d72bda27/0x7b044d4128f9cd82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.697370:0:25728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d72bda27/0x7b044d4128f9cd82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.697378:0:25728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d72bda27/0x7b044d4128f9cd82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.697393:0:25728:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784938443.697510:0:25728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+35:16389:x1871643350872064:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 25999us (26839us total) trans 4294967464 rc 0/0 00000100:00100000:0.0:1784938443.697517:0:25728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 752 00010000:00010000:0.0:1784938443.697538:0:25727:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9cd9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.697548:0:25727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9cd9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.697557:0:25727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9cd9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.697564:0:25727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9cd9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.697576:0:25727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1784938443.697658:0:25727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+34:16392:x1871643350872960:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 24978us (26903us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1784938443.697668:0:25727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 756 00010000:00010000:0.0:1784938443.697788:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938443.697794:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d72bda27/0x7b044d4128f9cd82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.697802:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf0600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938443.697806:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d72bda27/0x7b044d4128f9cd82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.697816:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d72bda27/0x7b044d4128f9cd82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.697829:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d72bda27/0x7b044d4128f9cd82 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.697837:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d72bda27/0x7b044d4128f9cd82 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.697856:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938443.697859:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9cd9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.697866:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17b400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938443.697869:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9cd9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.697882:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9cd9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.697905:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9cd9e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.697913:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9cd9e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.697927:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.697929:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.697931:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.697942:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938443.699534:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a04ce4d5/0x7b044d4128f9a852 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636f6 expref: 66 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.699558:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.699562:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.699568:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004fe810d2/0x7b044d4128f9cd97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.699580:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fe810d2/0x7b044d4128f9cd97 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.699620:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.699665:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+65:10959:x1871643337463936:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3822us (12786us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.699675:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 359 00000100:00100000:1.0:1784938443.699734:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350875904:192.168.202.154@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1784938443.699806:0:21151:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004fe810d2/0x7b044d4128f9cd97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.699815:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fe810d2/0x7b044d4128f9cd97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.699829:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fe810d2/0x7b044d4128f9cd97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.699837:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fe810d2/0x7b044d4128f9cd97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.699860:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784938443.700178:0:25718:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25718:1871643350876160:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938443.700219:0:25718:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f249d7bae40 going to sleep for 11 seconds 00010000:00010000:3.0:1784938443.700237:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938443.700243:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fe810d2/0x7b044d4128f9cd97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.700251:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17a600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938443.700255:0:25732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fe810d2/0x7b044d4128f9cd97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.700268:0:25732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fe810d2/0x7b044d4128f9cd97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.700281:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fe810d2/0x7b044d4128f9cd97 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.700289:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fe810d2/0x7b044d4128f9cd97 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.700308:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938443.700310:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938443.700312:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938443.700416:0:25721:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000086e06a59/0x7b044d4128f9cd90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.700426:0:25721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086e06a59/0x7b044d4128f9cd90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.700435:0:25721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086e06a59/0x7b044d4128f9cd90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.700442:0:25721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086e06a59/0x7b044d4128f9cd90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.700455:0:25721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784938443.700574:0:25721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+35:16389:x1871643350873344:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 28273us (29863us total) trans 4294967465 rc 0/0 00000100:00100000:2.0:1784938443.700582:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 754 00000100:00100000:2.0:1784938443.700644:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938443.700745:0:25725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f180e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:25725:1871643350874240:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938443.700766:0:25725:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9cda5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.700815:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938443.700873:0:25722:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f248700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25722:1871643350874752:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938443.700970:0:25722:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005b9ed1c8/0x7b044d4128f9cdac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.701122:0:25724:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2381d2bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:25724:1871643350874880:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938443.701136:0:25724:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9cdb3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.701202:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.701228:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.701978:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+34:16392:x1871643350873088:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 29427us (31249us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1784938443.701988:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 755 00000100:00100000:1.0:1784938443.702010:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350875648 00000100:00100000:1.0:1784938443.702016:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350875648 00000100:00100000:1.0:1784938443.702174:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350875776 00000100:00100000:1.0:1784938443.702178:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350875776 00000100:00100000:1.0:1784938443.702199:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 764 00000100:00100000:1.0:1784938443.702207:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+34:16390:x1871643350875648:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1784938443.702234:0:21151:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:17 count 1 00010000:00010000:1.0:1784938443.702255:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021eb4aad/0x7b044d4128f9cddd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.702270:0:21151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b12ac78e/0x7b044d4128f9a8d7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663720 expref: 64 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.702277:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1784938443.702282:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.702288:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021eb4aad/0x7b044d4128f9cddd lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.702330:0:21151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b12ac78e/0x7b044d4128f9a8d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663720 expref: 64 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.702344:0:21151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b12ac78e/0x7b044d4128f9a8d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663720 expref: 64 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.702357:0:21151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:21151:1871643350876288:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938443.702400:0:21151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485023b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938443.702419:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337464192 00000100:00100000:1.0:1784938443.702422:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337464192 00010000:00010000:1.0:1784938443.702441:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000039cfb67e/0x7b044d4128f9a805 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663704 expref: 65 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.702460:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337464320 00000100:00100000:1.0:1784938443.702463:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337464320 00010000:00010000:1.0:1784938443.702474:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000caa17f53/0x7b044d4128f9a7e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636ef expref: 58 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.702487:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 362 00000100:00100000:1.0:1784938443.702493:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2488a66850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+65:10958:x1871643337464192:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.702501:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.702506:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000039cfb67e/0x7b044d4128f9a805 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663704 expref: 65 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.702523:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000039cfb67e/0x7b044d4128f9a805 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663704 expref: 65 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.702540:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039cfb67e/0x7b044d4128f9a805 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663704 expref: 65 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.702551:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.702555:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.702560:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9cda5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.702569:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9cda5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.702593:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.702610:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2488a66850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+64:10958:x1871643337464192:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 117us (1408us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.702616:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 362 00000100:00100000:1.0:1784938443.702649:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 363 00000100:00100000:1.0:1784938443.702655:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f180700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+58:10959:x1871643337464320:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.702662:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.702667:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000caa17f53/0x7b044d4128f9a7e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636ef expref: 58 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.702682:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000caa17f53/0x7b044d4128f9a7e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636ef expref: 58 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.702696:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000caa17f53/0x7b044d4128f9a7e2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636ef expref: 58 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.702706:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.702708:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.702712:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005b9ed1c8/0x7b044d4128f9cdac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.702719:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b9ed1c8/0x7b044d4128f9cdac lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.702736:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.702754:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f180700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+57:10959:x1871643337464320:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 99us (1525us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.702761:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 363 00000004:00080000:1.0:1784938443.702871:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24bd256300/2, rc 0, transno 4294967457 00000100:00100000:0.0:1784938443.703082:0:25728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 765 00000100:00100000:0.0:1784938443.703091:0:25728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+35:16390:x1871643350875776:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1784938443.703109:0:25728:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:38 count 1 00010000:00010000:0.0:1784938443.703125:0:25728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000018dca04/0x7b044d4128f9cde4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.703138:0:25728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000097f32afe/0x7b044d4128f9a8e5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663727 expref: 56 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.703171:0:25728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1784938443.703175:0:25728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.703178:0:25728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000018dca04/0x7b044d4128f9cde4 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.703202:0:25728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000097f32afe/0x7b044d4128f9a8e5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663727 expref: 56 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.703212:0:25728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000097f32afe/0x7b044d4128f9a8e5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663727 expref: 56 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.703224:0:25728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388124380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:25728:1871643350876416:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938443.703255:0:25728:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f249164b0c0 going to sleep for 11 seconds 00000004:00080000:0.0:1784938443.703289:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238d147800/2, rc 0, transno 4294967464 00000100:00100000:0.0:1784938443.703301:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d147800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350872064:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1784938443.703368:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938443.703379:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350876544:192.168.202.154@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1784938443.703421:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938443.703428:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086e06a59/0x7b044d4128f9cd90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.703435:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17a200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938443.703439:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086e06a59/0x7b044d4128f9cd90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.703447:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086e06a59/0x7b044d4128f9cd90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.703459:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086e06a59/0x7b044d4128f9cd90 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.703466:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086e06a59/0x7b044d4128f9cd90 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.703482:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.703484:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.703486:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.703494:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938443.703654:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.703762:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938443.703780:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350875904 00000100:00100000:0.0:1784938443.703785:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350875904 00000100:00100000:0.0:1784938443.703813:0:25720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 766 00000100:00100000:0.0:1784938443.703820:0:25720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:16391:x1871643350875904:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1784938443.703833:0:25720:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:25 count 1 00010000:00010000:0.0:1784938443.703850:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f74bf49c/0x7b044d4128f9cdeb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.703862:0:25720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002a9da5e4/0x7b044d4128f9a8fa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766372e expref: 63 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.703869:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1784938443.703872:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.703876:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f74bf49c/0x7b044d4128f9cdeb lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.703910:0:25720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002a9da5e4/0x7b044d4128f9a8fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e94766372e expref: 63 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.703924:0:25720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002a9da5e4/0x7b044d4128f9a8fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766372e expref: 63 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.703934:0:25720:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388126680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:25720:1871643350876672:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938443.703967:0:25720:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbe9c0 going to sleep for 11 seconds 00000004:00080000:0.0:1784938443.707639:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24bd254000/2, rc 0, transno 4294967465 00000100:00100000:0.0:1784938443.707664:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350873344:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1784938443.707749:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350876800:192.168.202.154@tcp:6:osp-syn-0-0.0 00010000:00010000:2.0:1784938443.708179:0:25725:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9cda5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.708194:0:25725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9cda5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.708206:0:25725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9cda5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.708215:0:25725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9cda5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.708239:0:25725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784938443.708392:0:25725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+36:16392:x1871643350873472:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 35572us (37621us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1784938443.708403:0:25725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 757 00010000:00010000:2.0:1784938443.708436:0:25722:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005b9ed1c8/0x7b044d4128f9cdac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.708445:0:25722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b9ed1c8/0x7b044d4128f9cdac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.708454:0:25722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b9ed1c8/0x7b044d4128f9cdac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.708461:0:25722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b9ed1c8/0x7b044d4128f9cdac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.708475:0:25722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1784938443.708545:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:16392:x1871643350874368:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 26489us (27878us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1784938443.708552:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 758 00010000:00010000:2.0:1784938443.708575:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938443.708581:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9cda5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.708590:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17b000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938443.708595:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9cda5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.708604:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9cda5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.708623:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9cda5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.708632:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9cda5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.708653:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938443.708656:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b9ed1c8/0x7b044d4128f9cdac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.708664:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17b600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938443.708667:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b9ed1c8/0x7b044d4128f9cdac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.708675:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b9ed1c8/0x7b044d4128f9cdac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.708685:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b9ed1c8/0x7b044d4128f9cdac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.708692:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b9ed1c8/0x7b044d4128f9cdac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.708704:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938443.708706:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938443.708708:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938443.708823:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.711292:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938443.711638:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd256300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350872960:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1784938443.711733:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938443.711750:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350876928:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1784938443.711820:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337464448 00000100:00100000:1.0:1784938443.711827:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337464448 00010000:00010000:1.0:1784938443.711860:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bd5af998/0x7b044d4128f9a7e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766370b expref: 64 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.712999:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 364 00000100:00100000:1.0:1784938443.713013:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f182a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+64:10959:x1871643337464448:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.713085:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.713093:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bd5af998/0x7b044d4128f9a7e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766370b expref: 64 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.713108:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bd5af998/0x7b044d4128f9a7e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766370b expref: 64 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.713129:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd5af998/0x7b044d4128f9a7e9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766370b expref: 64 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.713159:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.713163:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.713169:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9cdb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.713179:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9cdb3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.713208:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.713249:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f182a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+63:10959:x1871643337464448:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 240us (9595us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.713261:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 364 00010000:00010000:1.0:1784938443.713293:0:25724:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9cdb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.713302:0:25724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9cdb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.713314:0:25724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9cdb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.713333:0:25724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9cdb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.713350:0:25724:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938443.713503:0:25724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388247800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+36:16390:x1871643350874624:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 31260us (32190us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1784938443.713512:0:25724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 759 00010000:00010000:1.0:1784938443.713532:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938443.713538:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9cdb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.713546:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17ae00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938443.713550:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9cdb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.713559:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9cdb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.713572:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9cdb3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.713578:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9cdb3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.713596:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938443.713598:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938443.713600:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784938443.715185:0:16390:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24bd254380/2, rc 0, transno 4294967460 00000100:00100000:0.0:1784938443.715210:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350874624:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1784938443.715260:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938443.715285:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.715303:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938443.715362:0:25719:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388126300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:25719:1871643350875008:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938443.715382:0:25719:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9cdba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.715446:0:25729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388125c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:25729:1871643350875136:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938443.715459:0:25729:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000015b67b51/0x7b044d4128f9cdc1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.715506:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.715528:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938443.715557:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.715577:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337464960 00000100:00100000:0.0:1784938443.715583:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337464960 00010000:00010000:0.0:1784938443.715611:0:25731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000e788d2b/0x7b044d4128f9a779 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636cc expref: 63 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.715637:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337464832 00000100:00100000:0.0:1784938443.715640:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337464832 00010000:00010000:0.0:1784938443.715653:0:25731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000320d80b3/0x7b044d4128f9a860 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636fd expref: 57 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.715673:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 365 00000100:00100000:0.0:1784938443.715681:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388125c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+63:10958:x1871643337464960:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938443.715694:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938443.715700:0:25731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000e788d2b/0x7b044d4128f9a779 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636cc expref: 63 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.715712:0:25731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000e788d2b/0x7b044d4128f9a779 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636cc expref: 63 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.715732:0:25731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e788d2b/0x7b044d4128f9a779 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636cc expref: 63 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.715752:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.715757:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.715762:0:25731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000015b67b51/0x7b044d4128f9cdc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.715772:0:25731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015b67b51/0x7b044d4128f9cdc1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.715793:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938443.715824:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388125c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+62:10958:x1871643337464960:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 143us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.715831:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 365 00000100:00100000:0.0:1784938443.715848:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 366 00000100:00100000:0.0:1784938443.715854:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388126a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+57:10958:x1871643337464832:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938443.715862:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938443.715867:0:25731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000320d80b3/0x7b044d4128f9a860 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636fd expref: 57 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.715877:0:25731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000320d80b3/0x7b044d4128f9a860 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636fd expref: 57 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.716313:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337464704 00000100:00100000:3.0:1784938443.716317:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337464704 00000100:00100000:3.0:1784938443.716409:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 91 00000100:00100000:3.0:1784938443.716417:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+82:17096:x1871643337464704:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938443.716662:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+83:17096:x1871643337464704:12345-192.168.202.54@tcp:35:cp.0 Request processed in 245us (1374us total) trans 8589934840 rc 0/0 00000100:00100000:3.0:1784938443.716669:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 91 00000100:00100000:3.0:1784938443.716694:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350876544 00000100:00100000:3.0:1784938443.716697:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350876544 00000100:00100000:3.0:1784938443.716721:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350876800 00000100:00100000:3.0:1784938443.716723:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350876800 00000100:00100000:3.0:1784938443.716736:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350876928 00000100:00100000:3.0:1784938443.716739:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350876928 00000100:00100000:3.0:1784938443.716757:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 767 00000100:00100000:3.0:1784938443.716764:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:16391:x1871643350876544:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:3.0:1784938443.716781:0:21149:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:31 count 1 00010000:00010000:3.0:1784938443.716804:0:21149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9cdf2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.716819:0:21149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003bb5a6dc/0x7b044d4128f9a90f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663735 expref: 57 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.716827:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1784938443.716830:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.716834:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9cdf2 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.716860:0:21149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003bb5a6dc/0x7b044d4128f9a90f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663735 expref: 57 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.716871:0:21149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003bb5a6dc/0x7b044d4128f9a90f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663735 expref: 57 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938443.717426:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24bd257480/2, rc 0, transno 4294967458 00000100:00100000:1.0:1784938443.717445:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350873088:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1784938443.717454:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784938443.717466:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350877056:192.168.202.154@tcp:6:osp-syn-1-0.0 00000004:00080000:1.0:1784938443.717537:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24bd255880/2, rc 0, transno 4294967466 00000100:00100000:1.0:1784938443.717549:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350874368:192.168.202.154@tcp:6:osp-syn-0-0.0 00000004:00080000:1.0:1784938443.717558:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24bd254700/2, rc 0, transno 4294967459 00000100:00100000:1.0:1784938443.717562:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350873472:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1784938443.717620:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350877312:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1784938443.717651:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350877440:192.168.202.154@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1784938443.718003:0:25731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000320d80b3/0x7b044d4128f9a860 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636fd expref: 57 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.718030:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.718034:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.718039:0:25731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9cdba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.718048:0:25731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9cdba lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.718070:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938443.718092:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388126a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+56:10958:x1871643337464832:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 2239us (2535us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.718100:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 366 00000100:00100000:0.0:1784938443.718139:0:25727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 768 00000100:00100000:0.0:1784938443.718163:0:25727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+37:16389:x1871643350876800:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1784938443.718182:0:25727:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:28 count 1 00010000:00010000:0.0:1784938443.718198:0:25727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077eceeb9/0x7b044d4128f9cdf9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.718213:0:25727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000208322d9/0x7b044d4128f9a916 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663751 expref: 55 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.718220:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1784938443.718223:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.718226:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077eceeb9/0x7b044d4128f9cdf9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.718413:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 769 00000100:00100000:2.0:1784938443.718424:0:25721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:16389:x1871643350876928:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:2.0:1784938443.718439:0:25721:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:29 count 1 00010000:00010000:2.0:1784938443.718454:0:25721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000866e2be0/0x7b044d4128f9ce00 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.718472:0:25721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000056e6923c/0x7b044d4128f9a8de lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766373c expref: 61 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.718480:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784938443.718482:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.718487:0:25721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000866e2be0/0x7b044d4128f9ce00 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.718506:0:25721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000056e6923c/0x7b044d4128f9a8de lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e94766373c expref: 61 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.718518:0:25721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000056e6923c/0x7b044d4128f9a8de lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766373c expref: 61 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.718530:0:25721:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2381d2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:25721:1871643350877568:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938443.718566:0:25721:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d3a4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938443.718779:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.718813:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.718830:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938443.719089:0:25725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350877056 00000100:00100000:2.0:1784938443.719096:0:25725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350877056 00000100:00100000:2.0:1784938443.719138:0:25725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350877312 00000100:00100000:2.0:1784938443.719141:0:25725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350877312 00000100:00100000:2.0:1784938443.719181:0:25725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350877440 00000100:00100000:2.0:1784938443.719185:0:25725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350877440 00000100:00100000:2.0:1784938443.719197:0:25725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 770 00000100:00100000:2.0:1784938443.719204:0:25725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+39:16392:x1871643350877056:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:2.0:1784938443.719217:0:25725:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:2.0:1784938443.719231:0:25725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4e6532c/0x7b044d4128f9ce07 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.719245:0:25725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b94587ea/0x7b044d4128f9a8ec lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663743 expref: 61 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.719252:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784938443.719256:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.719260:0:25725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4e6532c/0x7b044d4128f9ce07 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.719281:0:25725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b94587ea/0x7b044d4128f9a8ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663743 expref: 61 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.719291:0:25725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b94587ea/0x7b044d4128f9a8ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663743 expref: 61 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.719303:0:25725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2381d28380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:25725:1871643350877696:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938443.719352:0:25725:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d3a4240 going to sleep for 11 seconds 00000100:00100000:2.0:1784938443.719370:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 771 00000100:00100000:2.0:1784938443.719377:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+39:16392:x1871643350877312:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:2.0:1784938443.719389:0:25722:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:33 count 1 00010000:00010000:2.0:1784938443.719400:0:25722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9ce0e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.719412:0:25722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5824ac7/0x7b044d4128f9a901 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766374a expref: 61 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.719419:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784938443.719422:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.719426:0:25722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9ce0e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.719442:0:25722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d5824ac7/0x7b044d4128f9a901 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e94766374a expref: 61 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.719452:0:25722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d5824ac7/0x7b044d4128f9a901 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766374a expref: 61 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.719462:0:25722:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2381d2ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25722:1871643350877824:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938443.719483:0:25722:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d3a4900 going to sleep for 11 seconds 00000100:00100000:1.0:1784938443.719604:0:25724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 772 00000100:00100000:1.0:1784938443.719613:0:25724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388247b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+39:16389:x1871643350877440:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1784938443.719625:0:25724:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:12 count 1 00010000:00010000:1.0:1784938443.719636:0:25724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000007385ab/0x7b044d4128f9ce15 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.719647:0:25724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000979273d6/0x7b044d4128f9a955 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663758 expref: 61 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.719654:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1784938443.719656:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.719660:0:25724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000007385ab/0x7b044d4128f9ce15 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.719677:0:25724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000979273d6/0x7b044d4128f9a955 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663758 expref: 61 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.719686:0:25724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000979273d6/0x7b044d4128f9a955 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663758 expref: 61 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.719696:0:25724:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388246680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:25724:1871643350877952:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938443.719725:0:25724:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b2d2cd80 going to sleep for 11 seconds 00010000:00010000:1.0:1784938443.720432:0:25729:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000015b67b51/0x7b044d4128f9cdc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.720444:0:25729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015b67b51/0x7b044d4128f9cdc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.720455:0:25729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015b67b51/0x7b044d4128f9cdc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.720462:0:25729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015b67b51/0x7b044d4128f9cdc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.720481:0:25729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938443.720608:0:25729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+40:16389:x1871643350871552:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 36334us (49977us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1784938443.720616:0:25729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 761 00000004:00080000:1.0:1784938443.720773:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f2c9180/2, rc 0, transno 4294967461 00000100:00100000:1.0:1784938443.720785:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f2c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350871552:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1784938443.720837:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938443.720847:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23882bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350878080:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1784938443.720979:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.720994:0:25729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350878080 00000100:00100000:1.0:1784938443.720999:0:25729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350878080 00000100:00100000:1.0:1784938443.721181:0:25729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 773 00000100:00100000:1.0:1784938443.721189:0:25729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+40:16389:x1871643350878080:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1784938443.721208:0:25729:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:27 count 1 00010000:00010000:1.0:1784938443.721226:0:25729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005979dcbb/0x7b044d4128f9ce1c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.721242:0:25729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000744dbf0d/0x7b044d4128f9a978 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766377b expref: 61 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.721250:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1784938443.721254:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.721257:0:25729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005979dcbb/0x7b044d4128f9ce1c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.721280:0:25729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000744dbf0d/0x7b044d4128f9a978 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e94766377b expref: 61 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.721291:0:25729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000744dbf0d/0x7b044d4128f9a978 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766377b expref: 61 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.721302:0:25729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23882bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:25729:1871643350878208:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938443.721347:0:25729:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b2d2cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938443.721998:0:21149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d144a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:21149:1871643350877184:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938443.722587:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.722608:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337465216 00000100:00100000:1.0:1784938443.722614:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337465216 00010000:00010000:1.0:1784938443.722642:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000096447157/0x7b044d4128f9a8f3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663712 expref: 56 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.722670:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 367 00000100:00100000:1.0:1784938443.722678:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+56:10960:x1871643337465216:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.722690:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.722696:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000096447157/0x7b044d4128f9a8f3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663712 expref: 56 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.722713:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000096447157/0x7b044d4128f9a8f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663712 expref: 56 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.722738:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.722742:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.722747:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9033458/0x7b044d4128f9cdcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.722758:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9033458/0x7b044d4128f9cdcf lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.722775:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.722813:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+56:10960:x1871643337465216:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 136us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.722821:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 367 00000100:00100000:1.0:1784938443.722860:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.722877:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337465728 00000100:00100000:1.0:1784938443.722880:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337465728 00010000:00010000:1.0:1784938443.722895:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000097f32afe/0x7b044d4128f9a8e5 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663727 expref: 56 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.722930:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 368 00000100:00100000:1.0:1784938443.722937:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+56:10960:x1871643337465728:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.722945:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.722949:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000097f32afe/0x7b044d4128f9a8e5 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663727 expref: 56 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.722960:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000097f32afe/0x7b044d4128f9a8e5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663727 expref: 56 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.722971:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.722974:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.722978:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000018dca04/0x7b044d4128f9cde4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.722986:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000018dca04/0x7b044d4128f9cde4 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.722999:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.723031:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+56:10960:x1871643337465728:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 95us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.723037:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 368 00000100:00100000:1.0:1784938443.723098:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.723116:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337465088 00000100:00100000:1.0:1784938443.723121:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337465088 00010000:00010000:1.0:1784938443.723170:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000062c9d3db/0x7b044d4128f9a84b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636da expref: 56 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.723192:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 369 00000100:00100000:1.0:1784938443.723199:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248abad450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+56:10960:x1871643337465088:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.723207:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.723212:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000062c9d3db/0x7b044d4128f9a84b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636da expref: 56 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.723223:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000062c9d3db/0x7b044d4128f9a84b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636da expref: 56 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.723235:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.723239:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.723243:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000480c0a41/0x7b044d4128f9cd89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.723251:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000480c0a41/0x7b044d4128f9cd89 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.723264:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.723283:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248abad450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+56:10960:x1871643337465088:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 84us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.723289:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 369 00000100:00100000:2.0:1784938443.723961:0:21151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:21151:1871643350876288:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938443.723983:0:21151:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000021eb4aad/0x7b044d4128f9cddd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.725377:0:25715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062c9d3db/0x7b044d4128f9a84b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636da expref: 55 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.725397:0:25715:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d146d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25715:1871643350873728:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938443.725556:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784938443.725571:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23882be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350878336:192.168.202.154@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1784938443.725648:0:25719:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9cdba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.725658:0:25719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9cdba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.725669:0:25719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9cdba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.725677:0:25719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9cdba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.725694:0:25719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1784938443.725840:0:25719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388246d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:16389:x1871643350874496:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 42876us (44481us total) trans 4294967467 rc 0/0 00000100:00100000:1.0:1784938443.725850:0:25719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 760 00000100:00100000:1.0:1784938443.725908:0:21629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388125f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:21629:1871643350875264:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938443.725971:0:25727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000208322d9/0x7b044d4128f9a916 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663751 expref: 54 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.725984:0:25727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000208322d9/0x7b044d4128f9a916 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663751 expref: 54 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.725996:0:25727:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388127100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:25727:1871643350878464:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938443.726057:0:25727:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbe300 going to sleep for 11 seconds 00010000:00010000:0.0:1784938443.726084:0:25728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097f32afe/0x7b044d4128f9a8e5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663727 expref: 54 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.726095:0:25728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388124380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:25728:1871643350876416:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938443.726113:0:25728:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000018dca04/0x7b044d4128f9cde4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.726123:0:25728:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000018dca04/0x7b044d4128f9cde4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.726139:0:25728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000018dca04/0x7b044d4128f9cde4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.726168:0:25728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000018dca04/0x7b044d4128f9cde4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.726180:0:25728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000018dca04/0x7b044d4128f9cde4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.726196:0:25728:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1784938443.726265:0:25728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+38:16390:x1871643350875776:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 23175us (25448us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1784938443.726273:0:25728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 765 00000100:00100000:0.0:1784938443.726329:0:25720:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388126680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:25720:1871643350876672:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938443.726343:0:25720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f74bf49c/0x7b044d4128f9cdeb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.726360:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784938443.726367:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015b67b51/0x7b044d4128f9cdc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.726375:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938443.726380:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015b67b51/0x7b044d4128f9cdc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.726390:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015b67b51/0x7b044d4128f9cdc1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.726407:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015b67b51/0x7b044d4128f9cdc1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.726419:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015b67b51/0x7b044d4128f9cdc1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.726437:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938443.726441:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9cdba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.726447:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b34200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938443.726450:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9cdba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.726458:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9cdba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.726468:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9cdba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.726475:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9cdba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.726491:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938443.726494:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000018dca04/0x7b044d4128f9cde4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.726501:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b34400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938443.726504:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000018dca04/0x7b044d4128f9cde4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.726511:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000018dca04/0x7b044d4128f9cde4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.726520:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000018dca04/0x7b044d4128f9cde4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.726527:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000018dca04/0x7b044d4128f9cde4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.726538:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.726539:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.726541:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.726547:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938443.727794:0:21149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2487fb16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938443.727841:0:25718:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25718:1871643350876160:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938443.727861:0:25718:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d5a6dfda/0x7b044d4128f9cdd6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.728075:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.728115:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337465600 00000100:00100000:0.0:1784938443.728122:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337465600 00010000:00010000:0.0:1784938443.728179:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b12ac78e/0x7b044d4128f9a8d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663720 expref: 62 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.728211:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 370 00000100:00100000:0.0:1784938443.728220:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388126680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+62:10960:x1871643337465600:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938443.728233:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938443.728238:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b12ac78e/0x7b044d4128f9a8d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663720 expref: 62 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.728255:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b12ac78e/0x7b044d4128f9a8d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663720 expref: 62 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.728273:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b12ac78e/0x7b044d4128f9a8d7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663720 expref: 62 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.728287:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.728291:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.728297:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000021eb4aad/0x7b044d4128f9cddd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.728307:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021eb4aad/0x7b044d4128f9cddd lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.728337:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938443.728362:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388126680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+61:10960:x1871643337465600:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 143us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.728370:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 370 00000100:00100000:0.0:1784938443.728439:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.728486:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.728515:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.728530:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337465344 00000100:00100000:0.0:1784938443.728533:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337465344 00010000:00010000:0.0:1784938443.728550:0:25731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002ff6aa56/0x7b044d4128f9a74f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636be expref: 54 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.728573:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337465856 00000100:00100000:0.0:1784938443.728576:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337465856 00010000:00010000:0.0:1784938443.728589:0:25731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002a9da5e4/0x7b044d4128f9a8fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766372e expref: 61 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.728604:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337465472 00000100:00100000:0.0:1784938443.728607:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337465472 00010000:00010000:0.0:1784938443.728617:0:25731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d310ee32/0x7b044d4128f9a908 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663719 expref: 62 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.728630:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 371 00000100:00100000:0.0:1784938443.728636:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388124380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+54:10957:x1871643337465344:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938443.728644:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938443.728649:0:25731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002ff6aa56/0x7b044d4128f9a74f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636be expref: 54 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.728658:0:25731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002ff6aa56/0x7b044d4128f9a74f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636be expref: 54 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.728671:0:25731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ff6aa56/0x7b044d4128f9a74f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476636be expref: 54 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.728681:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.728684:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.728689:0:25731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000077b8fdcf/0x7b044d4128f9cdc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.728699:0:25731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077b8fdcf/0x7b044d4128f9cdc8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.728713:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938443.728732:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388124380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+53:10957:x1871643337465344:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 95us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.728738:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 371 00000100:00100000:0.0:1784938443.728752:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 372 00000100:00100000:0.0:1784938443.728758:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388125500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+62:10957:x1871643337465856:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938443.728765:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938443.728770:0:25731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002a9da5e4/0x7b044d4128f9a8fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766372e expref: 62 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.728779:0:25731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002a9da5e4/0x7b044d4128f9a8fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766372e expref: 62 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.728792:0:25731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a9da5e4/0x7b044d4128f9a8fa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766372e expref: 62 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.728802:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.728805:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.728810:0:25731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f74bf49c/0x7b044d4128f9cdeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.728822:0:25731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f74bf49c/0x7b044d4128f9cdeb lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.728840:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938443.728860:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388125500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+61:10957:x1871643337465856:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 102us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.728866:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 372 00000100:00100000:0.0:1784938443.728879:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 373 00010000:00010000:3.0:1784938443.729109:0:21151:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000021eb4aad/0x7b044d4128f9cddd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.729118:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021eb4aad/0x7b044d4128f9cddd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.729137:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021eb4aad/0x7b044d4128f9cddd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.729171:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021eb4aad/0x7b044d4128f9cddd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.729190:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784938443.729335:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:16390:x1871643350875648:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 27127us (28689us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1784938443.729344:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 764 00000100:00100000:0.0:1784938443.729490:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388124e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+60:10957:x1871643337465472:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938443.729500:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938443.729505:0:25731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d310ee32/0x7b044d4128f9a908 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663719 expref: 60 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.729517:0:25731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d310ee32/0x7b044d4128f9a908 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663719 expref: 60 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.729532:0:25731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d310ee32/0x7b044d4128f9a908 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663719 expref: 60 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.729543:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.729547:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.729551:0:25731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5a6dfda/0x7b044d4128f9cdd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.729565:0:25731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5a6dfda/0x7b044d4128f9cdd6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.729581:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938443.729601:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388124e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+59:10957:x1871643337465472:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 716us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.729608:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 373 00010000:00010000:0.0:1784938443.729636:0:25720:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f74bf49c/0x7b044d4128f9cdeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.729644:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f74bf49c/0x7b044d4128f9cdeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.729654:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f74bf49c/0x7b044d4128f9cdeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.729662:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f74bf49c/0x7b044d4128f9cdeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.729678:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1784938443.729741:0:25720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:16391:x1871643350875904:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 25921us (25980us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1784938443.729749:0:25720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 766 00010000:00010000:0.0:1784938443.729765:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938443.729771:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021eb4aad/0x7b044d4128f9cddd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.729780:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c559600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938443.729785:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021eb4aad/0x7b044d4128f9cddd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.729795:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021eb4aad/0x7b044d4128f9cddd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.729807:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021eb4aad/0x7b044d4128f9cddd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.729815:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021eb4aad/0x7b044d4128f9cddd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.729830:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938443.729833:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f74bf49c/0x7b044d4128f9cdeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.729840:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938443.729843:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f74bf49c/0x7b044d4128f9cdeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.729850:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f74bf49c/0x7b044d4128f9cdeb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.729859:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f74bf49c/0x7b044d4128f9cdeb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.729867:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f74bf49c/0x7b044d4128f9cdeb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.729879:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.729880:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938443.729987:0:25718:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d5a6dfda/0x7b044d4128f9cdd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.729997:0:25718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5a6dfda/0x7b044d4128f9cdd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.730006:0:25718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5a6dfda/0x7b044d4128f9cdd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.730087:0:25718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5a6dfda/0x7b044d4128f9cdd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.730101:0:25718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784938443.730239:0:25718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:16392:x1871643350875520:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 33437us (43917us total) trans 4294967464 rc 0/0 00000100:00100000:3.0:1784938443.730246:0:25718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 763 00010000:00010000:2.0:1784938443.730366:0:25715:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000480c0a41/0x7b044d4128f9cd89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.730382:0:25715:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000480c0a41/0x7b044d4128f9cd89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.730388:0:25715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000480c0a41/0x7b044d4128f9cd89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.730395:0:25715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000480c0a41/0x7b044d4128f9cd89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.730402:0:25715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000480c0a41/0x7b044d4128f9cd89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.730414:0:25715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1784938443.730492:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381360050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:16389:x1871643350873216:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 58705us (59801us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1784938443.730500:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 753 00010000:00010000:2.0:1784938443.730545:0:25730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096447157/0x7b044d4128f9a8f3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663712 expref: 52 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.730556:0:25730:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d147b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:25730:1871643350876032:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938443.730568:0:25730:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9033458/0x7b044d4128f9cdcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.730577:0:25730:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9033458/0x7b044d4128f9cdcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.730584:0:25730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9033458/0x7b044d4128f9cdcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.730592:0:25730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9033458/0x7b044d4128f9cdcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.730599:0:25730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9033458/0x7b044d4128f9cdcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.730609:0:25730:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1784938443.730664:0:25730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+38:16391:x1871643350875392:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 34144us (44654us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1784938443.730671:0:25730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 762 00000100:00100000:2.0:1784938443.730723:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.730754:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337465984 00000100:00100000:2.0:1784938443.730759:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337465984 00000100:00100000:2.0:1784938443.730792:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 463 00000100:00100000:2.0:1784938443.730799:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+83:17096:x1871643337465984:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938443.730818:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938443.730835:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7600/0x7b044d4128f9ce23 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476641d1 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.730981:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784938443.730987:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5a6dfda/0x7b044d4128f9cdd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.730996:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938443.730999:0:25732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5a6dfda/0x7b044d4128f9cdd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.731008:0:25732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5a6dfda/0x7b044d4128f9cdd6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.731083:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5a6dfda/0x7b044d4128f9cdd6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.731093:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5a6dfda/0x7b044d4128f9cdd6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.731108:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938443.731112:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000480c0a41/0x7b044d4128f9cd89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.731119:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf0000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938443.731122:0:25732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000480c0a41/0x7b044d4128f9cd89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.731217:0:25732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000480c0a41/0x7b044d4128f9cd89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.731230:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000480c0a41/0x7b044d4128f9cd89 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.731238:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000480c0a41/0x7b044d4128f9cd89 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.731252:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938443.731255:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9033458/0x7b044d4128f9cdcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.731261:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1e00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938443.731264:0:25732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9033458/0x7b044d4128f9cdcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.731271:0:25732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9033458/0x7b044d4128f9cdcf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.731285:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9033458/0x7b044d4128f9cdcf lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.731292:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9033458/0x7b044d4128f9cdcf lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.731303:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938443.731305:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938443.731307:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.731375:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.731381:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.731386:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938443.731497:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.731515:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337466112 00000100:00100000:0.0:1784938443.731520:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337466112 00010000:00010000:0.0:1784938443.731539:0:25731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000056e6923c/0x7b044d4128f9a8de lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766373c expref: 59 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.731560:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 374 00000100:00100000:0.0:1784938443.731566:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388124000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+59:10957:x1871643337466112:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938443.731576:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938443.731580:0:25731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000056e6923c/0x7b044d4128f9a8de lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766373c expref: 59 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.731590:0:25731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000056e6923c/0x7b044d4128f9a8de lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766373c expref: 59 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.731606:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.731610:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.731616:0:25731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000866e2be0/0x7b044d4128f9ce00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.731625:0:25731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000866e2be0/0x7b044d4128f9ce00 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.731640:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938443.731661:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388124000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+59:10957:x1871643337466112:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 96us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.731668:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 374 00000100:00100000:0.0:1784938443.731784:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.731798:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337466240 00000100:00100000:0.0:1784938443.731802:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337466240 00010000:00010000:0.0:1784938443.731814:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b94587ea/0x7b044d4128f9a8ec lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663743 expref: 59 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.731832:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 375 00000100:00100000:0.0:1784938443.731838:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388125180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+59:10959:x1871643337466240:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938443.731845:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938443.731850:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b94587ea/0x7b044d4128f9a8ec lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663743 expref: 59 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.731859:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b94587ea/0x7b044d4128f9a8ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663743 expref: 59 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.731870:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.731874:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.731878:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4e6532c/0x7b044d4128f9ce07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.731995:0:25721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056e6923c/0x7b044d4128f9a8de lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766373c expref: 59 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.732009:0:25721:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2381d2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:25721:1871643350877568:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938443.732090:0:25721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000866e2be0/0x7b044d4128f9ce00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.732101:0:25721:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000866e2be0/0x7b044d4128f9ce00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.732108:0:25721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000866e2be0/0x7b044d4128f9ce00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.732118:0:25721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000866e2be0/0x7b044d4128f9ce00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.732230:0:21629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000077b8fdcf/0x7b044d4128f9cdc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.732267:0:25724:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388246680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:25724:1871643350877952:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938443.732279:0:25724:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000007385ab/0x7b044d4128f9ce15 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.732303:0:25729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23882bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:25729:1871643350878208:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938443.732315:0:25729:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005979dcbb/0x7b044d4128f9ce1c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.732339:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938443.732344:0:21629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000077b8fdcf/0x7b044d4128f9cdc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.732356:0:21629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077b8fdcf/0x7b044d4128f9cdc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.732364:0:21629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077b8fdcf/0x7b044d4128f9cdc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.732370:0:21629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077b8fdcf/0x7b044d4128f9cdc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.732385:0:21629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938443.732495:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+38:16389:x1871643350871936:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 66639us (69623us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1784938443.732503:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 751 00000100:00100000:1.0:1784938443.732623:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.732662:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.732677:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337466368 00000100:00100000:1.0:1784938443.732681:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337466368 00010000:00010000:1.0:1784938443.732699:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d5824ac7/0x7b044d4128f9a901 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766374a expref: 59 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.732717:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337466496 00000100:00100000:1.0:1784938443.732719:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337466496 00010000:00010000:1.0:1784938443.732730:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000979273d6/0x7b044d4128f9a955 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663758 expref: 60 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.732742:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 376 00000100:00100000:1.0:1784938443.732748:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24829e3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+60:10959:x1871643337466368:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.732757:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.732761:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d5824ac7/0x7b044d4128f9a901 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766374a expref: 60 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.732771:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d5824ac7/0x7b044d4128f9a901 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766374a expref: 60 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.732785:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.732789:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.732793:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9ce0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.732802:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9ce0e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.732815:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.732832:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24829e3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+60:10959:x1871643337466368:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 84us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.732838:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 376 00000100:00100000:1.0:1784938443.732852:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 377 00000100:00100000:1.0:1784938443.732857:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+59:10957:x1871643337466496:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.732865:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.732869:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000979273d6/0x7b044d4128f9a955 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663758 expref: 59 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.732990:0:25721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000866e2be0/0x7b044d4128f9ce00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.733003:0:25721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1784938443.733091:0:25721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:16389:x1871643350876928:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 14669us (17561us total) trans 4294967465 rc 0/0 00000100:00100000:3.0:1784938443.733098:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 769 00010000:00010000:3.0:1784938443.733123:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938443.733232:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9ce2a lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.733246:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9ce2a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.733255:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9ce2a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.733269:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9ce31 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x489b8eb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.733276:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9ce31 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.733283:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9ce31 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.733332:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9ce2a lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.733340:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9ce2a lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.733346:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9ce2a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.733352:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9ce2a lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.733358:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a6200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938443.733363:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9ce2a lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.733369:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9ce2a lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.733379:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938443.733382:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.733386:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9ce2a lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.733392:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6200/0x7b044d4128f9ce2a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.733403:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9ce31 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.733409:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9ce31 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.733415:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9ce31 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.733420:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a6400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938443.733423:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9ce31 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.733429:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9ce31 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.733436:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x489b8eb2 (ffff9f23861f4800) 00010000:00010000:2.0:1784938443.733438:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.733441:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9ce31 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.733446:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6400/0x7b044d4128f9ce31 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.733479:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7600/0x7b044d4128f9ce23 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641d1 expref: 84 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.733488:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938443.733490:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.733494:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7600/0x7b044d4128f9ce23 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641d1 expref: 84 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.733502:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a7600, rc 0) 00000100:00100000:2.0:1784938443.733525:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+83:17096:x1871643337465984:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2726us (2802us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938443.733531:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 463 00010000:00010000:2.0:1784938443.733577:0:25725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b94587ea/0x7b044d4128f9a8ec lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663743 expref: 59 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.733588:0:25725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2381d28380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:25725:1871643350877696:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938443.733711:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077b8fdcf/0x7b044d4128f9cdc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.733718:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b34a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938443.733721:0:25732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077b8fdcf/0x7b044d4128f9cdc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.733728:0:25732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077b8fdcf/0x7b044d4128f9cdc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.733740:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077b8fdcf/0x7b044d4128f9cdc8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.733746:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077b8fdcf/0x7b044d4128f9cdc8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.733764:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938443.733768:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000866e2be0/0x7b044d4128f9ce00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.733774:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a7400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938443.733777:0:25732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000866e2be0/0x7b044d4128f9ce00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.733784:0:25732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000866e2be0/0x7b044d4128f9ce00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.733793:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000866e2be0/0x7b044d4128f9ce00 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.733799:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000866e2be0/0x7b044d4128f9ce00 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.733811:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938443.733813:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938443.733815:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.733876:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4e6532c/0x7b044d4128f9ce07 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.733993:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000979273d6/0x7b044d4128f9a955 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663758 expref: 58 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.734008:0:22955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000979273d6/0x7b044d4128f9a955 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663758 expref: 58 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.734213:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.734216:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.734221:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000007385ab/0x7b044d4128f9ce15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.734230:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000007385ab/0x7b044d4128f9ce15 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.734253:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.734279:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+57:10957:x1871643337466496:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 1421us (1616us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.734288:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 377 00000100:00100000:1.0:1784938443.734383:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.734403:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337466624 00000100:00100000:1.0:1784938443.734409:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337466624 00010000:00010000:1.0:1784938443.734429:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000744dbf0d/0x7b044d4128f9a978 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766377b expref: 57 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.734454:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 378 00000100:00100000:1.0:1784938443.734462:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+57:10957:x1871643337466624:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.734472:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.734476:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000744dbf0d/0x7b044d4128f9a978 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766377b expref: 57 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.734485:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000744dbf0d/0x7b044d4128f9a978 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766377b expref: 57 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.734498:0:22955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000744dbf0d/0x7b044d4128f9a978 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766377b expref: 57 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.734507:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.734510:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.734514:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005979dcbb/0x7b044d4128f9ce1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.734523:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005979dcbb/0x7b044d4128f9ce1c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.734540:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.734557:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+56:10957:x1871643337466624:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 96us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.734564:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 378 00010000:00010000:1.0:1784938443.734582:0:25729:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005979dcbb/0x7b044d4128f9ce1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.734597:0:25729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005979dcbb/0x7b044d4128f9ce1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.734606:0:25729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005979dcbb/0x7b044d4128f9ce1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.734613:0:25729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005979dcbb/0x7b044d4128f9ce1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.734626:0:25729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938443.734724:0:25729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+41:16389:x1871643350878080:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 13535us (13744us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1784938443.734731:0:25729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 773 00010000:00010000:2.0:1784938443.736669:0:25725:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c4e6532c/0x7b044d4128f9ce07 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.736750:0:25722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5824ac7/0x7b044d4128f9a901 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766374a expref: 55 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.736766:0:25722:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2381d2ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25722:1871643350877824:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938443.736793:0:25722:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9ce0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.736802:0:25722:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9ce0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.736810:0:25722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9ce0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.736820:0:25722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9ce0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.736827:0:25722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9ce0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.736856:0:25722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784938443.736983:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938443.737096:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388125180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+54:10959:x1871643337466240:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 5256us (5309us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.737107:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 375 00010000:00010000:0.0:1784938443.737182:0:25725:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c4e6532c/0x7b044d4128f9ce07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.737192:0:25725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4e6532c/0x7b044d4128f9ce07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.737202:0:25725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4e6532c/0x7b044d4128f9ce07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.737210:0:25725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4e6532c/0x7b044d4128f9ce07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.737222:0:25725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1784938443.737339:0:25725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+41:16392:x1871643350877056:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 18133us (18560us total) trans 4294967467 rc 0/0 00000100:00100000:0.0:1784938443.737347:0:25725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 770 00010000:00010000:0.0:1784938443.737373:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784938443.737380:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005979dcbb/0x7b044d4128f9ce1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.737388:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c559000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938443.737392:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005979dcbb/0x7b044d4128f9ce1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.737402:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005979dcbb/0x7b044d4128f9ce1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.737420:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005979dcbb/0x7b044d4128f9ce1c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.737427:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005979dcbb/0x7b044d4128f9ce1c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.737447:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938443.737450:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9ce0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.737457:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a7000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938443.737460:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9ce0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.737467:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9ce0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.737481:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9ce0e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.737489:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9ce0e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.737505:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938443.737508:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4e6532c/0x7b044d4128f9ce07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.737515:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a6000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938443.737518:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4e6532c/0x7b044d4128f9ce07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.737526:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4e6532c/0x7b044d4128f9ce07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.737535:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4e6532c/0x7b044d4128f9ce07 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.737541:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4e6532c/0x7b044d4128f9ce07 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.737552:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.737554:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.737556:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.737563:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784938443.737744:0:16391:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24b6b8ed80/2, rc 0, transno 4294967463 00000100:00100000:0.0:1784938443.737757:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350875904:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1784938443.737832:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350878592:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:2.0:1784938443.738129:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:16392:x1871643350877312:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 18751us (19313us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1784938443.738138:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 771 00010000:00010000:2.0:1784938443.738174:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938443.738712:0:25724:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000007385ab/0x7b044d4128f9ce15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.738725:0:25724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000007385ab/0x7b044d4128f9ce15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.738736:0:25724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000007385ab/0x7b044d4128f9ce15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.738750:0:25724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000007385ab/0x7b044d4128f9ce15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938443.738868:0:16390:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24b6b8c700/2, rc 0, transno 4294967462 00010000:00010000:3.0:1784938443.738993:0:25724:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784938443.739190:0:25724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388247b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+41:16389:x1871643350877440:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 19576us (20356us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1784938443.739199:0:25724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 772 00010000:00010000:3.0:1784938443.739246:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938443.739252:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000007385ab/0x7b044d4128f9ce15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.739259:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c559a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938443.739263:0:25732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000007385ab/0x7b044d4128f9ce15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.739271:0:25732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000007385ab/0x7b044d4128f9ce15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.739288:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000007385ab/0x7b044d4128f9ce15 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.739296:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000007385ab/0x7b044d4128f9ce15 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.739315:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938443.739318:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938443.739329:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938443.739404:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350875648:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1784938443.739529:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.739552:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337466752 00000100:00100000:1.0:1784938443.739559:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337466752 00010000:00010000:1.0:1784938443.739589:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000208322d9/0x7b044d4128f9a916 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663751 expref: 52 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.739619:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 379 00000100:00100000:1.0:1784938443.739627:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+52:10959:x1871643337466752:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.739638:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.739645:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000208322d9/0x7b044d4128f9a916 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663751 expref: 52 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.739655:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000208322d9/0x7b044d4128f9a916 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663751 expref: 52 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.739675:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.739679:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.739685:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000077eceeb9/0x7b044d4128f9cdf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.739696:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077eceeb9/0x7b044d4128f9cdf9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.739712:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.739732:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+52:10959:x1871643337466752:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 106us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.739738:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 379 00000100:00100000:1.0:1784938443.739788:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.740365:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.740539:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388124380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350878720:192.168.202.154@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1784938443.740618:0:25727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000208322d9/0x7b044d4128f9a916 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663751 expref: 51 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.740631:0:25727:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388127100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:25727:1871643350878464:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938443.740648:0:25727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000077eceeb9/0x7b044d4128f9cdf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.740658:0:25727:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000077eceeb9/0x7b044d4128f9cdf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.740665:0:25727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077eceeb9/0x7b044d4128f9cdf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.740674:0:25727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077eceeb9/0x7b044d4128f9cdf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.740682:0:25727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077eceeb9/0x7b044d4128f9cdf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.740700:0:25727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784938443.740800:0:25727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+38:16389:x1871643350876800:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 22653us (25495us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1784938443.740808:0:25727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 768 00000100:00100000:0.0:1784938443.740834:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337466880 00000100:00100000:0.0:1784938443.740839:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337466880 00010000:00010000:0.0:1784938443.740859:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003bb5a6dc/0x7b044d4128f9a90f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663735 expref: 51 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.740882:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 380 00000100:00100000:0.0:1784938443.740959:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+51:10959:x1871643337466880:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938443.740969:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938443.740974:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003bb5a6dc/0x7b044d4128f9a90f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663735 expref: 51 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.740987:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003bb5a6dc/0x7b044d4128f9a90f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663735 expref: 51 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.741005:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.741009:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.741078:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9cdf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.741089:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9cdf2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.741104:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938443.741123:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+51:10959:x1871643337466880:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 167us (1335us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.741129:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 380 00010000:00010000:0.0:1784938443.741182:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938443.741187:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077eceeb9/0x7b044d4128f9cdf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.741195:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938443.741198:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077eceeb9/0x7b044d4128f9cdf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.741207:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077eceeb9/0x7b044d4128f9cdf9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.741219:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077eceeb9/0x7b044d4128f9cdf9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.741226:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077eceeb9/0x7b044d4128f9cdf9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.741245:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.741247:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.741248:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.741254:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938443.741396:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000004:00080000:0.0:1784938443.741452:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24bd255500/2, rc 0, transno 4294967467 00000100:00100000:0.0:1784938443.741465:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350874496:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1784938443.741512:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350878848:192.168.202.154@tcp:6:osp-syn-0-0.0 00000004:00080000:0.0:1784938443.741582:0:16390:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24b6b8ce00/2, rc 0, transno 4294967468 00000100:00100000:0.0:1784938443.741590:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350875776:192.168.202.154@tcp:6:osp-syn-0-0.0 00010000:00010000:3.0:1784938443.741723:0:21149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bb5a6dc/0x7b044d4128f9a90f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663735 expref: 50 pid: 25716 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.741735:0:21149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d144a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:21149:1871643350877184:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938443.741750:0:21149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9cdf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.741758:0:21149:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9cdf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.741765:0:21149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9cdf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.741773:0:21149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9cdf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.741781:0:21149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9cdf2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.741799:0:21149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784938443.742004:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337467008 00000100:00100000:2.0:1784938443.742009:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337467008 00000100:00100000:2.0:1784938443.742512:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 464 00000100:00100000:2.0:1784938443.742521:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+83:17096:x1871643337467008:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938443.742538:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938443.742557:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9ce38 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476641d8 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.742619:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9ce3f lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.742632:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9ce3f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.742643:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9ce3f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.742657:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7400/0x7b044d4128f9ce46 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x489b8eb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.742664:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7400/0x7b044d4128f9ce46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.742671:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7400/0x7b044d4128f9ce46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.742710:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9ce3f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.742717:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9ce3f lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.742723:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9ce3f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.742729:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a7a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938443.742734:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9ce3f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.742741:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9ce3f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.742751:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938443.742754:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.742758:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9ce3f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.742764:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9ce3f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.742775:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7400/0x7b044d4128f9ce46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.742781:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7400/0x7b044d4128f9ce46 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.742787:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7400/0x7b044d4128f9ce46 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.742792:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a7400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938443.742795:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7400/0x7b044d4128f9ce46 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.742800:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7400/0x7b044d4128f9ce46 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.742808:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x489b8eb2 (ffff9f23861f4c00) 00010000:00010000:2.0:1784938443.742810:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.742813:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7400/0x7b044d4128f9ce46 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.742819:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7400/0x7b044d4128f9ce46 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.742849:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9ce38 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641d8 expref: 84 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.742862:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938443.742864:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.742867:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9ce38 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641d8 expref: 84 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.742875:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a6a00, rc 0) 00000100:00100000:2.0:1784938443.743219:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+83:17096:x1871643337467008:12345-192.168.202.54@tcp:101:cp.0 Request processed in 697us (2853us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938443.743227:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 464 00010000:00010000:2.0:1784938443.743251:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938443.743257:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9cdf2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.743265:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf0400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938443.743268:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9cdf2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.743276:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9cdf2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.743289:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9cdf2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.743296:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e54ea8ff/0x7b044d4128f9cdf2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.743318:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938443.743330:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938443.743332:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938443.743415:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938443.743472:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00010000:00010000:2.0:1784938443.743492:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938443.743502:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350878336 00000100:00100000:2.0:1784938443.743507:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350878336 00000100:00100000:2.0:1784938443.743528:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350878592 00000100:00100000:2.0:1784938443.743531:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350878592 00000100:00100000:2.0:1784938443.743542:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350878720 00000100:00100000:2.0:1784938443.743544:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350878720 00000100:00100000:2.0:1784938443.743559:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 774 00000100:00100000:2.0:1784938443.743565:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:16392:x1871643350878336:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:2.0:1784938443.743584:0:25716:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:18 count 1 00010000:00010000:2.0:1784938443.743600:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e788d2b/0x7b044d4128f9ce4d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.743614:0:25716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4b45686/0x7b044d4128f9a95c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766375f expref: 49 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.743622:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784938443.743626:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.743630:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e788d2b/0x7b044d4128f9ce4d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.743655:0:25716:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c4b45686/0x7b044d4128f9a95c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e94766375f expref: 49 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.743668:0:25716:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c4b45686/0x7b044d4128f9a95c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766375f expref: 49 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.743682:0:25716:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2381d2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25716:1871643350879104:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938443.743723:0:25716:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d3a4240 going to sleep for 11 seconds 00000004:00080000:0.0:1784938443.743791:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24b6b8dc00/2, rc 0, transno 4294967464 00000100:00100000:0.0:1784938443.743811:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350875520:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1784938443.743818:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938443.743829:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350878976:192.168.202.154@tcp:6:osp-syn-0-0.0 00000004:00080000:0.0:1784938443.743869:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24b6b8e680/2, rc 0, transno 4294967468 00000100:00100000:0.0:1784938443.743874:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350877312:192.168.202.154@tcp:6:osp-syn-1-0.0 00000004:00080000:0.0:1784938443.743894:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238d146a00/2, rc 0, transno 4294967467 00000100:00100000:0.0:1784938443.743899:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350877056:192.168.202.154@tcp:6:osp-syn-1-0.0 00000004:00080000:0.0:1784938443.743922:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f23882bdc00/2, rc 0, transno 4294967466 00000100:00100000:0.0:1784938443.743926:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23882bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350878080:192.168.202.154@tcp:6:osp-syn-1-0.0 00000004:00080000:0.0:1784938443.743933:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24b6b8d500/2, rc 0, transno 4294967469 00000100:00100000:0.0:1784938443.743936:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350877440:192.168.202.154@tcp:6:osp-syn-1-0.0 00000004:00080000:0.0:1784938443.743942:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24b6b8f100/2, rc 0, transno 4294967465 00000100:00100000:0.0:1784938443.743945:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350876928:192.168.202.154@tcp:6:osp-syn-1-0.0 00000004:00080000:0.0:1784938443.743955:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f2388124a80/2, rc 0, transno 4294967472 00000100:00100000:0.0:1784938443.743963:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350876800:192.168.202.154@tcp:6:osp-syn-0-0.0 00000004:00080000:0.0:1784938443.743974:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24bd254e00/2, rc 0, transno 4294967469 00000100:00100000:0.0:1784938443.743978:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350873216:192.168.202.154@tcp:6:osp-syn-0-0.0 00000004:00080000:0.0:1784938443.743987:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238d145c00/2, rc 0, transno 4294967471 00000100:00100000:0.0:1784938443.743991:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d145c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350871936:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1784938443.744010:0:25728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 775 00000100:00100000:0.0:1784938443.744031:0:25728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+42:16392:x1871643350878592:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1784938443.744046:0:25728:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:40 count 1 00010000:00010000:0.0:1784938443.744061:0:25728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f74bf49c/0x7b044d4128f9ce54 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.744074:0:25728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004435011c/0x7b044d4128f9a97f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663782 expref: 53 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.744081:0:25728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1784938443.744084:0:25728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.744088:0:25728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f74bf49c/0x7b044d4128f9ce54 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.744109:0:25728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004435011c/0x7b044d4128f9a97f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663782 expref: 53 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.744119:0:25728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004435011c/0x7b044d4128f9a97f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663782 expref: 53 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.744130:0:25728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388124000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:25728:1871643350879232:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938443.744172:0:25728:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbe300 going to sleep for 11 seconds 00000100:00100000:0.0:1784938443.744230:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350879360:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1784938443.744267:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350879488:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1784938443.744291:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938443.744296:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350879616:192.168.202.154@tcp:6:osp-syn-0-0.0 00000004:00080000:0.0:1784938443.744348:0:16391:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f2388245880/2, rc 0, transno 4294967470 00000100:00100000:0.0:1784938443.744356:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350875392:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1784938443.744387:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938443.744394:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388125c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350879744:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1784938443.744590:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938443.744614:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938443.744632:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350878848 00000100:00100000:0.0:1784938443.744636:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350878848 00000100:00100000:0.0:1784938443.744666:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350878976 00000100:00100000:0.0:1784938443.744668:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350878976 00000100:00100000:0.0:1784938443.744687:0:25720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 776 00000100:00100000:0.0:1784938443.744693:0:25720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+42:16389:x1871643350878720:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1784938443.744708:0:25720:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:16 count 1 00010000:00010000:0.0:1784938443.744722:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf7e7655/0x7b044d4128f9ce5b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.744733:0:25720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb10cc2f/0x7b044d4128f9a98d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663790 expref: 53 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.744741:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1784938443.744744:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.744748:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf7e7655/0x7b044d4128f9ce5b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.744769:0:25720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cb10cc2f/0x7b044d4128f9a98d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663790 expref: 53 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.744778:0:25720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cb10cc2f/0x7b044d4128f9a98d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663790 expref: 53 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.744790:0:25720:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387daed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:25720:1871643350879872:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938443.744814:0:25720:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbe9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938443.744833:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 777 00000100:00100000:0.0:1784938443.744840:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:16390:x1871643350878848:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1784938443.744856:0:25715:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:22 count 1 00010000:00010000:0.0:1784938443.744869:0:25715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9ce62 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.744882:0:25715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da59e430/0x7b044d4128f9a963 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663766 expref: 49 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.744889:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1784938443.744892:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.744895:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9ce62 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.744920:0:25715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000da59e430/0x7b044d4128f9a963 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663766 expref: 49 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.744931:0:25715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000da59e430/0x7b044d4128f9a963 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663766 expref: 49 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.744941:0:25715:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387daf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25715:1871643350880000:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938443.744961:0:25715:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbe000 going to sleep for 11 seconds 00000100:00100000:0.0:1784938443.744976:0:25718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 778 00000100:00100000:0.0:1784938443.744982:0:25718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:16392:x1871643350878976:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1784938443.744993:0:25718:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:0.0:1784938443.745003:0:25718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015b67b51/0x7b044d4128f9ce69 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.745014:0:25718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006887c39c/0x7b044d4128f9a96a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766376d expref: 49 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.745021:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1784938443.745024:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.745028:0:25718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015b67b51/0x7b044d4128f9ce69 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.745044:0:25718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006887c39c/0x7b044d4128f9a96a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e94766376d expref: 49 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.745058:0:25718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006887c39c/0x7b044d4128f9a96a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766376d expref: 49 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.745068:0:25718:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd255180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25718:1871643350880128:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938443.745086:0:25718:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbea80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938443.745109:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938443.745125:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938443.745164:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938443.745185:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.745446:0:25726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350879360 00000100:00100000:1.0:1784938443.745452:0:25726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350879360 00000100:00100000:1.0:1784938443.745484:0:25726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350879488 00000100:00100000:1.0:1784938443.745487:0:25726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350879488 00000100:00100000:1.0:1784938443.745502:0:25726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350879616 00000100:00100000:1.0:1784938443.745505:0:25726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350879616 00000100:00100000:1.0:1784938443.745520:0:25726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350879744 00000100:00100000:1.0:1784938443.745523:0:25726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350879744 00000100:00100000:1.0:1784938443.745540:0:25726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 779 00000100:00100000:1.0:1784938443.745547:0:25726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+45:16392:x1871643350879360:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1784938443.745566:0:25726:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:33 count 1 00010000:00010000:1.0:1784938443.745580:0:25726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f873e89f/0x7b044d4128f9ce70 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.745593:0:25726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006a0b2b36/0x7b044d4128f9a971 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663774 expref: 49 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.745600:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1784938443.745603:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.745606:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f873e89f/0x7b044d4128f9ce70 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.745626:0:25726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006a0b2b36/0x7b044d4128f9a971 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663774 expref: 49 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.745636:0:25726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006a0b2b36/0x7b044d4128f9a971 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663774 expref: 49 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.745646:0:25726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23882bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:25726:1871643350880256:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938443.745680:0:25726:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2482d95540 going to sleep for 11 seconds 00000100:00100000:1.0:1784938443.745700:0:25724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 780 00000100:00100000:1.0:1784938443.745707:0:25724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+45:16389:x1871643350879488:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1784938443.745718:0:25724:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:39 count 1 00010000:00010000:1.0:1784938443.745730:0:25724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7a2d07f/0x7b044d4128f9ce77 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.745743:0:25724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003889d17a/0x7b044d4128f987eb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947662f4e expref: 49 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.745749:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=14s v=(0 0) 00010000:00010000:1.0:1784938443.745751:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.745755:0:25724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7a2d07f/0x7b044d4128f9ce77 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.745773:0:25724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003889d17a/0x7b044d4128f987eb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947662f4e expref: 49 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.745782:0:25724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003889d17a/0x7b044d4128f987eb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947662f4e expref: 49 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.745792:0:25724:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23882bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:25724:1871643350880384:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938443.745813:0:25724:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2482d95000 going to sleep for 11 seconds 00000100:00100000:1.0:1784938443.745828:0:25719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 781 00000100:00100000:1.0:1784938443.745835:0:25719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+45:16389:x1871643350879616:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1784938443.745846:0:25719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:24 count 1 00010000:00010000:1.0:1784938443.745857:0:25719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098b26aa7/0x7b044d4128f9ce7e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.745868:0:25719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000dda476a/0x7b044d4128f9a986 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663789 expref: 49 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.745879:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1784938443.745896:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.745900:0:25719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098b26aa7/0x7b044d4128f9ce7e lrc: 4/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.745920:0:25719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000dda476a/0x7b044d4128f9a986 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663789 expref: 49 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.745930:0:25719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000dda476a/0x7b044d4128f9a986 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663789 expref: 49 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.745940:0:25719:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23882bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:25719:1871643350880512:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938443.745958:0:25719:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2482d95840 going to sleep for 11 seconds 00000100:00100000:1.0:1784938443.745974:0:25729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 782 00000100:00100000:1.0:1784938443.745981:0:25729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+45:16392:x1871643350879744:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1784938443.745991:0:25729:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00010000:00010000:1.0:1784938443.746002:0:25729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9ce85 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.746117:0:25729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca568404/0x7b044d4128f9a9a9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766379e expref: 49 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.746126:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1784938443.746129:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.746134:0:25729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9ce85 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.746183:0:25729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ca568404/0x7b044d4128f9a9a9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e94766379e expref: 49 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.746192:0:25729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ca568404/0x7b044d4128f9a9a9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766379e expref: 49 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.746202:0:25729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23882bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:25729:1871643350880640:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938443.746227:0:25729:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2482d95d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938443.746575:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350880768:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1784938443.746623:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f248700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350881280:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1784938443.746650:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938443.746655:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f248e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350881152:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1784938443.746680:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f24a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350880896:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1784938443.746701:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350881408:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1784938443.746718:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938443.746723:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f24b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350881024:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:2.0:1784938443.746938:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938443.746966:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938443.746981:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938443.746996:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938443.747012:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350880768 00000100:00100000:2.0:1784938443.747139:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350880768 00000100:00100000:2.0:1784938443.747217:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350881280 00000100:00100000:2.0:1784938443.747220:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350881280 00000100:00100000:2.0:1784938443.747236:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350881152 00000100:00100000:2.0:1784938443.747238:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350881152 00000100:00100000:2.0:1784938443.747252:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350880896 00000100:00100000:2.0:1784938443.747255:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350880896 00000100:00100000:2.0:1784938443.747268:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 783 00000100:00100000:2.0:1784938443.747275:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381363850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+46:16392:x1871643350880768:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:2.0:1784938443.747293:0:25722:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:21 count 1 00010000:00010000:2.0:1784938443.747311:0:25722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9ce8c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.747337:0:25722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000029fd9487/0x7b044d4128f9a994 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663797 expref: 53 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.747350:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784938443.747354:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.747358:0:25722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9ce8c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.747382:0:25722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000029fd9487/0x7b044d4128f9a994 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663797 expref: 53 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.747393:0:25722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000029fd9487/0x7b044d4128f9a994 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663797 expref: 53 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.747405:0:25722:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25722:1871643350881536:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938443.747440:0:25722:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d3a43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938443.747459:0:25725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 784 00000100:00100000:2.0:1784938443.747467:0:25725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+46:16392:x1871643350881280:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:2.0:1784938443.747480:0:25725:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:14 count 1 00010000:00010000:2.0:1784938443.747493:0:25725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b9ed1c8/0x7b044d4128f9ce93 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.747504:0:25725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009ae6d3d8/0x7b044d4128f9a9c5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476637c8 expref: 53 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.747511:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784938443.747514:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.747518:0:25725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b9ed1c8/0x7b044d4128f9ce93 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.747536:0:25725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009ae6d3d8/0x7b044d4128f9a9c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637c8 expref: 53 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.747546:0:25725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009ae6d3d8/0x7b044d4128f9a9c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637c8 expref: 53 pid: 25715 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.747556:0:25725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:25725:1871643350881664:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938443.747576:0:25725:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d3a4900 going to sleep for 11 seconds 00000100:00100000:2.0:1784938443.747592:0:25730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 785 00000100:00100000:2.0:1784938443.747598:0:25730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+46:16392:x1871643350881152:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:2.0:1784938443.747609:0:25730:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:19 count 1 00010000:00010000:2.0:1784938443.747620:0:25730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9ce9a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.747631:0:25730:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000929c3b73/0x7b044d4128f9a9cc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476637c1 expref: 53 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.747639:0:25730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784938443.747641:0:25730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.747645:0:25730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9ce9a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.747660:0:25730:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000929c3b73/0x7b044d4128f9a9cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637c1 expref: 53 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.747670:0:25730:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000929c3b73/0x7b044d4128f9a9cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637c1 expref: 53 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.747680:0:25730:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:25730:1871643350881792:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938443.747701:0:25730:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d3a4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938443.747717:0:25727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 786 00000100:00100000:2.0:1784938443.747724:0:25727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+46:16389:x1871643350880896:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:2.0:1784938443.747734:0:25727:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:26 count 1 00010000:00010000:2.0:1784938443.747745:0:25727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9cea1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.747755:0:25727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004b818fb0/0x7b044d4128f9a99b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476637ac expref: 53 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.747763:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784938443.747766:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.747769:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9cea1 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.747785:0:25727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004b818fb0/0x7b044d4128f9a99b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637ac expref: 53 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.747794:0:25727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004b818fb0/0x7b044d4128f9a99b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637ac expref: 53 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.747810:0:25727:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:25727:1871643350881920:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938443.747829:0:25727:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d3a4180 going to sleep for 11 seconds 00000100:00100000:2.0:1784938443.747954:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938443.747980:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938443.748248:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:16391:x1871643350876544:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 31482us (32985us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1784938443.748257:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 767 00000100:00100000:3.0:1784938443.748279:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350881408 00000100:00100000:3.0:1784938443.748285:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350881408 00000100:00100000:3.0:1784938443.748301:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350881024 00000100:00100000:3.0:1784938443.748303:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350881024 00000100:00100000:3.0:1784938443.748313:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 787 00000100:00100000:3.0:1784938443.748318:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:16389:x1871643350881408:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:3.0:1784938443.748342:0:21149:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:9 count 1 00010000:00010000:3.0:1784938443.748354:0:21149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9033458/0x7b044d4128f9cea8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.748367:0:21149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a14dc117/0x7b044d4128f9a9be lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476637cf expref: 53 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.748375:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1784938443.748377:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.748380:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9033458/0x7b044d4128f9cea8 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.748401:0:21149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a14dc117/0x7b044d4128f9a9be lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637cf expref: 53 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.748410:0:21149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a14dc117/0x7b044d4128f9a9be lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637cf expref: 53 pid: 25715 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.748419:0:21149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d144a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:21149:1871643350882048:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938443.748448:0:21149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f249d7bae40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938443.748467:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 788 00000100:00100000:3.0:1784938443.748473:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:16389:x1871643350881024:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 00002000:00080000:3.0:1784938443.748485:0:21151:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00010000:00010000:3.0:1784938443.748498:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000480c0a41/0x7b044d4128f9ceaf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.748508:0:21151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008690a6d9/0x7b044d4128f9a9b0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476637ba expref: 53 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.748515:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1784938443.748518:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.748522:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000480c0a41/0x7b044d4128f9ceaf lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.748539:0:21151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008690a6d9/0x7b044d4128f9a9b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637ba expref: 53 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.748548:0:21151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008690a6d9/0x7b044d4128f9a9b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637ba expref: 53 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.748558:0:21151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:21151:1871643350882176:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938443.748583:0:21151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f249d7ba780 going to sleep for 11 seconds 00000004:00080000:0.0:1784938443.748824:0:16391:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f2388125880/2, rc 0, transno 4294967473 00000100:00100000:0.0:1784938443.748847:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350876544:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1784938443.749697:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350882304:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:3.0:1784938443.750713:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938443.750743:0:25721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350882304 00000100:00100000:3.0:1784938443.750750:0:25721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350882304 00000100:00100000:3.0:1784938443.750791:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 789 00000100:00100000:3.0:1784938443.750799:0:25721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:16390:x1871643350882304:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:3.0:1784938443.750824:0:25721:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:10 count 1 00010000:00010000:3.0:1784938443.750846:0:25721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017474f15/0x7b044d4128f9ceb6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.750867:0:25721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000096b2cd9a/0x7b044d4128f9a9b7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476637a5 expref: 49 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.750875:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1784938443.750878:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.750883:0:25721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017474f15/0x7b044d4128f9ceb6 lrc: 4/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.752206:0:25721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000096b2cd9a/0x7b044d4128f9a9b7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637a5 expref: 49 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.752220:0:25721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000096b2cd9a/0x7b044d4128f9a9b7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637a5 expref: 49 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.752236:0:25721:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d144700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:25721:1871643350882432:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938443.752311:0:25721:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f249d7baf00 going to sleep for 11 seconds 00000100:00100000:1.0:1784938443.757896:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.757933:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.757960:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337467264 00000100:00100000:1.0:1784938443.757968:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337467264 00010000:00010000:1.0:1784938443.758011:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004435011c/0x7b044d4128f9a97f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663782 expref: 54 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.758055:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337467136 00000100:00100000:1.0:1784938443.758059:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337467136 00010000:00010000:1.0:1784938443.758074:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c4b45686/0x7b044d4128f9a95c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766375f expref: 50 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.758093:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 381 00000100:00100000:1.0:1784938443.758102:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+54:10958:x1871643337467264:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.758117:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.758123:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004435011c/0x7b044d4128f9a97f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663782 expref: 54 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.758137:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004435011c/0x7b044d4128f9a97f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663782 expref: 54 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.758196:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.758201:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.758208:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f74bf49c/0x7b044d4128f9ce54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.758219:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f74bf49c/0x7b044d4128f9ce54 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.758241:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.758288:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+54:10958:x1871643337467264:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 187us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.758297:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 381 00000100:00100000:1.0:1784938443.758314:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 382 00000100:00100000:1.0:1784938443.758333:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+50:10958:x1871643337467136:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.758342:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.758347:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c4b45686/0x7b044d4128f9a95c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766375f expref: 50 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.758359:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c4b45686/0x7b044d4128f9a95c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766375f expref: 50 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.758378:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.758381:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.758385:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000e788d2b/0x7b044d4128f9ce4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.758393:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e788d2b/0x7b044d4128f9ce4d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.758406:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.758423:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+50:10958:x1871643337467136:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 103us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.758431:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 382 00000100:00100000:1.0:1784938443.758475:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:0.0:1784938443.758769:0:25728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004435011c/0x7b044d4128f9a97f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663782 expref: 53 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.758786:0:25728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388124000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:25728:1871643350879232:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938443.758807:0:25728:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f74bf49c/0x7b044d4128f9ce54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.758817:0:25728:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f74bf49c/0x7b044d4128f9ce54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.758824:0:25728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f74bf49c/0x7b044d4128f9ce54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.758836:0:25728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f74bf49c/0x7b044d4128f9ce54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.758845:0:25728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f74bf49c/0x7b044d4128f9ce54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.758874:0:25728:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784938443.759030:0:25728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+49:16392:x1871643350878592:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 15012us (15615us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1784938443.759039:0:25728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 775 00010000:00010000:3.0:1784938443.759100:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938443.759107:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f74bf49c/0x7b044d4128f9ce54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.759115:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938443.759119:0:25732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f74bf49c/0x7b044d4128f9ce54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.759133:0:25732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f74bf49c/0x7b044d4128f9ce54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.759174:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f74bf49c/0x7b044d4128f9ce54 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.759183:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f74bf49c/0x7b044d4128f9ce54 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.759201:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938443.759203:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938443.759204:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938443.759676:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337467520 00000100:00100000:2.0:1784938443.759683:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337467520 00000100:00100000:2.0:1784938443.759727:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 465 00000100:00100000:2.0:1784938443.759736:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+83:17096:x1871643337467520:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938443.759752:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938443.759769:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a200/0x7b044d4128f9cebd lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476641df expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.759867:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a800/0x7b044d4128f9cec4 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.759893:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a800/0x7b044d4128f9cec4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.759903:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a800/0x7b044d4128f9cec4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.759917:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b800/0x7b044d4128f9cecb lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x489b8eb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.759924:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b800/0x7b044d4128f9cecb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.759930:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b800/0x7b044d4128f9cecb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.760241:0:25716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4b45686/0x7b044d4128f9a95c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766375f expref: 49 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.760255:0:25716:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2381d2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25716:1871643350879104:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938443.760274:0:25716:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000e788d2b/0x7b044d4128f9ce4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.760285:0:25716:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000e788d2b/0x7b044d4128f9ce4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.760292:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e788d2b/0x7b044d4128f9ce4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.760306:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e788d2b/0x7b044d4128f9ce4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.760313:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e788d2b/0x7b044d4128f9ce4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.760344:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784938443.760460:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+46:16392:x1871643350878336:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 16892us (19063us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1784938443.760469:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 774 00000004:00080000:2.0:1784938443.760752:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x65:0x0], index 0: 0 00010000:00010000:2.0:1784938443.760894:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17be00/0x7b044d4128f9ced2 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.760905:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17be00/0x7b044d4128f9ced2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.760913:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17be00/0x7b044d4128f9ced2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.760942:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a800/0x7b044d4128f9cec4 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.760947:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a800/0x7b044d4128f9cec4 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.760952:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a800/0x7b044d4128f9cec4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.760959:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a800/0x7b044d4128f9cec4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.760964:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17a800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938443.760967:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a800/0x7b044d4128f9cec4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.760974:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a800/0x7b044d4128f9cec4 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.760983:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938443.760987:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.760991:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a800/0x7b044d4128f9cec4 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.760997:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a800/0x7b044d4128f9cec4 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938443.761009:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aa26a8b8 reply state 00000000ccd13475 transno 8589934841 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b800/0x7b044d4128f9cecb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.761116:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938443.761124:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e788d2b/0x7b044d4128f9ce4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.761133:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17a400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938443.761137:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e788d2b/0x7b044d4128f9ce4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.761169:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e788d2b/0x7b044d4128f9ce4d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.761184:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e788d2b/0x7b044d4128f9ce4d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.761192:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e788d2b/0x7b044d4128f9ce4d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.761207:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.761209:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.761211:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938443.761362:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b800/0x7b044d4128f9cecb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.761369:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x489b8eb2 (ffff9f23861f4800) 00010000:00010000:2.0:1784938443.761371:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938443.761374:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938443.761408:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a200/0x7b044d4128f9cebd lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641df expref: 86 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.761424:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17be00/0x7b044d4128f9ced2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641df expref: 85 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.761431:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x49:0x0].0x0 (ffff9f23861f4c00) 00010000:00010000:2.0:1784938443.761433:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938443.761435:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17be00, rc 0) 00000100:00100000:2.0:1784938443.761491:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+86:17096:x1871643337467520:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1756us (3016us total) trans 8589934841 rc 0/0 00000100:00100000:2.0:1784938443.761499:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 465 00000004:00080000:2.0:1784938443.762586:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f2388126680/2, rc 0, transno 4294967470 00000100:00100000:2.0:1784938443.762598:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350878592:192.168.202.154@tcp:6:osp-syn-1-0.0 00000004:00080000:2.0:1784938443.762610:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f23882be680/2, rc 0, transno 4294967474 00000100:00100000:2.0:1784938443.762688:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23882be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350878336:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1784938443.763185:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784938443.763203:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350882560:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1784938443.763616:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.763673:0:25723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350882560 00000100:00100000:1.0:1784938443.763680:0:25723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350882560 00000100:00100000:1.0:1784938443.763734:0:25723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 790 00000100:00100000:1.0:1784938443.763743:0:25723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+46:16392:x1871643350882560:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1784938443.763769:0:25723:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:15 count 1 00010000:00010000:1.0:1784938443.763792:0:25723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e54e2326/0x7b044d4128f9cee0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.763810:0:25723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d41c9e94/0x7b044d4128f9a9a2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476637b3 expref: 48 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.763825:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1784938443.763829:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.763833:0:25723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e54e2326/0x7b044d4128f9cee0 lrc: 4/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.763860:0:25723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d41c9e94/0x7b044d4128f9a9a2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637b3 expref: 48 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.763873:0:25723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d41c9e94/0x7b044d4128f9a9a2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637b3 expref: 48 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.763899:0:25723:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f2c8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:25723:1871643350882688:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938443.764403:0:25723:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2482d95240 going to sleep for 11 seconds 00000100:00100000:0.0:1784938443.770868:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.770921:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.770936:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.770990:0:25715:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387daf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25715:1871643350880000:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938443.771022:0:25715:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9ce62 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.771100:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.771123:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337467648 00000100:00100000:0.0:1784938443.771128:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337467648 00010000:00010000:0.0:1784938443.771181:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cb10cc2f/0x7b044d4128f9a98d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663790 expref: 53 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.771211:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337467776 00000100:00100000:0.0:1784938443.771214:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337467776 00010000:00010000:0.0:1784938443.771229:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006887c39c/0x7b044d4128f9a96a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766376d expref: 49 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.771241:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337467904 00000100:00100000:0.0:1784938443.771244:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337467904 00010000:00010000:0.0:1784938443.771255:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003889d17a/0x7b044d4128f987eb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947662f4e expref: 50 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.771265:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337468160 00000100:00100000:0.0:1784938443.771267:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337468160 00010000:00010000:0.0:1784938443.771278:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000dda476a/0x7b044d4128f9a986 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663789 expref: 51 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.771294:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 383 00000100:00100000:0.0:1784938443.771302:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24829e1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+53:10960:x1871643337467648:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938443.771317:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938443.771354:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cb10cc2f/0x7b044d4128f9a98d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663790 expref: 53 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.771367:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cb10cc2f/0x7b044d4128f9a98d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663790 expref: 53 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.771392:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.771397:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.771403:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf7e7655/0x7b044d4128f9ce5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.771413:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf7e7655/0x7b044d4128f9ce5b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.771431:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938443.771480:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24829e1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+53:10960:x1871643337467648:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 178us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.771488:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 383 00000100:00100000:0.0:1784938443.771528:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 384 00000100:00100000:0.0:1784938443.771534:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23880a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+51:10960:x1871643337467776:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938443.771542:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938443.771547:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006887c39c/0x7b044d4128f9a96a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766376d expref: 51 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.771557:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006887c39c/0x7b044d4128f9a96a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766376d expref: 51 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.771570:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.771573:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.771578:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000015b67b51/0x7b044d4128f9ce69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.771586:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015b67b51/0x7b044d4128f9ce69 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.771597:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938443.771611:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23880a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+51:10960:x1871643337467776:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 77us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.771617:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 384 00000100:00100000:0.0:1784938443.771628:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 385 00000100:00100000:0.0:1784938443.771633:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23880a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+50:10958:x1871643337467904:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938443.771639:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938443.771643:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003889d17a/0x7b044d4128f987eb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947662f4e expref: 50 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.771653:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003889d17a/0x7b044d4128f987eb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947662f4e expref: 50 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.771664:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.771667:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.771671:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e7a2d07f/0x7b044d4128f9ce77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.771679:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7a2d07f/0x7b044d4128f9ce77 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.771693:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938443.771711:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23880a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+50:10958:x1871643337467904:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 78us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.771717:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 385 00000100:00100000:0.0:1784938443.771729:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 386 00000100:00100000:0.0:1784938443.771735:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23880a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+49:10959:x1871643337468160:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938443.771742:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938443.771747:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000dda476a/0x7b044d4128f9a986 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663789 expref: 49 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.771757:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000dda476a/0x7b044d4128f9a986 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663789 expref: 49 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.771768:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.771771:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.771775:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000098b26aa7/0x7b044d4128f9ce7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.771783:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098b26aa7/0x7b044d4128f9ce7e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.771794:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938443.771810:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23880a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+49:10959:x1871643337468160:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 76us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.771820:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 386 00000100:00100000:0.0:1784938443.771863:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.771882:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337468288 00000100:00100000:0.0:1784938443.771886:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337468288 00010000:00010000:0.0:1784938443.771901:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ca568404/0x7b044d4128f9a9a9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766379e expref: 49 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.771920:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 387 00000100:00100000:0.0:1784938443.771926:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+49:10959:x1871643337468288:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938443.771933:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938443.771936:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ca568404/0x7b044d4128f9a9a9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766379e expref: 49 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.771945:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ca568404/0x7b044d4128f9a9a9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766379e expref: 49 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.771956:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.771959:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.771962:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9ce85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.771969:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9ce85 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.771980:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938443.771998:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+49:10959:x1871643337468288:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 72us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.772003:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 387 00010000:00010000:3.0:1784938443.772211:0:25718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006887c39c/0x7b044d4128f9a96a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766376d expref: 48 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.772227:0:25718:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd255180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25718:1871643350880128:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938443.772242:0:25718:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000015b67b51/0x7b044d4128f9ce69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.772251:0:25718:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000015b67b51/0x7b044d4128f9ce69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.772258:0:25718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015b67b51/0x7b044d4128f9ce69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.772267:0:25718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015b67b51/0x7b044d4128f9ce69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.772276:0:25718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015b67b51/0x7b044d4128f9ce69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.772296:0:25718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784938443.772459:0:25718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+47:16392:x1871643350878976:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 27476us (27842us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1784938443.772467:0:25718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 778 00000100:00100000:2.0:1784938443.772586:0:25725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:25725:1871643350881664:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938443.772602:0:25725:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005b9ed1c8/0x7b044d4128f9ce93 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.772626:0:25722:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25722:1871643350881536:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938443.772637:0:25722:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9ce8c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.772659:0:25720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb10cc2f/0x7b044d4128f9a98d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663790 expref: 52 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.772670:0:25720:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387daed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:25720:1871643350879872:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938443.772680:0:25720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bf7e7655/0x7b044d4128f9ce5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.772687:0:25720:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bf7e7655/0x7b044d4128f9ce5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.772694:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf7e7655/0x7b044d4128f9ce5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.772701:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf7e7655/0x7b044d4128f9ce5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.772708:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf7e7655/0x7b044d4128f9ce5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.772721:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1784938443.772801:0:25720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:16389:x1871643350878720:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 28108us (29328us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1784938443.772809:0:25720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 776 00010000:00010000:2.0:1784938443.772828:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938443.772834:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015b67b51/0x7b044d4128f9ce69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.772842:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938443.772846:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015b67b51/0x7b044d4128f9ce69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.772855:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015b67b51/0x7b044d4128f9ce69 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.772869:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015b67b51/0x7b044d4128f9ce69 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.772877:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015b67b51/0x7b044d4128f9ce69 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.772895:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938443.772900:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf7e7655/0x7b044d4128f9ce5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.772907:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938443.772910:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf7e7655/0x7b044d4128f9ce5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.772917:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf7e7655/0x7b044d4128f9ce5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.772927:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf7e7655/0x7b044d4128f9ce5b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.772934:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf7e7655/0x7b044d4128f9ce5b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.772945:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938443.772947:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938443.772949:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784938443.773087:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f2388124380/2, rc 0, transno 4294967471 00000100:00100000:2.0:1784938443.773094:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388124380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350878720:192.168.202.154@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1784938443.773603:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938443.773708:0:25724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003889d17a/0x7b044d4128f987eb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947662f4e expref: 47 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.773721:0:25724:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23882bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:25724:1871643350880384:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938443.773737:0:25724:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e7a2d07f/0x7b044d4128f9ce77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.773746:0:25724:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e7a2d07f/0x7b044d4128f9ce77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.773753:0:25724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7a2d07f/0x7b044d4128f9ce77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.773763:0:25724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7a2d07f/0x7b044d4128f9ce77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.773770:0:25724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7a2d07f/0x7b044d4128f9ce77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.773788:0:25724:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938443.773901:0:25724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+47:16389:x1871643350879488:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 28192us (28772us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1784938443.773909:0:25724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 780 00010000:00010000:1.0:1784938443.773947:0:25719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dda476a/0x7b044d4128f9a986 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663789 expref: 46 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.773957:0:25719:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23882bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:25719:1871643350880512:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938443.773970:0:25719:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000098b26aa7/0x7b044d4128f9ce7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.773979:0:25719:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000098b26aa7/0x7b044d4128f9ce7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.773986:0:25719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098b26aa7/0x7b044d4128f9ce7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.773994:0:25719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098b26aa7/0x7b044d4128f9ce7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.774002:0:25719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098b26aa7/0x7b044d4128f9ce7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.774027:0:25719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1784938443.774082:0:25719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+47:16389:x1871643350879616:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 28247us (28937us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1784938443.774089:0:25719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 781 00010000:00010000:1.0:1784938443.774118:0:25729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca568404/0x7b044d4128f9a9a9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766379e expref: 45 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.774128:0:25729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23882bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:25729:1871643350880640:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938443.774139:0:25729:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9ce85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.774174:0:25729:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9ce85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.774181:0:25729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9ce85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.774189:0:25729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9ce85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.774197:0:25729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9ce85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.774210:0:25729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1784938443.774272:0:25729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+47:16392:x1871643350879744:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 28291us (29085us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1784938443.774279:0:25729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 782 00000004:00080000:1.0:1784938443.774315:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f2388124e00/2, rc 0, transno 4294967475 00000100:00100000:1.0:1784938443.774337:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350878976:192.168.202.154@tcp:6:osp-syn-0-0.0 00010000:00010000:3.0:1784938443.774414:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784938443.774420:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7a2d07f/0x7b044d4128f9ce77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.774428:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c559c00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938443.774432:0:25732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7a2d07f/0x7b044d4128f9ce77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.774442:0:25732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7a2d07f/0x7b044d4128f9ce77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.774458:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7a2d07f/0x7b044d4128f9ce77 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.774465:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7a2d07f/0x7b044d4128f9ce77 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.774480:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938443.774484:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098b26aa7/0x7b044d4128f9ce7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.774490:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c559200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938443.774494:0:25732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098b26aa7/0x7b044d4128f9ce7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.774501:0:25732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098b26aa7/0x7b044d4128f9ce7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.774509:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098b26aa7/0x7b044d4128f9ce7e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.774516:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098b26aa7/0x7b044d4128f9ce7e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.774526:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938443.774529:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9ce85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.774535:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c558e00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938443.774538:0:25732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9ce85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.774546:0:25732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9ce85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.774560:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9ce85 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.774567:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9ce85 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.774578:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938443.774579:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938443.774581:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938443.774760:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.775083:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784938443.775354:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f2388125f80/2, rc 0, transno 4294967477 00000100:00100000:2.0:1784938443.775361:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350879616:192.168.202.154@tcp:6:osp-syn-0-0.0 00000004:00080000:2.0:1784938443.775371:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f2388127480/2, rc 0, transno 4294967476 00000100:00100000:2.0:1784938443.775375:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350879488:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:2.0:1784938443.775389:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938443.775405:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23882bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350882816:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:3.0:1784938443.775585:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938443.775764:0:21152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350882816 00000100:00100000:1.0:1784938443.775771:0:21152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350882816 00000100:00100000:1.0:1784938443.775811:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 791 00000100:00100000:1.0:1784938443.775820:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+47:16391:x1871643350882816:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1784938443.775846:0:21152:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:25 count 1 00010000:00010000:1.0:1784938443.775868:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000007385ab/0x7b044d4128f9cee7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.776020:0:21152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005777c505/0x7b044d4128f9a9d3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476637d6 expref: 44 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.776030:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1784938443.776035:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.776040:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000007385ab/0x7b044d4128f9cee7 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.776067:0:21152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005777c505/0x7b044d4128f9a9d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637d6 expref: 44 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.776085:0:21152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005777c505/0x7b044d4128f9a9d3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637d6 expref: 44 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.776098:0:21152:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f2caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:21152:1871643350882944:192.168.202.54@tcp:104: 00000004:00080000:0.0:1784938443.776255:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f2388125c00/2, rc 0, transno 4294967478 00000100:00100000:0.0:1784938443.776261:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388125c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350879744:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:2.0:1784938443.776510:0:21152:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2482d95780 going to sleep for 11 seconds 00000100:00100000:0.0:1784938443.787394:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.787435:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337468672 00000100:00100000:0.0:1784938443.787442:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337468672 00010000:00010000:0.0:1784938443.787489:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000929c3b73/0x7b044d4128f9a9cc lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637c1 expref: 52 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.787524:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 388 00000100:00100000:0.0:1784938443.787533:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+52:10959:x1871643337468672:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938443.787549:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938443.787554:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000929c3b73/0x7b044d4128f9a9cc lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637c1 expref: 52 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.787566:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000929c3b73/0x7b044d4128f9a9cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637c1 expref: 52 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.787591:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.787595:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.787601:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9ce9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.787617:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9ce9a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.787637:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938443.787687:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+52:10959:x1871643337468672:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 154us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.787695:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 388 00000100:00100000:0.0:1784938443.787738:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.787839:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.787867:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.788047:0:25727:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:25727:1871643350881920:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938443.788074:0:25727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9cea1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.788106:0:25723:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f2c8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:25723:1871643350882688:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938443.788118:0:25723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e54e2326/0x7b044d4128f9cee0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.788532:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.788550:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337468800 00000100:00100000:0.0:1784938443.788555:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337468800 00010000:00010000:0.0:1784938443.788576:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004b818fb0/0x7b044d4128f9a99b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637ac expref: 52 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.788597:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337469184 00000100:00100000:0.0:1784938443.788600:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337469184 00010000:00010000:0.0:1784938443.788613:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000096b2cd9a/0x7b044d4128f9a9b7 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637a5 expref: 45 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.788625:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337469312 00000100:00100000:0.0:1784938443.788627:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337469312 00010000:00010000:0.0:1784938443.788639:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d41c9e94/0x7b044d4128f9a9a2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637b3 expref: 46 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.788655:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337468032 00000100:00100000:0.0:1784938443.788658:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337468032 00010000:00010000:0.0:1784938443.788668:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000da59e430/0x7b044d4128f9a963 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663766 expref: 47 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.788683:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 389 00000100:00100000:0.0:1784938443.788689:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+52:10959:x1871643337468800:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938443.788701:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938443.788706:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004b818fb0/0x7b044d4128f9a99b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637ac expref: 52 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.788716:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004b818fb0/0x7b044d4128f9a99b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637ac expref: 52 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.788733:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b818fb0/0x7b044d4128f9a99b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637ac expref: 52 pid: 21152 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.788748:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.788752:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.788757:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9cea1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.788765:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9cea1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.788789:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938443.788819:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+51:10959:x1871643337468800:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 129us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.788825:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 389 00000100:00100000:0.0:1784938443.788841:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 390 00000100:00100000:0.0:1784938443.788847:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24829e3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+47:10959:x1871643337469184:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938443.788877:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1784938443.789010:0:25726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23882bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:25726:1871643350880256:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938443.789038:0:25726:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f873e89f/0x7b044d4128f9ce70 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.789055:0:25727:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9cea1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.789064:0:25727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9cea1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.789074:0:25727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9cea1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.789086:0:25727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9cea1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.789103:0:25727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784938443.789278:0:25727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+49:16389:x1871643350880896:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 41554us (42279us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1784938443.789286:0:25727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 786 00010000:00010000:2.0:1784938443.789306:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938443.789312:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9cea1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.789338:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17b400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938443.789343:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9cea1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.789354:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9cea1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.789367:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9cea1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.789374:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9cea1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.789390:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938443.789393:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938443.789395:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938443.789982:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000096b2cd9a/0x7b044d4128f9a9b7 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637a5 expref: 47 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.789998:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000096b2cd9a/0x7b044d4128f9a9b7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637a5 expref: 47 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.790073:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.790078:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.790083:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000017474f15/0x7b044d4128f9ceb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.790091:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017474f15/0x7b044d4128f9ceb6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.790107:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938443.790258:0:25730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000929c3b73/0x7b044d4128f9a9cc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637c1 expref: 50 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.790272:0:25730:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:25730:1871643350881792:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938443.790289:0:25730:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9ce9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.790315:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 391 00000100:00100000:1.0:1784938443.790335:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+47:10959:x1871643337469312:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.790348:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.790354:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d41c9e94/0x7b044d4128f9a9a2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637b3 expref: 47 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.790364:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d41c9e94/0x7b044d4128f9a9a2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637b3 expref: 47 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.790378:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d41c9e94/0x7b044d4128f9a9a2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637b3 expref: 47 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.790393:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.790396:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.790400:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e54e2326/0x7b044d4128f9cee0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.790408:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e54e2326/0x7b044d4128f9cee0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.790430:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938443.790548:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24829e3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+46:10959:x1871643337469184:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 1700us (2708us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.790559:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 390 00000100:00100000:0.0:1784938443.790602:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 392 00000100:00100000:0.0:1784938443.790609:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+45:10958:x1871643337468032:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938443.790617:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938443.790622:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000da59e430/0x7b044d4128f9a963 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663766 expref: 45 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.790632:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000da59e430/0x7b044d4128f9a963 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663766 expref: 45 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.790645:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da59e430/0x7b044d4128f9a963 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663766 expref: 45 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.790654:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.790658:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.790662:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9ce62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.790669:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9ce62 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.790693:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938443.790733:0:25715:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9ce62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.790742:0:25715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9ce62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.790752:0:25715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9ce62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.790760:0:25715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9ce62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.790777:0:25715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784938443.791189:0:21151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:21151:1871643350882176:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938443.791206:0:21151:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000480c0a41/0x7b044d4128f9ceaf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.791232:0:25721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096b2cd9a/0x7b044d4128f9a9b7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637a5 expref: 44 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.791243:0:25721:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d144700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:25721:1871643350882432:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938443.791254:0:25721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000017474f15/0x7b044d4128f9ceb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.791262:0:25721:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000017474f15/0x7b044d4128f9ceb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.791274:0:25721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017474f15/0x7b044d4128f9ceb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.791283:0:25721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017474f15/0x7b044d4128f9ceb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.791290:0:25721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017474f15/0x7b044d4128f9ceb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.791304:0:25721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1784938443.792312:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+43:10959:x1871643337469312:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 1983us (4438us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.792336:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 391 00010000:00010000:1.0:1784938443.792383:0:25730:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9ce9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.792395:0:25730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9ce9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.792405:0:25730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9ce9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.792413:0:25730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9ce9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.792435:0:25730:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1784938443.792541:0:25730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+49:16392:x1871643350881152:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 44942us (45558us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1784938443.792549:0:25730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 785 00010000:00010000:1.0:1784938443.792572:0:25723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e54e2326/0x7b044d4128f9cee0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.792580:0:25723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e54e2326/0x7b044d4128f9cee0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.792589:0:25723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e54e2326/0x7b044d4128f9cee0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.792596:0:25723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e54e2326/0x7b044d4128f9cee0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.792611:0:25723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1784938443.792619:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1784938443.792625:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9ce62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.792633:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b34200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938443.792638:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9ce62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.792648:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9ce62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.792671:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9ce62 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.792680:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9ce62 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.792700:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784938443.792704:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017474f15/0x7b044d4128f9ceb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.792710:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1c00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938443.792713:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017474f15/0x7b044d4128f9ceb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.792720:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017474f15/0x7b044d4128f9ceb6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.792730:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017474f15/0x7b044d4128f9ceb6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.792737:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017474f15/0x7b044d4128f9ceb6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.792750:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784938443.792754:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9ce9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.792760:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17b000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938443.792763:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9ce9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.792770:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9ce9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.792780:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9ce9a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.792786:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9ce9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.792799:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938443.792802:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e54e2326/0x7b044d4128f9cee0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.792809:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c558000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938443.792812:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e54e2326/0x7b044d4128f9cee0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.792819:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e54e2326/0x7b044d4128f9cee0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.792828:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e54e2326/0x7b044d4128f9cee0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.792835:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e54e2326/0x7b044d4128f9cee0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.792849:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938443.792851:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938443.792852:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938443.793354:0:25723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+50:16392:x1871643350882560:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 29609us (29737us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1784938443.793363:0:25723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 790 00000100:00100000:0.0:1784938443.793632:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+42:10958:x1871643337468032:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3020us (5098us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.793640:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 392 00000100:00100000:0.0:1784938443.793708:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.793785:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.793830:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.793863:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.793905:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.793924:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337468544 00000100:00100000:0.0:1784938443.793931:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337468544 00010000:00010000:0.0:1784938443.793958:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009ae6d3d8/0x7b044d4128f9a9c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637c8 expref: 50 pid: 25715 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.793980:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337469056 00000100:00100000:0.0:1784938443.793982:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337469056 00010000:00010000:0.0:1784938443.793992:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008690a6d9/0x7b044d4128f9a9b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637ba expref: 51 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.794003:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337468416 00000100:00100000:0.0:1784938443.794005:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337468416 00010000:00010000:0.0:1784938443.794024:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000029fd9487/0x7b044d4128f9a994 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663797 expref: 52 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.794035:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337468928 00000100:00100000:0.0:1784938443.794038:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337468928 00010000:00010000:0.0:1784938443.794048:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a14dc117/0x7b044d4128f9a9be lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637cf expref: 53 pid: 25715 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.794061:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 393 00000100:00100000:0.0:1784938443.794069:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+53:10958:x1871643337468544:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938443.794080:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938443.794086:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009ae6d3d8/0x7b044d4128f9a9c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637c8 expref: 53 pid: 25715 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.794097:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009ae6d3d8/0x7b044d4128f9a9c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637c8 expref: 53 pid: 25715 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.794115:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ae6d3d8/0x7b044d4128f9a9c5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637c8 expref: 53 pid: 25715 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.794448:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.794453:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.794459:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005b9ed1c8/0x7b044d4128f9ce93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.794469:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b9ed1c8/0x7b044d4128f9ce93 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.794495:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938443.794521:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+52:10958:x1871643337468544:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 452us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.794528:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 393 00000100:00100000:0.0:1784938443.794545:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 394 00000100:00100000:0.0:1784938443.794551:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+51:10958:x1871643337469056:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938443.794558:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938443.794563:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008690a6d9/0x7b044d4128f9a9b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637ba expref: 51 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.794578:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008690a6d9/0x7b044d4128f9a9b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637ba expref: 51 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.794591:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008690a6d9/0x7b044d4128f9a9b0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637ba expref: 51 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.794604:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.794607:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.794612:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000480c0a41/0x7b044d4128f9ceaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.794619:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000480c0a41/0x7b044d4128f9ceaf lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.794639:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938443.794657:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+50:10958:x1871643337469056:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 106us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.794663:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 394 00000100:00100000:0.0:1784938443.794677:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 395 00000100:00100000:0.0:1784938443.794683:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+49:10958:x1871643337468416:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938443.794690:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938443.794694:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000029fd9487/0x7b044d4128f9a994 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663797 expref: 49 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.794708:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000029fd9487/0x7b044d4128f9a994 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663797 expref: 49 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.794721:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029fd9487/0x7b044d4128f9a994 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663797 expref: 49 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.794730:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.794733:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.794738:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9ce8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.794745:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9ce8c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.794763:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938443.794781:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+48:10958:x1871643337468416:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 99us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.794788:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 395 00000100:00100000:0.0:1784938443.794802:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 396 00000100:00100000:0.0:1784938443.794808:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+47:10958:x1871643337468928:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938443.794814:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938443.794819:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a14dc117/0x7b044d4128f9a9be lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637cf expref: 47 pid: 25715 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.794834:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a14dc117/0x7b044d4128f9a9be lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637cf expref: 47 pid: 25715 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.794846:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.794849:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.794853:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9033458/0x7b044d4128f9cea8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.794862:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9033458/0x7b044d4128f9cea8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.794874:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938443.794906:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+47:10958:x1871643337468928:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 98us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.794912:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 396 00010000:00010000:0.0:1784938443.794938:0:21151:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000480c0a41/0x7b044d4128f9ceaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.794947:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000480c0a41/0x7b044d4128f9ceaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.794956:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000480c0a41/0x7b044d4128f9ceaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.794964:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000480c0a41/0x7b044d4128f9ceaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.794979:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784938443.795222:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:16389:x1871643350881024:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 46747us (47240us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1784938443.795230:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 788 00000100:00100000:0.0:1784938443.795246:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337469568 00000100:00100000:0.0:1784938443.795250:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337469568 00000100:00100000:0.0:1784938443.795275:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 792 00000100:00100000:0.0:1784938443.795281:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+42:10958:x1871643337469568:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938443.795293:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938443.795308:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015b67b51/0x7b044d4128f9ceee lrc: 2/0,0 mode: --/PR res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476641e6 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938443.795338:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x65:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938443.795350:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x65:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1784938443.795354:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x65:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.795360:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015b67b51/0x7b044d4128f9ceee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641e6 expref: 43 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.795374:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000015b67b51/0x7b044d4128f9ceee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641e6 expref: 43 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.795386:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b35000, rc 0) 00000100:00100000:0.0:1784938443.795405:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+43:10958:x1871643337469568:12345-192.168.202.54@tcp:101:cp.0 Request processed in 124us (1575us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.795414:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 792 00000100:00100000:0.0:1784938443.795478:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.795493:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337469440 00000100:00100000:0.0:1784938443.795496:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337469440 00010000:00010000:0.0:1784938443.795510:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006a0b2b36/0x7b044d4128f9a971 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663774 expref: 43 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.795527:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 397 00000100:00100000:0.0:1784938443.795532:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24829e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+43:10958:x1871643337469440:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938443.795540:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938443.795544:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006a0b2b36/0x7b044d4128f9a971 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663774 expref: 43 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.795555:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006a0b2b36/0x7b044d4128f9a971 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663774 expref: 43 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.795568:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a0b2b36/0x7b044d4128f9a971 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663774 expref: 43 pid: 21629 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.795578:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.795581:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.795585:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f873e89f/0x7b044d4128f9ce70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.795592:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f873e89f/0x7b044d4128f9ce70 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.795610:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938443.795625:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24829e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+42:10958:x1871643337469440:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 93us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.795631:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 397 00000100:00100000:0.0:1784938443.795832:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.795849:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337469696 00000100:00100000:0.0:1784938443.795853:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337469696 00010000:00010000:0.0:1784938443.795867:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005777c505/0x7b044d4128f9a9d3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637d6 expref: 42 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.796010:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 398 00000100:00100000:1.0:1784938443.796031:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+42:10959:x1871643337469696:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.796039:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.796045:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005777c505/0x7b044d4128f9a9d3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637d6 expref: 42 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.796056:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005777c505/0x7b044d4128f9a9d3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637d6 expref: 42 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.796069:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.796072:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.796077:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000007385ab/0x7b044d4128f9cee7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.796085:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000007385ab/0x7b044d4128f9cee7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.796098:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.796116:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+42:10959:x1871643337469696:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 89us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.796122:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 398 00010000:00010000:1.0:1784938443.796178:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938443.796184:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000480c0a41/0x7b044d4128f9ceaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.796192:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf0000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938443.796197:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000480c0a41/0x7b044d4128f9ceaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.796206:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000480c0a41/0x7b044d4128f9ceaf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.796219:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000480c0a41/0x7b044d4128f9ceaf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.796227:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000480c0a41/0x7b044d4128f9ceaf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.796245:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938443.796247:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938443.796248:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938443.796441:0:25726:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f873e89f/0x7b044d4128f9ce70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.796451:0:25726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f873e89f/0x7b044d4128f9ce70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.796461:0:25726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f873e89f/0x7b044d4128f9ce70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.796469:0:25726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f873e89f/0x7b044d4128f9ce70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.796495:0:25726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784938443.796598:0:25726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+50:16392:x1871643350879360:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 51051us (51488us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1784938443.796606:0:25726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 779 00000004:00080000:2.0:1784938443.796653:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f24b480/2, rc 0, transno 4294967474 00000100:00100000:2.0:1784938443.796659:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f24b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350881024:192.168.202.154@tcp:6:osp-syn-1-0.0 00000004:00080000:2.0:1784938443.796668:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f24a300/2, rc 0, transno 4294967472 00000100:00100000:2.0:1784938443.796672:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f24a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350880896:192.168.202.154@tcp:6:osp-syn-1-0.0 00010000:00010000:2.0:1784938443.796689:0:25725:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005b9ed1c8/0x7b044d4128f9ce93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.796699:0:25725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b9ed1c8/0x7b044d4128f9ce93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.796707:0:25725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b9ed1c8/0x7b044d4128f9ce93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.796715:0:25725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b9ed1c8/0x7b044d4128f9ce93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.796726:0:25725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1784938443.796789:0:25725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+49:16392:x1871643350881280:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 49322us (49821us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1784938443.796795:0:25725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 784 00010000:00010000:2.0:1784938443.796815:0:25722:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9ce8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.796824:0:25722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9ce8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.796833:0:25722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9ce8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.796839:0:25722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9ce8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.796847:0:25722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1784938443.797075:0:25721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:16390:x1871643350882304:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 46211us (46302us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1784938443.797087:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 789 00010000:00010000:3.0:1784938443.797127:0:21149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a14dc117/0x7b044d4128f9a9be lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637cf expref: 46 pid: 25715 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.797139:0:21149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d144a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:21149:1871643350882048:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938443.797178:0:21149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d9033458/0x7b044d4128f9cea8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.797188:0:21149:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d9033458/0x7b044d4128f9cea8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.797195:0:21149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9033458/0x7b044d4128f9cea8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.797204:0:21149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9033458/0x7b044d4128f9cea8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.797210:0:21149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9033458/0x7b044d4128f9cea8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.797219:0:21149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1784938443.797259:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784938443.797264:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f873e89f/0x7b044d4128f9ce70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.797272:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c559e00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938443.797275:0:25732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f873e89f/0x7b044d4128f9ce70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.797283:0:25732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f873e89f/0x7b044d4128f9ce70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.797296:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f873e89f/0x7b044d4128f9ce70 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.797304:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f873e89f/0x7b044d4128f9ce70 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.797330:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784938443.797334:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b9ed1c8/0x7b044d4128f9ce93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.797340:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17b600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938443.797343:0:25732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b9ed1c8/0x7b044d4128f9ce93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.797350:0:25732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b9ed1c8/0x7b044d4128f9ce93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.797360:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b9ed1c8/0x7b044d4128f9ce93 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.797368:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b9ed1c8/0x7b044d4128f9ce93 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.797380:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938443.797383:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9ce8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.797389:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17ae00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938443.797393:0:25732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9ce8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.797399:0:25732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9ce8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.797412:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9ce8c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.797419:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9ce8c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.797430:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938443.797434:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9033458/0x7b044d4128f9cea8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.797439:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1e00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938443.797442:0:25732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9033458/0x7b044d4128f9cea8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.797449:0:25732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9033458/0x7b044d4128f9cea8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.797458:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9033458/0x7b044d4128f9cea8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.797465:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9033458/0x7b044d4128f9cea8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.797477:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938443.797479:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938443.797481:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784938443.797575:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f1b6a00/2, rc 0, transno 4294967481 00000100:00100000:0.0:1784938443.797581:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350882560:192.168.202.154@tcp:6:osp-syn-0-0.0 00000004:00080000:0.0:1784938443.797594:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f248e00/2, rc 0, transno 4294967473 00000100:00100000:0.0:1784938443.797599:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f248e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350881152:192.168.202.154@tcp:6:osp-syn-1-0.0 00000004:00080000:0.0:1784938443.797796:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f2388125180/2, rc 0, transno 4294967482 00000100:00100000:0.0:1784938443.797802:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350879360:192.168.202.154@tcp:6:osp-syn-0-0.0 00000004:00080000:0.0:1784938443.797851:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f248700/2, rc 0, transno 4294967475 00000100:00100000:0.0:1784938443.797856:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f248700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350881280:192.168.202.154@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1784938443.798111:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938443.798117:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938443.800653:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381363850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+50:16392:x1871643350880768:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 53366us (53703us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1784938443.800670:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 783 00010000:00010000:2.0:1784938443.800745:0:21152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005777c505/0x7b044d4128f9a9d3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476637d6 expref: 41 pid: 21149 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.800768:0:21152:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f2caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:21152:1871643350882944:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938443.800791:0:21152:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000007385ab/0x7b044d4128f9cee7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.800802:0:21152:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000007385ab/0x7b044d4128f9cee7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.800816:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000007385ab/0x7b044d4128f9cee7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.800827:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000007385ab/0x7b044d4128f9cee7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.800836:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000007385ab/0x7b044d4128f9cee7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.800857:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1784938443.801203:0:16390:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238e0ec700/2, rc 0, transno 4294967480 00000100:00100000:0.0:1784938443.801212:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350882304:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:3.0:1784938443.801531:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:16389:x1871643350881408:12345-192.168.202.154@tcp:6:osp-syn-1-0.0 Request processed in 53210us (53649us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1784938443.801541:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 787 00010000:00010000:3.0:1784938443.801564:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938443.801571:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000007385ab/0x7b044d4128f9cee7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.801580:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c559a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938443.801584:0:25732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000007385ab/0x7b044d4128f9cee7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.801594:0:25732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000007385ab/0x7b044d4128f9cee7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.801613:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000007385ab/0x7b044d4128f9cee7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.801621:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000007385ab/0x7b044d4128f9cee7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.801646:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938443.801648:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938443.801650:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938443.801721:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.801864:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:16391:x1871643350882816:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 26043us (26278us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1784938443.801872:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 791 00000100:00100000:2.0:1784938443.802248:0:21152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337469824 00000100:00100000:2.0:1784938443.802255:0:21152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337469824 00000100:00100000:2.0:1784938443.802290:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 793 00000004:00080000:0.0:1784938443.802568:0:16392:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24b6b8f800/2, rc 0, transno 4294967476 00000100:00100000:0.0:1784938443.802575:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350880768:192.168.202.154@tcp:6:osp-syn-1-0.0 00000100:00100000:2.0:1784938443.802651:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+41:17096:x1871643337469824:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938443.802669:0:21152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938443.802685:0:21152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086e06a59/0x7b044d4128f9cef5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476641ed expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.802709:0:21152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000015b67b51/0x7b044d4128f9ceee lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641e6 expref: 42 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.802718:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x65:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.802722:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x65:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.802727:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086e06a59/0x7b044d4128f9cef5 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641ed expref: 42 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.802756:0:21152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000015b67b51/0x7b044d4128f9ceee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e9476641e6 expref: 42 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.802770:0:21152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000015b67b51/0x7b044d4128f9ceee lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476641e6 expref: 42 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.802784:0:21152:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:21152:1871643350883072:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938443.802846:0:21152:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d3a4240 going to sleep for 11 seconds 00000004:00080000:2.0:1784938443.802870:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24b37cb800/2, rc 0, transno 4294967477 00000100:00100000:2.0:1784938443.802875:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350881408:192.168.202.154@tcp:6:osp-syn-1-0.0 00000004:00080000:2.0:1784938443.805475:0:16391:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f23882bce00/2, rc 0, transno 4294967483 00000100:00100000:2.0:1784938443.805493:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23882bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350882816:192.168.202.154@tcp:6:osp-syn-0-0.0 00010000:00010000:3.0:1784938443.805850:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938443.805986:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:16390:x1871643350878848:12345-192.168.202.154@tcp:6:osp-syn-0-0.0 Request processed in 61143us (61393us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1784938443.805997:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 777 00010000:00010000:3.0:1784938443.806134:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938443.807116:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.807255:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337469952 00000100:00100000:1.0:1784938443.807262:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337469952 00010000:00010000:1.0:1784938443.807295:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000015b67b51/0x7b044d4128f9ceee lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476641e6 expref: 43 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.807342:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 399 00000100:00100000:1.0:1784938443.807350:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+43:10959:x1871643337469952:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.807366:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.807388:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000015b67b51/0x7b044d4128f9ceee lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476641e6 expref: 43 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.807402:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000015b67b51/0x7b044d4128f9ceee lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476641e6 expref: 43 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.807424:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x65:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.807429:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x65:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.807437:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000086e06a59/0x7b044d4128f9cef5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641ed expref: 43 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.807447:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086e06a59/0x7b044d4128f9cef5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641ed expref: 43 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.807480:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000086e06a59/0x7b044d4128f9cef5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641ed expref: 43 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.807493:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f2caa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:19221:1871643350883200:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938443.807549:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2482d95240 going to sleep for 11 seconds 00010000:00010000:3.0:1784938443.807711:0:21152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015b67b51/0x7b044d4128f9ceee lrc: 0/0,0 mode: --/PR res: [0x280000401:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476641e6 expref: 43 pid: 21151 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.807726:0:21152:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:21152:1871643350883072:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938443.807749:0:21152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000086e06a59/0x7b044d4128f9cef5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476641ed expref: 42 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.807759:0:21152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17a200, rc 0) 00000100:00100000:3.0:1784938443.807785:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+42:17096:x1871643337469824:12345-192.168.202.54@tcp:101:cp.0 Request processed in 5488us (6066us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938443.807793:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 793 00000004:00080000:0.0:1784938443.807985:0:16390:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f2388125500/2, rc 0, transno 4294967479 00000100:00100000:0.0:1784938443.807992:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350878848:192.168.202.154@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1784938443.813787:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.813880:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f2caa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:19221:1871643350883200:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938443.813914:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938443.813975:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+41:10959:x1871643337469952:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 6624us (6862us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938443.813986:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 399 00000100:00100000:3.0:1784938443.814065:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337470208 00000100:00100000:3.0:1784938443.814076:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337470208 00000100:00100000:3.0:1784938443.814127:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 92 00000100:00100000:3.0:1784938443.814135:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f2c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+86:17096:x1871643337470208:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938443.814463:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f2c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+87:17096:x1871643337470208:12345-192.168.202.54@tcp:35:cp.0 Request processed in 328us (685us total) trans 8589934842 rc 0/0 00000100:00100000:3.0:1784938443.814471:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 92 00000100:00100000:0.0:1784938443.818036:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.818101:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337470336 00000100:00100000:2.0:1784938443.818110:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337470336 00000100:00100000:2.0:1784938443.818213:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 466 00000100:00100000:2.0:1784938443.818224:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+87:17096:x1871643337470336:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938443.818247:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938443.818271:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a800/0x7b044d4128f9cefc lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476641f4 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.818346:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b000/0x7b044d4128f9cf03 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.818361:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b000/0x7b044d4128f9cf03 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.818372:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b000/0x7b044d4128f9cf03 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.818387:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9cf0a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xf2ca543e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.818394:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9cf0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.818399:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9cf0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.818449:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b000/0x7b044d4128f9cf03 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.818456:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b000/0x7b044d4128f9cf03 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.818462:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b000/0x7b044d4128f9cf03 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.818472:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17b000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938443.818477:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b000/0x7b044d4128f9cf03 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.818484:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b000/0x7b044d4128f9cf03 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.818496:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938443.818500:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.818505:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b000/0x7b044d4128f9cf03 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.818511:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b000/0x7b044d4128f9cf03 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.818523:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9cf0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.818529:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9cf0a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.818535:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9cf0a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.818541:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17ae00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938443.818544:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9cf0a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.818551:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9cf0a lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.818562:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xf2ca543e (ffff9f23861f4d00) 00010000:00010000:2.0:1784938443.818565:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.818567:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9cf0a lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.818572:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9cf0a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.818607:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a800/0x7b044d4128f9cefc lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641f4 expref: 88 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.818617:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938443.818620:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.818624:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a800/0x7b044d4128f9cefc lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641f4 expref: 88 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.818633:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17a800, rc 0) 00000100:00100000:2.0:1784938443.818689:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+87:17096:x1871643337470336:12345-192.168.202.54@tcp:101:cp.0 Request processed in 466us (662us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938443.818697:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 466 00000100:00100000:1.0:1784938443.823355:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.823617:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337470464 00000100:00100000:3.0:1784938443.823629:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337470464 00000100:00100000:3.0:1784938443.823689:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 467 00000100:00100000:3.0:1784938443.823699:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f2caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+87:17096:x1871643337470464:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938443.823720:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938443.823741:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9cf11 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476641fb expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.823806:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9cf18 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.823821:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9cf18 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.823831:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9cf18 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.823845:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9cf1f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xf2ca543e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.823851:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9cf1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.823858:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9cf1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.824006:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9cf18 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.824025:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9cf18 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.824032:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9cf18 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.824038:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938443.824042:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9cf18 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.824054:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9cf18 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.824066:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938443.824069:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.824074:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9cf18 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.824080:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9cf18 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.824093:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9cf1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.824099:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9cf1f lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.824105:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9cf1f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.824110:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf0a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938443.824113:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9cf1f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.824119:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9cf1f lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.824125:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xf2ca543e (ffff9f2484afd200) 00010000:00010000:3.0:1784938443.824128:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.824131:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9cf1f lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.824378:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9cf1f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.824421:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9cf11 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641fb expref: 88 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.824432:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938443.824434:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.824438:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9cf11 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641fb expref: 88 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.824448:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf1e00, rc 0) 00000100:00100000:3.0:1784938443.824516:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f2caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+87:17096:x1871643337470464:12345-192.168.202.54@tcp:101:cp.0 Request processed in 818us (1169us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938443.824524:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 467 00000100:00100000:0.0:1784938443.829924:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.830293:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337470720 00000100:00100000:3.0:1784938443.830304:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337470720 00000100:00100000:3.0:1784938443.830424:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 468 00000100:00100000:3.0:1784938443.830436:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+87:17096:x1871643337470720:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938443.830459:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938443.830486:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9cf26 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664202 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.830605:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0e00/0x7b044d4128f9cf2d lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.830621:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0e00/0x7b044d4128f9cf2d lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.830633:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0e00/0x7b044d4128f9cf2d lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.830647:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1800/0x7b044d4128f9cf34 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0xf2ca543e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.830654:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1800/0x7b044d4128f9cf34 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.830660:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1800/0x7b044d4128f9cf34 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938443.831084:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x65:0x0], index 1: 0 00010000:00010000:3.0:1784938443.831262:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0000/0x7b044d4128f9cf3b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.831272:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0000/0x7b044d4128f9cf3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.831279:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0000/0x7b044d4128f9cf3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.831306:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0e00/0x7b044d4128f9cf2d lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.831313:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0e00/0x7b044d4128f9cf2d lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.831331:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0e00/0x7b044d4128f9cf2d lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.831337:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf0e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938443.831343:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0e00/0x7b044d4128f9cf2d lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.831351:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0e00/0x7b044d4128f9cf2d lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.831362:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938443.831365:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.831369:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0e00/0x7b044d4128f9cf2d lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.831375:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0e00/0x7b044d4128f9cf2d lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938443.831389:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a7e5f53b reply state 00000000732a9256 transno 8589934843 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1800/0x7b044d4128f9cf34 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.831399:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1800/0x7b044d4128f9cf34 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.831405:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xf2ca543e (ffff9f2484afd700) 00010000:00010000:3.0:1784938443.831408:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938443.831410:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938443.831438:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9cf26 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664202 expref: 90 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.831453:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0000/0x7b044d4128f9cf3b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664202 expref: 89 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.831460:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4a:0x0].0x0 (ffff9f2484afd600) 00010000:00010000:3.0:1784938443.831463:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938443.831466:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf0000, rc 0) 00000100:00100000:3.0:1784938443.831676:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+90:17096:x1871643337470720:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1241us (1762us total) trans 8589934843 rc 0/0 00000100:00100000:3.0:1784938443.831686:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 468 00000100:00100000:1.0:1784938443.835500:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.835574:0:25724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337470848 00000100:00100000:2.0:1784938443.835583:0:25724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337470848 00000100:00100000:2.0:1784938443.835670:0:25724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 794 00000100:00100000:2.0:1784938443.835680:0:25724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7ea6e988-18ba-4c98-b179-17995571b98b+46:10958:x1871643337470848:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938443.835699:0:25724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938443.835721:0:25724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9cf49 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664209 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938443.835754:0:25724:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x65:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938443.835777:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x65:0x0].0x0 since=710s v=(0 0) 00010000:00010000:2.0:1784938443.835782:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x65:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.835793:0:25724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9cf49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664209 expref: 47 pid: 25724 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.835810:0:25724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9cf49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664209 expref: 47 pid: 25724 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.835822:0:25724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17ae00, rc 0) 00000100:00100000:2.0:1784938443.835893:0:25724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7ea6e988-18ba-4c98-b179-17995571b98b+47:10958:x1871643337470848:12345-192.168.202.54@tcp:101:cp.0 Request processed in 214us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938443.835900:0:25724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 794 00000100:00100000:3.0:1784938443.838347:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.839129:0:25719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337470976 00000100:00100000:1.0:1784938443.839140:0:25719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337470976 00000100:00100000:0.0:1784938443.842350:0:25719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 795 00000100:00100000:0.0:1784938443.842365:0:25719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7ea6e988-18ba-4c98-b179-17995571b98b+47:17096:x1871643337470976:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938443.842383:0:25719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938443.842405:0:25719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015b67b51/0x7b044d4128f9cf50 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664210 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.842439:0:25719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9cf49 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664209 expref: 48 pid: 25724 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.842447:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x65:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.842452:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x65:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.842456:0:25719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015b67b51/0x7b044d4128f9cf50 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664210 expref: 48 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.842494:0:25719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9cf49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664209 expref: 48 pid: 25724 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.842509:0:25719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9cf49 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664209 expref: 48 pid: 25724 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.842523:0:25719:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23882bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:25719:1871643350883328:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938443.842665:0:25719:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbe780 going to sleep for 11 seconds 00000100:00100000:1.0:1784938443.846443:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.846697:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337471104 00000100:00100000:3.0:1784938443.846707:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337471104 00010000:00010000:3.0:1784938443.846752:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9cf49 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664209 expref: 49 pid: 25724 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.846807:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 400 00000100:00100000:3.0:1784938443.846817:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+49:10957:x1871643337471104:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938443.846834:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938443.846860:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9cf49 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664209 expref: 49 pid: 25724 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.846874:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9cf49 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664209 expref: 49 pid: 25724 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.846911:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x65:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.846915:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x65:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.846924:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000015b67b51/0x7b044d4128f9cf50 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664210 expref: 49 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.846934:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015b67b51/0x7b044d4128f9cf50 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664210 expref: 49 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.846979:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000015b67b51/0x7b044d4128f9cf50 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664210 expref: 49 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.846994:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d144700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22955:1871643350883456:192.168.202.54@tcp:105: 00000100:00100000:3.0:1784938443.847074:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f249d7baf00 going to sleep for 11 seconds 00000100:00100000:1.0:1784938443.850317:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d144700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22955:1871643350883456:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938443.850356:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.850421:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+49:10957:x1871643337471104:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3605us (3985us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.850432:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 400 00010000:00010000:0.0:1784938443.851706:0:25719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000057fcbbb/0x7b044d4128f9cf49 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664209 expref: 48 pid: 25724 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.851727:0:25719:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23882bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:25719:1871643350883328:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938443.851751:0:25719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000015b67b51/0x7b044d4128f9cf50 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664210 expref: 47 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.851767:0:25719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b35000, rc 0) 00000100:00100000:1.0:1784938443.852006:0:25719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7ea6e988-18ba-4c98-b179-17995571b98b+47:17096:x1871643337470976:12345-192.168.202.54@tcp:101:cp.0 Request processed in 9642us (13666us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.852024:0:25719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 795 00000100:00100000:3.0:1784938443.854793:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.854883:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337471360 00000100:00100000:0.0:1784938443.854893:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337471360 00000100:00100000:0.0:1784938443.855001:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 93 00000100:00100000:0.0:1784938443.855009:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24857f8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+90:17096:x1871643337471360:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:0.0:1784938443.855382:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24857f8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+91:17096:x1871643337471360:12345-192.168.202.54@tcp:35:cp.0 Request processed in 372us (593us total) trans 8589934844 rc 0/0 00000100:00100000:0.0:1784938443.855390:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 93 00000100:00100000:2.0:1784938443.858654:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.858738:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337471488 00000100:00100000:0.0:1784938443.858749:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337471488 00000100:00100000:0.0:1784938443.858824:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 469 00000100:00100000:0.0:1784938443.858834:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+91:17096:x1871643337471488:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938443.858858:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938443.858893:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9cf57 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664217 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.858960:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35a00/0x7b044d4128f9cf5e lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.858972:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35a00/0x7b044d4128f9cf5e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.858981:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35a00/0x7b044d4128f9cf5e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.858991:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34400/0x7b044d4128f9cf65 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xd06bcd9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.858995:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34400/0x7b044d4128f9cf65 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.858999:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34400/0x7b044d4128f9cf65 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.859138:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35a00/0x7b044d4128f9cf5e lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.859162:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35a00/0x7b044d4128f9cf5e lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.859166:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35a00/0x7b044d4128f9cf5e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.859170:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35a00/0x7b044d4128f9cf5e lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.859174:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.859177:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35a00/0x7b044d4128f9cf5e lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.859182:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35a00/0x7b044d4128f9cf5e lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.859195:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938443.859199:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.859203:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35a00/0x7b044d4128f9cf5e lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.859210:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35a00/0x7b044d4128f9cf5e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.859226:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34400/0x7b044d4128f9cf65 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.859233:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34400/0x7b044d4128f9cf65 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.859239:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34400/0x7b044d4128f9cf65 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.859245:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b34400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938443.859247:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34400/0x7b044d4128f9cf65 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.859253:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34400/0x7b044d4128f9cf65 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.859261:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xd06bcd9f (ffff9f24985e9e00) 00010000:00010000:0.0:1784938443.859263:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.859266:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34400/0x7b044d4128f9cf65 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.859271:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34400/0x7b044d4128f9cf65 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.859310:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9cf57 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664217 expref: 92 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.859331:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938443.859334:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938443.859338:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9cf57 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664217 expref: 92 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.859348:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b34200, rc 0) 00000100:00100000:0.0:1784938443.859411:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+91:17096:x1871643337471488:12345-192.168.202.54@tcp:101:cp.0 Request processed in 578us (762us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938443.859418:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 469 00000100:00100000:1.0:1784938443.861676:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.861855:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337471616 00000100:00100000:0.0:1784938443.861864:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337471616 00000100:00100000:0.0:1784938443.861981:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 470 00000100:00100000:0.0:1784938443.861988:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+91:17096:x1871643337471616:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938443.862005:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938443.862068:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35600/0x7b044d4128f9cf6c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766421e expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.862114:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9cf73 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.862286:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9cf73 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.862301:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9cf73 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.862511:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f9cf7a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xd06bcd9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.862521:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f9cf7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.862530:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f9cf7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.862570:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9cf73 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.862577:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9cf73 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.862584:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9cf73 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.862591:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9cf73 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.862597:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b34a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938443.862602:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9cf73 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.862608:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9cf73 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.862618:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938443.862621:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.862625:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9cf73 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.862632:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9cf73 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.862646:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f9cf7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.862652:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f9cf7a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.862658:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f9cf7a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.862663:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c559000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938443.862666:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f9cf7a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.862672:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f9cf7a lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.862678:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xd06bcd9f (ffff9f24898dd700) 00010000:00010000:1.0:1784938443.862681:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.862683:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f9cf7a lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.862688:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f9cf7a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.862719:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35600/0x7b044d4128f9cf6c lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766421e expref: 92 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.862729:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938443.862732:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.862736:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35600/0x7b044d4128f9cf6c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766421e expref: 92 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.862745:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b35600, rc 0) 00000100:00100000:1.0:1784938443.862836:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+91:17096:x1871643337471616:12345-192.168.202.54@tcp:101:cp.0 Request processed in 847us (1165us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938443.862844:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 470 00000100:00100000:1.0:1784938443.866605:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.866687:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337471872 00000100:00100000:3.0:1784938443.866698:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337471872 00000100:00100000:3.0:1784938443.866800:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 471 00000100:00100000:3.0:1784938443.866811:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+91:17096:x1871643337471872:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938443.866835:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938443.866858:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9cf81 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664225 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.866988:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9cf88 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.867004:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9cf88 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.867028:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9cf88 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.867045:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0e00/0x7b044d4128f9cf8f lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0xd06bcd9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.867052:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0e00/0x7b044d4128f9cf8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.867059:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0e00/0x7b044d4128f9cf8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938443.867462:0:24203:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x66:0x0], index 0: 0 00010000:00010000:3.0:1784938443.867601:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9cf96 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.867611:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9cf96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.867620:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9cf96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.867654:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9cf88 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.867661:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9cf88 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.867668:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9cf88 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.867673:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938443.867678:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9cf88 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.867685:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9cf88 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.867696:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938443.867699:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.867704:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9cf88 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.867710:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9cf88 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938443.867723:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ac4e0402 reply state 0000000085c5a6df transno 8589934845 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0e00/0x7b044d4128f9cf8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.867734:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0e00/0x7b044d4128f9cf8f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.867740:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xd06bcd9f (ffff9f2484afd200) 00010000:00010000:3.0:1784938443.867743:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938443.867745:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938443.867776:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9cf81 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664225 expref: 94 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.867790:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9cf96 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664225 expref: 93 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.867798:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4b:0x0].0x0 (ffff9f2484afda00) 00010000:00010000:3.0:1784938443.867800:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938443.867803:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf0a00, rc 0) 00000100:00100000:3.0:1784938443.867866:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+94:17096:x1871643337471872:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1057us (1271us total) trans 8589934845 rc 0/0 00000100:00100000:3.0:1784938443.867874:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 471 00000100:00100000:2.0:1784938443.871665:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.871769:0:25727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337472000 00000100:00100000:0.0:1784938443.871779:0:25727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337472000 00000100:00100000:0.0:1784938443.871873:0:25727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 796 00000100:00100000:0.0:1784938443.871895:0:25727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7ea6e988-18ba-4c98-b179-17995571b98b+41:10959:x1871643337472000:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938443.871915:0:25727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938443.871939:0:25727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9cfa4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766422c expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938443.871965:0:25727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x66:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938443.871988:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x66:0x0].0x0 since=710s v=(0 0) 00010000:00010000:0.0:1784938443.871992:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x66:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.872002:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9cfa4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766422c expref: 42 pid: 25727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.872034:0:25727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9cfa4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766422c expref: 42 pid: 25727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.872047:0:25727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b34200, rc 0) 00000100:00100000:0.0:1784938443.872108:0:25727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7ea6e988-18ba-4c98-b179-17995571b98b+42:10959:x1871643337472000:12345-192.168.202.54@tcp:101:cp.0 Request processed in 226us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938443.872116:0:25727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 796 00000100:00100000:3.0:1784938443.874698:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.875226:0:25730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337472128 00000100:00100000:1.0:1784938443.875237:0:25730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337472128 00000100:00100000:1.0:1784938443.875295:0:25730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 797 00000100:00100000:1.0:1784938443.875305:0:25730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:7ea6e988-18ba-4c98-b179-17995571b98b+42:17096:x1871643337472128:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938443.875334:0:25730:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938443.875354:0:25730:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021eb4aad/0x7b044d4128f9cfab lrc: 2/0,0 mode: --/PW res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664233 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.875390:0:25730:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9cfa4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766422c expref: 43 pid: 25727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.875400:0:25730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x66:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.875405:0:25730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x66:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.875410:0:25730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021eb4aad/0x7b044d4128f9cfab lrc: 4/0,0 mode: --/PW res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664233 expref: 43 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.875444:0:25730:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9cfa4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e94766422c expref: 43 pid: 25727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.875458:0:25730:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9cfa4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766422c expref: 43 pid: 25727 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.875474:0:25730:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f241880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:25730:1871643350883584:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938443.875552:0:25730:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2482d95540 going to sleep for 11 seconds 00000100:00100000:1.0:1784938443.880048:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938443.880263:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337472256 00000100:00100000:0.0:1784938443.880275:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337472256 00010000:00010000:0.0:1784938443.880332:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9cfa4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766422c expref: 44 pid: 25727 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.880381:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 401 00000100:00100000:0.0:1784938443.880391:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+44:10959:x1871643337472256:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938443.880409:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938443.880432:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9cfa4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766422c expref: 44 pid: 25727 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.880445:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9cfa4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766422c expref: 44 pid: 25727 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.880471:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x66:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.880476:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x66:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.880483:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000021eb4aad/0x7b044d4128f9cfab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664233 expref: 44 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.880493:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021eb4aad/0x7b044d4128f9cfab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664233 expref: 44 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.880530:0:19220:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000021eb4aad/0x7b044d4128f9cfab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664233 expref: 44 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.880543:0:19220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23882bca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:19220:1871643350883712:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938443.880627:0:19220:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbe840 going to sleep for 11 seconds 00010000:00010000:2.0:1784938443.880773:0:25730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056ad80ca/0x7b044d4128f9cfa4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766422c expref: 44 pid: 25727 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938443.880789:0:25730:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f241880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:25730:1871643350883584:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938443.880813:0:25730:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000021eb4aad/0x7b044d4128f9cfab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664233 expref: 43 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.880823:0:25730:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c559600, rc 0) 00000100:00100000:2.0:1784938443.880855:0:25730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:7ea6e988-18ba-4c98-b179-17995571b98b+43:17096:x1871643337472128:12345-192.168.202.54@tcp:101:cp.0 Request processed in 5551us (6167us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938443.880863:0:25730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 797 00000100:00100000:0.0:1784938443.889433:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.889529:0:19220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23882bca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:19220:1871643350883712:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938443.889553:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.889611:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+42:10959:x1871643337472256:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 9221us (9571us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.889623:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 401 00000100:00100000:3.0:1784938443.890605:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337472512 00000100:00100000:3.0:1784938443.890619:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337472512 00000100:00100000:3.0:1784938443.890691:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 94 00000100:00100000:3.0:1784938443.890700:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+94:17096:x1871643337472512:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938443.891116:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+95:17096:x1871643337472512:12345-192.168.202.54@tcp:35:cp.0 Request processed in 415us (1690us total) trans 8589934846 rc 0/0 00000100:00100000:3.0:1784938443.891124:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 94 00000100:00100000:0.0:1784938443.894480:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.894568:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337472640 00000100:00100000:2.0:1784938443.894577:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337472640 00000100:00100000:2.0:1784938443.894670:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 472 00000100:00100000:2.0:1784938443.894680:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+95:17096:x1871643337472640:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938443.894706:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938443.894728:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a400/0x7b044d4128f9cfb2 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766423a expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.894797:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a600/0x7b044d4128f9cfb9 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.894811:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a600/0x7b044d4128f9cfb9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.894833:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a600/0x7b044d4128f9cfb9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.894849:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b600/0x7b044d4128f9cfc0 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x22eacdcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.894856:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b600/0x7b044d4128f9cfc0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.894863:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b600/0x7b044d4128f9cfc0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.895386:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a600/0x7b044d4128f9cfb9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.895401:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a600/0x7b044d4128f9cfb9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.895408:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a600/0x7b044d4128f9cfb9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.895414:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17a600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938443.895418:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a600/0x7b044d4128f9cfb9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.895426:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a600/0x7b044d4128f9cfb9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.895440:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938443.895443:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.895448:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a600/0x7b044d4128f9cfb9 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.895455:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a600/0x7b044d4128f9cfb9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.895467:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b600/0x7b044d4128f9cfc0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.895472:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b600/0x7b044d4128f9cfc0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.895479:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b600/0x7b044d4128f9cfc0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.895484:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17b600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938443.895487:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b600/0x7b044d4128f9cfc0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.895493:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b600/0x7b044d4128f9cfc0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.895499:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x22eacdcf (ffff9f23861f4200) 00010000:00010000:2.0:1784938443.895502:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.895504:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b600/0x7b044d4128f9cfc0 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.895510:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b600/0x7b044d4128f9cfc0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.895544:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a400/0x7b044d4128f9cfb2 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766423a expref: 96 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.895554:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938443.895556:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.895560:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a400/0x7b044d4128f9cfb2 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766423a expref: 96 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.895569:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17a400, rc 0) 00000100:00100000:2.0:1784938443.895669:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+95:17096:x1871643337472640:12345-192.168.202.54@tcp:101:cp.0 Request processed in 991us (1198us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938443.895677:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 472 00000100:00100000:0.0:1784938443.898661:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.898729:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337472768 00000100:00100000:2.0:1784938443.898737:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337472768 00000100:00100000:2.0:1784938443.898822:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 473 00000100:00100000:2.0:1784938443.898833:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+95:17096:x1871643337472768:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938443.898856:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938443.898890:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b000/0x7b044d4128f9cfc7 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664241 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.898954:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9cfce lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.898968:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9cfce lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.898979:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9cfce lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.898994:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9cfd5 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x22eacdcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.899001:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9cfd5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.899007:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9cfd5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.899060:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9cfce lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.899067:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9cfce lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.899073:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9cfce lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.899078:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17ae00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938443.899083:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9cfce lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.899090:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9cfce lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.899102:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938443.899106:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.899110:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9cfce lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.899117:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9cfce lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.899139:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9cfd5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.899174:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9cfd5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.899180:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9cfd5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.899186:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17b400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938443.899189:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9cfd5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.899194:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9cfd5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.899201:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x22eacdcf (ffff9f23861f4000) 00010000:00010000:2.0:1784938443.899204:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.899207:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9cfd5 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.899213:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9cfd5 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.899247:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b000/0x7b044d4128f9cfc7 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664241 expref: 96 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.899256:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938443.899258:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.899261:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b000/0x7b044d4128f9cfc7 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664241 expref: 96 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.899270:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17b000, rc 0) 00000100:00100000:2.0:1784938443.899331:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+95:17096:x1871643337472768:12345-192.168.202.54@tcp:101:cp.0 Request processed in 499us (678us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938443.899338:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 473 00000100:00100000:0.0:1784938443.902446:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.902583:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337473024 00000100:00100000:3.0:1784938443.902591:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337473024 00000100:00100000:3.0:1784938443.902649:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 474 00000100:00100000:3.0:1784938443.902658:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+95:17096:x1871643337473024:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938443.902678:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938443.902698:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9cfdc lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664248 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.902795:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9cfe3 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.902810:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9cfe3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.902821:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9cfe3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.902834:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9cfea lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x22eacdcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.902841:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9cfea lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.902847:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9cfea lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938443.903193:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x66:0x0], index 1: 0 00010000:00010000:3.0:1784938443.903343:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9cff1 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.903357:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9cff1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.903366:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9cff1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.903399:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9cfe3 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.903406:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9cfe3 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.903413:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9cfe3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.903419:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9cfe3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.903425:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938443.903429:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9cfe3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.903436:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9cfe3 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.903447:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938443.903450:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.903455:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9cfe3 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.903461:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9cfe3 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938443.903475:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000885cea46 reply state 000000000a507e7c transno 8589934847 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9cfea lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.903486:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9cfea lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.903492:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x22eacdcf (ffff9f2484afd800) 00010000:00010000:3.0:1784938443.903494:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938443.903499:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938443.903528:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9cfdc lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664248 expref: 98 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.903542:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9cff1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664248 expref: 97 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.903548:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9f2484afd100) 00010000:00010000:3.0:1784938443.903551:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938443.903553:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf1c00, rc 0) 00000100:00100000:3.0:1784938443.903621:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+98:17096:x1871643337473024:12345-192.168.202.54@tcp:101:cp.0 Request processed in 963us (1183us total) trans 8589934847 rc 0/0 00000100:00100000:3.0:1784938443.903629:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 474 00000100:00100000:0.0:1784938443.907411:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.907493:0:25726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337473152 00000100:00100000:2.0:1784938443.907503:0:25726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337473152 00000100:00100000:2.0:1784938443.907560:0:25726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 798 00000100:00100000:2.0:1784938443.907570:0:25726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7ea6e988-18ba-4c98-b179-17995571b98b+47:10958:x1871643337473152:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938443.907587:0:25726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938443.907606:0:25726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091814461/0x7b044d4128f9cfff lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766424f expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938443.907630:0:25726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x66:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938443.907651:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x66:0x0].0x0 since=710s v=(0 0) 00010000:00010000:2.0:1784938443.907657:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x66:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.907666:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091814461/0x7b044d4128f9cfff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766424f expref: 48 pid: 25726 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.907683:0:25726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000091814461/0x7b044d4128f9cfff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766424f expref: 48 pid: 25726 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.907696:0:25726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17a800, rc 0) 00000100:00100000:2.0:1784938443.907756:0:25726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7ea6e988-18ba-4c98-b179-17995571b98b+48:10958:x1871643337473152:12345-192.168.202.54@tcp:101:cp.0 Request processed in 187us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938443.907763:0:25726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 798 00000100:00100000:0.0:1784938443.910677:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.910760:0:25721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337473280 00000100:00100000:3.0:1784938443.910774:0:25721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337473280 00000100:00100000:3.0:1784938443.910844:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 799 00000100:00100000:3.0:1784938443.910855:0:25721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f2c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7ea6e988-18ba-4c98-b179-17995571b98b+48:17096:x1871643337473280:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938443.910876:0:25721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938443.910910:0:25721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9d006 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664256 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.910943:0:25721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000091814461/0x7b044d4128f9cfff lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766424f expref: 49 pid: 25726 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.910952:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x66:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.910957:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x66:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.910963:0:25721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9d006 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664256 expref: 49 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.910996:0:25721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000091814461/0x7b044d4128f9cfff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e94766424f expref: 49 pid: 25726 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.911010:0:25721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000091814461/0x7b044d4128f9cfff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766424f expref: 49 pid: 25726 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.911035:0:25721:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d145180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:25721:1871643350883840:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938443.911171:0:25721:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d077180 going to sleep for 11 seconds 00000100:00100000:0.0:1784938443.914737:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.914848:0:25721:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d145180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:25721:1871643350883840:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938443.914899:0:25721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9d006 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664256 expref: 49 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.914921:0:25721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf1600, rc 0) 00000100:00100000:3.0:1784938443.914982:0:25721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f2c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7ea6e988-18ba-4c98-b179-17995571b98b+49:17096:x1871643337473280:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4128us (4315us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938443.914992:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 799 00000100:00100000:2.0:1784938443.916726:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337473408 00000100:00100000:2.0:1784938443.916740:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337473408 00010000:00010000:0.0:1784938443.916948:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000091814461/0x7b044d4128f9cfff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766424f expref: 49 pid: 25726 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.917043:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 402 00000100:00100000:0.0:1784938443.917052:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23880a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+49:10958:x1871643337473408:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938443.917067:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938443.917091:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000091814461/0x7b044d4128f9cfff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766424f expref: 49 pid: 25726 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.917105:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000091814461/0x7b044d4128f9cfff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766424f expref: 49 pid: 25726 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.917387:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091814461/0x7b044d4128f9cfff lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766424f expref: 49 pid: 25726 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.917404:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x66:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.917408:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x66:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938443.917417:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9d006 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664256 expref: 48 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.917434:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9d006 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664256 expref: 48 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938443.917474:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9d006 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664256 expref: 48 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938443.917488:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23880a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350883968:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938443.917575:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbe9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938443.925058:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.925122:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337473664 00000100:00100000:3.0:1784938443.925131:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337473664 00000100:00100000:3.0:1784938443.925241:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 95 00000100:00100000:3.0:1784938443.925253:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23880a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+98:17096:x1871643337473664:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938443.925634:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23880a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+99:17096:x1871643337473664:12345-192.168.202.54@tcp:35:cp.0 Request processed in 382us (585us total) trans 8589934848 rc 0/0 00000100:00100000:3.0:1784938443.925643:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 95 00000100:00100000:1.0:1784938443.926415:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23880a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350883968:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938443.926440:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.926488:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23880a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+48:10958:x1871643337473408:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 9437us (11763us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.926497:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 402 00000100:00100000:0.0:1784938443.930347:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.930433:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337473792 00000100:00100000:3.0:1784938443.930444:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337473792 00000100:00100000:3.0:1784938443.930507:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 475 00000100:00100000:3.0:1784938443.930519:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23880a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+99:17096:x1871643337473792:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938443.930546:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938443.930569:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d00d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766425d expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.930640:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d014 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.930657:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d014 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.930671:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d014 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.930686:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d01b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x9ce4d69c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.930693:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d01b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.930699:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d01b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.930746:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d014 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.930754:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d014 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.930761:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d014 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.930768:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938443.930774:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d014 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.930784:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d014 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.930796:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938443.930800:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.930805:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d014 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.930811:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d014 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.930826:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d01b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.930834:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d01b lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.930840:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d01b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.930845:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938443.930847:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d01b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.930853:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d01b lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.930860:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x9ce4d69c (ffff9f2484afdc00) 00010000:00010000:3.0:1784938443.930863:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.930865:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d01b lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.930871:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d01b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.930922:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d00d lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766425d expref: 100 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.930933:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938443.930935:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.930939:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d00d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766425d expref: 100 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.930953:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf1e00, rc 0) 00000100:00100000:3.0:1784938443.931024:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23880a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+99:17096:x1871643337473792:12345-192.168.202.54@tcp:101:cp.0 Request processed in 507us (685us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938443.931032:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 475 00000100:00100000:2.0:1784938443.934100:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.934273:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337473920 00000100:00100000:3.0:1784938443.934284:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337473920 00000100:00100000:3.0:1784938443.934348:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 476 00000100:00100000:3.0:1784938443.934359:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+99:17096:x1871643337473920:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938443.934381:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938443.934402:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9d022 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664264 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.934469:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0600/0x7b044d4128f9d029 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.934484:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0600/0x7b044d4128f9d029 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.934494:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0600/0x7b044d4128f9d029 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.934509:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9d030 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x9ce4d69c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.934515:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9d030 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.934521:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9d030 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.934560:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0600/0x7b044d4128f9d029 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.934568:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0600/0x7b044d4128f9d029 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.934574:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0600/0x7b044d4128f9d029 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.934580:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0600/0x7b044d4128f9d029 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.934586:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf0600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938443.934590:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0600/0x7b044d4128f9d029 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.934597:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0600/0x7b044d4128f9d029 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.934608:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938443.934610:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.934615:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0600/0x7b044d4128f9d029 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.934621:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0600/0x7b044d4128f9d029 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.934635:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9d030 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.934641:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9d030 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.934647:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9d030 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.934653:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27cc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938443.934655:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9d030 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.934661:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9d030 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.934666:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x9ce4d69c (ffff9f24898e0700) 00010000:00010000:3.0:1784938443.934668:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.934671:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9d030 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.934676:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9d030 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.934702:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9d022 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664264 expref: 100 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.934711:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938443.934713:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.934717:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0400/0x7b044d4128f9d022 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664264 expref: 100 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.934724:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf0400, rc 0) 00000100:00100000:3.0:1784938443.934847:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+99:17096:x1871643337473920:12345-192.168.202.54@tcp:101:cp.0 Request processed in 489us (755us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938443.934857:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 476 00000100:00100000:2.0:1784938443.938430:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.938511:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337474176 00000100:00100000:3.0:1784938443.938522:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337474176 00000100:00100000:3.0:1784938443.938584:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 477 00000100:00100000:3.0:1784938443.938592:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+99:17096:x1871643337474176:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938443.938611:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938443.938631:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9d037 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766426b expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.938732:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9d03e lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.938748:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9d03e lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.938759:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9d03e lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.938772:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d200/0x7b044d4128f9d045 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x9ce4d69c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.938778:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d200/0x7b044d4128f9d045 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.938784:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d200/0x7b044d4128f9d045 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938443.939104:0:24203:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x67:0x0], index 0: 0 00010000:00010000:3.0:1784938443.939288:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9d04c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.939299:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9d04c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.939307:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9d04c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.939354:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9d03e lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.939361:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9d03e lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.939368:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9d03e lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.939374:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27d600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938443.939378:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9d03e lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.939385:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9d03e lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.939398:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938443.939401:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.939406:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9d03e lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.939412:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9d03e lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938443.939426:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d386ba24 reply state 00000000bde5fa81 transno 8589934849 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d200/0x7b044d4128f9d045 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.939437:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d200/0x7b044d4128f9d045 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.939444:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x9ce4d69c (ffff9f24898e0500) 00010000:00010000:3.0:1784938443.939447:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938443.939449:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938443.939478:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9d037 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766426b expref: 102 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.939489:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9d04c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766426b expref: 101 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.939494:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9f24898e0000) 00010000:00010000:3.0:1784938443.939496:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938443.939497:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d27c800, rc 0) 00000100:00100000:3.0:1784938443.939552:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+102:17096:x1871643337474176:12345-192.168.202.54@tcp:101:cp.0 Request processed in 962us (1135us total) trans 8589934849 rc 0/0 00000100:00100000:3.0:1784938443.939558:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 477 00000100:00100000:0.0:1784938443.942870:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.942980:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337474304 00000100:00100000:2.0:1784938443.942990:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337474304 00000100:00100000:2.0:1784938443.943082:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 800 00000100:00100000:2.0:1784938443.943092:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387daf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+42:10959:x1871643337474304:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938443.943112:0:25722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938443.943170:0:25722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fe810d2/0x7b044d4128f9d05a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664272 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938443.943199:0:25722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x67:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938443.943217:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x67:0x0].0x0 since=710s v=(0 0) 00010000:00010000:2.0:1784938443.943220:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x67:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.943229:0:25722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fe810d2/0x7b044d4128f9d05a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664272 expref: 43 pid: 25722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.943246:0:25722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004fe810d2/0x7b044d4128f9d05a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664272 expref: 43 pid: 25722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.943258:0:25722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17a600, rc 0) 00000100:00100000:2.0:1784938443.943317:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387daf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+43:10959:x1871643337474304:12345-192.168.202.54@tcp:101:cp.0 Request processed in 227us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938443.943333:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 800 00000100:00100000:2.0:1784938443.950335:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.950423:0:25718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337474432 00000100:00100000:3.0:1784938443.950432:0:25718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337474432 00000100:00100000:3.0:1784938443.950490:0:25718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 801 00000100:00100000:3.0:1784938443.950500:0:25718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ea6e988-18ba-4c98-b179-17995571b98b+43:17096:x1871643337474432:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938443.950525:0:25718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938443.950545:0:25718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f8d5b00/0x7b044d4128f9d061 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664279 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.950580:0:25718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004fe810d2/0x7b044d4128f9d05a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664272 expref: 44 pid: 25722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.950587:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x67:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.950591:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x67:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.950594:0:25718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f8d5b00/0x7b044d4128f9d061 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664279 expref: 44 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.950623:0:25718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004fe810d2/0x7b044d4128f9d05a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664272 expref: 44 pid: 25722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.950634:0:25718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004fe810d2/0x7b044d4128f9d05a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664272 expref: 44 pid: 25722 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.950646:0:25718:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d145180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25718:1871643350884096:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938443.950742:0:25718:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24917e70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938443.952793:0:25718:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d145180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25718:1871643350884096:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938443.952842:0:25718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005f8d5b00/0x7b044d4128f9d061 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664279 expref: 44 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.952863:0:25718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d27c400, rc 0) 00000100:00100000:3.0:1784938443.952943:0:25718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ea6e988-18ba-4c98-b179-17995571b98b+44:17096:x1871643337474432:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2444us (2626us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938443.952953:0:25718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 801 00000100:00100000:0.0:1784938443.954578:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.954758:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337474560 00000100:00100000:1.0:1784938443.954771:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337474560 00010000:00010000:1.0:1784938443.954819:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004fe810d2/0x7b044d4128f9d05a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664272 expref: 44 pid: 25722 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.954979:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 403 00000100:00100000:1.0:1784938443.954990:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+44:10960:x1871643337474560:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.955010:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.955048:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004fe810d2/0x7b044d4128f9d05a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664272 expref: 44 pid: 25722 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.955063:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004fe810d2/0x7b044d4128f9d05a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664272 expref: 44 pid: 25722 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.955087:0:22955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fe810d2/0x7b044d4128f9d05a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664272 expref: 44 pid: 25722 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.955103:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x67:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.955107:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x67:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.955114:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005f8d5b00/0x7b044d4128f9d061 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664279 expref: 43 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.955121:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f8d5b00/0x7b044d4128f9d061 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664279 expref: 43 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.955206:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005f8d5b00/0x7b044d4128f9d061 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664279 expref: 43 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.955219:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd5a5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350884224:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938443.955293:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2482d95d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938443.958513:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.958565:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337474816 00000100:00100000:3.0:1784938443.958573:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337474816 00000100:00100000:3.0:1784938443.958622:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 96 00000100:00100000:3.0:1784938443.958630:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+102:17096:x1871643337474816:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938443.958898:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+103:17096:x1871643337474816:12345-192.168.202.54@tcp:35:cp.0 Request processed in 267us (392us total) trans 8589934850 rc 0/0 00000100:00100000:3.0:1784938443.958906:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 96 00000100:00100000:1.0:1784938443.959081:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd5a5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350884224:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938443.959099:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.959117:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+43:10960:x1871643337474560:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 4131us (4549us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.959123:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 403 00000100:00100000:0.0:1784938443.961548:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.961627:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337474944 00000100:00100000:3.0:1784938443.961635:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337474944 00000100:00100000:3.0:1784938443.961682:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 478 00000100:00100000:3.0:1784938443.961692:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387daed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+103:17096:x1871643337474944:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938443.961716:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938443.961738:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9d068 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664280 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.961800:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9d06f lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.961812:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9d06f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.962107:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9d06f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.962120:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9d076 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x6caa4986 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.962126:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9d076 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.962133:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9d076 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.962397:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9d06f lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.962406:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9d06f lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.962413:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9d06f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.962419:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9d06f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.962425:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27d600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938443.962428:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9d06f lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.962435:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9d06f lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.962452:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938443.962455:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.962460:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9d06f lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.962466:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9d06f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.962478:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9d076 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.962484:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9d076 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.962490:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9d076 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.962494:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27cc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938443.962497:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9d076 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.962503:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9d076 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.962511:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x6caa4986 (ffff9f24898e0700) 00010000:00010000:2.0:1784938443.962512:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.962514:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9d076 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.962518:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9d076 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.962549:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9d068 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664280 expref: 104 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.962556:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938443.962557:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.962559:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d000/0x7b044d4128f9d068 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664280 expref: 104 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.962565:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d27d000, rc 0) 00000100:00100000:2.0:1784938443.962616:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387daed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+103:17096:x1871643337474944:12345-192.168.202.54@tcp:101:cp.0 Request processed in 927us (1075us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938443.962622:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 478 00000100:00100000:2.0:1784938443.964264:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.964351:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337475072 00000100:00100000:3.0:1784938443.964369:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337475072 00000100:00100000:3.0:1784938443.964424:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 479 00000100:00100000:3.0:1784938443.964433:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+103:17096:x1871643337475072:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938443.964452:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938443.964472:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27da00/0x7b044d4128f9d07d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664287 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.964532:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f9d084 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.964546:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f9d084 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.964556:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f9d084 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.964570:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d08b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x6caa4986 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.964577:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d08b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.964583:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d08b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.964617:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f9d084 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.964625:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f9d084 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.964632:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f9d084 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.964638:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27c000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938443.964641:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f9d084 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.964648:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f9d084 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.964658:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938443.964661:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.964665:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f9d084 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.964671:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f9d084 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.964684:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d08b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.964691:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d08b lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.964697:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d08b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.964702:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27dc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938443.964704:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d08b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.964713:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d08b lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.964720:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x6caa4986 (ffff9f24898e0a00) 00010000:00010000:3.0:1784938443.964723:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.964725:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d08b lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.964731:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d08b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.964756:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27da00/0x7b044d4128f9d07d lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664287 expref: 104 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.964763:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938443.964765:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.964767:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27da00/0x7b044d4128f9d07d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664287 expref: 104 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.964772:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d27da00, rc 0) 00000100:00100000:3.0:1784938443.964821:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+103:17096:x1871643337475072:12345-192.168.202.54@tcp:101:cp.0 Request processed in 390us (565us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938443.964829:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 479 00000100:00100000:0.0:1784938443.967797:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.967868:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337475328 00000100:00100000:2.0:1784938443.967877:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337475328 00000100:00100000:2.0:1784938443.968026:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 480 00000100:00100000:2.0:1784938443.968037:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387daf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+103:17096:x1871643337475328:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938443.968057:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938443.968077:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9d092 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766428e expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.968206:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9d099 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.968222:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9d099 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.968246:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9d099 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.968264:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a800/0x7b044d4128f9d0a0 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x6caa4986 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.968271:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a800/0x7b044d4128f9d0a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.968278:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a800/0x7b044d4128f9d0a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938443.968576:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x67:0x0], index 1: 0 00010000:00010000:2.0:1784938443.968679:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b000/0x7b044d4128f9d0a7 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.968685:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b000/0x7b044d4128f9d0a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.968689:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b000/0x7b044d4128f9d0a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.968712:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9d099 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.968716:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9d099 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.968721:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9d099 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.968724:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17b400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938443.968728:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9d099 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.968733:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9d099 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.968742:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938443.968744:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938443.968747:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9d099 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.968751:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9d099 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938443.968759:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cfaca830 reply state 0000000084886480 transno 8589934851 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a800/0x7b044d4128f9d0a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.968766:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a800/0x7b044d4128f9d0a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.968771:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x6caa4986 (ffff9f23861e4700) 00010000:00010000:2.0:1784938443.968773:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938443.968775:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938443.968801:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9d092 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766428e expref: 106 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.968815:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b000/0x7b044d4128f9d0a7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766428e expref: 105 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.968821:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4e:0x0].0x0 (ffff9f23861e4800) 00010000:00010000:2.0:1784938443.968824:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938443.968826:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17b000, rc 0) 00000100:00100000:2.0:1784938443.968902:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387daf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+106:17096:x1871643337475328:12345-192.168.202.54@tcp:101:cp.0 Request processed in 867us (1110us total) trans 8589934851 rc 0/0 00000100:00100000:2.0:1784938443.968910:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 480 00000100:00100000:0.0:1784938443.971245:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938443.971379:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337475456 00000100:00100000:2.0:1784938443.971387:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337475456 00000100:00100000:2.0:1784938443.971497:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 802 00000100:00100000:2.0:1784938443.971505:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f228380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+48:10957:x1871643337475456:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938443.971522:0:21629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938443.971537:0:21629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fe810d2/0x7b044d4128f9d0b5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664295 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938443.971557:0:21629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x67:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938443.971572:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x67:0x0].0x0 since=710s v=(0 0) 00010000:00010000:2.0:1784938443.971575:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x67:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938443.971582:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fe810d2/0x7b044d4128f9d0b5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664295 expref: 49 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.971594:0:21629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004fe810d2/0x7b044d4128f9d0b5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664295 expref: 49 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938443.971602:0:21629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17a600, rc 0) 00000100:00100000:2.0:1784938443.971671:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f228380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+49:10957:x1871643337475456:12345-192.168.202.54@tcp:101:cp.0 Request processed in 167us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938443.971676:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 802 00000100:00100000:0.0:1784938443.973954:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.974050:0:21152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337475584 00000100:00100000:3.0:1784938443.974060:0:21152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337475584 00000100:00100000:3.0:1784938443.974210:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 803 00000100:00100000:3.0:1784938443.974219:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+49:17096:x1871643337475584:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938443.974236:0:21152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938443.974253:0:21152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042554b23/0x7b044d4128f9d0bc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766429c expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.974283:0:21152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004fe810d2/0x7b044d4128f9d0b5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664295 expref: 50 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.974293:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x67:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.974297:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x67:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938443.974302:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042554b23/0x7b044d4128f9d0bc lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->319487] (req 0->319487) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766429c expref: 50 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.974353:0:21152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004fe810d2/0x7b044d4128f9d0b5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664295 expref: 50 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.974369:0:21152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004fe810d2/0x7b044d4128f9d0b5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664295 expref: 50 pid: 21629 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.974385:0:21152:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d145180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:21152:1871643350884352:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938443.974466:0:21152:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f249d7baf00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938443.977587:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.977642:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337475712 00000100:00100000:1.0:1784938443.977649:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337475712 00010000:00010000:1.0:1784938443.977682:0:19220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004fe810d2/0x7b044d4128f9d0b5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664295 expref: 51 pid: 21629 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.977716:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 404 00000100:00100000:1.0:1784938443.977723:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24829e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+51:10957:x1871643337475712:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938443.977755:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938443.977774:0:19220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004fe810d2/0x7b044d4128f9d0b5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664295 expref: 51 pid: 21629 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.977784:0:19220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004fe810d2/0x7b044d4128f9d0b5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664295 expref: 51 pid: 21629 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.977804:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x67:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.977808:0:19220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x67:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938443.977814:0:19220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000042554b23/0x7b044d4128f9d0bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766429c expref: 51 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.977821:0:19220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042554b23/0x7b044d4128f9d0bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766429c expref: 51 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.977859:0:19220:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000042554b23/0x7b044d4128f9d0bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766429c expref: 51 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938443.977874:0:19220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd5a5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:19220:1871643350884480:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938443.977962:0:19220:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2482d95d80 going to sleep for 11 seconds 00010000:00010000:3.0:1784938443.978450:0:21152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fe810d2/0x7b044d4128f9d0b5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664295 expref: 51 pid: 21629 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938443.978467:0:21152:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d145180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:21152:1871643350884352:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938443.978494:0:21152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000042554b23/0x7b044d4128f9d0bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766429c expref: 50 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.978504:0:21152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d27c200, rc 0) 00000100:00100000:2.0:1784938443.978679:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+50:17096:x1871643337475584:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4458us (4730us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938443.978689:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 803 00000100:00100000:1.0:1784938443.981650:0:19220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd5a5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:19220:1871643350884480:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938443.981690:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938443.981767:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24829e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ea6e988-18ba-4c98-b179-17995571b98b+49:10957:x1871643337475712:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 4042us (4187us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938443.981782:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 404 00000100:00100000:0.0:1784938443.988947:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.989039:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337475968 00000100:00100000:3.0:1784938443.989050:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337475968 00000100:00100000:3.0:1784938443.989114:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 97 00000100:00100000:3.0:1784938443.989125:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+106:17096:x1871643337475968:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938443.989451:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+107:17096:x1871643337475968:12345-192.168.202.54@tcp:35:cp.0 Request processed in 327us (513us total) trans 8589934852 rc 0/0 00000100:00100000:3.0:1784938443.989456:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 97 00000100:00100000:2.0:1784938443.993766:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938443.993825:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337476096 00000100:00100000:3.0:1784938443.993834:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337476096 00000100:00100000:3.0:1784938443.993905:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 481 00000100:00100000:3.0:1784938443.993915:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+107:17096:x1871643337476096:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938443.993942:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938443.993966:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27da00/0x7b044d4128f9d0c3 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476642a3 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.994036:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d0ca lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.994048:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d0ca lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.994057:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d0ca lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.994066:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f9d0d1 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x47a21a83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.994071:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f9d0d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.994075:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f9d0d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.994107:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d0ca lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.994122:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d0ca lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.994129:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d0ca lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.994135:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27dc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938443.994139:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d0ca lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.994187:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d0ca lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.994200:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938443.994203:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.994208:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d0ca lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.994214:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d0ca lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.994226:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f9d0d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.994230:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f9d0d1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.994234:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f9d0d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.994239:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27c000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938443.994241:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f9d0d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.994247:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f9d0d1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.994254:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x47a21a83 (ffff9f24898e0a00) 00010000:00010000:3.0:1784938443.994256:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.994259:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f9d0d1 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.994264:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f9d0d1 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.994297:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27da00/0x7b044d4128f9d0c3 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642a3 expref: 108 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.994305:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:3.0:1784938443.994306:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938443.994309:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27da00/0x7b044d4128f9d0c3 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642a3 expref: 108 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938443.994332:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d27da00, rc 0) 00000100:00100000:3.0:1784938443.994386:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+107:17096:x1871643337476096:12345-192.168.202.54@tcp:101:cp.0 Request processed in 472us (627us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938443.994393:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 481 00000100:00100000:0.0:1784938443.997104:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938443.997668:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337476224 00000100:00100000:1.0:1784938443.997678:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337476224 00000100:00100000:1.0:1784938443.997776:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 482 00000100:00100000:1.0:1784938443.997787:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+107:17096:x1871643337476224:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938443.997809:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938443.997832:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f9d0d8 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476642aa expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.997917:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558400/0x7b044d4128f9d0df lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.997932:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558400/0x7b044d4128f9d0df lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.997943:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558400/0x7b044d4128f9d0df lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.997958:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558000/0x7b044d4128f9d0e6 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x47a21a83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.997964:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558000/0x7b044d4128f9d0e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.997970:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558000/0x7b044d4128f9d0e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.998024:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558400/0x7b044d4128f9d0df lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.998031:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558400/0x7b044d4128f9d0df lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.998038:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558400/0x7b044d4128f9d0df lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.998048:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558400/0x7b044d4128f9d0df lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.998054:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c558400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938443.998059:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558400/0x7b044d4128f9d0df lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.998068:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558400/0x7b044d4128f9d0df lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.998081:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938443.998085:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.998090:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558400/0x7b044d4128f9d0df lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.998097:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558400/0x7b044d4128f9d0df lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.998112:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558000/0x7b044d4128f9d0e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.998119:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558000/0x7b044d4128f9d0e6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.998125:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558000/0x7b044d4128f9d0e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.998130:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c558000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938443.998133:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558000/0x7b044d4128f9d0e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.998172:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558000/0x7b044d4128f9d0e6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.998182:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x47a21a83 (ffff9f24898dd700) 00010000:00010000:1.0:1784938443.998185:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.998188:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558000/0x7b044d4128f9d0e6 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.998194:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558000/0x7b044d4128f9d0e6 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.998227:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f9d0d8 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642aa expref: 108 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.998238:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:1.0:1784938443.998241:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938443.998244:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f9d0d8 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642aa expref: 108 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938443.998253:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c559000, rc 0) 00000100:00100000:1.0:1784938443.998331:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+107:17096:x1871643337476224:12345-192.168.202.54@tcp:101:cp.0 Request processed in 544us (1234us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938443.998339:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 482 00000100:00100000:0.0:1784938444.004575:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938444.005056:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337476480 00000100:00100000:1.0:1784938444.005067:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337476480 00000100:00100000:1.0:1784938444.005175:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 483 00000100:00100000:1.0:1784938444.005186:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+107:17096:x1871643337476480:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938444.005214:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938444.005238:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559a00/0x7b044d4128f9d0ed lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476642b1 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.005350:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559e00/0x7b044d4128f9d0f4 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.005367:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559e00/0x7b044d4128f9d0f4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.005379:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559e00/0x7b044d4128f9d0f4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.005394:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559800/0x7b044d4128f9d0fb lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x47a21a83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.005401:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559800/0x7b044d4128f9d0fb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.005408:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559800/0x7b044d4128f9d0fb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938444.005725:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x68:0x0], index 0: 0 00010000:00010000:1.0:1784938444.005861:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558e00/0x7b044d4128f9d102 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.005872:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558e00/0x7b044d4128f9d102 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.006233:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558e00/0x7b044d4128f9d102 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.006401:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559e00/0x7b044d4128f9d0f4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.006410:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559e00/0x7b044d4128f9d0f4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.006421:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559e00/0x7b044d4128f9d0f4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.006428:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c559e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938444.006432:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559e00/0x7b044d4128f9d0f4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.006440:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559e00/0x7b044d4128f9d0f4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.006453:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938444.006457:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938444.006461:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559e00/0x7b044d4128f9d0f4 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.006468:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559e00/0x7b044d4128f9d0f4 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938444.006482:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000db4a5413 reply state 00000000469f07e5 transno 8589934853 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559800/0x7b044d4128f9d0fb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.006494:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559800/0x7b044d4128f9d0fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.006500:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x47a21a83 (ffff9f24898dda00) 00010000:00010000:0.0:1784938444.006503:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938444.006505:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938444.006536:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559a00/0x7b044d4128f9d0ed lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642b1 expref: 110 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.006551:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558e00/0x7b044d4128f9d102 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642b1 expref: 109 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.006558:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4f:0x0].0x0 (ffff9f24898dd800) 00010000:00010000:0.0:1784938444.006560:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938444.006562:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c558e00, rc 0) 00000100:00100000:0.0:1784938444.006637:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+110:17096:x1871643337476480:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1453us (2071us total) trans 8589934853 rc 0/0 00000100:00100000:0.0:1784938444.006646:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 483 00000100:00100000:0.0:1784938444.020331:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938444.020403:0:25729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337476608 00000100:00100000:1.0:1784938444.020413:0:25729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337476608 00000100:00100000:1.0:1784938444.020470:0:25729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 804 00000100:00100000:1.0:1784938444.020479:0:25729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7ea6e988-18ba-4c98-b179-17995571b98b+43:10960:x1871643337476608:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938444.020496:0:25729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938444.020517:0:25729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005979dcbb/0x7b044d4128f9d110 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476642b8 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938444.020542:0:25729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x68:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938444.020563:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68:0x0].0x0 since=710s v=(0 0) 00010000:00010000:1.0:1784938444.020567:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938444.020577:0:25729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005979dcbb/0x7b044d4128f9d110 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642b8 expref: 44 pid: 25729 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.020596:0:25729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005979dcbb/0x7b044d4128f9d110 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642b8 expref: 44 pid: 25729 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.020610:0:25729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c559000, rc 0) 00000100:00100000:1.0:1784938444.020671:0:25729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7ea6e988-18ba-4c98-b179-17995571b98b+44:10960:x1871643337476608:12345-192.168.202.54@tcp:101:cp.0 Request processed in 192us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938444.020678:0:25729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 804 00000100:00100000:3.0:1784938444.024189:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938444.024304:0:25719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337476736 00000100:00100000:1.0:1784938444.024314:0:25719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337476736 00000100:00100000:1.0:1784938444.024381:0:25719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 805 00000100:00100000:1.0:1784938444.024391:0:25719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7ea6e988-18ba-4c98-b179-17995571b98b+44:17096:x1871643337476736:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938444.024411:0:25719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938444.024429:0:25719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e54e2326/0x7b044d4128f9d117 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476642bf expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.024464:0:25719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005979dcbb/0x7b044d4128f9d110 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642b8 expref: 45 pid: 25729 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.024473:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938444.024477:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938444.024483:0:25719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e54e2326/0x7b044d4128f9d117 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642bf expref: 45 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.024517:0:25719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005979dcbb/0x7b044d4128f9d110 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e9476642b8 expref: 45 pid: 25729 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.024533:0:25719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005979dcbb/0x7b044d4128f9d110 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476642b8 expref: 45 pid: 25729 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938444.024549:0:25719:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd5a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:25719:1871643350884608:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938444.024633:0:25719:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2482d95480 going to sleep for 11 seconds 00000100:00100000:1.0:1784938444.027843:0:25719:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd5a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:25719:1871643350884608:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938444.027895:0:25719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e54e2326/0x7b044d4128f9d117 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476642bf expref: 45 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.027916:0:25719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c558000, rc 0) 00000100:00100000:1.0:1784938444.027983:0:25719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7ea6e988-18ba-4c98-b179-17995571b98b+45:17096:x1871643337476736:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3593us (3843us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938444.027993:0:25719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 805 00000100:00100000:0.0:1784938444.030634:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938444.031205:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337476864 00000100:00100000:1.0:1784938444.031215:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337476864 00010000:00010000:1.0:1784938444.031265:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005979dcbb/0x7b044d4128f9d110 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476642b8 expref: 45 pid: 25729 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938444.031329:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 405 00000100:00100000:1.0:1784938444.031344:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+45:10959:x1871643337476864:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938444.031366:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938444.031386:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005979dcbb/0x7b044d4128f9d110 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476642b8 expref: 45 pid: 25729 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.031397:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005979dcbb/0x7b044d4128f9d110 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476642b8 expref: 45 pid: 25729 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.031415:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005979dcbb/0x7b044d4128f9d110 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476642b8 expref: 45 pid: 25729 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.031429:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938444.031432:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938444.031438:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e54e2326/0x7b044d4128f9d117 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476642bf expref: 44 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.031444:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e54e2326/0x7b044d4128f9d117 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476642bf expref: 44 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.031471:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e54e2326/0x7b044d4128f9d117 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476642bf expref: 44 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938444.031481:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd5a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:19221:1871643350884736:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938444.031569:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2482d95480 going to sleep for 11 seconds 00000100:00100000:0.0:1784938444.035787:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938444.039373:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd5a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:19221:1871643350884736:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938444.039403:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938444.039470:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+44:10959:x1871643337476864:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 8131us (8844us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938444.039483:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 405 00000100:00100000:3.0:1784938444.039618:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337477120 00000100:00100000:3.0:1784938444.039626:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337477120 00000100:00100000:3.0:1784938444.039674:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 98 00000100:00100000:3.0:1784938444.039684:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+110:17096:x1871643337477120:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938444.039977:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+111:17096:x1871643337477120:12345-192.168.202.54@tcp:35:cp.0 Request processed in 293us (4201us total) trans 8589934854 rc 0/0 00000100:00100000:3.0:1784938444.039984:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 98 00000100:00100000:3.0:1784938444.064365:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938444.064647:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337477376 00000100:00100000:0.0:1784938444.064659:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337477376 00000100:00100000:0.0:1784938444.064722:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 484 00000100:00100000:0.0:1784938444.064733:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+111:17100:x1871643337477376:12345-192.168.202.54@tcp:36:mkdir.0 00010000:00010000:0.0:1784938444.064978:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34400/0x7b044d4128f9d11e lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.064996:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34400/0x7b044d4128f9d11e lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.065008:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34400/0x7b044d4128f9d11e lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.065023:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35600/0x7b044d4128f9d125 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x2:0x0].0x5b337780 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.065031:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35600/0x7b044d4128f9d125 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x5b337780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.065042:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35600/0x7b044d4128f9d125 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x5b337780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.068729:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d12c lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x50:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.068752:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d12c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.069406:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d12c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938444.069431:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000075219fe3 reply state 0000000058b34227 transno 8589934855 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d12c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.069443:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d12c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.069451:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x50:0x0].0x0 (ffff9f24985e9900) 00010000:00010000:0.0:1784938444.069454:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938444.069459:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784938444.069464:0:24945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0x50:0x0]: returning size 4096 00010000:00010000:0.0:1784938444.069473:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34400/0x7b044d4128f9d11e lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.069480:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34400/0x7b044d4128f9d11e lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.069487:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34400/0x7b044d4128f9d11e lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.069494:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b34400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938444.069498:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34400/0x7b044d4128f9d11e lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.069506:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34400/0x7b044d4128f9d11e lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.069516:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938444.069519:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938444.069523:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34400/0x7b044d4128f9d11e lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.069529:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34400/0x7b044d4128f9d11e lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938444.069544:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000075219fe3 reply state 0000000058b34227 transno 8589934855 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35600/0x7b044d4128f9d125 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x2:0x0].0x5b337780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.069553:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35600/0x7b044d4128f9d125 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x5b337780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.069559:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x5b337780 (ffff9f24985e9a00) 00010000:00010000:0.0:1784938444.069561:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938444.069563:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1784938444.069690:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+113:17100:x1871643337477376:12345-192.168.202.54@tcp:36:mkdir.0 Request processed in 4956us (5332us total) trans 8589934855 rc 0/0 00000100:00100000:0.0:1784938444.069699:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 484 00000100:00100000:0.0:1784938444.094630:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938444.095545:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337477504 00000100:00100000:3.0:1784938444.095557:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337477504 00000100:00100000:0.0:1784938444.095781:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 485 00000100:00100000:0.0:1784938444.095792:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+113:17101:x1871643337477504:12345-192.168.202.54@tcp:101:touch.0 00010000:00010000:0.0:1784938444.095819:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938444.095876:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34400/0x7b044d4128f9d133 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476642c6 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.096366:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35200/0x7b044d4128f9d13a lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.096383:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35200/0x7b044d4128f9d13a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.096394:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35200/0x7b044d4128f9d13a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.096406:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35a00/0x7b044d4128f9d141 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x5b337780 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.096414:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35a00/0x7b044d4128f9d141 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x5b337780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.096421:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35a00/0x7b044d4128f9d141 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x5b337780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.096501:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34800/0x7b044d4128f9d148 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x50:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.096510:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34800/0x7b044d4128f9d148 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x50:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.096517:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34800/0x7b044d4128f9d148 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x50:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938444.096555:0:24203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0x50:0x0]: returning size 4096 00000004:00200000:0.0:1784938444.096559:0:24203:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784938444.096596:0:24203:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34800/0x7b044d4128f9d148 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x50:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.096609:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35200/0x7b044d4128f9d13a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.096616:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35200/0x7b044d4128f9d13a lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.096623:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35200/0x7b044d4128f9d13a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.096629:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938444.096633:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35200/0x7b044d4128f9d13a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.096641:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35200/0x7b044d4128f9d13a lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.096734:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:0.0:1784938444.096737:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938444.096742:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35200/0x7b044d4128f9d13a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.096749:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35200/0x7b044d4128f9d13a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.096764:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35a00/0x7b044d4128f9d141 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x5b337780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.096770:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35a00/0x7b044d4128f9d141 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x5b337780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.096776:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35a00/0x7b044d4128f9d141 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x5b337780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.096781:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938444.096785:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35a00/0x7b044d4128f9d141 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x5b337780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.096791:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35a00/0x7b044d4128f9d141 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x2:0x0].0x5b337780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.096798:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x5b337780 (ffff9f24985e9a00) 00010000:00010000:0.0:1784938444.096800:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938444.096803:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35a00/0x7b044d4128f9d141 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x5b337780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.096809:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35a00/0x7b044d4128f9d141 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x5b337780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.096866:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34400/0x7b044d4128f9d133 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642c6 expref: 115 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.097373:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34800/0x7b044d4128f9d148 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x50:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642c6 expref: 114 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.097382:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x50:0x0].0x0 (ffff9f24985e9900) 00010000:00010000:0.0:1784938444.097385:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784938444.097387:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b34800, rc 0) 00000100:00100000:0.0:1784938444.097460:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+114:17101:x1871643337477504:12345-192.168.202.54@tcp:101:touch.0 Request processed in 1668us (2838us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938444.097468:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 485 00000100:00100000:3.0:1784938444.101711:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938444.101870:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337477760 00000100:00100000:2.0:1784938444.101886:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337477760 00000100:00100000:2.0:1784938444.101946:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 486 00000100:00100000:2.0:1784938444.101956:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d144380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+114:17101:x1871643337477760:12345-192.168.202.54@tcp:101:touch.0 00010000:00010000:2.0:1784938444.101980:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938444.102002:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9d14f lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x50:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476642cd expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.102105:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9d156 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x50:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.102117:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9d156 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x50:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.102125:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9d156 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x50:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.102134:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a600/0x7b044d4128f9d15d lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x50:0x0].0x1cda55a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.102138:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a600/0x7b044d4128f9d15d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.102177:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a600/0x7b044d4128f9d15d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938444.102624:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x68:0x0], index 1: 0 00010000:00010000:3.0:1784938444.102788:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27da00/0x7b044d4128f9d164 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x51:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.102800:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27da00/0x7b044d4128f9d164 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.102809:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27da00/0x7b044d4128f9d164 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.102996:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9d156 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x50:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.103005:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9d156 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x50:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.103022:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9d156 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x50:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.103031:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9d156 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x50:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.103038:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17ae00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938444.103043:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9d156 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x50:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.103051:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9d156 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0x50:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.103065:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x50:0x0].0x0 (ffff9f24985e9900) 00010000:00010000:3.0:1784938444.103068:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938444.103073:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9d156 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x50:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.103080:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9d156 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x50:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938444.103095:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008c072c54 reply state 00000000e803b9b0 transno 8589934856 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a600/0x7b044d4128f9d15d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.103107:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a600/0x7b044d4128f9d15d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.103124:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x50:0x0].0x1cda55a (ffff9f23861e4500) 00010000:00010000:3.0:1784938444.103127:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938444.103130:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938444.103186:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9d14f lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642cd expref: 117 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.103202:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27da00/0x7b044d4128f9d164 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642cd expref: 116 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.103209:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x51:0x0].0x0 (ffff9f24898e0a00) 00010000:00010000:3.0:1784938444.103212:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938444.103215:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d27da00, rc 0) 00000100:00100000:3.0:1784938444.103285:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d144380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+117:17101:x1871643337477760:12345-192.168.202.54@tcp:101:touch.0 Request processed in 1330us (1583us total) trans 8589934856 rc 0/0 00000100:00100000:3.0:1784938444.103295:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 486 00000100:00100000:3.0:1784938444.106790:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938444.106847:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337478016 00000100:00100000:2.0:1784938444.106857:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337478016 00000100:00100000:2.0:1784938444.107008:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 487 00000100:00100000:2.0:1784938444.107018:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d145880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+117:17101:x1871643337478016:12345-192.168.202.54@tcp:36:touch.0 00010000:00010000:2.0:1784938444.107074:0:24202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938444.107099:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27da00/0x7b044d4128f9d164 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642cd expref: 117 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.107130:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x51:0x0].0x0 (ffff9f24898e0a00) 00010000:00010000:2.0:1784938444.107140:0:24202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938444.107220:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b600/0x7b044d4128f9d172 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x51:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.107233:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b600/0x7b044d4128f9d172 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x51:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.107243:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b600/0x7b044d4128f9d172 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x51:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938444.107365:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000057957b90 reply state 00000000d3a26bc9 transno 8589934857 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b600/0x7b044d4128f9d172 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x51:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.107376:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b600/0x7b044d4128f9d172 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x51:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.107382:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x51:0x0].0x0 (ffff9f23861e4100) 00010000:00010000:2.0:1784938444.107385:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938444.107387:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938444.107474:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d145880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+118:17101:x1871643337478016:12345-192.168.202.54@tcp:36:touch.0 Request processed in 458us (693us total) trans 8589934857 rc 0/0 00000100:00100000:2.0:1784938444.107481:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 487 00000100:00100000:3.0:1784938444.110440:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938444.128677:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337478144 00000100:00100000:0.0:1784938444.128693:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337478144 00000100:00100000:0.0:1784938444.129209:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 488 00000100:00100000:0.0:1784938444.129222:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+118:17101:x1871643337478144:12345-192.168.202.54@tcp:101:touch.0 00010000:00010000:0.0:1784938444.129248:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938444.129268:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9d179 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x51:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476642d4 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.129337:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9d179 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x51:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642d4 expref: 119 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.129359:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9d179 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x51:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642d4 expref: 119 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.129377:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x51:0x0].0x0 (ffff9f23861e4100) 00010000:00010000:0.0:1784938444.129381:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784938444.129385:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b34200, rc 0) 00000100:00100000:0.0:1784938444.129455:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+119:17101:x1871643337478144:12345-192.168.202.54@tcp:101:touch.0 Request processed in 237us (19025us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938444.142725:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938444.143015:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 488 00000100:00100000:0.0:1784938444.143056:0:25727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337478272 00000100:00100000:0.0:1784938444.143065:0:25727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337478272 00000100:00100000:0.0:1784938444.143118:0:25727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 806 00000100:00100000:0.0:1784938444.143127:0:25727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7ea6e988-18ba-4c98-b179-17995571b98b+49:10957:x1871643337478272:12345-192.168.202.54@tcp:2:touch.0 00000100:00100000:0.0:1784938444.143358:0:25727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7ea6e988-18ba-4c98-b179-17995571b98b+50:10957:x1871643337478272:12345-192.168.202.54@tcp:2:touch.0 Request processed in 231us (640us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1784938444.143365:0:25727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 806 00000100:00100000:2.0:1784938444.156942:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938444.157201:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337478528 00000100:00100000:3.0:1784938444.157212:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337478528 00000100:00100000:3.0:1784938444.157280:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 99 00000100:00100000:3.0:1784938444.157292:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24857ff050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+119:17101:x1871643337478528:12345-192.168.202.54@tcp:35:touch.0 00000100:00100000:3.0:1784938444.157731:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24857ff050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+120:17101:x1871643337478528:12345-192.168.202.54@tcp:35:touch.0 Request processed in 440us (800us total) trans 8589934858 rc 0/0 00000100:00100000:3.0:1784938444.157740:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 99 00000100:00100000:3.0:1784938444.176620:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938444.176926:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337478784 00000100:00100000:1.0:1784938444.176940:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337478784 00000100:00100000:1.0:1784938444.177006:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 489 00000100:00100000:1.0:1784938444.177016:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d146d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+120:17102:x1871643337478784:12345-192.168.202.54@tcp:101:dd.0 00010000:00010000:1.0:1784938444.177043:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938444.177067:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f9d180 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x50:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476642db expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.177228:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558400/0x7b044d4128f9d187 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x50:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.177244:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558400/0x7b044d4128f9d187 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x50:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.177255:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558400/0x7b044d4128f9d187 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x50:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.177271:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559200/0x7b044d4128f9d18e lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x50:0x0].0x45fac828 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.177278:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559200/0x7b044d4128f9d18e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.177285:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559200/0x7b044d4128f9d18e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938444.177925:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x69:0x0], index 0: 0 00010000:00010000:1.0:1784938444.178093:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559c00/0x7b044d4128f9d195 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.178104:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559c00/0x7b044d4128f9d195 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.178112:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559c00/0x7b044d4128f9d195 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.178533:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558400/0x7b044d4128f9d187 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0x50:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.178542:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558400/0x7b044d4128f9d187 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x50:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.178548:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558400/0x7b044d4128f9d187 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x50:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.178555:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c558400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938444.178559:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558400/0x7b044d4128f9d187 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x50:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.178570:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558400/0x7b044d4128f9d187 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0x50:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.178585:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x50:0x0].0x0 (ffff9f24985e9900) 00010000:00010000:1.0:1784938444.178588:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938444.178592:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558400/0x7b044d4128f9d187 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x50:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.178599:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558400/0x7b044d4128f9d187 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x50:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938444.178615:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000048975942 reply state 000000009180beaf transno 8589934859 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559200/0x7b044d4128f9d18e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.178627:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559200/0x7b044d4128f9d18e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.178633:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x50:0x0].0x45fac828 (ffff9f24898ddc00) 00010000:00010000:1.0:1784938444.178635:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938444.178637:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938444.179418:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559000/0x7b044d4128f9d180 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642db expref: 123 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.179441:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559c00/0x7b044d4128f9d195 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642db expref: 122 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.179464:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x52:0x0].0x0 (ffff9f24898dd600) 00010000:00010000:1.0:1784938444.179466:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938444.179469:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c559c00, rc 0) 00000100:00100000:1.0:1784938444.179555:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d146d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+123:17102:x1871643337478784:12345-192.168.202.54@tcp:101:dd.0 Request processed in 2540us (2946us total) trans 8589934859 rc 0/0 00000100:00100000:1.0:1784938444.179565:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 489 00000100:00100000:0.0:1784938444.187268:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938444.187376:0:25730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337478912 00000100:00100000:2.0:1784938444.187387:0:25730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337478912 00000100:00100000:2.0:1784938444.187462:0:25730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 807 00000100:00100000:2.0:1784938444.187473:0:25730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:7ea6e988-18ba-4c98-b179-17995571b98b+44:17102:x1871643337478912:12345-192.168.202.54@tcp:101:dd.0 00010000:00010000:2.0:1784938444.187493:0:25730:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938444.187516:0:25730:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000057fcbbb/0x7b044d4128f9d1a3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476642e2 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938444.187542:0:25730:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x69:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938444.187567:0:25730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69:0x0].0x0 since=710s v=(0 0) 00010000:00010000:2.0:1784938444.187572:0:25730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938444.187582:0:25730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000057fcbbb/0x7b044d4128f9d1a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642e2 expref: 45 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.187599:0:25730:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000057fcbbb/0x7b044d4128f9d1a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642e2 expref: 45 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.187613:0:25730:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17ae00, rc 0) 00000100:00100000:2.0:1784938444.187690:0:25730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:7ea6e988-18ba-4c98-b179-17995571b98b+45:17102:x1871643337478912:12345-192.168.202.54@tcp:101:dd.0 Request processed in 218us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938444.187697:0:25730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 807 00000100:00100000:2.0:1784938444.243120:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938444.244065:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337479168 00000100:00100000:3.0:1784938444.244078:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337479168 00000100:00100000:3.0:1784938444.244141:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 100 00000100:00100000:3.0:1784938444.244188:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+123:17102:x1871643337479168:12345-192.168.202.54@tcp:35:dd.0 00000100:00100000:3.0:1784938444.244781:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+124:17102:x1871643337479168:12345-192.168.202.54@tcp:35:dd.0 Request processed in 594us (1669us total) trans 8589934860 rc 0/0 00000100:00100000:3.0:1784938444.244790:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 100 00000100:00100000:3.0:1784938444.348366:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938444.348979:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337479296 00000100:00100000:1.0:1784938444.348991:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337479296 00000100:00100000:1.0:1784938444.349221:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 490 00000100:00100000:1.0:1784938444.349235:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+124:17107:x1871643337479296:12345-192.168.202.54@tcp:41:stat.0 00000004:00000024:1.0:1784938444.349325:0:24202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 626114560 avail 570490880 00000100:00100000:1.0:1784938444.349528:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+124:17107:x1871643337479296:12345-192.168.202.54@tcp:41:stat.0 Request processed in 295us (1178us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938444.349537:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 490 00000100:00100000:1.0:1784938444.400583:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938444.400669:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337479424 00000100:00100000:3.0:1784938444.400679:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337479424 00000100:00100000:3.0:1784938444.400738:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 491 00000100:00100000:3.0:1784938444.400747:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+124:17111:x1871643337479424:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1784938444.400767:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938444.400788:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f9d1aa lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476642e9 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.400849:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d1b1 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.400862:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d1b1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.400874:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d1b1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.400898:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d1b8 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.400905:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.400911:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.400953:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d1b1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.400971:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d1b1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.400977:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d1b1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.400985:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d1b1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.400991:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27dc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938444.400995:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d1b1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.401001:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d1b1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.401339:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1:0x0].0x0 (ffff9f2387231d00) 00010000:00010000:3.0:1784938444.401343:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938444.401348:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d1b1 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.401356:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d1b1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.401371:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.401377:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d1b8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.401382:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d1b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.401387:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27ca00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938444.401390:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d1b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.401397:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d1b8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.401405:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1:0x0].0xc4959c6c (ffff9f24898e0100) 00010000:00010000:3.0:1784938444.401407:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938444.401410:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d1b8 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.401415:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d1b8 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.401449:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f9d1aa lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642e9 expref: 125 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.401460:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1:0x0].0x0 (ffff9f2387231d00) 00010000:00010000:3.0:1784938444.401463:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938444.401466:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f9d1aa lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642e9 expref: 125 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.401475:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d27c000, rc 0) 00000100:00100000:3.0:1784938444.401549:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+124:17111:x1871643337479424:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 802us (974us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938444.401561:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 491 00000100:00100000:2.0:1784938444.405438:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938444.405940:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337479552 00000100:00100000:0.0:1784938444.405952:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337479552 00000100:00100000:0.0:1784938444.406029:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 492 00000100:00100000:0.0:1784938444.406039:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+124:17111:x1871643337479552:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1784938444.406064:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938444.406088:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35a00/0x7b044d4128f9d1bf lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476642f0 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.406181:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35200/0x7b044d4128f9d1c6 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.406198:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35200/0x7b044d4128f9d1c6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.406215:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35200/0x7b044d4128f9d1c6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.406233:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34400/0x7b044d4128f9d1cd lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.406239:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34400/0x7b044d4128f9d1cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.406245:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34400/0x7b044d4128f9d1cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.406293:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35200/0x7b044d4128f9d1c6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.406300:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35200/0x7b044d4128f9d1c6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.406311:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35200/0x7b044d4128f9d1c6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.406327:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938444.406332:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35200/0x7b044d4128f9d1c6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.406341:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35200/0x7b044d4128f9d1c6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.406353:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1:0x0].0x0 (ffff9f2387231d00) 00010000:00010000:0.0:1784938444.406356:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938444.406361:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35200/0x7b044d4128f9d1c6 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.406367:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35200/0x7b044d4128f9d1c6 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.406384:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34400/0x7b044d4128f9d1cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.406390:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34400/0x7b044d4128f9d1cd lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.406395:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34400/0x7b044d4128f9d1cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.406400:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b34400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938444.406403:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34400/0x7b044d4128f9d1cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.406412:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34400/0x7b044d4128f9d1cd lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.406420:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1:0x0].0xc4959c6c (ffff9f24985e9f00) 00010000:00010000:0.0:1784938444.406422:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938444.406425:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34400/0x7b044d4128f9d1cd lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.406431:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34400/0x7b044d4128f9d1cd lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.406471:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35a00/0x7b044d4128f9d1bf lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642f0 expref: 125 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.406482:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1:0x0].0x0 (ffff9f2387231d00) 00010000:00010000:0.0:1784938444.406485:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938444.406488:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35a00/0x7b044d4128f9d1bf lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642f0 expref: 125 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.406498:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b35a00, rc 0) 00000100:00100000:0.0:1784938444.406564:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+124:17111:x1871643337479552:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 525us (1138us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938444.406573:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 492 00000100:00100000:2.0:1784938444.410640:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938444.410746:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337479680 00000100:00100000:0.0:1784938444.410758:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337479680 00000100:00100000:0.0:1784938444.410819:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 493 00000100:00100000:0.0:1784938444.410829:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+124:17111:x1871643337479680:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1784938444.410855:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938444.410878:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9d1d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476642f7 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.410961:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9d1db lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.410975:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9d1db lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.410987:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9d1db lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938444.411047:0:24945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784938444.411051:0:24945:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784938444.411071:0:24945:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9d1db lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.411104:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35800/0x7b044d4128f9d1d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642f7 expref: 126 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.411130:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9d1db lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642f7 expref: 125 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.411139:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1:0x0].0x0 (ffff9f2387231d00) 00010000:00010000:0.0:1784938444.411170:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784938444.411175:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c9f7e00, rc 0) 00000100:00100000:0.0:1784938444.411236:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+125:17111:x1871643337479680:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 408us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938444.411251:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 493 00000100:00100000:3.0:1784938444.424341:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938444.424509:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337479936 00000100:00100000:0.0:1784938444.424520:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337479936 00000100:00100000:0.0:1784938444.424593:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 494 00000100:00100000:0.0:1784938444.424603:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+125:17111:x1871643337479936:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1784938444.424627:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938444.424648:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9d1e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476642fe expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938444.424761:0:24203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1784938444.424861:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9d1e2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642fe expref: 127 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.424887:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2381d78600) 00010000:00010000:0.0:1784938444.424891:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784938444.424896:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9d1e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642fe expref: 127 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.424912:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c9f6600, rc 0) 00000100:00100000:0.0:1784938444.424975:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+126:17111:x1871643337479936:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 374us (643us total) trans 8589934861 rc 301/301 00000100:00100000:0.0:1784938444.424983:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 494 00000100:00100000:2.0:1784938444.432704:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938444.433376:0:24210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337480064 00000100:00100000:0.0:1784938444.433386:0:24210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337480064 00000100:00100000:0.0:1784938444.433467:0:24210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:0.0:1784938444.433477:0:24210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7ea6e988-18ba-4c98-b179-17995571b98b+5:17111:x1871643337480064:12345-192.168.202.54@tcp:700:lfs.0 00000100:00100000:0.0:1784938444.433566:0:24210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7ea6e988-18ba-4c98-b179-17995571b98b+5:17111:x1871643337480064:12345-192.168.202.54@tcp:700:lfs.0 Request processed in 90us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938444.433577:0:24210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00080000:3.0:1784938444.433765:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784938444.440022:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938444.440276:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337480320 00000100:00100000:0.0:1784938444.440288:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337480320 00000100:00100000:0.0:1784938444.440359:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 495 00000100:00100000:0.0:1784938444.440368:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+5:17111:x1871643337480320:12345-192.168.202.54@tcp:36:lfs.0 00000100:00100000:0.0:1784938444.440511:0:24945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f228700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:24945:1871643350884864:192.168.202.154@tcp:1000:mdt00_003.0 00000100:00100000:0.0:1784938444.440618:0:24945:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbea80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938444.440969:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938444.441239:0:21160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350884864 00000100:00100000:0.0:1784938444.441430:0:21160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350884864 00000100:00100000:0.0:1784938444.441530:0:21160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 63 00000100:00100000:0.0:1784938444.441539:0:21160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:24945:x1871643350884864:12345-192.168.202.154@tcp:1000:mdt00_003.0 00000100:00100000:0.0:1784938444.441613:0:21160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:24945:x1871643350884864:12345-192.168.202.154@tcp:1000:mdt00_003.0 Request processed in 75us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938444.441620:0:21160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 63 00000100:00100000:1.0:1784938444.445462:0:24945:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 8589934605 gen 2 00000004:00080000:1.0:1784938444.445475:0:24945:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934605 committed transno 8589934605 00000020:00080000:1.0:1784938444.445481:0:24945:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9f24917e7780 refcount 2 committed 0 result 0 batchid 4294967464 00000020:00080000:1.0:1784938444.445486:0:24945:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9f238cf81000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9f24917e7e40 00000020:00080000:1.0:1784938444.445490:0:24945:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000bd1:0x1:0x0].1 00000020:00080000:1.0:1784938444.445493:0:24945:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9f238cf81100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f2491d3e400 00000020:00080000:1.0:1784938444.445496:0:24945:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000bd0:0x1:0x0].1 00000100:00100000:1.0:1784938444.445593:0:24945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f228700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:24945:1871643350884864:192.168.202.154@tcp:1000:mdt00_003.0 00000100:00100000:1.0:1784938444.445708:0:24945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd5a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:24945:1871643350884992:192.168.202.154@tcp:1000:mdt00_003.0 00000100:00100000:1.0:1784938444.445785:0:24945:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2482d95000 going to sleep for 11 seconds 00000100:00100000:1.0:1784938444.445964:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000020:00080000:3.0:1784938444.446111:0:24957:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4294967464 committed batchid 1 00000020:00080000:3.0:1784938444.446227:0:24957:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 1 00000100:00100000:2.0:1784938444.457731:0:25714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350884992 00000100:00100000:2.0:1784938444.457759:0:25714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350884992 00000100:00100000:2.0:1784938444.457829:0:25714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 64 00000100:00100000:2.0:1784938444.457839:0:25714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:24945:x1871643350884992:12345-192.168.202.154@tcp:1000:mdt00_003.0 00000100:00100000:2.0:1784938444.457984:0:25714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:24945:x1871643350884992:12345-192.168.202.154@tcp:1000:mdt00_003.0 Request processed in 145us (12018us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938444.457992:0:25714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 64 00000100:00100000:1.0:1784938444.458612:0:24945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd5a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:24945:1871643350884992:192.168.202.154@tcp:1000:mdt00_003.0 00000100:00100000:1.0:1784938444.458692:0:24945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd5a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:24945:1871643350885120:192.168.202.154@tcp:1000:mdt00_003.0 00000100:00100000:1.0:1784938444.458986:0:24945:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2482d95000 going to sleep for 11 seconds 00000100:00100000:1.0:1784938444.459079:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938444.461027:0:25714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350885120 00000100:00100000:2.0:1784938444.461040:0:25714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350885120 00000100:00100000:2.0:1784938444.461109:0:25714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 65 00000100:00100000:2.0:1784938444.461365:0:25714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:24945:x1871643350885120:12345-192.168.202.154@tcp:1000:mdt00_003.0 00000100:00100000:2.0:1784938444.461494:0:25714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:24945:x1871643350885120:12345-192.168.202.154@tcp:1000:mdt00_003.0 Request processed in 131us (2414us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784938444.462424:0:25714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 65 00000100:00100000:0.0:1784938444.462557:0:24945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd5a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:24945:1871643350885120:192.168.202.154@tcp:1000:mdt00_003.0 00010000:00010000:0.0:1784938444.462640:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238c9f6600/0x7b044d4128f9d1f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.462649:0:24945:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238c9f6600/0x7b044d4128f9d1f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.462659:0:24945:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238c9f6600/0x7b044d4128f9d1f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938444.462679:0:24945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f228000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:24945:1871643350885248:192.168.202.154@tcp:101:mdt00_003.0 00000100:00100000:0.0:1784938444.462995:0:24945:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b2d2cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938444.468870:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938444.469287:0:21160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350885248 00000100:00100000:2.0:1784938444.469298:0:21160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350885248 00000100:00100000:2.0:1784938444.469371:0:21160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 66 00000100:00100000:2.0:1784938444.469382:0:21160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:24945:x1871643350885248:12345-192.168.202.154@tcp:101:mdt00_003.0 00010000:00010000:2.0:1784938444.469407:0:21160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938444.469433:0:21160:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9d1f7 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9d1f0 expref: -99 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.469465:0:21160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9d1db lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642f7 expref: 125 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.469474:0:21160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9d1f7 lrc: 4/0,0 mode: --/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.154@tcp remote: 0x7b044d4128f9d1f0 expref: 7 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.469513:0:21160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9d1db lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x571025e9476642f7 expref: 125 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.469527:0:21160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9d1db lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476642f7 expref: 125 pid: 24945 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938444.469540:0:21160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:21160:1871643350885376:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938444.469623:0:21160:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d3a43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938444.473500:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938444.473585:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337480448 00000100:00100000:3.0:1784938444.473596:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337480448 00010000:00010000:3.0:1784938444.473643:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9d1db lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476642f7 expref: 126 pid: 24945 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938444.473812:0:21160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:21160:1871643350885376:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938444.473840:0:21160:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9d1f7 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.154@tcp remote: 0x7b044d4128f9d1f0 expref: 7 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.473852:0:21160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1:0x0].0x0 (ffff9f2387231d00) 00010000:00010000:2.0:1784938444.473866:0:21160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938444.473871:0:21160:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9d1f7 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.154@tcp remote: 0x7b044d4128f9d1f0 expref: 7 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.473887:0:21160:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17b400, rc 0) 00000100:00100000:2.0:1784938444.473948:0:21160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:24945:x1871643350885248:12345-192.168.202.154@tcp:101:mdt00_003.0 Request processed in 4568us (5088us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938444.473957:0:21160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 66 00000100:00100000:3.0:1784938444.474426:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 406 00000100:00100000:3.0:1784938444.474438:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+126:10957:x1871643337480448:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938444.474454:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938444.474461:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9d1db lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476642f7 expref: 126 pid: 24945 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.474474:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9d1db lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476642f7 expref: 126 pid: 24945 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.474497:0:22955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7e00/0x7b044d4128f9d1db lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476642f7 expref: 126 pid: 24945 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.474513:0:22955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1:0x0].0x0 (ffff9f2387231d00) 00010000:00010000:3.0:1784938444.474518:0:22955:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9d1f7 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.154@tcp remote: 0x7b044d4128f9d1f0 expref: 6 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.474528:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9d1f7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.154@tcp remote: 0x7b044d4128f9d1f0 expref: 6 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.474537:0:22955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9d1f7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.154@tcp remote: 0x7b044d4128f9d1f0 expref: 6 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.474568:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9d1f7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.154@tcp remote: 0x7b044d4128f9d1f0 expref: 6 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938444.474581:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:22955:1871643350885504:192.168.202.154@tcp:105: 00000100:00100000:3.0:1784938444.474633:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24917e7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938444.476001:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938444.476121:0:19217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350885504 00000100:00100000:2.0:1784938444.476129:0:19217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350885504 00000100:00100000:2.0:1784938444.476201:0:19217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 43 00000100:00100000:2.0:1784938444.476221:0:19217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23880a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:22955:x1871643350885504:12345-192.168.202.154@tcp:105: 00010000:00010000:2.0:1784938444.476235:0:19217:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238c9f6600/0x7b044d4128f9d1f0 lrc: 4/0,1 mode: --/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9d1f7 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.476255:0:19217:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238c9f6600/0x7b044d4128f9d1f0 lrc: 4/0,1 mode: --/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9d1f7 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.476264:0:19217:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238c9f6600/0x7b044d4128f9d1f0 lrc: 4/0,1 mode: --/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9d1f7 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.476272:0:19217:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238c9f6600/0x7b044d4128f9d1f0 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b044d4128f9d1f7 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.476279:0:19217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238c9f6600/0x7b044d4128f9d1f0 lrc: 5/0,1 mode: CW/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b044d4128f9d1f7 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.476288:0:19217:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238c9f6600/0x7b044d4128f9d1f0 lrc: 5/0,1 mode: CW/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b044d4128f9d1f7 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.476305:0:19217:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9f238c9f6600) 00000100:00100000:2.0:1784938444.476358:0:19217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23880a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:22955:x1871643350885504:12345-192.168.202.154@tcp:105: Request processed in 139us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938444.476365:0:19217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 43 00000100:00100000:2.0:1784938444.476422:0:24945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f228000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:24945:1871643350885248:192.168.202.154@tcp:101:mdt00_003.0 00010000:00010000:2.0:1784938444.476443:0:24945:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238c9f6600/0x7b044d4128f9d1f0 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9d1f7 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938444.476469:0:24945:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000bd2:0x1:0x0] 00010000:00010000:2.0:1784938444.476514:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238d17a400/0x7b044d4128f9d1fe lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.476522:0:24945:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238d17a400/0x7b044d4128f9d1fe lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.476531:0:24945:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238d17a400/0x7b044d4128f9d1fe lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938444.476548:0:24945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:24945:1871643350885632:192.168.202.154@tcp:101:mdt00_003.0 00000100:00100000:2.0:1784938444.476592:0:24945:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d3a43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938444.480800:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:22955:1871643350885504:192.168.202.154@tcp:105: 00010000:00010000:3.0:1784938444.480828:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938444.480893:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+125:10957:x1871643337480448:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 6457us (7403us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938444.480906:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 406 00000100:00100000:1.0:1784938444.481028:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938444.483313:0:21161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350885632 00000100:00100000:2.0:1784938444.483338:0:21161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350885632 00000100:00100000:2.0:1784938444.483412:0:21161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 67 00000100:00100000:2.0:1784938444.483421:0:21161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23880a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:24945:x1871643350885632:12345-192.168.202.154@tcp:101:mdt00_003.0 00010000:00010000:2.0:1784938444.483442:0:21161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938444.483471:0:21161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9d205 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9d1fe expref: -99 pid: 21161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.483501:0:21161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9d205 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.154@tcp remote: 0x7b044d4128f9d1fe expref: 8 pid: 21161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.483516:0:21161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9d205 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.154@tcp remote: 0x7b044d4128f9d1fe expref: 8 pid: 21161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.483526:0:21161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1:0x0].0xc4959c6c (ffff9f23861e4300) 00010000:00010000:2.0:1784938444.483529:0:21161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938444.483532:0:21161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a6a00, rc 0) 00000100:00100000:2.0:1784938444.483587:0:21161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23880a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:24945:x1871643350885632:12345-192.168.202.154@tcp:101:mdt00_003.0 Request processed in 167us (2560us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938444.483595:0:21161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 67 00000100:00100000:1.0:1784938444.484079:0:24945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:24945:1871643350885632:192.168.202.154@tcp:101:mdt00_003.0 00010000:00010000:1.0:1784938444.484102:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238d17a400/0x7b044d4128f9d1fe lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9d205 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.484124:0:24945:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238d17a400/0x7b044d4128f9d1fe lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9d205 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938444.484179:0:24945:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000bd2:0x1:0x0] 00000100:00100000:1.0:1784938444.484252:0:24945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387dac700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:24945:1871643350885760:192.168.202.154@tcp:1000:mdt00_003.0 00000100:00100000:1.0:1784938444.484303:0:24945:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2482d95780 going to sleep for 11 seconds 00000100:00100000:1.0:1784938444.484392:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938444.484901:0:21160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350885760 00000100:00100000:2.0:1784938444.484909:0:21160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350885760 00000100:00100000:2.0:1784938444.484958:0:21160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 68 00000100:00100000:2.0:1784938444.484967:0:21160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:24945:x1871643350885760:12345-192.168.202.154@tcp:1000:mdt00_003.0 00000100:00100000:2.0:1784938444.485052:0:21160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:24945:x1871643350885760:12345-192.168.202.154@tcp:1000:mdt00_003.0 Request processed in 85us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938444.485060:0:21160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 68 00000100:00100000:1.0:1784938444.486308:0:24945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387dac700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:24945:1871643350885760:192.168.202.154@tcp:1000:mdt00_003.0 00000100:00100000:1.0:1784938444.486397:0:24945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388247800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:24945:1871643350885888:192.168.202.154@tcp:1000:mdt00_003.0 00000100:00100000:1.0:1784938444.486469:0:24945:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2482d95780 going to sleep for 11 seconds 00000100:00100000:1.0:1784938444.486598:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938444.486622:0:25714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350885888 00000100:00100000:1.0:1784938444.486627:0:25714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350885888 00000100:00100000:1.0:1784938444.486666:0:25714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 69 00000100:00100000:1.0:1784938444.486675:0:25714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388246d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:24945:x1871643350885888:12345-192.168.202.154@tcp:1000:mdt00_003.0 00000100:00100000:1.0:1784938444.488033:0:25714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388246d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:24945:x1871643350885888:12345-192.168.202.154@tcp:1000:mdt00_003.0 Request processed in 1348us (1425us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784938444.488046:0:25714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 69 00000100:00100000:0.0:1784938444.502647:0:24945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388247800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:24945:1871643350885888:192.168.202.154@tcp:1000:mdt00_003.0 00000100:00100000:0.0:1784938444.502803:0:24945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:24945:1871643350886016:192.168.202.154@tcp:1000:mdt00_003.0 00000100:00100000:0.0:1784938444.502872:0:24945:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b2d2cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938444.506356:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938444.506570:0:21161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350886016 00000100:00100000:3.0:1784938444.506579:0:21161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350886016 00000100:00100000:3.0:1784938444.506636:0:21161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 70 00000100:00100000:3.0:1784938444.506645:0:21161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f228e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:24945:x1871643350886016:12345-192.168.202.154@tcp:1000:mdt00_003.0 00000100:00100000:3.0:1784938444.506764:0:21161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f228e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:24945:x1871643350886016:12345-192.168.202.154@tcp:1000:mdt00_003.0 Request processed in 119us (417us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784938444.506772:0:21161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 70 00000100:00100000:1.0:1784938444.509033:0:24945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:24945:1871643350886016:192.168.202.154@tcp:1000:mdt00_003.0 00000100:00100000:1.0:1784938444.509138:0:24945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388247b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:24945:1871643350886144:192.168.202.154@tcp:1000:mdt00_003.0 00000100:00100000:1.0:1784938444.510274:0:24945:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2482d95540 going to sleep for 11 seconds 00000100:00100000:0.0:1784938444.517296:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938444.517504:0:25714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350886144 00000100:00100000:2.0:1784938444.517515:0:25714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350886144 00000100:00100000:2.0:1784938444.517574:0:25714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 71 00000100:00100000:2.0:1784938444.517583:0:25714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:24945:x1871643350886144:12345-192.168.202.154@tcp:1000:mdt00_003.0 00000100:00100000:2.0:1784938444.517678:0:25714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:24945:x1871643350886144:12345-192.168.202.154@tcp:1000:mdt00_003.0 Request processed in 95us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938444.517687:0:25714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 71 00000100:00100000:1.0:1784938444.519306:0:24945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388247b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:24945:1871643350886144:192.168.202.154@tcp:1000:mdt00_003.0 00000100:00100000:1.0:1784938444.519403:0:24945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388247b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:24945:1871643350886272:192.168.202.154@tcp:1000:mdt00_003.0 00010000:00010000:2.0:1784938444.530904:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938444.532496:0:24945:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2482d95540 going to sleep for 11 seconds 00000100:00100000:0.0:1784938444.532827:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938444.533955:0:21160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350886272 00000100:00100000:1.0:1784938444.533968:0:21160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350886272 00000100:00100000:1.0:1784938444.534049:0:21160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 72 00000100:00100000:1.0:1784938444.534059:0:21160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:24945:x1871643350886272:12345-192.168.202.154@tcp:1000:mdt00_003.0 00000100:00100000:1.0:1784938444.535011:0:21160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:24945:x1871643350886272:12345-192.168.202.154@tcp:1000:mdt00_003.0 Request processed in 949us (2184us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938444.535023:0:21160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 72 00000100:00100000:1.0:1784938444.537140:0:24945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388247b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:24945:1871643350886272:192.168.202.154@tcp:1000:mdt00_003.0 00000100:00100000:1.0:1784938444.537256:0:24945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388247b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:24945:1871643350886400:192.168.202.154@tcp:1000:mdt00_003.0 00000100:00100000:1.0:1784938444.537340:0:24945:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2482d95540 going to sleep for 11 seconds 00000100:00100000:3.0:1784938444.537551:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938444.537617:0:21161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350886400 00000100:00100000:1.0:1784938444.537624:0:21161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350886400 00000100:00100000:1.0:1784938444.537671:0:21161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 73 00000100:00100000:1.0:1784938444.537680:0:21161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:24945:x1871643350886400:12345-192.168.202.154@tcp:1000:mdt00_003.0 00000100:00100000:1.0:1784938444.543642:0:21161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:24945:x1871643350886400:12345-192.168.202.154@tcp:1000:mdt00_003.0 Request processed in 5945us (6073us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938444.543662:0:21161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 73 00000100:00100000:1.0:1784938444.551546:0:24945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388247b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:24945:1871643350886400:192.168.202.154@tcp:1000:mdt00_003.0 00000040:00080000:1.0:1784938444.553258:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd0:0x1:0x0].2, 1080 off34264 00000040:00080000:1.0:1784938444.553343:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd1:0x1:0x0].2, 1224 off34488 00000004:00080000:1.0:1784938444.553350:0:24945:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9f2482d95000 with version 8 00000004:00080000:2.0:1784938444.553421:0:24942:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9f238ec48000 version 8 rpc_version 8 00000020:00100000:2.0:1784938444.553456:0:24942:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1784938444.553467:0:24942:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9f238e0ed180 x1871643350886656/t0(0) o1000->lustre-MDT0000-osp-MDT0001@192.168.202.154@tcp:24/4 lens 2496/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784938444.553491:0:24942:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ed180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:24942:1871643350886656:192.168.202.154@tcp:1000:osp_up0-1.0 00000100:00100000:2.0:1784938444.553576:0:24942:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d3a4900 going to sleep for 11 seconds 00000100:00100000:1.0:1784938444.554425:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938444.554511:0:25714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350886656 00000100:00100000:2.0:1784938444.554520:0:25714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350886656 00000100:00100000:2.0:1784938444.554574:0:25714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 74 00000100:00100000:2.0:1784938444.554584:0:25714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388247b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:24942:x1871643350886656:12345-192.168.202.154@tcp:1000:osp_up0-1.0 00000100:00100000:2.0:1784938444.555419:0:25714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388247b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:24942:x1871643350886656:12345-192.168.202.154@tcp:1000:osp_up0-1.0 Request processed in 833us (993us total) trans 8589934862 rc 0/0 00000100:00100000:2.0:1784938444.555431:0:25714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 74 00000100:00100000:2.0:1784938444.562780:0:24942:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ed180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:24942:1871643350886656:192.168.202.154@tcp:1000:osp_up0-1.0 00010000:00010000:3.0:1784938444.563178:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27da00/0x7b044d4128f9d20c lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.563196:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27da00/0x7b044d4128f9d20c lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.563343:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27da00/0x7b044d4128f9d20c lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938444.563368:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fa754b29 reply state 000000001b7050ca transno 8589934685 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27da00/0x7b044d4128f9d20c lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.563380:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27da00/0x7b044d4128f9d20c lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.563388:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938444.563391:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938444.563394:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784938444.563400:0:24945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd1:0x1:0x0]: returning size 4096 00000004:00080000:3.0:1784938444.563411:0:24945:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000bd2:0x1:0x0] 00010000:00010000:3.0:1784938444.563423:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238c9f6600/0x7b044d4128f9d1f0 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9d1f7 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.563432:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238c9f6600/0x7b044d4128f9d1f0 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b044d4128f9d1f7 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.563438:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238c9f6600/0x7b044d4128f9d1f0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b044d4128f9d1f7 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.563466:0:24945:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1784938444.563470:0:24945:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000bd2:0x1:0x0] 00010000:00010000:3.0:1784938444.563475:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238d17a400/0x7b044d4128f9d1fe lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9d205 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.563483:0:24945:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238d17a400/0x7b044d4128f9d1fe lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9d205 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938444.563594:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+7:17111:x1871643337480320:12345-192.168.202.54@tcp:36:lfs.0 Request processed in 123226us (123579us total) trans 8589934685 rc 0/0 00000100:00100000:3.0:1784938444.563604:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 495 00010000:00010000:2.0:1784938444.565131:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938444.565169:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238c9f6600/0x7b044d4128f9d1f0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b044d4128f9d1f7 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.565182:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f6600 already unused, calling callback (ffffffffc19aded0) 00010000:00010000:2.0:1784938444.565188:0:19223:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238c9f6600/0x7b044d4128f9d1f0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b044d4128f9d1f7 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938444.565197:0:19223:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238c9f6600/0x7b044d4128f9d1f0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b044d4128f9d1f7 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.565242:0:19223:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238c9f6600/0x7b044d4128f9d1f0 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b044d4128f9d1f7 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.565249:0:19223:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938444.565280:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238c9f6600/0x7b044d4128f9d1f0 lrc: 1/0,0 mode: --/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b044d4128f9d1f7 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.565289:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238c9f6600/0x7b044d4128f9d1f0 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b044d4128f9d1f7 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.565325:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938444.565328:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938444.565330:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938444.566053:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350886784:192.168.202.154@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1784938444.566506:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938444.566537:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350886784 00000100:00100000:2.0:1784938444.566543:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350886784 00000100:00100000:2.0:1784938444.566596:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 22 00000100:00100000:2.0:1784938444.566606:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:16389:x1871643350886784:12345-192.168.202.154@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938444.566620:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938444.566644:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9d1f7 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.154@tcp remote: 0x7b044d4128f9d1f0 expref: 9 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.566660:0:19220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1:0x0].0x0 (ffff9f2387231d00) 00010000:00010000:2.0:1784938444.566666:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938444.566694:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+8:16389:x1871643350886784:12345-192.168.202.154@tcp:103:ldlm_bl.0 Request processed in 89us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938444.566704:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 22 00000100:00100000:3.0:1784938444.567079:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350886784:192.168.202.154@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1784938444.584726:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938444.584864:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337480704 00000100:00100000:3.0:1784938444.584875:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337480704 00000100:00100000:3.0:1784938444.584941:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 101 00000100:00100000:3.0:1784938444.584950:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+125:17111:x1871643337480704:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:3.0:1784938444.585720:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+126:17111:x1871643337480704:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 767us (1000us total) trans 8589934863 rc 0/0 00000100:00100000:3.0:1784938444.585729:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 101 00000100:00100000:0.0:1784938444.600855:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938444.600898:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938444.601091:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337480832 00000100:00100000:1.0:1784938444.601101:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337480832 00002000:00100000:1.0:1784938444.601188:0:23334:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x42:0x0] (0->902) req@ffff9f238f229880 x1871643337480832/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:675/0 lens 1392/0 e 0 to 0 dl 1784938455 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938444.601199:0:23334:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f229880 with x1871643337480832 ext(0->902) 00002000:00010000:1.0:1784938444.601205:0:23334:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f229880 00000100:00100000:1.0:1784938444.601230:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 158 00000100:00100000:1.0:1784938444.601240:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7ea6e988-18ba-4c98-b179-17995571b98b+45:10960:x1871643337480832:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:3.0:1784938444.601990:0:25725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337480960 00000100:00100000:3.0:1784938444.601998:0:25725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337480960 00000100:00100000:3.0:1784938444.602044:0:25725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 808 00000100:00100000:3.0:1784938444.602052:0:25725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f229500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7ea6e988-18ba-4c98-b179-17995571b98b+48:10960:x1871643337480960:12345-192.168.202.54@tcp:16:kworker.0 00000100:00100000:1.0:1784938444.607436:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7ea6e988-18ba-4c98-b179-17995571b98b+48:10960:x1871643337480832:12345-192.168.202.54@tcp:4:cp.0 Request processed in 6188us (6526us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1784938444.607451:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 158 00002000:00100000:1.0:1784938444.607468:0:23334:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x42:0x0] (0->902) req@ffff9f238f229880 x1871643337480832/t4294967484(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:675/0 lens 1392/448 e 0 to 0 dl 1784938455 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938444.607478:0:23334:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f229880 with x1871643337480832 ext(0->902) 00002000:00010000:1.0:1784938444.607484:0:23334:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f229880 00000100:00100000:2.0:1784938444.616287:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938444.616329:0:24192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337481088 00000100:00100000:2.0:1784938444.616338:0:24192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337481088 00000100:00100000:2.0:1784938444.616386:0:24192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 99 00000100:00100000:2.0:1784938444.616395:0:24192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:357535a6-3234-42c0-bf92-af4663775ca3+10:10958:x1871643337481088:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1784938444.616462:0:24192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:357535a6-3234-42c0-bf92-af4663775ca3+10:10958:x1871643337481088:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 67us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938444.616469:0:24192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 99 00000100:00100000:2.0:1784938444.616528:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938444.616796:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337481216 00000100:00100000:0.0:1784938444.616801:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337481216 00000100:00100000:0.0:1784938444.617124:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 496 00000100:00100000:0.0:1784938444.617132:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+126:17112:x1871643337481216:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938444.617186:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938444.617210:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6400/0x7b044d4128f9d213 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664305 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.617278:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9d21a lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.617292:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9d21a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.617304:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9d21a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.617326:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d221 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.617337:0:24203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9d205 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.154@tcp remote: 0x7b044d4128f9d1fe expref: 7 pid: 21161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.617346:0:24203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d221 lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.617379:0:24203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9d205 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.154@tcp remote: 0x7b044d4128f9d1fe expref: 7 pid: 21161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938444.617394:0:24203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:24203:1871643350886912:192.168.202.154@tcp:104: 00000100:00100000:0.0:1784938444.617452:0:24203:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b2d2c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938444.617681:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938444.620782:0:19217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350886912 00000100:00100000:2.0:1784938444.620798:0:19217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350886912 00000100:00100000:2.0:1784938444.620862:0:19217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 44 00000100:00100000:2.0:1784938444.620880:0:19217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388245180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:24203:x1871643350886912:12345-192.168.202.154@tcp:104: 00010000:00010000:2.0:1784938444.620902:0:19217:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238d17a400/0x7b044d4128f9d1fe lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b044d4128f9d205 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.620989:0:19217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784938444.620996:0:19217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388245180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:24203:x1871643350886912:12345-192.168.202.154@tcp:104: Request processed in 126us (3317us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938444.621004:0:19217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 44 00010000:00010000:3.0:1784938444.621527:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938444.621536:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238d17a400/0x7b044d4128f9d1fe lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b044d4128f9d205 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.621550:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17a400 already unused, calling callback (ffffffffc19aded0) 00010000:00010000:3.0:1784938444.621555:0:25732:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238d17a400/0x7b044d4128f9d1fe lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7b044d4128f9d205 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938444.621564:0:25732:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238d17a400/0x7b044d4128f9d1fe lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7b044d4128f9d205 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.621601:0:25732:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238d17a400/0x7b044d4128f9d1fe lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b044d4128f9d205 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.621608:0:25732:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938444.621642:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238d17a400/0x7b044d4128f9d1fe lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b044d4128f9d205 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.621650:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238d17a400/0x7b044d4128f9d1fe lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b044d4128f9d205 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.621678:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938444.621679:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350887040:192.168.202.154@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938444.621681:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938444.621685:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938444.621993:0:24203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:24203:1871643350886912:192.168.202.154@tcp:104: 00010000:00010000:3.0:1784938444.622013:0:24203:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d221 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938444.622083:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938444.622434:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350887040 00000100:00100000:1.0:1784938444.622441:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350887040 00010000:00010000:1.0:1784938444.622469:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9d205 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 192.168.202.154@tcp remote: 0x7b044d4128f9d1fe expref: 8 pid: 21161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938444.622493:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 407 00000100:00100000:1.0:1784938444.622501:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388124700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+8:16390:x1871643350887040:12345-192.168.202.154@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938444.622514:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1784938444.623663:0:21144:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967484 is committed 00000001:00080000:0.0:1784938444.623677:0:21144:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967483 is committed 00000001:00080000:0.0:1784938444.623736:0:21144:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967444 is committed 00000100:00100000:3.0:1784938444.623970:0:25725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f229500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7ea6e988-18ba-4c98-b179-17995571b98b+45:10960:x1871643337480960:12345-192.168.202.54@tcp:16:kworker.0 Request processed in 21916us (23123us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938444.623984:0:25725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 808 00000001:00080000:3.0:1784938444.628620:0:24188:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934863 is committed 00000001:00080000:3.0:1784938444.628639:0:24188:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934862 is committed 00010000:00010000:2.0:1784938444.628776:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42ce00/0x7b044d4128f9ccda lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.628789:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42ce00/0x7b044d4128f9ccda lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.628797:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42ce00/0x7b044d4128f9ccda lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.628806:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42ce00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938444.628807:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9d205 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.154@tcp remote: 0x7b044d4128f9d1fe expref: 7 pid: 21161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.628812:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42ce00/0x7b044d4128f9ccda lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.628827:0:19221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1:0x0].0xc4959c6c (ffff9f23861e4300) 00010000:00010000:2.0:1784938444.628840:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42ce00/0x7b044d4128f9ccda lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.628851:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x4d2290fc (ffff9f23861f4300) 00010000:00010000:2.0:1784938444.628854:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938444.628859:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42ce00/0x7b044d4128f9ccda lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.628870:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42ce00/0x7b044d4128f9ccda lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.628895:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b800/0x7b044d4128f9cecb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.628902:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b800/0x7b044d4128f9cecb lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.628907:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b800/0x7b044d4128f9cecb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.628911:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17b800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938444.628914:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b800/0x7b044d4128f9cecb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.628919:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b800/0x7b044d4128f9cecb lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.628925:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x489b8eb2 (ffff9f23861f4800) 00010000:00010000:2.0:1784938444.628927:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938444.628931:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b800/0x7b044d4128f9cecb lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.628936:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b800/0x7b044d4128f9cecb lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.628947:0:19221:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d221 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.628949:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1800/0x7b044d4128f9cf34 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.628965:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1800/0x7b044d4128f9cf34 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.628967:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d221 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.628981:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1800/0x7b044d4128f9cf34 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.628983:0:19221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d221 lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.628996:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938444.629000:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1800/0x7b044d4128f9cf34 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629007:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1800/0x7b044d4128f9cf34 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629016:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xf2ca543e (ffff9f2484afd700) 00010000:00010000:2.0:1784938444.629018:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938444.629021:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1800/0x7b044d4128f9cf34 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629031:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1800/0x7b044d4128f9cf34 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629046:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0e00/0x7b044d4128f9cf8f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629052:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0e00/0x7b044d4128f9cf8f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629058:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0e00/0x7b044d4128f9cf8f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629062:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf0e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938444.629065:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0e00/0x7b044d4128f9cf8f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.629069:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938444.629078:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0e00/0x7b044d4128f9cf8f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629087:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0xd06bcd9f (ffff9f2484afd200) 00010000:00010000:2.0:1784938444.629089:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938444.629092:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0e00/0x7b044d4128f9cf8f lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629098:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0e00/0x7b044d4128f9cf8f lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629112:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9cfea lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629118:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9cfea lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629124:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9cfea lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629129:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938444.629132:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9cfea lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938444.629138:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388124700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+6:16390:x1871643350887040:12345-192.168.202.154@tcp:103:ldlm_bl.0 Request processed in 6635us (7052us total) trans 0 rc 0/0 00010000:00010000:2.0:1784938444.629141:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9cfea lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938444.629181:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 407 00010000:00010000:2.0:1784938444.629182:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x22eacdcf (ffff9f2484afd800) 00010000:00010000:2.0:1784938444.629186:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938444.629190:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9cfea lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629196:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1400/0x7b044d4128f9cfea lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629212:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d200/0x7b044d4128f9d045 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629218:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d200/0x7b044d4128f9d045 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629224:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d200/0x7b044d4128f9d045 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629229:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27d200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938444.629232:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d200/0x7b044d4128f9d045 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629239:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d200/0x7b044d4128f9d045 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629247:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x9ce4d69c (ffff9f24898e0500) 00010000:00010000:2.0:1784938444.629249:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938444.629252:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d200/0x7b044d4128f9d045 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629258:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d200/0x7b044d4128f9d045 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629271:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a800/0x7b044d4128f9d0a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629276:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a800/0x7b044d4128f9d0a0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629283:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a800/0x7b044d4128f9d0a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629288:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17a800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938444.629291:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a800/0x7b044d4128f9d0a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629297:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a800/0x7b044d4128f9d0a0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629304:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x6caa4986 (ffff9f23861e4700) 00010000:00010000:2.0:1784938444.629307:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938444.629309:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a800/0x7b044d4128f9d0a0 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629332:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a800/0x7b044d4128f9d0a0 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629348:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559800/0x7b044d4128f9d0fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629355:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559800/0x7b044d4128f9d0fb lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629361:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559800/0x7b044d4128f9d0fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629366:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c559800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938444.629368:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559800/0x7b044d4128f9d0fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629378:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559800/0x7b044d4128f9d0fb lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629386:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x47a21a83 (ffff9f24898dda00) 00010000:00010000:2.0:1784938444.629388:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938444.629391:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559800/0x7b044d4128f9d0fb lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629397:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559800/0x7b044d4128f9d0fb lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629411:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35600/0x7b044d4128f9d125 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x5b337780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629417:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35600/0x7b044d4128f9d125 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x5b337780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629423:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35600/0x7b044d4128f9d125 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x5b337780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629429:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938444.629432:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35600/0x7b044d4128f9d125 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x5b337780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629438:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35600/0x7b044d4128f9d125 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x2:0x0].0x5b337780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629445:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x5b337780 (ffff9f24985e9a00) 00010000:00010000:2.0:1784938444.629447:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938444.629450:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35600/0x7b044d4128f9d125 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x5b337780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629457:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b35600/0x7b044d4128f9d125 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x2:0x0].0x5b337780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629471:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d12c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x50:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629477:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d12c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x50:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629483:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d12c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x50:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629488:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b34a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938444.629491:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d12c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x50:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629497:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d12c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x50:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629504:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x50:0x0].0x0 (ffff9f24985e9900) 00010000:00010000:2.0:1784938444.629506:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938444.629509:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d12c lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x50:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629516:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d12c lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x50:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629527:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a600/0x7b044d4128f9d15d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629533:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a600/0x7b044d4128f9d15d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629539:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a600/0x7b044d4128f9d15d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629545:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17a600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938444.629548:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a600/0x7b044d4128f9d15d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629553:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a600/0x7b044d4128f9d15d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629560:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x50:0x0].0x1cda55a (ffff9f23861e4500) 00010000:00010000:2.0:1784938444.629562:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938444.629565:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a600/0x7b044d4128f9d15d lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629571:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a600/0x7b044d4128f9d15d lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629582:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b600/0x7b044d4128f9d172 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x51:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629588:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b600/0x7b044d4128f9d172 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x51:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629593:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b600/0x7b044d4128f9d172 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x51:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629598:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17b600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938444.629601:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b600/0x7b044d4128f9d172 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x51:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629610:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b600/0x7b044d4128f9d172 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x51:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629618:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x51:0x0].0x0 (ffff9f23861e4100) 00010000:00010000:2.0:1784938444.629621:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938444.629624:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b600/0x7b044d4128f9d172 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x51:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629629:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b600/0x7b044d4128f9d172 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x51:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629638:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559200/0x7b044d4128f9d18e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629644:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559200/0x7b044d4128f9d18e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629649:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559200/0x7b044d4128f9d18e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629654:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c559200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938444.629656:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559200/0x7b044d4128f9d18e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629662:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559200/0x7b044d4128f9d18e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629669:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x50:0x0].0x45fac828 (ffff9f24898ddc00) 00010000:00010000:2.0:1784938444.629670:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938444.629673:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559200/0x7b044d4128f9d18e lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.629678:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559200/0x7b044d4128f9d18e lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938444.631282:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350887040:192.168.202.154@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938444.642628:0:24203:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d221 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.642647:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d221 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938444.642806:0:24203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388126300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:24203:1871643350887168:192.168.202.154@tcp:1000:mdt00_002.0 00000100:00100000:3.0:1784938444.653343:0:24203:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238cd3fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938444.654392:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938444.654635:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337481344 00000100:00100000:3.0:1784938444.654644:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337481344 00002000:00100000:3.0:1784938444.654686:0:23327:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x42:0x0] (0->5633) req@ffff9f238f228000 x1871643337481344/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:675/0 lens 6128/0 e 0 to 0 dl 1784938455 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938444.654698:0:23327:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f228000 with x1871643337481344 ext(0->5633) 00002000:00010000:3.0:1784938444.654704:0:23327:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f238f228000 00000100:00100000:3.0:1784938444.654729:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 159 00000100:00100000:3.0:1784938444.654737:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f228000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7ea6e988-18ba-4c98-b179-17995571b98b+50:10957:x1871643337481344:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938444.664106:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938444.664189:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938444.666129:0:25721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337481472 00000100:00100000:2.0:1784938444.666156:0:25721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337481472 00000100:00100000:2.0:1784938444.666232:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 809 00000100:00100000:2.0:1784938444.666242:0:25721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7ea6e988-18ba-4c98-b179-17995571b98b+53:10959:x1871643337481472:12345-192.168.202.54@tcp:16:kworker.0 00000100:00100000:3.0:1784938444.666478:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f228000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7ea6e988-18ba-4c98-b179-17995571b98b+53:10957:x1871643337481344:12345-192.168.202.54@tcp:4:cp.0 Request processed in 11739us (12091us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1784938444.666489:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 159 00002000:00100000:3.0:1784938444.666502:0:23327:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x42:0x0] (0->5633) req@ffff9f238f228000 x1871643337481344/t4294967479(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:675/0 lens 6128/448 e 0 to 0 dl 1784938455 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938444.666513:0:23327:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f228000 with x1871643337481344 ext(0->5633) 00002000:00010000:3.0:1784938444.666520:0:23327:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f238f228000 00000100:00100000:1.0:1784938444.670123:0:21160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350887168 00000100:00100000:1.0:1784938444.670140:0:21160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350887168 00000100:00100000:1.0:1784938444.670225:0:21160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 75 00000100:00100000:1.0:1784938444.670234:0:21160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:24203:x1871643350887168:12345-192.168.202.154@tcp:1000:mdt00_002.0 00000100:00100000:1.0:1784938444.670528:0:21160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:24203:x1871643350887168:12345-192.168.202.154@tcp:1000:mdt00_002.0 Request processed in 293us (6336us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938444.670535:0:21160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 75 00000100:00100000:3.0:1784938444.670812:0:24203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388126300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:24203:1871643350887168:192.168.202.154@tcp:1000:mdt00_002.0 00010000:00010000:3.0:1784938444.670891:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9d228 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.670908:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9d228 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.670920:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9d228 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938444.670942:0:24203:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9d228 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.670954:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9d21a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.670960:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9d21a lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.670967:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9d21a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.670973:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f6600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938444.670977:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9d21a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.670984:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9d21a lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.670996:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1:0x0].0x0 (ffff9f2387231d00) 00010000:00010000:3.0:1784938444.670999:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938444.671004:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9d21a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.671010:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6600/0x7b044d4128f9d21a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.671024:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d221 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.671031:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d221 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.671036:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d221 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.671042:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f7600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938444.671044:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d221 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.671050:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d221 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.671057:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1:0x0].0xc4959c6c (ffff9f23861e4300) 00010000:00010000:3.0:1784938444.671060:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938444.671063:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d221 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.671069:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d221 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.671108:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6400/0x7b044d4128f9d213 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664305 expref: 92 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.671129:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9d228 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664305 expref: 91 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.671136:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f248fb8fa00) 00010000:00010000:3.0:1784938444.671139:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784938444.671141:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d27cc00, rc 0) 00000100:00100000:3.0:1784938444.671194:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+91:17112:x1871643337481216:12345-192.168.202.54@tcp:101:cp.0 Request processed in 54063us (54667us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938444.671202:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 496 00000001:00080000:3.0:1784938444.676114:0:22178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967479 is committed 00000001:00080000:3.0:1784938444.676136:0:22178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967477 is committed 00000001:00080000:3.0:1784938444.676233:0:22178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967437 is committed 00000100:00100000:1.0:1784938444.676410:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938444.676449:0:25721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7ea6e988-18ba-4c98-b179-17995571b98b+49:10959:x1871643337481472:12345-192.168.202.54@tcp:16:kworker.0 Request processed in 10206us (12351us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938444.676461:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 809 00000100:00100000:3.0:1784938444.676587:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337481600 00000100:00100000:3.0:1784938444.676596:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337481600 00000100:00100000:3.0:1784938444.676703:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 497 00000100:00100000:3.0:1784938444.676713:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+7:17112:x1871643337481600:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938444.676751:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938444.676773:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d600/0x7b044d4128f9d22f lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766430c expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.676850:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d000/0x7b044d4128f9d236 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.676865:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d000/0x7b044d4128f9d236 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.676876:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d000/0x7b044d4128f9d236 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938444.676922:0:24201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784938444.676926:0:24201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1784938444.676986:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d600/0x7b044d4128f9d22f lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766430c expref: 9 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.677009:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d000/0x7b044d4128f9d236 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766430c expref: 8 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.677019:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938444.677022:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784938444.677026:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d27d000, rc 0) 00000100:00100000:3.0:1784938444.677066:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+8:17112:x1871643337481600:12345-192.168.202.54@tcp:101:cp.0 Request processed in 355us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938444.677073:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 497 00000100:00100000:1.0:1784938444.692563:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938444.692659:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337481728 00000100:00100000:2.0:1784938444.692670:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337481728 00000100:00100000:2.0:1784938444.692734:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 498 00000100:00100000:2.0:1784938444.692744:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+8:17112:x1871643337481728:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938444.692764:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938444.692784:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d23d lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664313 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.692854:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6200/0x7b044d4128f9d244 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.692869:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6200/0x7b044d4128f9d244 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.692894:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6200/0x7b044d4128f9d244 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.692911:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d24b lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x45c0cf9c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.692918:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d24b lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.692925:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d24b lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.692965:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6200/0x7b044d4128f9d244 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.692973:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6200/0x7b044d4128f9d244 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.692980:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6200/0x7b044d4128f9d244 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.692986:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a6200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938444.692990:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6200/0x7b044d4128f9d244 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.692998:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6200/0x7b044d4128f9d244 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.693009:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938444.693012:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938444.693017:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6200/0x7b044d4128f9d244 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.693024:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6200/0x7b044d4128f9d244 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.693037:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d24b lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.693044:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d24b lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.693049:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d24b lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.693054:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a7600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938444.693057:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d24b lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.693063:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d24b lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.693070:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x45c0cf9c (ffff9f2382049400) 00010000:00010000:2.0:1784938444.693072:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938444.693074:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d24b lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.693079:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d24b lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.693113:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d23d lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664313 expref: 9 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.693124:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938444.693126:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938444.693130:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d23d lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664313 expref: 9 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.693140:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a6400, rc 0) 00000100:00100000:2.0:1784938444.694773:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+8:17112:x1871643337481728:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2016us (2206us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938444.694786:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 498 00000100:00100000:1.0:1784938444.696307:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938444.696437:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938444.696581:0:21155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337481856 00000100:00100000:3.0:1784938444.696589:0:21155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337481856 00002000:00100000:3.0:1784938444.696627:0:21155:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x43:0x0] (0->391199) req@ffff9f2388245f80 x1871643337481856/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:675/0 lens 488/0 e 0 to 0 dl 1784938455 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938444.696635:0:21155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2388245f80 with x1871643337481856 ext(0->391199) 00002000:00010000:3.0:1784938444.696639:0:21155:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2388245f80 00000100:00100000:3.0:1784938444.696666:0:21155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 160 00000100:00100000:3.0:1784938444.696673:0:21155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7ea6e988-18ba-4c98-b179-17995571b98b+45:10959:x1871643337481856:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938444.697895:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337481984 00000100:00100000:2.0:1784938444.697903:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337481984 00000100:00100000:2.0:1784938444.697956:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 810 00000100:00100000:2.0:1784938444.697965:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+47:10957:x1871643337481984:12345-192.168.202.54@tcp:16:kworker.0 00000100:00100000:2.0:1784938444.698065:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+47:10957:x1871643337481984:12345-192.168.202.54@tcp:16:kworker.0 Request processed in 100us (1762us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938444.698073:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 810 00000100:00100000:1.0:1784938444.717806:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938444.722713:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938444.722828:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337482496 00000100:00100000:0.0:1784938444.722839:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337482496 00000100:00100000:0.0:1784938444.722912:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 499 00000100:00100000:0.0:1784938444.722923:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+8:17112:x1871643337482496:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938444.722945:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938444.722949:0:24201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784938444.722977:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d000/0x7b044d4128f9d236 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766430c expref: 8 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.723017:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938444.723025:0:24201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784938444.723040:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f6200/0x7b044d4128f9d252 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766431a expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938444.723207:0:24201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f228700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID:24201:1871643350887296:192.168.202.154@tcp:900:mdt00_000.0 00000100:00100000:0.0:1784938444.723525:0:24201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b2d2cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938444.723740:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938444.723764:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350887296 00000100:00100000:1.0:1784938444.723768:0:24212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350887296 00000100:00100000:1.0:1784938444.723805:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 7 00000100:00100000:1.0:1784938444.723812:0:24212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:24201:x1871643350887296:12345-192.168.202.154@tcp:900:mdt00_000.0 00000100:00100000:1.0:1784938444.723853:0:24212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:24201:x1871643350887296:12345-192.168.202.154@tcp:900:mdt00_000.0 Request processed in 41us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938444.723860:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 7 00000100:00100000:1.0:1784938444.724194:0:24201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f228700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID:24201:1871643350887296:192.168.202.154@tcp:900:mdt00_000.0 00000100:00100000:1.0:1784938444.724294:0:24201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388247100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:24201:1871643350887424:192.168.202.154@tcp:1000:mdt00_000.0 00000100:00100000:1.0:1784938444.724338:0:24201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbea80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938444.724400:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938444.724575:0:25714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350887424 00000100:00100000:2.0:1784938444.724580:0:25714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350887424 00000100:00100000:2.0:1784938444.724617:0:25714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 76 00000100:00100000:2.0:1784938444.724624:0:25714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:24201:x1871643350887424:12345-192.168.202.154@tcp:1000:mdt00_000.0 00000100:00100000:2.0:1784938444.724743:0:25714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:24201:x1871643350887424:12345-192.168.202.154@tcp:1000:mdt00_000.0 Request processed in 119us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938444.724750:0:25714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 76 00000100:00100000:3.0:1784938444.726224:0:25718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337482240 00000100:00100000:3.0:1784938444.726234:0:25718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337482240 00000100:00100000:3.0:1784938444.726549:0:25718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 811 00000100:00100000:3.0:1784938444.726560:0:25718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ea6e988-18ba-4c98-b179-17995571b98b+49:10960:x1871643337482240:12345-192.168.202.54@tcp:16:kworker.0 00000100:00100000:3.0:1784938444.726772:0:25718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ea6e988-18ba-4c98-b179-17995571b98b+49:10960:x1871643337482240:12345-192.168.202.54@tcp:16:kworker.0 Request processed in 214us (8975us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938444.726780:0:25718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 811 00000100:00100000:0.0:1784938444.729765:0:24201:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 8589934862 gen 2 00000004:00080000:0.0:1784938444.729780:0:24201:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934862 committed transno 8589934862 00000100:00100000:0.0:1784938444.729815:0:24201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388247100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:24201:1871643350887424:192.168.202.154@tcp:1000:mdt00_000.0 00010000:00010000:0.0:1784938444.729903:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238c9f7e00/0x7b044d4128f9d259 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.729914:0:24201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238c9f7e00/0x7b044d4128f9d259 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.729925:0:24201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238c9f7e00/0x7b044d4128f9d259 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938444.729946:0:24201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f229f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:24201:1871643350887552:192.168.202.154@tcp:101:mdt00_000.0 00000100:00100000:0.0:1784938444.730028:0:24201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b2d2cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1784938444.730426:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938444.730454:0:21160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350887552 00000100:00100000:1.0:1784938444.730461:0:21160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350887552 00000100:00100000:1.0:1784938444.730509:0:21160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 77 00000100:00100000:1.0:1784938444.730519:0:21160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388246300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:24201:x1871643350887552:12345-192.168.202.154@tcp:101:mdt00_000.0 00010000:00010000:1.0:1784938444.730536:0:21160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938444.730553:0:21160:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559e00/0x7b044d4128f9d260 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9d259 expref: -99 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.730579:0:21160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559e00/0x7b044d4128f9d260 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.154@tcp remote: 0x7b044d4128f9d259 expref: 7 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.730593:0:21160:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559e00/0x7b044d4128f9d260 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.154@tcp remote: 0x7b044d4128f9d259 expref: 7 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.730602:0:21160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2381d78600) 00010000:00010000:1.0:1784938444.730605:0:21160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784938444.730609:0:21160:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c559e00, rc 0) 00000100:00100000:1.0:1784938444.730638:0:21160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388246300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:24201:x1871643350887552:12345-192.168.202.154@tcp:101:mdt00_000.0 Request processed in 121us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938444.730645:0:21160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 77 00000100:00100000:1.0:1784938444.730740:0:24201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f229f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:24201:1871643350887552:192.168.202.154@tcp:101:mdt00_000.0 00010000:00010000:1.0:1784938444.730755:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238c9f7e00/0x7b044d4128f9d259 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9d260 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.730766:0:24201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238c9f7e00/0x7b044d4128f9d259 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9d260 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938444.730789:0:24201:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1784938444.730796:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238c9f7e00/0x7b044d4128f9d259 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9d260 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.730804:0:24201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238c9f7e00/0x7b044d4128f9d259 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9d260 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.730861:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558a00/0x7b044d4128f9d267 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.730870:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558a00/0x7b044d4128f9d267 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.730877:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558a00/0x7b044d4128f9d267 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.730888:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f9d26e lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x45c0cf9c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.730895:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f9d26e lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.730901:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f9d26e lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938444.731034:0:24201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388246680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:24201:1871643350887680:192.168.202.154@tcp:1000:mdt00_000.0 00000100:00100000:1.0:1784938444.731065:0:24201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbea80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938444.731130:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938444.731436:0:25714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350887680 00000100:00100000:3.0:1784938444.731443:0:25714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350887680 00000100:00100000:3.0:1784938444.731484:0:25714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 78 00000100:00100000:3.0:1784938444.731492:0:25714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388247100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:24201:x1871643350887680:12345-192.168.202.154@tcp:1000:mdt00_000.0 00000100:00100000:3.0:1784938444.731548:0:25714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388247100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:24201:x1871643350887680:12345-192.168.202.154@tcp:1000:mdt00_000.0 Request processed in 57us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938444.731555:0:25714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 78 00000100:00100000:0.0:1784938444.731994:0:24201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388246680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:24201:1871643350887680:192.168.202.154@tcp:1000:mdt00_000.0 00000004:00080000:0.0:1784938444.732293:0:24201:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000400:0x29:0x0], count =25 00000004:00080000:0.0:1784938444.732300:0:24201:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000400:0x29:0x0]+25 in llog 00000004:00080000:0.0:1784938444.732328:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x42:0x0], index 1: 0 00010000:00010000:0.0:1784938444.732495:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f6400/0x7b044d4128f9d275 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.732509:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f6400/0x7b044d4128f9d275 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.732519:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f6400/0x7b044d4128f9d275 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.732556:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558a00/0x7b044d4128f9d267 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.732563:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558a00/0x7b044d4128f9d267 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.732568:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558a00/0x7b044d4128f9d267 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.732575:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558a00/0x7b044d4128f9d267 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.732581:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c558a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938444.732585:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558a00/0x7b044d4128f9d267 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.732592:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558a00/0x7b044d4128f9d267 lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.732605:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938444.732607:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938444.732612:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558a00/0x7b044d4128f9d267 lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.732618:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558a00/0x7b044d4128f9d267 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938444.732632:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000727c7fb5 reply state 00000000be1694dc transno 8589934686 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f9d26e lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.732643:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f9d26e lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.732650:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x45c0cf9c (ffff9f24898dd300) 00010000:00010000:0.0:1784938444.732652:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938444.732655:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938444.732693:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f6200/0x7b044d4128f9d252 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766431a expref: 10 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.732712:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f6400/0x7b044d4128f9d275 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766431a expref: 9 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.732720:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2:0x0].0x0 (ffff9f24985e9f00) 00010000:00010000:0.0:1784938444.732723:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938444.732725:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c9f6400, rc 0) 00000100:00100000:0.0:1784938444.733064:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+10:17112:x1871643337482496:12345-192.168.202.54@tcp:101:cp.0 Request processed in 10142us (11060us total) trans 8589934686 rc 0/0 00000100:00100000:0.0:1784938444.733072:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 499 00000100:00100000:2.0:1784938444.734259:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938444.735040:0:23328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337482112 00000100:00100000:3.0:1784938444.735053:0:23328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337482112 00002000:00100000:3.0:1784938444.735096:0:23328:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x43:0x0] (0->1734) req@ffff9f24b37cb100 x1871643337482112/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:675/0 lens 2224/0 e 0 to 0 dl 1784938455 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938444.735107:0:23328:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37cb100 with x1871643337482112 ext(0->1734) 00002000:00010000:3.0:1784938444.735113:0:23328:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b37cb100 00000100:00100000:3.0:1784938444.735168:0:23328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 161 00000100:00100000:3.0:1784938444.735178:0:23328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7ea6e988-18ba-4c98-b179-17995571b98b+49:10958:x1871643337482112:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:3.0:1784938444.737006:0:23328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7ea6e988-18ba-4c98-b179-17995571b98b+51:10958:x1871643337482112:12345-192.168.202.54@tcp:4:cp.0 Request processed in 1820us (2852us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1784938444.737019:0:23328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 161 00002000:00100000:3.0:1784938444.737029:0:23328:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x43:0x0] (0->1734) req@ffff9f24b37cb100 x1871643337482112/t4294967480(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:675/0 lens 2224/448 e 0 to 0 dl 1784938455 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938444.737039:0:23328:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37cb100 with x1871643337482112 ext(0->1734) 00002000:00010000:3.0:1784938444.737046:0:23328:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b37cb100 00000100:00100000:0.0:1784938444.737221:0:21155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7ea6e988-18ba-4c98-b179-17995571b98b+47:10959:x1871643337481856:12345-192.168.202.54@tcp:4:cp.0 Request processed in 40545us (40781us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1784938444.737229:0:21155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 160 00002000:00100000:0.0:1784938444.737235:0:21155:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x43:0x0] (0->391199) req@ffff9f2388245f80 x1871643337481856/t4294967485(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:675/0 lens 488/448 e 0 to 0 dl 1784938455 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938444.737243:0:21155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2388245f80 with x1871643337481856 ext(0->391199) 00002000:00010000:0.0:1784938444.737247:0:21155:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2388245f80 00000100:00100000:1.0:1784938444.738669:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938444.738772:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938444.738901:0:23329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337482624 00000100:00100000:2.0:1784938444.738909:0:23329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337482624 00002000:00100000:2.0:1784938444.738942:0:23329:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x44:0x0] (0->9973) req@ffff9f2381e3e450 x1871643337482624/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:675/0 lens 10464/0 e 0 to 0 dl 1784938455 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938444.738960:0:23329:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2381e3e450 with x1871643337482624 ext(0->9973) 00002000:00010000:2.0:1784938444.738965:0:23329:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2381e3e450 00000100:00100000:2.0:1784938444.738987:0:23329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 162 00000100:00100000:2.0:1784938444.738994:0:23329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7ea6e988-18ba-4c98-b179-17995571b98b+47:10959:x1871643337482624:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938444.740540:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337482752 00000100:00100000:0.0:1784938444.740551:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337482752 00000100:00100000:0.0:1784938444.740596:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 812 00000100:00100000:0.0:1784938444.740604:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388247800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+50:10958:x1871643337482752:12345-192.168.202.54@tcp:16:kworker.0 00000100:00100000:3.0:1784938444.741123:0:23329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7ea6e988-18ba-4c98-b179-17995571b98b+50:10959:x1871643337482624:12345-192.168.202.54@tcp:4:cp.0 Request processed in 2127us (2349us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1784938444.741133:0:23329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 162 00002000:00100000:3.0:1784938444.741142:0:23329:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x44:0x0] (0->9973) req@ffff9f2381e3e450 x1871643337482624/t4294967486(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:675/0 lens 10464/448 e 0 to 0 dl 1784938455 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938444.741178:0:23329:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2381e3e450 with x1871643337482624 ext(0->9973) 00002000:00010000:3.0:1784938444.741183:0:23329:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2381e3e450 00000001:00080000:0.0:1784938444.743116:0:21144:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967486 is committed 00000100:00100000:2.0:1784938444.743374:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388247800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+45:10958:x1871643337482752:12345-192.168.202.54@tcp:16:kworker.0 Request processed in 2764us (4705us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938444.743385:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 812 00000100:00100000:1.0:1784938444.752263:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938444.752310:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938444.752432:0:21152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337483008 00000100:00100000:3.0:1784938444.752444:0:21152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337483008 00000100:00100000:3.0:1784938444.752511:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 813 00000100:00100000:3.0:1784938444.752522:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+51:10960:x1871643337483008:12345-192.168.202.54@tcp:16:kworker.0 00000100:00100000:3.0:1784938444.752644:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+51:10960:x1871643337483008:12345-192.168.202.54@tcp:16:kworker.0 Request processed in 124us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938444.752651:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 813 00000100:00100000:2.0:1784938444.752893:0:23331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337482880 00000100:00100000:2.0:1784938444.752897:0:23331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337482880 00002000:00100000:2.0:1784938444.752924:0:23331:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x44:0x0] (0->38516) req@ffff9f2388245f80 x1871643337482880/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:675/0 lens 488/0 e 0 to 0 dl 1784938455 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938444.752934:0:23331:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2388245f80 with x1871643337482880 ext(0->38516) 00002000:00010000:2.0:1784938444.752939:0:23331:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2388245f80 00000100:00100000:2.0:1784938444.753005:0:23331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 163 00000100:00100000:2.0:1784938444.753013:0:23331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7ea6e988-18ba-4c98-b179-17995571b98b+51:10958:x1871643337482880:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938444.758465:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938444.758995:0:25728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337483136 00000100:00100000:0.0:1784938444.759069:0:25728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337483136 00000100:00100000:0.0:1784938444.759136:0:25728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 814 00000100:00100000:0.0:1784938444.759168:0:25728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:7ea6e988-18ba-4c98-b179-17995571b98b+53:10960:x1871643337483136:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938444.759189:0:25728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938444.759211:0:25728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a59b7f1/0x7b044d4128f9d283 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664321 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938444.759236:0:25728:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938444.759255:0:25728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x42:0x0].0x0 since=710s v=(0 0) 00010000:00010000:0.0:1784938444.759259:0:25728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938444.759268:0:25728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a59b7f1/0x7b044d4128f9d283 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664321 expref: 54 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.759298:0:25728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001a59b7f1/0x7b044d4128f9d283 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664321 expref: 54 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.759310:0:25728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c9f7600, rc 0) 00000100:00100000:0.0:1784938444.759510:0:25728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:7ea6e988-18ba-4c98-b179-17995571b98b+54:10960:x1871643337483136:12345-192.168.202.54@tcp:101:cp.0 Request processed in 364us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938444.759518:0:25728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 814 00000100:00100000:3.0:1784938444.760993:0:23331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7ea6e988-18ba-4c98-b179-17995571b98b+54:10958:x1871643337482880:12345-192.168.202.54@tcp:4:cp.0 Request processed in 7972us (8734us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1784938444.761018:0:23331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 163 00002000:00100000:3.0:1784938444.761029:0:23331:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x44:0x0] (0->38516) req@ffff9f2388245f80 x1871643337482880/t4294967481(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:675/0 lens 488/448 e 0 to 0 dl 1784938455 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938444.761040:0:23331:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2388245f80 with x1871643337482880 ext(0->38516) 00002000:00010000:3.0:1784938444.761046:0:23331:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2388245f80 00000100:00100000:0.0:1784938444.762047:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938444.762091:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938444.762259:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337483264 00000100:00100000:3.0:1784938444.762268:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337483264 00002000:00100000:3.0:1784938444.762307:0:23334:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x45:0x0] (0->39342) req@ffff9f238f229880 x1871643337483264/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:675/0 lens 488/0 e 0 to 0 dl 1784938455 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938444.762329:0:23334:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f229880 with x1871643337483264 ext(0->39342) 00002000:00010000:3.0:1784938444.762334:0:23334:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f229880 00000100:00100000:3.0:1784938444.762367:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 164 00000100:00100000:3.0:1784938444.762377:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7ea6e988-18ba-4c98-b179-17995571b98b+45:10958:x1871643337483264:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938444.762631:0:25719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337483392 00000100:00100000:1.0:1784938444.762636:0:25719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337483392 00000100:00100000:1.0:1784938444.762673:0:25719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 815 00000100:00100000:1.0:1784938444.762681:0:25719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7ea6e988-18ba-4c98-b179-17995571b98b+47:10958:x1871643337483392:12345-192.168.202.54@tcp:16:kworker.0 00000100:00100000:1.0:1784938444.762736:0:25719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7ea6e988-18ba-4c98-b179-17995571b98b+47:10958:x1871643337483392:12345-192.168.202.54@tcp:16:kworker.0 Request processed in 54us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938444.762743:0:25719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 815 00000100:00100000:3.0:1784938444.775080:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7ea6e988-18ba-4c98-b179-17995571b98b+47:10958:x1871643337483264:12345-192.168.202.54@tcp:4:cp.0 Request processed in 12691us (12974us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1784938444.775099:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 164 00002000:00100000:3.0:1784938444.775115:0:23334:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x45:0x0] (0->39342) req@ffff9f238f229880 x1871643337483264/t4294967487(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:675/0 lens 488/448 e 0 to 0 dl 1784938455 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938444.775126:0:23334:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f229880 with x1871643337483264 ext(0->39342) 00002000:00010000:3.0:1784938444.775133:0:23334:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f229880 00000100:00100000:1.0:1784938444.781962:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938444.782726:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938444.782988:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938444.783389:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337483648 00000100:00100000:3.0:1784938444.783400:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337483648 00002000:00100000:3.0:1784938444.783458:0:23327:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x45:0x0] (0->15475) req@ffff9f238f183480 x1871643337483648/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:675/0 lens 15968/0 e 0 to 0 dl 1784938455 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938444.783469:0:23327:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f183480 with x1871643337483648 ext(0->15475) 00002000:00010000:3.0:1784938444.783474:0:23327:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f238f183480 00000100:00100000:3.0:1784938444.783508:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 165 00000100:00100000:3.0:1784938444.783517:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7ea6e988-18ba-4c98-b179-17995571b98b+54:10960:x1871643337483648:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938444.785934:0:25727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337483520 00000100:00100000:0.0:1784938444.785951:0:25727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337483520 00000100:00100000:3.0:1784938444.789336:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7ea6e988-18ba-4c98-b179-17995571b98b+57:10960:x1871643337483648:12345-192.168.202.54@tcp:4:cp.0 Request processed in 5808us (6336us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1784938444.789353:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 165 00002000:00100000:3.0:1784938444.789367:0:23327:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x45:0x0] (0->15475) req@ffff9f238f183480 x1871643337483648/t4294967482(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:675/0 lens 15968/448 e 0 to 0 dl 1784938455 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938444.789378:0:23327:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f183480 with x1871643337483648 ext(0->15475) 00002000:00010000:3.0:1784938444.789385:0:23327:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f238f183480 00000100:00100000:2.0:1784938444.797306:0:25730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337483776 00000100:00100000:2.0:1784938444.797333:0:25730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337483776 00000100:00100000:2.0:1784938444.797414:0:25730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 816 00000100:00100000:2.0:1784938444.797425:0:25730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:7ea6e988-18ba-4c98-b179-17995571b98b+57:17112:x1871643337483520:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938444.797443:0:25730:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938444.797464:0:25730:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9d28a lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664328 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.797519:0:25730:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001a59b7f1/0x7b044d4128f9d283 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664321 expref: 58 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.797529:0:25730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938444.797533:0:25730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938444.797538:0:25730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9d28a lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664328 expref: 58 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.797578:0:25730:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001a59b7f1/0x7b044d4128f9d283 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664321 expref: 58 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.797593:0:25730:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001a59b7f1/0x7b044d4128f9d283 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664321 expref: 58 pid: 25728 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938444.797608:0:25730:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:25730:1871643350887808:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938444.797711:0:25730:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d3a4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938444.799086:0:25726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 817 00000100:00100000:1.0:1784938444.799105:0:25726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7ea6e988-18ba-4c98-b179-17995571b98b+58:10959:x1871643337483776:12345-192.168.202.54@tcp:16:kworker.0 00000100:00100000:1.0:1784938444.812303:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938444.812963:0:25730:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:25730:1871643350887808:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938444.812999:0:25730:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9d28a lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664328 expref: 58 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.813035:0:25730:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a7000, rc 0) 00000100:00100000:2.0:1784938444.813101:0:25730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:7ea6e988-18ba-4c98-b179-17995571b98b+58:17112:x1871643337483520:12345-192.168.202.54@tcp:101:cp.0 Request processed in 15677us (31147us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938444.813109:0:25730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 816 00000100:00100000:3.0:1784938444.813747:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337483904 00000100:00100000:3.0:1784938444.813755:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337483904 00010000:00010000:3.0:1784938444.813786:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001a59b7f1/0x7b044d4128f9d283 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664321 expref: 58 pid: 25728 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938444.813823:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 408 00000100:00100000:3.0:1784938444.813831:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f180700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+58:10957:x1871643337483904:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938444.813844:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938444.813866:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001a59b7f1/0x7b044d4128f9d283 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664321 expref: 58 pid: 25728 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.813878:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001a59b7f1/0x7b044d4128f9d283 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664321 expref: 58 pid: 25728 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.813899:0:22955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a59b7f1/0x7b044d4128f9d283 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664321 expref: 58 pid: 25728 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.813914:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938444.813918:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938444.813925:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9d28a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664328 expref: 57 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.813934:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9d28a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664328 expref: 57 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.813965:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9d28a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664328 expref: 57 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938444.813978:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388126300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22955:1871643350887936:192.168.202.54@tcp:105: 00000100:00100000:3.0:1784938444.814066:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24867a3840 going to sleep for 11 seconds 00000100:00100000:0.0:1784938444.820839:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938444.820936:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337484160 00000100:00100000:2.0:1784938444.820946:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337484160 00000100:00100000:2.0:1784938444.821008:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 102 00000100:00100000:2.0:1784938444.821018:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+10:17112:x1871643337484160:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:2.0:1784938444.821356:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+11:17112:x1871643337484160:12345-192.168.202.54@tcp:35:cp.0 Request processed in 338us (525us total) trans 8589934687 rc 0/0 00000100:00100000:2.0:1784938444.821364:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 102 00000100:00100000:3.0:1784938444.821841:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388126300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22955:1871643350887936:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938444.821862:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938444.821890:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f180700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+57:10957:x1871643337483904:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 8059us (9597us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938444.821899:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 408 00000100:00100000:0.0:1784938444.825580:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938444.826765:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337484288 00000100:00100000:3.0:1784938444.826778:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337484288 00000100:00100000:3.0:1784938444.826846:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 500 00000100:00100000:3.0:1784938444.826856:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+91:17112:x1871643337484288:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938444.826884:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938444.826904:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d291 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766432f expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.826963:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d298 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.826977:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d298 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.826988:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d298 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.827001:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9d29f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784938444.827441:0:22178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967482 is committed 00000100:00100000:1.0:1784938444.827640:0:25726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7ea6e988-18ba-4c98-b179-17995571b98b+50:10959:x1871643337483776:12345-192.168.202.54@tcp:16:kworker.0 Request processed in 28540us (44913us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938444.827652:0:25726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 817 00010000:00010000:3.0:1784938444.828549:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9d29f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.828561:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9d29f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.828624:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f9d2a6 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.828633:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f9d2a6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.828640:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f9d2a6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938444.828662:0:24203:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f9d2a6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.828674:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d298 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.828681:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d298 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.828687:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d298 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.828693:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27dc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938444.828696:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d298 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.828704:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d298 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.828715:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1:0x0].0x0 (ffff9f2387231d00) 00010000:00010000:3.0:1784938444.828718:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938444.828722:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d298 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.828727:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d298 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.828739:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9d29f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.828745:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9d29f lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.828751:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9d29f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.828756:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27d600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938444.828758:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9d29f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.828764:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9d29f lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.828771:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1:0x0].0xc4959c6c (ffff9f248fb8f300) 00010000:00010000:3.0:1784938444.828773:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938444.828776:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9d29f lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.828786:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d600/0x7b044d4128f9d29f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.828822:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d291 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766432f expref: 93 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.828835:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f9d2a6 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766432f expref: 92 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.828843:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f248fb8fa00) 00010000:00010000:3.0:1784938444.828845:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784938444.828848:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d27c000, rc 0) 00000100:00100000:3.0:1784938444.828904:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+92:17112:x1871643337484288:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2049us (3333us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938444.828912:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 500 00000100:00100000:0.0:1784938444.860502:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938444.860556:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938444.860663:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337484544 00000100:00100000:2.0:1784938444.860673:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337484544 00000100:00100000:2.0:1784938444.860746:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:2.0:1784938444.860758:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+92:10958:x1871643337484544:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938444.860780:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938444.860807:0:25731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c000/0x7b044d4128f9d2a6 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766432f expref: 92 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.860826:0:25731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f248fb8fa00) 00010000:00010000:2.0:1784938444.860832:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938444.860891:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+91:10958:x1871643337484544:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 135us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938444.860898:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:1.0:1784938444.861116:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337484416 00000100:00100000:1.0:1784938444.861121:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337484416 00000100:00100000:1.0:1784938444.861202:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 501 00000100:00100000:1.0:1784938444.861209:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+11:17112:x1871643337484416:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938444.861231:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938444.861247:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559a00/0x7b044d4128f9d2ad lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664336 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.861329:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558a00/0x7b044d4128f9d2b4 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.861343:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558a00/0x7b044d4128f9d2b4 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.861355:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558a00/0x7b044d4128f9d2b4 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938444.861399:0:24945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784938444.861403:0:24945:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1784938444.861441:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559a00/0x7b044d4128f9d2ad lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664336 expref: 13 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.861455:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558a00/0x7b044d4128f9d2b4 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664336 expref: 12 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.861463:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938444.861467:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1784938444.861470:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c558a00, rc 0) 00000100:00100000:1.0:1784938444.861498:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+12:17112:x1871643337484416:12345-192.168.202.54@tcp:101:cp.0 Request processed in 289us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938444.861504:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 501 00000100:00100000:0.0:1784938444.875972:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938444.876092:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337484672 00000100:00100000:2.0:1784938444.876104:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337484672 00000100:00100000:2.0:1784938444.876208:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 502 00000100:00100000:2.0:1784938444.876219:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+12:17112:x1871643337484672:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938444.876241:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938444.876263:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d2bb lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766433d expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.876342:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9d2c2 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.876356:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9d2c2 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.876367:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9d2c2 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.876382:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d2c9 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x56569231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.876389:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d2c9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.876396:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d2c9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.876434:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9d2c2 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.876441:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9d2c2 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.876447:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9d2c2 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.876453:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a6a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938444.876457:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9d2c2 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.876468:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9d2c2 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.876479:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938444.876483:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938444.876487:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9d2c2 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.876493:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9d2c2 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.876506:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d2c9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.876511:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d2c9 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.876517:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d2c9 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.876521:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a7a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938444.876524:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d2c9 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.876530:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d2c9 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.876537:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x56569231 (ffff9f2382049400) 00010000:00010000:2.0:1784938444.876540:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938444.876542:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d2c9 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.876552:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d2c9 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.876588:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d2bb lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766433d expref: 13 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.876598:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938444.876600:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938444.876603:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d2bb lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766433d expref: 13 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.876612:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a6000, rc 0) 00000100:00100000:2.0:1784938444.876670:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+12:17112:x1871643337484672:12345-192.168.202.54@tcp:101:cp.0 Request processed in 453us (708us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938444.876677:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 502 00000100:00100000:3.0:1784938444.893684:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938444.893803:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337484800 00000100:00100000:1.0:1784938444.893814:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337484800 00000100:00100000:1.0:1784938444.893888:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 503 00000100:00100000:1.0:1784938444.893897:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+12:17112:x1871643337484800:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938444.893920:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938444.893941:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559a00/0x7b044d4128f9d2d0 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664344 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.894022:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9d2d7 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.894038:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9d2d7 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.894050:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9d2d7 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.894064:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9d2de lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x56569231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.894072:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9d2de lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.894079:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9d2de lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.894116:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9d2d7 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.894123:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9d2d7 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.894140:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9d2d7 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.894190:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9d2d7 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.894198:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c559400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938444.894203:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9d2d7 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.894211:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9d2d7 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.894222:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938444.894225:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938444.894229:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9d2d7 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.894235:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9d2d7 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.894250:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9d2de lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.894255:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9d2de lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.894261:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9d2de lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.894266:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c558800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938444.894269:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9d2de lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.894275:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9d2de lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.894286:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x56569231 (ffff9f24898ddf00) 00010000:00010000:1.0:1784938444.894288:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938444.894291:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9d2de lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.894297:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9d2de lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.894339:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559a00/0x7b044d4128f9d2d0 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664344 expref: 13 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.894351:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938444.894353:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938444.894357:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559a00/0x7b044d4128f9d2d0 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664344 expref: 13 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938444.894365:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c559a00, rc 0) 00000100:00100000:1.0:1784938444.894419:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+12:17112:x1871643337484800:12345-192.168.202.54@tcp:101:cp.0 Request processed in 523us (745us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938444.894427:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 503 00000100:00100000:0.0:1784938444.904139:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938444.904371:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337485056 00000100:00100000:2.0:1784938444.904381:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337485056 00000100:00100000:2.0:1784938444.904442:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 504 00000100:00100000:2.0:1784938444.904452:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+12:17112:x1871643337485056:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938444.904472:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938444.904493:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d2e5 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766434b expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.904602:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d2ec lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.904617:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d2ec lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.904629:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d2ec lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.904644:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9d2f3 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x56569231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.904652:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9d2f3 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.904659:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9d2f3 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938444.904969:0:24202:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x2a:0x0], count =24 00000004:00080000:2.0:1784938444.904976:0:24202:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x2a:0x0]+24 in llog 00000004:00080000:2.0:1784938444.904986:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x42:0x0], index 0: 0 00010000:00010000:2.0:1784938444.905174:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7400/0x7b044d4128f9d2fa lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.905184:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7400/0x7b044d4128f9d2fa lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.905192:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7400/0x7b044d4128f9d2fa lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.905223:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d2ec lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.905231:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d2ec lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.905237:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d2ec lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.905243:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a7a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938444.905248:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d2ec lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.905257:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d2ec lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.905268:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938444.905272:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938444.905276:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d2ec lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.905282:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d2ec lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938444.905294:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003f6f9ea6 reply state 0000000036db08d9 transno 8589934688 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9d2f3 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.905305:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9d2f3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.905323:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x56569231 (ffff9f2382049400) 00010000:00010000:2.0:1784938444.905325:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938444.905328:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938444.905356:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d2e5 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766434b expref: 15 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.905376:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7400/0x7b044d4128f9d2fa lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766434b expref: 14 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.905388:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x3:0x0].0x0 (ffff9f2382049b00) 00010000:00010000:2.0:1784938444.905391:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938444.905393:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a7400, rc 0) 00000100:00100000:2.0:1784938444.905523:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+15:17112:x1871643337485056:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1072us (1411us total) trans 8589934688 rc 0/0 00000100:00100000:2.0:1784938444.905532:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 504 00000100:00100000:1.0:1784938444.918110:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938444.918694:0:25725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337485184 00000100:00100000:3.0:1784938444.918704:0:25725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337485184 00000100:00100000:3.0:1784938444.918768:0:25725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 818 00000100:00100000:3.0:1784938444.918779:0:25725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7ea6e988-18ba-4c98-b179-17995571b98b+47:10960:x1871643337485184:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938444.918799:0:25725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938444.918822:0:25725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dc2a334/0x7b044d4128f9d308 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664352 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938444.918850:0:25725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938444.918871:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1784938444.918889:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938444.918899:0:25725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dc2a334/0x7b044d4128f9d308 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664352 expref: 48 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.918919:0:25725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000dc2a334/0x7b044d4128f9d308 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664352 expref: 48 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.918934:0:25725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d27d600, rc 0) 00000100:00100000:3.0:1784938444.922429:0:25725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7ea6e988-18ba-4c98-b179-17995571b98b+48:10960:x1871643337485184:12345-192.168.202.54@tcp:101:cp.0 Request processed in 224us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938444.922447:0:25725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 818 00000100:00100000:1.0:1784938444.922812:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938444.925299:0:25721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337485312 00000100:00100000:2.0:1784938444.925323:0:25721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337485312 00000100:00100000:2.0:1784938444.925401:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 819 00000100:00100000:2.0:1784938444.925411:0:25721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7ea6e988-18ba-4c98-b179-17995571b98b+48:17112:x1871643337485312:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938444.925429:0:25721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938444.925448:0:25721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6280b1e/0x7b044d4128f9d30f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664359 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.925484:0:25721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000dc2a334/0x7b044d4128f9d308 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664352 expref: 49 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.925493:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938444.925498:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938444.925504:0:25721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6280b1e/0x7b044d4128f9d30f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664359 expref: 49 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.925539:0:25721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000dc2a334/0x7b044d4128f9d308 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664352 expref: 49 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.925560:0:25721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000dc2a334/0x7b044d4128f9d308 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664352 expref: 49 pid: 25725 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938444.925574:0:25721:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:25721:1871643350888064:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938444.925668:0:25721:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d0770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938444.941462:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938444.941564:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337485440 00000100:00100000:0.0:1784938444.941574:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337485440 00010000:00010000:0.0:1784938444.941616:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000dc2a334/0x7b044d4128f9d308 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664352 expref: 50 pid: 25725 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938444.941666:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 409 00000100:00100000:0.0:1784938444.941675:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24829e1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+50:10959:x1871643337485440:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938444.941691:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938444.941713:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000dc2a334/0x7b044d4128f9d308 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664352 expref: 50 pid: 25725 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.941729:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000dc2a334/0x7b044d4128f9d308 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664352 expref: 50 pid: 25725 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.941755:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938444.941760:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938444.941769:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6280b1e/0x7b044d4128f9d30f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664359 expref: 50 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.941780:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6280b1e/0x7b044d4128f9d30f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664359 expref: 50 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.941818:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c6280b1e/0x7b044d4128f9d30f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664359 expref: 50 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938444.941833:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd5a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:19221:1871643350888192:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938444.941921:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b2d2c0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1784938444.942120:0:25721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dc2a334/0x7b044d4128f9d308 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664352 expref: 50 pid: 25725 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938444.942135:0:25721:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:25721:1871643350888064:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938444.942201:0:25721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c6280b1e/0x7b044d4128f9d30f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664359 expref: 49 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.942212:0:25721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a6200, rc 0) 00000100:00100000:2.0:1784938444.942241:0:25721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7ea6e988-18ba-4c98-b179-17995571b98b+49:17112:x1871643337485312:12345-192.168.202.54@tcp:101:cp.0 Request processed in 16831us (19429us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938444.942248:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 819 00000100:00100000:0.0:1784938444.944658:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd5a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:19221:1871643350888192:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938444.944686:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938444.944740:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24829e1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+48:10959:x1871643337485440:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3066us (3287us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938444.944752:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 409 00000100:00100000:3.0:1784938444.947496:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938444.947573:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337485696 00000100:00100000:2.0:1784938444.947581:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337485696 00000100:00100000:2.0:1784938444.947632:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 103 00000100:00100000:2.0:1784938444.947640:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+15:17112:x1871643337485696:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:2.0:1784938444.947901:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+16:17112:x1871643337485696:12345-192.168.202.54@tcp:35:cp.0 Request processed in 261us (413us total) trans 8589934689 rc 0/0 00000100:00100000:2.0:1784938444.947909:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 103 00000100:00100000:1.0:1784938444.954389:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938444.954791:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337485824 00000100:00100000:3.0:1784938444.954802:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337485824 00000100:00100000:3.0:1784938444.954881:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 505 00000100:00100000:3.0:1784938444.954893:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+16:17112:x1871643337485824:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938444.954917:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938444.954939:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d316 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664360 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.955026:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d31d lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.955042:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d31d lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.955055:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d31d lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.955077:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d600/0x7b044d4128f9d324 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa6e7eec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.955085:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d600/0x7b044d4128f9d324 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.955091:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d600/0x7b044d4128f9d324 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.955388:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d31d lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.955396:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d31d lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.955403:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d31d lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.955409:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d31d lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.955415:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27dc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938444.955420:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d31d lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.955427:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d31d lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.955440:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938444.955443:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938444.955448:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d31d lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.955454:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d31d lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.955469:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d600/0x7b044d4128f9d324 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.955475:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d600/0x7b044d4128f9d324 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.955481:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d600/0x7b044d4128f9d324 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.955486:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27d600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938444.955489:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d600/0x7b044d4128f9d324 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.955494:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d600/0x7b044d4128f9d324 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.955501:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xa6e7eec (ffff9f248fb8f000) 00010000:00010000:3.0:1784938444.955503:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938444.955505:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d600/0x7b044d4128f9d324 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.955511:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d600/0x7b044d4128f9d324 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.955543:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d316 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664360 expref: 17 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.955558:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938444.955560:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938444.955564:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d316 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664360 expref: 17 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.955573:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d27ca00, rc 0) 00000100:00100000:3.0:1784938444.955647:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+16:17112:x1871643337485824:12345-192.168.202.54@tcp:101:cp.0 Request processed in 755us (1537us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938444.955655:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 505 00000100:00100000:1.0:1784938444.963470:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938444.963686:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337485952 00000100:00100000:2.0:1784938444.963697:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337485952 00000100:00100000:2.0:1784938444.963763:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 506 00000100:00100000:2.0:1784938444.963773:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+16:17112:x1871643337485952:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938444.963795:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938444.963815:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d32b lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664367 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.963887:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d332 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.963900:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d332 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.963911:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d332 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.963923:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d339 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa6e7eec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.963929:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d339 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.963936:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d339 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.963970:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d332 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.963976:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d332 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.963987:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d332 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.963993:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a7a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938444.963997:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d332 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.964013:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d332 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.964025:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938444.964027:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938444.964032:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d332 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.964038:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d332 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.964051:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d339 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.964057:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d339 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.964062:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d339 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.964067:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a7600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938444.964070:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d339 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.964078:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d339 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.964084:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xa6e7eec (ffff9f2382049800) 00010000:00010000:2.0:1784938444.964086:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938444.964089:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d339 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.964094:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d339 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.965242:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d32b lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664367 expref: 17 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.965259:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938444.965261:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938444.965266:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d32b lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664367 expref: 17 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.965278:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a6000, rc 0) 00000100:00100000:2.0:1784938444.965365:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+16:17112:x1871643337485952:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1593us (1907us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938444.965373:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 506 00000100:00100000:1.0:1784938444.969072:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938444.969412:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337486208 00000100:00100000:3.0:1784938444.969422:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337486208 00000100:00100000:3.0:1784938444.969480:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 507 00000100:00100000:3.0:1784938444.969489:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+16:17112:x1871643337486208:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938444.969508:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938444.969526:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27c000/0x7b044d4128f9d340 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766436e expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.969620:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d000/0x7b044d4128f9d347 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.969633:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d000/0x7b044d4128f9d347 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.969644:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d000/0x7b044d4128f9d347 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.969656:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d200/0x7b044d4128f9d34e lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0xa6e7eec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.969671:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d200/0x7b044d4128f9d34e lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.969677:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d200/0x7b044d4128f9d34e lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938444.969977:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x43:0x0], index 1: 0 00010000:00010000:3.0:1784938444.970098:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1400/0x7b044d4128f9d355 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.970108:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1400/0x7b044d4128f9d355 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.970700:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1400/0x7b044d4128f9d355 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.970744:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d000/0x7b044d4128f9d347 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.970751:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d000/0x7b044d4128f9d347 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.970756:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d000/0x7b044d4128f9d347 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.970762:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d000/0x7b044d4128f9d347 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.970767:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27d000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938444.970771:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d000/0x7b044d4128f9d347 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.970781:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d000/0x7b044d4128f9d347 lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.970792:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938444.970795:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938444.970799:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d000/0x7b044d4128f9d347 lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.970804:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d000/0x7b044d4128f9d347 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938444.970817:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006ba0332d reply state 000000000933eceb transno 8589934690 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d200/0x7b044d4128f9d34e lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.970827:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d200/0x7b044d4128f9d34e lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.970832:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xa6e7eec (ffff9f248fb8ff00) 00010000:00010000:3.0:1784938444.970834:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938444.970836:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938444.970865:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27c000/0x7b044d4128f9d340 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766436e expref: 19 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.970880:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1400/0x7b044d4128f9d355 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766436e expref: 18 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.970887:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x4:0x0].0x0 (ffff9f248fb8f800) 00010000:00010000:3.0:1784938444.970889:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938444.970891:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf1400, rc 0) 00000100:00100000:3.0:1784938444.970961:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+19:17112:x1871643337486208:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1473us (1899us total) trans 8589934690 rc 0/0 00000100:00100000:3.0:1784938444.970969:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 507 00000100:00100000:1.0:1784938444.976908:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938444.976990:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337486336 00000100:00100000:2.0:1784938444.977009:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337486336 00000100:00100000:2.0:1784938444.977065:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 820 00000100:00100000:2.0:1784938444.977075:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+50:10958:x1871643337486336:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938444.977094:0:25722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938444.977125:0:25722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4e6532c/0x7b044d4128f9d363 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664375 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938444.977179:0:25722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x43:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938444.977199:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x43:0x0].0x0 since=711s v=(0 0) 00010000:00010000:2.0:1784938444.977204:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938444.977213:0:25722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4e6532c/0x7b044d4128f9d363 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664375 expref: 51 pid: 25722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.977231:0:25722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c4e6532c/0x7b044d4128f9d363 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664375 expref: 51 pid: 25722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938444.977245:0:25722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a6000, rc 0) 00000100:00100000:2.0:1784938444.977296:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+51:10958:x1871643337486336:12345-192.168.202.54@tcp:101:cp.0 Request processed in 223us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938444.977303:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 820 00000100:00100000:1.0:1784938444.982470:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938444.982648:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337486464 00000100:00100000:3.0:1784938444.982658:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337486464 00000100:00100000:3.0:1784938444.982717:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 821 00000100:00100000:3.0:1784938444.982727:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+51:17112:x1871643337486464:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938444.982744:0:25715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938444.982761:0:25715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000735f81e4/0x7b044d4128f9d36a lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766437c expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.982792:0:25715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4e6532c/0x7b044d4128f9d363 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664375 expref: 52 pid: 25722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.982801:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938444.982805:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938444.982810:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000735f81e4/0x7b044d4128f9d36a lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->393215] (req 0->393215) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766437c expref: 52 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.982840:0:25715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c4e6532c/0x7b044d4128f9d363 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664375 expref: 52 pid: 25722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.982854:0:25715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c4e6532c/0x7b044d4128f9d363 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664375 expref: 52 pid: 25722 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938444.982868:0:25715:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388127b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25715:1871643350888320:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938444.982951:0:25715:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24867a3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784938444.986919:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938444.987047:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337486592 00000100:00100000:0.0:1784938444.987058:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337486592 00010000:00010000:0.0:1784938444.987106:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c4e6532c/0x7b044d4128f9d363 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664375 expref: 53 pid: 25722 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938444.987208:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 410 00000100:00100000:0.0:1784938444.987219:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+53:10958:x1871643337486592:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938444.987234:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938444.987256:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c4e6532c/0x7b044d4128f9d363 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664375 expref: 53 pid: 25722 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.987270:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c4e6532c/0x7b044d4128f9d363 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664375 expref: 53 pid: 25722 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.987301:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938444.987306:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938444.987324:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000735f81e4/0x7b044d4128f9d36a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->393215) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766437c expref: 53 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.987335:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000735f81e4/0x7b044d4128f9d36a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->393215) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766437c expref: 53 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938444.987371:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000735f81e4/0x7b044d4128f9d36a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->393215) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766437c expref: 53 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938444.987385:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd5a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22955:1871643350888448:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938444.987463:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b2d2cd80 going to sleep for 11 seconds 00010000:00010000:3.0:1784938444.988658:0:25715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4e6532c/0x7b044d4128f9d363 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664375 expref: 53 pid: 25722 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938444.988679:0:25715:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388127b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25715:1871643350888320:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938444.988709:0:25715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000735f81e4/0x7b044d4128f9d36a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->393215) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766437c expref: 52 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938444.988723:0:25715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf0e00, rc 0) 00000100:00100000:3.0:1784938444.988786:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+52:17112:x1871643337486464:12345-192.168.202.54@tcp:101:cp.0 Request processed in 6060us (6324us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938444.988795:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 821 00000100:00100000:0.0:1784938444.995557:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd5a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22955:1871643350888448:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938444.995583:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938444.995637:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+51:10958:x1871643337486592:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 8420us (8730us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938444.995648:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 410 00000100:00100000:1.0:1784938445.008845:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938445.008957:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337486848 00000100:00100000:0.0:1784938445.008969:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337486848 00000100:00100000:0.0:1784938445.009043:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 104 00000100:00100000:0.0:1784938445.009054:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+19:17112:x1871643337486848:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:0.0:1784938445.009388:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+20:17112:x1871643337486848:12345-192.168.202.54@tcp:35:cp.0 Request processed in 335us (552us total) trans 8589934691 rc 0/0 00000100:00100000:0.0:1784938445.009400:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 104 00000100:00100000:1.0:1784938445.012783:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.012872:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337486976 00000100:00100000:3.0:1784938445.012891:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337486976 00000100:00100000:3.0:1784938445.012953:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 508 00000100:00100000:3.0:1784938445.012962:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+20:17112:x1871643337486976:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938445.012986:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.015697:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1800/0x7b044d4128f9d371 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664383 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.015793:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d378 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.015808:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d378 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.015820:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d378 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.015837:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d37f lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe6b34bd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.015844:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d37f lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.015851:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d37f lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.015902:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d378 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.015909:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d378 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.015916:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d378 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.015922:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a7600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.015927:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d378 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.015935:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d378 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.015946:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.015950:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.015954:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d378 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.015960:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d378 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.015974:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d37f lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.015980:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d37f lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.015985:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d37f lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.015991:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a7a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.015993:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d37f lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.015999:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d37f lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.016017:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xe6b34bd0 (ffff9f2382049000) 00010000:00010000:2.0:1784938445.016019:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.016023:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d37f lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.016029:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d37f lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.016067:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1800/0x7b044d4128f9d371 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664383 expref: 21 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.016078:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.016080:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.016085:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1800/0x7b044d4128f9d371 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664383 expref: 21 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.016094:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf1800, rc 0) 00000100:00100000:2.0:1784938445.016466:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+20:17112:x1871643337486976:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3503us (3692us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938445.016476:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 508 00000100:00100000:1.0:1784938445.019868:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.019962:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337487104 00000100:00100000:2.0:1784938445.019972:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337487104 00000100:00100000:2.0:1784938445.020037:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 509 00000100:00100000:2.0:1784938445.020047:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+20:17112:x1871643337487104:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.020068:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.020089:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d386 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766438a expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.020205:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d38d lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.020219:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d38d lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.020230:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d38d lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.020245:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9d394 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe6b34bd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.020252:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9d394 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.020259:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9d394 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.020298:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d38d lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.020305:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d38d lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.020319:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d38d lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.020326:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d38d lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.020332:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a6000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.020336:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d38d lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.020344:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d38d lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.020356:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.020359:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.020364:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d38d lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.020370:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d38d lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.020383:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9d394 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.020389:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9d394 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.020395:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9d394 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.020400:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17b600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.020403:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9d394 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.020409:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9d394 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.020417:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xe6b34bd0 (ffff9f2382049600) 00010000:00010000:2.0:1784938445.020419:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.020421:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9d394 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.020427:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9d394 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.020460:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d386 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766438a expref: 21 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.020470:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.020472:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.020475:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d386 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766438a expref: 21 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.020483:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a6400, rc 0) 00000100:00100000:2.0:1784938445.020542:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+20:17112:x1871643337487104:12345-192.168.202.54@tcp:101:cp.0 Request processed in 496us (684us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938445.020553:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 509 00000100:00100000:1.0:1784938445.025670:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.026455:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337487360 00000100:00100000:2.0:1784938445.026466:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337487360 00000100:00100000:2.0:1784938445.026560:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 510 00000100:00100000:2.0:1784938445.026571:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+20:17112:x1871643337487360:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.026592:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.026612:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a600/0x7b044d4128f9d39b lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664391 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.026706:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d3a2 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.026720:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d3a2 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.026730:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d3a2 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.026743:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b800/0x7b044d4128f9d3a9 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0xe6b34bd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.026750:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b800/0x7b044d4128f9d3a9 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.026757:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b800/0x7b044d4128f9d3a9 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938445.027062:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x43:0x0], index 0: 0 00010000:00010000:2.0:1784938445.027459:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a400/0x7b044d4128f9d3b0 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.027471:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a400/0x7b044d4128f9d3b0 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.027478:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a400/0x7b044d4128f9d3b0 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.027508:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d3a2 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.027515:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d3a2 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.027521:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d3a2 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.027526:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17a800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.027530:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d3a2 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.027537:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d3a2 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.027548:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.027551:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.027555:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d3a2 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.027561:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d3a2 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938445.027573:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d5ec54ec reply state 00000000318455af transno 8589934692 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b800/0x7b044d4128f9d3a9 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.027584:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b800/0x7b044d4128f9d3a9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.027590:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xe6b34bd0 (ffff9f2382049000) 00010000:00010000:2.0:1784938445.027593:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938445.027595:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938445.027625:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a600/0x7b044d4128f9d39b lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664391 expref: 23 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.027639:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a400/0x7b044d4128f9d3b0 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664391 expref: 22 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.027647:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x5:0x0].0x0 (ffff9f2382049d00) 00010000:00010000:2.0:1784938445.027650:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938445.027652:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17a400, rc 0) 00000100:00100000:2.0:1784938445.027791:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+23:17112:x1871643337487360:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1220us (2130us total) trans 8589934692 rc 0/0 00000100:00100000:2.0:1784938445.027799:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 510 00000100:00100000:1.0:1784938445.032401:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.032484:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337487488 00000100:00100000:2.0:1784938445.032494:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337487488 00000100:00100000:2.0:1784938445.032608:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 822 00000100:00100000:2.0:1784938445.032618:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381360450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+48:10960:x1871643337487488:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.032638:0:21629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.032660:0:21629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b9ed1c8/0x7b044d4128f9d3be lrc: 2/0,0 mode: --/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664398 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938445.032686:0:21629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x43:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938445.032705:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=711s v=(0 0) 00010000:00010000:2.0:1784938445.032710:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938445.032719:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b9ed1c8/0x7b044d4128f9d3be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664398 expref: 49 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.032736:0:21629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005b9ed1c8/0x7b044d4128f9d3be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664398 expref: 49 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.032750:0:21629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17b600, rc 0) 00000100:00100000:2.0:1784938445.032810:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381360450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+49:10960:x1871643337487488:12345-192.168.202.54@tcp:101:cp.0 Request processed in 193us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938445.032818:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 822 00000100:00080000:3.0:1784938445.039419:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938445.040254:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938445.042648:0:25729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337487616 00000100:00100000:0.0:1784938445.042666:0:25729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337487616 00000100:00100000:0.0:1784938445.042808:0:25729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 823 00000100:00100000:0.0:1784938445.042820:0:25729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7ea6e988-18ba-4c98-b179-17995571b98b+49:17112:x1871643337487616:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938445.042839:0:25729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938445.042861:0:25729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095b82f9b/0x7b044d4128f9d3c5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766439f expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.042907:0:25729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005b9ed1c8/0x7b044d4128f9d3be lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664398 expref: 50 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.042918:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938445.042923:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938445.042928:0:25729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095b82f9b/0x7b044d4128f9d3c5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766439f expref: 50 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.042966:0:25729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005b9ed1c8/0x7b044d4128f9d3be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664398 expref: 50 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.042981:0:25729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005b9ed1c8/0x7b044d4128f9d3be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664398 expref: 50 pid: 21629 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938445.042998:0:25729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd5a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:25729:1871643350888576:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938445.043122:0:25729:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2482d95780 going to sleep for 11 seconds 00000100:00100000:1.0:1784938445.048927:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.049023:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337487744 00000100:00100000:2.0:1784938445.049034:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337487744 00010000:00010000:2.0:1784938445.049077:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005b9ed1c8/0x7b044d4128f9d3be lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664398 expref: 51 pid: 21629 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938445.049142:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 411 00000100:00100000:2.0:1784938445.049178:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+51:10960:x1871643337487744:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938445.049195:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938445.049217:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005b9ed1c8/0x7b044d4128f9d3be lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664398 expref: 51 pid: 21629 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.049232:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005b9ed1c8/0x7b044d4128f9d3be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664398 expref: 51 pid: 21629 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.049262:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938445.049267:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938445.049276:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000095b82f9b/0x7b044d4128f9d3c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766439f expref: 51 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.049287:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095b82f9b/0x7b044d4128f9d3c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766439f expref: 51 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.049334:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000095b82f9b/0x7b044d4128f9d3c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766439f expref: 51 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938445.049349:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37c8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350888704:192.168.202.54@tcp:105: 00000100:00100000:2.0:1784938445.049418:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d3a4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938445.052679:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37c8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350888704:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938445.052708:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938445.052760:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+51:10960:x1871643337487744:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3583us (3842us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938445.052771:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 411 00010000:00010000:0.0:1784938445.057892:0:25729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b9ed1c8/0x7b044d4128f9d3be lrc: 0/0,0 mode: --/PR res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664398 expref: 50 pid: 21629 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938445.057922:0:25729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd5a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:25729:1871643350888576:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938445.057960:0:25729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000095b82f9b/0x7b044d4128f9d3c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766439f expref: 49 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.057978:0:25729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c9f6600, rc 0) 00000100:00100000:0.0:1784938445.058069:0:25729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7ea6e988-18ba-4c98-b179-17995571b98b+49:17112:x1871643337487616:12345-192.168.202.54@tcp:101:cp.0 Request processed in 15252us (17925us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938445.058079:0:25729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 823 00000100:00100000:1.0:1784938445.066455:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938445.066532:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337488000 00000100:00100000:0.0:1784938445.066542:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337488000 00000100:00100000:0.0:1784938445.066600:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 105 00000100:00100000:0.0:1784938445.066609:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24857fd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+23:17112:x1871643337488000:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:0.0:1784938445.066910:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24857fd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+24:17112:x1871643337488000:12345-192.168.202.54@tcp:35:cp.0 Request processed in 301us (464us total) trans 8589934693 rc 0/0 00000100:00100000:0.0:1784938445.066919:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 105 00000100:00100000:1.0:1784938445.073425:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.073709:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337488128 00000100:00100000:2.0:1784938445.073719:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337488128 00000100:00100000:2.0:1784938445.073779:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 511 00000100:00100000:2.0:1784938445.073789:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+24:17112:x1871643337488128:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.073811:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.073830:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a600/0x7b044d4128f9d3cc lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476643a6 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.073910:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d3d3 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.073926:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d3d3 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.073938:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d3d3 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.073954:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b400/0x7b044d4128f9d3da lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9ca112ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.073961:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b400/0x7b044d4128f9d3da lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.073967:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b400/0x7b044d4128f9d3da lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.074608:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d3d3 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.074617:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d3d3 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.074623:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d3d3 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.074628:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d3d3 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.074633:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17a800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.074638:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d3d3 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.074644:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d3d3 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.074657:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.074660:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.074664:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d3d3 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.074670:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d3d3 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.074683:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b400/0x7b044d4128f9d3da lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.074689:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b400/0x7b044d4128f9d3da lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.074694:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b400/0x7b044d4128f9d3da lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.074698:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17b400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.074701:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b400/0x7b044d4128f9d3da lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.074706:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b400/0x7b044d4128f9d3da lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.074712:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x9ca112ae (ffff9f2382049700) 00010000:00010000:2.0:1784938445.074714:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.074717:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b400/0x7b044d4128f9d3da lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.074722:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b400/0x7b044d4128f9d3da lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.074758:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a600/0x7b044d4128f9d3cc lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643a6 expref: 25 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.074769:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.074772:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.074775:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a600/0x7b044d4128f9d3cc lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643a6 expref: 25 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.074784:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17a600, rc 0) 00000100:00100000:2.0:1784938445.074851:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+24:17112:x1871643337488128:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1063us (1437us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938445.074858:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 511 00000100:00100000:1.0:1784938445.081952:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938445.082335:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337488256 00000100:00100000:0.0:1784938445.082345:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337488256 00000100:00100000:0.0:1784938445.082408:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 512 00000100:00100000:0.0:1784938445.082418:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+24:17112:x1871643337488256:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938445.082437:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938445.082458:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d3e1 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476643ad expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.082528:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f6200/0x7b044d4128f9d3e8 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.082543:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f6200/0x7b044d4128f9d3e8 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.082555:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f6200/0x7b044d4128f9d3e8 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.082570:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d3ef lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9ca112ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.082576:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d3ef lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.082582:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d3ef lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.082620:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f6200/0x7b044d4128f9d3e8 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.082627:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f6200/0x7b044d4128f9d3e8 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.082633:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f6200/0x7b044d4128f9d3e8 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.082639:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f6200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938445.082643:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f6200/0x7b044d4128f9d3e8 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.082654:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f6200/0x7b044d4128f9d3e8 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.082665:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938445.082668:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938445.082672:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f6200/0x7b044d4128f9d3e8 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.082678:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f6200/0x7b044d4128f9d3e8 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.082691:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d3ef lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.082697:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d3ef lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.082702:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d3ef lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.082707:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b34a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938445.082710:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d3ef lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.082716:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d3ef lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.082722:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x9ca112ae (ffff9f24898e0a00) 00010000:00010000:0.0:1784938445.082724:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938445.082727:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d3ef lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.082738:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d3ef lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.082768:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d3e1 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643ad expref: 25 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.082778:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938445.082780:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938445.082783:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d3e1 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643ad expref: 25 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.082792:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c9f7600, rc 0) 00000100:00100000:0.0:1784938445.082855:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+24:17112:x1871643337488256:12345-192.168.202.54@tcp:101:cp.0 Request processed in 438us (912us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938445.082862:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 512 00000100:00100000:1.0:1784938445.085960:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938445.086182:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337488512 00000100:00100000:0.0:1784938445.086191:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337488512 00000100:00100000:0.0:1784938445.086249:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 513 00000100:00100000:0.0:1784938445.086258:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+24:17112:x1871643337488512:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938445.086278:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938445.086298:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35600/0x7b044d4128f9d3f6 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476643b4 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.086404:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35800/0x7b044d4128f9d3fd lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.086418:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35800/0x7b044d4128f9d3fd lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.086430:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35800/0x7b044d4128f9d3fd lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.086444:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35a00/0x7b044d4128f9d404 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x9ca112ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.086451:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35a00/0x7b044d4128f9d404 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.086458:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35a00/0x7b044d4128f9d404 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938445.086756:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x44:0x0], index 1: 0 00010000:00010000:0.0:1784938445.086882:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34400/0x7b044d4128f9d40b lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.086890:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34400/0x7b044d4128f9d40b lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.086898:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34400/0x7b044d4128f9d40b lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.086930:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35800/0x7b044d4128f9d3fd lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.086936:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35800/0x7b044d4128f9d3fd lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.086941:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35800/0x7b044d4128f9d3fd lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.086947:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35800/0x7b044d4128f9d3fd lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.086953:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938445.086957:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35800/0x7b044d4128f9d3fd lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.086964:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35800/0x7b044d4128f9d3fd lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.086976:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938445.086978:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938445.086983:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35800/0x7b044d4128f9d3fd lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.086989:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35800/0x7b044d4128f9d3fd lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938445.087801:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c751df73 reply state 000000009e5d2617 transno 8589934694 ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35a00/0x7b044d4128f9d404 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.087825:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35a00/0x7b044d4128f9d404 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.087832:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x9ca112ae (ffff9f24898e0900) 00010000:00010000:0.0:1784938445.087836:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938445.087839:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938445.089370:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35600/0x7b044d4128f9d3f6 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643b4 expref: 27 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.089405:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34400/0x7b044d4128f9d40b lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643b4 expref: 26 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.089415:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x6:0x0].0x0 (ffff9f24898e0e00) 00010000:00010000:1.0:1784938445.089418:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938445.089421:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b34400, rc 0) 00000100:00100000:1.0:1784938445.089538:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+27:17112:x1871643337488512:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3279us (3585us total) trans 8589934694 rc 0/0 00000100:00100000:1.0:1784938445.089547:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 513 00000100:00100000:1.0:1784938445.094381:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938445.094470:0:25728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337488640 00000100:00100000:0.0:1784938445.094482:0:25728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337488640 00000100:00100000:0.0:1784938445.094609:0:25728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 824 00000100:00100000:0.0:1784938445.094621:0:25728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:7ea6e988-18ba-4c98-b179-17995571b98b+51:10958:x1871643337488640:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938445.094641:0:25728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938445.094667:0:25728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf7e7655/0x7b044d4128f9d419 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476643bb expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938445.094702:0:25728:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x44:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938445.094728:0:25728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x44:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1784938445.094733:0:25728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x44:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938445.094746:0:25728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf7e7655/0x7b044d4128f9d419 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643bb expref: 52 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.094765:0:25728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bf7e7655/0x7b044d4128f9d419 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643bb expref: 52 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.094783:0:25728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b35800, rc 0) 00000100:00100000:0.0:1784938445.094878:0:25728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:7ea6e988-18ba-4c98-b179-17995571b98b+52:10958:x1871643337488640:12345-192.168.202.54@tcp:101:cp.0 Request processed in 252us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938445.094887:0:25728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 824 00000100:00080000:3.0:1784938445.100596:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784938445.101017:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.101238:0:25723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337488768 00000100:00100000:3.0:1784938445.101247:0:25723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337488768 00000100:00100000:3.0:1784938445.101302:0:25723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 825 00000100:00100000:3.0:1784938445.101324:0:25723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7ea6e988-18ba-4c98-b179-17995571b98b+52:17112:x1871643337488768:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938445.101343:0:25723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938445.101361:0:25723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e54ea8ff/0x7b044d4128f9d420 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x44:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476643c2 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.101397:0:25723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf7e7655/0x7b044d4128f9d419 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643bb expref: 53 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.101407:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x44:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938445.101410:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x44:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938445.101415:0:25723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e54ea8ff/0x7b044d4128f9d420 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x44:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643c2 expref: 53 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.101448:0:25723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bf7e7655/0x7b044d4128f9d419 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e9476643bb expref: 53 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.101462:0:25723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bf7e7655/0x7b044d4128f9d419 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476643bb expref: 53 pid: 25728 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938445.101475:0:25723:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388127b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:25723:1871643350888832:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938445.101560:0:25723:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24867a3180 going to sleep for 11 seconds 00000100:00100000:3.0:1784938445.104727:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938445.104938:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337488896 00000100:00100000:0.0:1784938445.104947:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337488896 00010000:00010000:0.0:1784938445.104987:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bf7e7655/0x7b044d4128f9d419 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476643bb expref: 54 pid: 25728 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938445.105046:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 412 00000100:00100000:0.0:1784938445.105055:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388127100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+54:10957:x1871643337488896:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938445.105072:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938445.105098:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bf7e7655/0x7b044d4128f9d419 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476643bb expref: 54 pid: 25728 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.105119:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bf7e7655/0x7b044d4128f9d419 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476643bb expref: 54 pid: 25728 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.105175:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x44:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938445.105180:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x44:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938445.105189:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e54ea8ff/0x7b044d4128f9d420 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643c2 expref: 54 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.105200:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e54ea8ff/0x7b044d4128f9d420 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643c2 expref: 54 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.105246:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e54ea8ff/0x7b044d4128f9d420 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643c2 expref: 54 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938445.105262:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd5a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350888960:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938445.105355:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f249164b180 going to sleep for 11 seconds 00010000:00010000:1.0:1784938445.105618:0:25723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf7e7655/0x7b044d4128f9d419 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476643bb expref: 54 pid: 25728 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938445.105637:0:25723:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388127b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:25723:1871643350888832:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938445.105662:0:25723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e54ea8ff/0x7b044d4128f9d420 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476643c2 expref: 53 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.105674:0:25723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf0400, rc 0) 00000100:00100000:1.0:1784938445.105701:0:25723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7ea6e988-18ba-4c98-b179-17995571b98b+53:17112:x1871643337488768:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4391us (4702us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938445.105709:0:25723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 825 00000100:00100000:1.0:1784938445.108623:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd5a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350888960:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938445.108657:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938445.108719:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388127100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+52:10957:x1871643337488896:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3664us (4001us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938445.108729:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 412 00000100:00100000:1.0:1784938445.111821:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.111960:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337489152 00000100:00100000:2.0:1784938445.111971:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337489152 00000100:00100000:2.0:1784938445.112039:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 106 00000100:00100000:2.0:1784938445.112049:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+27:17112:x1871643337489152:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:2.0:1784938445.112423:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+28:17112:x1871643337489152:12345-192.168.202.54@tcp:35:cp.0 Request processed in 374us (614us total) trans 8589934695 rc 0/0 00000100:00100000:2.0:1784938445.112430:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 106 00000100:00100000:3.0:1784938445.115572:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938445.115728:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337489280 00000100:00100000:0.0:1784938445.115741:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337489280 00000100:00100000:0.0:1784938445.115810:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 514 00000100:00100000:0.0:1784938445.115820:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+28:17112:x1871643337489280:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938445.115843:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938445.115865:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35600/0x7b044d4128f9d427 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476643c9 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.115945:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d42e lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.115959:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d42e lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.115971:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d42e lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.115985:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d435 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9fe9a331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.115992:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d435 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.115998:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d435 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.119340:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d42e lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.119360:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d42e lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.119367:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d42e lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.119373:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b34a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938445.119378:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d42e lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.119390:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d42e lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.119407:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938445.119410:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938445.119416:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d42e lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.119421:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d42e lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.119440:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d435 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.119446:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d435 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.119451:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d435 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.119455:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938445.119458:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d435 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.119464:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d435 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.119471:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x9fe9a331 (ffff9f248fb6f400) 00010000:00010000:0.0:1784938445.119473:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938445.119476:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d435 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.119486:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d435 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.119562:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35600/0x7b044d4128f9d427 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643c9 expref: 29 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.119573:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938445.119575:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938445.119579:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35600/0x7b044d4128f9d427 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643c9 expref: 29 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.119589:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b35600, rc 0) 00000100:00100000:0.0:1784938445.119705:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+28:17112:x1871643337489280:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3883us (4138us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938445.119715:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 514 00000100:00100000:1.0:1784938445.123385:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.123479:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337489408 00000100:00100000:3.0:1784938445.123491:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337489408 00000100:00100000:3.0:1784938445.123564:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 515 00000100:00100000:3.0:1784938445.123575:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+28:17112:x1871643337489408:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938445.123601:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938445.123624:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf0600/0x7b044d4128f9d43c lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476643d0 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.123716:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d443 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.123734:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d443 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.123747:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d443 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.123761:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d44a lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9fe9a331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.123768:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d44a lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.123775:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d44a lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.123817:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d443 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.123825:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d443 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.123831:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d443 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.123837:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d443 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.123843:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938445.123848:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d443 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.123855:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d443 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.123868:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938445.123883:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938445.123889:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d443 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.123896:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d443 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.123909:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d44a lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.123915:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d44a lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.123920:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d44a lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.123925:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938445.123928:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d44a lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.123933:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d44a lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.123940:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x9fe9a331 (ffff9f248fb8f000) 00010000:00010000:3.0:1784938445.123943:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938445.123946:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d44a lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.123951:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d44a lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.123981:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf0600/0x7b044d4128f9d43c lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643d0 expref: 29 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.123991:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938445.123993:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938445.123997:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf0600/0x7b044d4128f9d43c lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643d0 expref: 29 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.124015:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf0600, rc 0) 00000100:00100000:3.0:1784938445.124087:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+28:17112:x1871643337489408:12345-192.168.202.54@tcp:101:cp.0 Request processed in 512us (712us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938445.124095:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 515 00000100:00100000:3.0:1784938445.128121:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938445.128248:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337489664 00000100:00100000:0.0:1784938445.128258:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337489664 00000100:00100000:0.0:1784938445.128327:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 516 00000100:00100000:0.0:1784938445.128337:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+28:17112:x1871643337489664:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938445.128359:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938445.128384:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35600/0x7b044d4128f9d451 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476643d7 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.128498:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d458 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.128514:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d458 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.128525:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d458 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.128540:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d45f lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x9fe9a331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.128547:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d45f lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.128553:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d45f lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938445.128893:0:24203:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x44:0x0], index 0: 0 00010000:00010000:0.0:1784938445.129037:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35800/0x7b044d4128f9d466 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.129046:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35800/0x7b044d4128f9d466 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.129054:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35800/0x7b044d4128f9d466 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.129087:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d458 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.129094:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d458 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.129100:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d458 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.129106:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938445.129112:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d458 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.129119:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d458 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.129132:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938445.129135:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938445.129139:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d458 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.129188:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d458 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938445.129202:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e7855afa reply state 00000000b575f39e transno 8589934696 ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d45f lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.129213:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d45f lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.129219:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x9fe9a331 (ffff9f248fb6f400) 00010000:00010000:0.0:1784938445.129221:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938445.129224:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938445.129254:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35600/0x7b044d4128f9d451 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643d7 expref: 31 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.129269:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35800/0x7b044d4128f9d466 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643d7 expref: 30 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.129277:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x7:0x0].0x0 (ffff9f248fb6f200) 00010000:00010000:0.0:1784938445.129280:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938445.129283:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b35800, rc 0) 00000100:00100000:0.0:1784938445.129359:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+31:17112:x1871643337489664:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1023us (1251us total) trans 8589934696 rc 0/0 00000100:00100000:0.0:1784938445.129368:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 516 00000100:00100000:0.0:1784938445.134619:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.134763:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337489792 00000100:00100000:3.0:1784938445.134775:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337489792 00000100:00100000:3.0:1784938445.134839:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 826 00000100:00100000:3.0:1784938445.134850:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+49:10959:x1871643337489792:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938445.134879:0:25716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938445.134903:0:25716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d72bda27/0x7b044d4128f9d474 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476643de expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938445.134933:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x44:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938445.134960:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x44:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1784938445.134966:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x44:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938445.134978:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d72bda27/0x7b044d4128f9d474 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643de expref: 50 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.134996:0:25716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d72bda27/0x7b044d4128f9d474 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643de expref: 50 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.135209:0:25716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf0600, rc 0) 00000100:00100000:3.0:1784938445.135274:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+50:10959:x1871643337489792:12345-192.168.202.54@tcp:101:cp.0 Request processed in 425us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938445.135282:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 826 00000100:00100000:1.0:1784938445.138530:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938445.138636:0:25726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337489920 00000100:00100000:0.0:1784938445.138647:0:25726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337489920 00000100:00100000:0.0:1784938445.138727:0:25726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 827 00000100:00100000:0.0:1784938445.138737:0:25726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7ea6e988-18ba-4c98-b179-17995571b98b+50:17112:x1871643337489920:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938445.138757:0:25726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938445.138776:0:25726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016494a26/0x7b044d4128f9d47b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x44:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476643e5 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.138808:0:25726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d72bda27/0x7b044d4128f9d474 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643de expref: 51 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.138817:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x44:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938445.138822:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x44:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938445.138828:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016494a26/0x7b044d4128f9d47b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x44:0x0].0x0 rrc: 3 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643e5 expref: 51 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.138859:0:25726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d72bda27/0x7b044d4128f9d474 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e9476643de expref: 51 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.138883:0:25726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d72bda27/0x7b044d4128f9d474 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476643de expref: 51 pid: 25716 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938445.138905:0:25726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd5a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:25726:1871643350889088:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938445.138978:0:25726:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b2d2cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938445.141523:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.141663:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337490048 00000100:00100000:3.0:1784938445.141672:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337490048 00010000:00010000:3.0:1784938445.141712:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d72bda27/0x7b044d4128f9d474 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476643de expref: 52 pid: 25716 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938445.141752:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 413 00000100:00100000:3.0:1784938445.141761:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+52:10959:x1871643337490048:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938445.141774:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938445.141793:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d72bda27/0x7b044d4128f9d474 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476643de expref: 52 pid: 25716 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.141807:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d72bda27/0x7b044d4128f9d474 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476643de expref: 52 pid: 25716 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.141829:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x44:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938445.141833:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x44:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938445.141841:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000016494a26/0x7b044d4128f9d47b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643e5 expref: 52 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.141851:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016494a26/0x7b044d4128f9d47b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643e5 expref: 52 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.141889:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000016494a26/0x7b044d4128f9d47b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643e5 expref: 52 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938445.141903:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388127800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350889216:192.168.202.54@tcp:105: 00000100:00100000:3.0:1784938445.141964:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24867a3c00 going to sleep for 11 seconds 00010000:00010000:0.0:1784938445.142260:0:25726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d72bda27/0x7b044d4128f9d474 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476643de expref: 52 pid: 25716 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938445.142276:0:25726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd5a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:25726:1871643350889088:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938445.142299:0:25726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000016494a26/0x7b044d4128f9d47b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476643e5 expref: 51 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.142321:0:25726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b35600, rc 0) 00000100:00100000:0.0:1784938445.142358:0:25726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7ea6e988-18ba-4c98-b179-17995571b98b+51:17112:x1871643337489920:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3623us (3839us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938445.142366:0:25726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 827 00000100:00100000:3.0:1784938445.145370:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388127800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350889216:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938445.145396:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938445.145447:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+50:10959:x1871643337490048:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3687us (3931us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938445.145458:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 413 00000100:00100000:3.0:1784938445.148292:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.148380:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337490304 00000100:00100000:2.0:1784938445.148389:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337490304 00000100:00100000:2.0:1784938445.148450:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 107 00000100:00100000:2.0:1784938445.148460:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+31:17112:x1871643337490304:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:2.0:1784938445.148772:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+32:17112:x1871643337490304:12345-192.168.202.54@tcp:35:cp.0 Request processed in 313us (487us total) trans 8589934697 rc 0/0 00000100:00100000:2.0:1784938445.148780:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 107 00000100:00100000:1.0:1784938445.152762:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.152860:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337490432 00000100:00100000:3.0:1784938445.152870:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337490432 00000100:00100000:3.0:1784938445.152943:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 517 00000100:00100000:3.0:1784938445.152953:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+32:17112:x1871643337490432:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938445.152978:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938445.153000:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d482 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476643ec expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.153094:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d489 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.153113:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d489 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.153357:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d489 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.153375:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d490 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x151c8ac3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.153384:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d490 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.153391:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d490 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.153435:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d489 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.153443:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d489 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.153450:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d489 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.153456:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d489 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.153462:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938445.153466:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d489 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.153474:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d489 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.153485:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938445.153488:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938445.153493:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d489 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.153499:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d489 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.153513:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d490 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.153519:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d490 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.153524:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d490 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.153529:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938445.153532:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d490 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.153537:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d490 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.153544:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x151c8ac3 (ffff9f248fb8fe00) 00010000:00010000:3.0:1784938445.153546:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938445.153548:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d490 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.153555:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d490 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.153584:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d482 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643ec expref: 33 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.153593:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938445.153596:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938445.153599:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d482 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643ec expref: 33 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.153607:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf1200, rc 0) 00000100:00100000:3.0:1784938445.153661:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+32:17112:x1871643337490432:12345-192.168.202.54@tcp:101:cp.0 Request processed in 710us (909us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938445.153668:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 517 00000100:00100000:1.0:1784938445.161675:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938445.161769:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337490560 00000100:00100000:0.0:1784938445.161778:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337490560 00000100:00100000:0.0:1784938445.161836:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 518 00000100:00100000:0.0:1784938445.161846:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d146680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+32:17112:x1871643337490560:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938445.161865:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938445.161895:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d497 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476643f3 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.161960:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d49e lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.161978:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d49e lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.161991:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d49e lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.162016:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f6200/0x7b044d4128f9d4a5 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x151c8ac3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.162024:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f6200/0x7b044d4128f9d4a5 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.162031:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f6200/0x7b044d4128f9d4a5 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.162069:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d49e lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.162077:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d49e lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.162082:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d49e lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.162089:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f7600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938445.162093:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d49e lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.162101:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d49e lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.162112:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938445.162116:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938445.162121:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d49e lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.162139:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d49e lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.162191:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f6200/0x7b044d4128f9d4a5 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.162197:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f6200/0x7b044d4128f9d4a5 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.162202:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f6200/0x7b044d4128f9d4a5 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.162206:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f6200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938445.162209:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f6200/0x7b044d4128f9d4a5 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.162214:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f6200/0x7b044d4128f9d4a5 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.162221:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x151c8ac3 (ffff9f248fb6f800) 00010000:00010000:0.0:1784938445.162224:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938445.162227:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f6200/0x7b044d4128f9d4a5 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.162233:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f6200/0x7b044d4128f9d4a5 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.162266:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d497 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643f3 expref: 33 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.162277:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938445.162280:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938445.162283:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d497 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643f3 expref: 33 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.162292:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b35200, rc 0) 00000100:00100000:0.0:1784938445.162353:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d146680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+32:17112:x1871643337490560:12345-192.168.202.54@tcp:101:cp.0 Request processed in 508us (686us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938445.162361:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 518 00000100:00100000:0.0:1784938445.165783:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938445.165888:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337490816 00000100:00100000:1.0:1784938445.165899:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337490816 00000100:00100000:1.0:1784938445.165960:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 519 00000100:00100000:1.0:1784938445.165970:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+32:17112:x1871643337490816:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938445.165990:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938445.166021:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9d4ac lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476643fa expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.166139:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9d4b3 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.166460:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9d4b3 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.166473:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9d4b3 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.166489:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9d4ba lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x151c8ac3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.166495:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9d4ba lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.166502:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9d4ba lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938445.166904:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x45:0x0], index 1: 0 00010000:00010000:1.0:1784938445.167395:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559a00/0x7b044d4128f9d4c1 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.167409:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559a00/0x7b044d4128f9d4c1 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.167417:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559a00/0x7b044d4128f9d4c1 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.167454:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9d4b3 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.167465:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9d4b3 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.167471:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9d4b3 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.167478:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9d4b3 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.167483:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c559400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938445.167489:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9d4b3 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.167495:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9d4b3 lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.167507:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938445.167511:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938445.167515:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9d4b3 lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.167522:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9d4b3 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938445.167536:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fd154a82 reply state 0000000057671054 transno 8589934698 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9d4ba lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.167547:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9d4ba lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.167554:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x151c8ac3 (ffff9f24898ddf00) 00010000:00010000:1.0:1784938445.167556:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938445.167559:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938445.167592:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9d4ac lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643fa expref: 35 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.167606:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559a00/0x7b044d4128f9d4c1 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643fa expref: 34 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.167613:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x8:0x0].0x0 (ffff9f24898dd100) 00010000:00010000:1.0:1784938445.167615:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938445.167618:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c559a00, rc 0) 00000100:00100000:1.0:1784938445.167698:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+35:17112:x1871643337490816:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1728us (1924us total) trans 8589934698 rc 0/0 00000100:00100000:1.0:1784938445.167707:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 519 00000100:00100000:1.0:1784938445.174903:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.174993:0:25725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337490944 00000100:00100000:3.0:1784938445.175012:0:25725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337490944 00000100:00100000:3.0:1784938445.175075:0:25725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 828 00000100:00100000:3.0:1784938445.175084:0:25725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7ea6e988-18ba-4c98-b179-17995571b98b+52:10958:x1871643337490944:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938445.175104:0:25725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938445.175135:0:25725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5a6dfda/0x7b044d4128f9d4cf lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664401 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938445.175193:0:25725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x45:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938445.175212:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x45:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1784938445.175218:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x45:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938445.175228:0:25725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5a6dfda/0x7b044d4128f9d4cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664401 expref: 53 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.175245:0:25725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d5a6dfda/0x7b044d4128f9d4cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664401 expref: 53 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.175258:0:25725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf1200, rc 0) 00000100:00100000:3.0:1784938445.175305:0:25725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7ea6e988-18ba-4c98-b179-17995571b98b+53:10958:x1871643337490944:12345-192.168.202.54@tcp:101:cp.0 Request processed in 222us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938445.175323:0:25725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 828 00000100:00100000:3.0:1784938445.178839:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.178936:0:25721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337491072 00000100:00100000:2.0:1784938445.178945:0:25721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337491072 00000100:00100000:2.0:1784938445.179015:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 829 00000100:00100000:2.0:1784938445.179028:0:25721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7ea6e988-18ba-4c98-b179-17995571b98b+53:17112:x1871643337491072:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.179046:0:25721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.179069:0:25721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9d4d6 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x45:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664408 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.179103:0:25721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5a6dfda/0x7b044d4128f9d4cf lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664401 expref: 54 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.179113:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x45:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938445.179117:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x45:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938445.179122:0:25721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9d4d6 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x45:0x0].0x0 rrc: 3 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664408 expref: 54 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.179197:0:25721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d5a6dfda/0x7b044d4128f9d4cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664401 expref: 54 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.179212:0:25721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d5a6dfda/0x7b044d4128f9d4cf lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664401 expref: 54 pid: 25725 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938445.179226:0:25721:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:25721:1871643350889344:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938445.179319:0:25721:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d3a4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938445.182381:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.182562:0:25721:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:25721:1871643350889344:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938445.182600:0:25721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9d4d6 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x45:0x0].0x0 rrc: 3 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664408 expref: 54 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.182623:0:25721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17b400, rc 0) 00000100:00100000:2.0:1784938445.182691:0:25721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7ea6e988-18ba-4c98-b179-17995571b98b+54:17112:x1871643337491072:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3667us (3861us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938445.182699:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 829 00000100:00100000:3.0:1784938445.183196:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337491200 00000100:00100000:3.0:1784938445.183204:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337491200 00010000:00010000:3.0:1784938445.183237:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d5a6dfda/0x7b044d4128f9d4cf lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664401 expref: 54 pid: 25725 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938445.183281:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 414 00000100:00100000:3.0:1784938445.183290:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+54:10958:x1871643337491200:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938445.183304:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938445.183334:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d5a6dfda/0x7b044d4128f9d4cf lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664401 expref: 54 pid: 25725 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.183347:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d5a6dfda/0x7b044d4128f9d4cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664401 expref: 54 pid: 25725 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.183374:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5a6dfda/0x7b044d4128f9d4cf lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664401 expref: 54 pid: 25725 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.183388:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x45:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938445.183392:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x45:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938445.183399:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9d4d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664408 expref: 53 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.183408:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9d4d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664408 expref: 53 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.183440:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9d4d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664408 expref: 53 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938445.183455:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388124700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:19219:1871643350889472:192.168.202.54@tcp:105: 00000100:00100000:3.0:1784938445.183524:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24867a3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938445.186796:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388124700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:19219:1871643350889472:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938445.186825:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938445.186897:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+53:10958:x1871643337491200:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3606us (4523us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938445.186909:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 414 00000100:00100000:1.0:1784938445.190353:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938445.190600:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337491456 00000100:00100000:0.0:1784938445.190613:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337491456 00000100:00100000:0.0:1784938445.190730:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 108 00000100:00100000:0.0:1784938445.190743:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+35:17112:x1871643337491456:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:0.0:1784938445.191213:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+36:17112:x1871643337491456:12345-192.168.202.54@tcp:35:cp.0 Request processed in 472us (868us total) trans 8589934699 rc 0/0 00000100:00100000:0.0:1784938445.191221:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 108 00000100:00100000:3.0:1784938445.194465:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.194578:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337491584 00000100:00100000:2.0:1784938445.194587:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337491584 00000100:00100000:2.0:1784938445.194652:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 520 00000100:00100000:2.0:1784938445.194662:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+36:17112:x1871643337491584:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.194687:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.194709:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d4dd lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766440f expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.194774:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a600/0x7b044d4128f9d4e4 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.194788:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a600/0x7b044d4128f9d4e4 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.194799:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a600/0x7b044d4128f9d4e4 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.194813:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9d4eb lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x15c8a56e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.194824:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9d4eb lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.194829:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9d4eb lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.194886:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a600/0x7b044d4128f9d4e4 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.194894:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a600/0x7b044d4128f9d4e4 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.194901:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a600/0x7b044d4128f9d4e4 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.194907:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17a600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.194911:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a600/0x7b044d4128f9d4e4 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.194919:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a600/0x7b044d4128f9d4e4 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.194932:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.194935:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.194940:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a600/0x7b044d4128f9d4e4 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.194946:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a600/0x7b044d4128f9d4e4 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.194962:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9d4eb lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.194970:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9d4eb lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.194975:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9d4eb lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.194981:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17b600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.194984:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9d4eb lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.194989:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9d4eb lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.194997:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x15c8a56e (ffff9f2382049700) 00010000:00010000:2.0:1784938445.194999:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.195002:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9d4eb lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.195016:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9d4eb lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.195055:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d4dd lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766440f expref: 37 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.195066:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.195068:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.195071:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d4dd lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766440f expref: 37 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.195085:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17a800, rc 0) 00000100:00100000:2.0:1784938445.195825:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+36:17112:x1871643337491584:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1160us (1367us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938445.195835:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 520 00000100:00100000:0.0:1784938445.198640:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.198738:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337491712 00000100:00100000:3.0:1784938445.198748:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337491712 00000100:00100000:3.0:1784938445.198845:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 521 00000100:00100000:3.0:1784938445.198855:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+36:17112:x1871643337491712:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938445.198886:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938445.198907:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d4f2 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664416 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.198970:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d4f9 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.198984:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d4f9 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.198995:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d4f9 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.199019:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d500 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x15c8a56e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.199026:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d500 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.199033:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d500 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.199071:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d4f9 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.199078:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d4f9 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.199084:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d4f9 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.199094:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d4f9 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.199100:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938445.199104:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d4f9 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.199111:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d4f9 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.199122:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938445.199475:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938445.199482:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d4f9 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.199490:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d4f9 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.199504:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d500 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.199510:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d500 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.199516:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d500 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.199521:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938445.199524:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d500 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.199534:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d500 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.199543:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x15c8a56e (ffff9f248fb8f700) 00010000:00010000:3.0:1784938445.199545:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938445.199548:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d500 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.199554:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d500 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.199585:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d4f2 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664416 expref: 37 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.199596:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938445.199598:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938445.199602:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d4f2 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664416 expref: 37 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.199610:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf1200, rc 0) 00000100:00100000:3.0:1784938445.199704:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+36:17112:x1871643337491712:12345-192.168.202.54@tcp:101:cp.0 Request processed in 850us (1072us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938445.199711:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 521 00000100:00100000:1.0:1784938445.202667:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.202763:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337491968 00000100:00100000:3.0:1784938445.202775:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337491968 00000100:00100000:3.0:1784938445.202886:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 522 00000100:00100000:3.0:1784938445.202897:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+36:17112:x1871643337491968:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938445.202924:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938445.202947:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf0600/0x7b044d4128f9d507 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766441d expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.203064:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1800/0x7b044d4128f9d50e lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.203078:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1800/0x7b044d4128f9d50e lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.203089:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1800/0x7b044d4128f9d50e lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.203105:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27c000/0x7b044d4128f9d515 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x15c8a56e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.203112:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27c000/0x7b044d4128f9d515 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.203118:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27c000/0x7b044d4128f9d515 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938445.203837:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x45:0x0], index 0: 0 00010000:00010000:3.0:1784938445.203973:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d000/0x7b044d4128f9d51c lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.203982:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d000/0x7b044d4128f9d51c lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.203990:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d000/0x7b044d4128f9d51c lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.204022:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1800/0x7b044d4128f9d50e lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.204029:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1800/0x7b044d4128f9d50e lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.204035:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1800/0x7b044d4128f9d50e lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.204041:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938445.204045:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1800/0x7b044d4128f9d50e lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.204053:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1800/0x7b044d4128f9d50e lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.204064:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938445.204067:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938445.204072:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1800/0x7b044d4128f9d50e lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.204078:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1800/0x7b044d4128f9d50e lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938445.204092:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c41f401f reply state 0000000043213a86 transno 8589934700 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27c000/0x7b044d4128f9d515 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.204103:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27c000/0x7b044d4128f9d515 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.204109:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x15c8a56e (ffff9f248fb8fd00) 00010000:00010000:3.0:1784938445.204111:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938445.204114:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938445.204160:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf0600/0x7b044d4128f9d507 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766441d expref: 39 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.204176:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d000/0x7b044d4128f9d51c lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766441d expref: 38 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.204183:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x9:0x0].0x0 (ffff9f248fb8fb00) 00010000:00010000:3.0:1784938445.204185:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938445.204187:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d27d000, rc 0) 00000100:00100000:3.0:1784938445.204261:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+39:17112:x1871643337491968:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1365us (1605us total) trans 8589934700 rc 0/0 00000100:00100000:3.0:1784938445.204269:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 522 00000100:00100000:2.0:1784938445.210399:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.210561:0:25718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337492096 00000100:00100000:3.0:1784938445.210571:0:25718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337492096 00000100:00100000:3.0:1784938445.210633:0:25718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 830 00000100:00100000:3.0:1784938445.210643:0:25718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ea6e988-18ba-4c98-b179-17995571b98b+50:10959:x1871643337492096:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938445.210661:0:25718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938445.210683:0:25718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000607bdb42/0x7b044d4128f9d52a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664424 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938445.210710:0:25718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x45:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938445.210733:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x45:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1784938445.210738:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x45:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938445.210748:0:25718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000607bdb42/0x7b044d4128f9d52a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664424 expref: 51 pid: 25718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.210772:0:25718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000607bdb42/0x7b044d4128f9d52a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664424 expref: 51 pid: 25718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.210785:0:25718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d27ca00, rc 0) 00000100:00100000:3.0:1784938445.210846:0:25718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ea6e988-18ba-4c98-b179-17995571b98b+51:10959:x1871643337492096:12345-192.168.202.54@tcp:101:cp.0 Request processed in 203us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938445.210853:0:25718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 830 00000100:00100000:1.0:1784938445.214467:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.214550:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337492224 00000100:00100000:3.0:1784938445.214563:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337492224 00000100:00100000:3.0:1784938445.214633:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 831 00000100:00100000:3.0:1784938445.214643:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+51:17112:x1871643337492224:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938445.214661:0:25715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938445.214680:0:25715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dc2a334/0x7b044d4128f9d531 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x45:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766442b expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.214713:0:25715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000607bdb42/0x7b044d4128f9d52a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664424 expref: 52 pid: 25718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.214723:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x45:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938445.214728:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x45:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938445.214733:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dc2a334/0x7b044d4128f9d531 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x45:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766442b expref: 52 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.214769:0:25715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000607bdb42/0x7b044d4128f9d52a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664424 expref: 52 pid: 25718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.214785:0:25715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000607bdb42/0x7b044d4128f9d52a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664424 expref: 52 pid: 25718 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938445.214799:0:25715:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388126d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25715:1871643350889600:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938445.214894:0:25715:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24867a3000 going to sleep for 11 seconds 00000100:00100000:3.0:1784938445.217461:0:25715:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388126d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25715:1871643350889600:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938445.217495:0:25715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000dc2a334/0x7b044d4128f9d531 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x45:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766442b expref: 52 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.217517:0:25715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d27d600, rc 0) 00000100:00100000:3.0:1784938445.217572:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+52:17112:x1871643337492224:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2931us (3120us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938445.217581:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 831 00000100:00100000:1.0:1784938445.219030:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938445.219112:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337492352 00000100:00100000:0.0:1784938445.219120:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337492352 00010000:00010000:0.0:1784938445.219202:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000607bdb42/0x7b044d4128f9d52a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664424 expref: 52 pid: 25718 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938445.219235:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 415 00000100:00100000:0.0:1784938445.219245:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d144e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+52:10959:x1871643337492352:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938445.219260:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938445.219284:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000607bdb42/0x7b044d4128f9d52a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664424 expref: 52 pid: 25718 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.219297:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000607bdb42/0x7b044d4128f9d52a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664424 expref: 52 pid: 25718 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.219335:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000607bdb42/0x7b044d4128f9d52a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664424 expref: 52 pid: 25718 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.219355:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x45:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938445.219360:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x45:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938445.219368:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000dc2a334/0x7b044d4128f9d531 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766442b expref: 51 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.219379:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dc2a334/0x7b044d4128f9d531 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766442b expref: 51 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.219414:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000dc2a334/0x7b044d4128f9d531 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766442b expref: 51 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938445.219429:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ec000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:19221:1871643350889728:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938445.219517:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238108e240 going to sleep for 11 seconds 00000100:00100000:0.0:1784938445.221835:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ec000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:19221:1871643350889728:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938445.221860:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938445.221914:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d144e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+51:10959:x1871643337492352:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 2671us (2890us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938445.221925:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 415 00000100:00100000:2.0:1784938445.224644:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.224729:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337492608 00000100:00100000:3.0:1784938445.224738:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337492608 00000100:00100000:3.0:1784938445.224798:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 109 00000100:00100000:3.0:1784938445.224809:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+39:17112:x1871643337492608:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938445.225126:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+40:17112:x1871643337492608:12345-192.168.202.54@tcp:35:cp.0 Request processed in 319us (489us total) trans 8589934701 rc 0/0 00000100:00100000:3.0:1784938445.225133:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 109 00000100:00100000:1.0:1784938445.229662:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.229770:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337492736 00000100:00100000:2.0:1784938445.229781:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337492736 00000100:00100000:2.0:1784938445.229856:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 523 00000100:00100000:2.0:1784938445.229868:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+40:17112:x1871643337492736:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.229902:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.229924:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d538 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664432 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.229987:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d53f lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.230000:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d53f lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.230018:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d53f lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.230033:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d546 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe7eb4718 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.230040:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d546 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.230050:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d546 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.230092:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d53f lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.230099:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d53f lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.230105:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d53f lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.230112:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d53f lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.230117:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a7600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.230121:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d53f lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.230347:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d53f lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.230361:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.230364:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.230369:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d53f lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.230376:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d53f lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.230401:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d546 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.230407:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d546 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.230413:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d546 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.230418:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a6000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.230421:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d546 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.230427:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d546 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.230434:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xe7eb4718 (ffff9f2382049700) 00010000:00010000:2.0:1784938445.230436:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.230439:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d546 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.230445:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d546 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.230479:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d538 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664432 expref: 41 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.230490:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.230492:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.230495:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d538 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664432 expref: 41 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.230510:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a7a00, rc 0) 00000100:00100000:2.0:1784938445.230584:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+40:17112:x1871643337492736:12345-192.168.202.54@tcp:101:cp.0 Request processed in 719us (933us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938445.230594:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 523 00000100:00100000:1.0:1784938445.235958:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.236046:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337492864 00000100:00100000:2.0:1784938445.236055:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337492864 00000100:00100000:2.0:1784938445.236115:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 524 00000100:00100000:2.0:1784938445.236135:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+40:17112:x1871643337492864:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.236200:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.236220:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d54d lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664439 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.236289:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d554 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.236304:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d554 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.236325:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d554 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.236338:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d55b lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe7eb4718 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.236346:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d55b lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.236352:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d55b lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.236391:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d554 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.236398:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d554 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.236404:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d554 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.236410:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a6000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.236414:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d554 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.236420:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d554 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.236432:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.236435:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.236439:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d554 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.236445:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d554 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.236456:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d55b lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.236462:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d55b lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.236467:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d55b lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.236473:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a7600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.236476:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d55b lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.236482:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d55b lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.236489:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xe7eb4718 (ffff9f2382049700) 00010000:00010000:2.0:1784938445.236492:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.236494:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d55b lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.236500:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d55b lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.236531:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d54d lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664439 expref: 41 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.236542:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.236544:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.236548:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d54d lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664439 expref: 41 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.236557:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a7a00, rc 0) 00000100:00100000:2.0:1784938445.236620:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+40:17112:x1871643337492864:12345-192.168.202.54@tcp:101:cp.0 Request processed in 496us (672us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938445.236628:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 524 00000100:00100000:1.0:1784938445.244632:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.244728:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337493120 00000100:00100000:3.0:1784938445.244738:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337493120 00000100:00100000:3.0:1784938445.244803:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 525 00000100:00100000:3.0:1784938445.244814:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+40:17112:x1871643337493120:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938445.244836:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938445.244860:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d562 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664440 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.244970:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d569 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.244986:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d569 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.244998:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d569 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.245025:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf0600/0x7b044d4128f9d570 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0xe7eb4718 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.245032:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf0600/0x7b044d4128f9d570 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.245038:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf0600/0x7b044d4128f9d570 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938445.245420:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x46:0x0], index 1: 0 00010000:00010000:3.0:1784938445.245550:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1800/0x7b044d4128f9d577 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.245560:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1800/0x7b044d4128f9d577 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.245568:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1800/0x7b044d4128f9d577 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.245597:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d569 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.245604:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d569 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.245610:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d569 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.245616:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d569 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.245622:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27ca00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938445.245626:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d569 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.245634:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d569 lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.245647:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938445.245649:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938445.245653:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d569 lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.245660:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d569 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938445.245672:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000019258de9 reply state 00000000cbdbc28d transno 8589934702 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf0600/0x7b044d4128f9d570 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.245681:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf0600/0x7b044d4128f9d570 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.245688:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xe7eb4718 (ffff9f248fb8f700) 00010000:00010000:3.0:1784938445.245690:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938445.245693:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938445.245717:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d562 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664440 expref: 43 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.245729:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1800/0x7b044d4128f9d577 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664440 expref: 42 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.245737:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0xa:0x0].0x0 (ffff9f238dcb3400) 00010000:00010000:3.0:1784938445.245739:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938445.245741:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf1800, rc 0) 00000100:00100000:3.0:1784938445.245805:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+43:17112:x1871643337493120:12345-192.168.202.54@tcp:101:cp.0 Request processed in 993us (1184us total) trans 8589934702 rc 0/0 00000100:00100000:3.0:1784938445.245812:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 525 00000100:00100000:1.0:1784938445.254670:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938445.254785:0:21152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337493248 00000100:00100000:0.0:1784938445.254795:0:21152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337493248 00000100:00100000:0.0:1784938445.254852:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 832 00000100:00100000:0.0:1784938445.254862:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23880a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+53:10957:x1871643337493248:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938445.254890:0:21152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938445.254913:0:21152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a59b7f1/0x7b044d4128f9d585 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664447 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938445.254938:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x46:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938445.254960:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x46:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1784938445.254965:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x46:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938445.254975:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a59b7f1/0x7b044d4128f9d585 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664447 expref: 54 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.254993:0:21152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001a59b7f1/0x7b044d4128f9d585 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664447 expref: 54 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.255016:0:21152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c9f7600, rc 0) 00000100:00100000:0.0:1784938445.255077:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23880a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+54:10957:x1871643337493248:12345-192.168.202.54@tcp:101:cp.0 Request processed in 216us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938445.255084:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 832 00000100:00100000:1.0:1784938445.258601:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938445.258698:0:25729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337493376 00000100:00100000:0.0:1784938445.258707:0:25729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337493376 00000100:00100000:0.0:1784938445.258772:0:25729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 833 00000100:00100000:0.0:1784938445.258781:0:25729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23880a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7ea6e988-18ba-4c98-b179-17995571b98b+54:17112:x1871643337493376:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938445.258798:0:25729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938445.258816:0:25729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3ec11b4/0x7b044d4128f9d58c lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x46:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766444e expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.258847:0:25729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001a59b7f1/0x7b044d4128f9d585 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664447 expref: 55 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.258856:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x46:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938445.258860:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x46:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938445.258865:0:25729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3ec11b4/0x7b044d4128f9d58c lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x46:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766444e expref: 55 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.258910:0:25729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001a59b7f1/0x7b044d4128f9d585 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664447 expref: 55 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.258923:0:25729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001a59b7f1/0x7b044d4128f9d585 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664447 expref: 55 pid: 21152 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938445.258936:0:25729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:25729:1871643350889856:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938445.259785:0:25729:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238108e240 going to sleep for 11 seconds 00000100:00100000:1.0:1784938445.265765:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.266052:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337493504 00000100:00100000:3.0:1784938445.266061:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337493504 00010000:00010000:3.0:1784938445.266103:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001a59b7f1/0x7b044d4128f9d585 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664447 expref: 56 pid: 21152 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938445.266176:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 416 00000100:00100000:3.0:1784938445.266187:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24829e0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+56:10958:x1871643337493504:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938445.266202:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938445.266223:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001a59b7f1/0x7b044d4128f9d585 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664447 expref: 56 pid: 21152 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.266244:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001a59b7f1/0x7b044d4128f9d585 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664447 expref: 56 pid: 21152 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.266267:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x46:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938445.266271:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x46:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938445.267211:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3ec11b4/0x7b044d4128f9d58c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766444e expref: 56 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.267224:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3ec11b4/0x7b044d4128f9d58c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766444e expref: 56 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.267268:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c3ec11b4/0x7b044d4128f9d58c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766444e expref: 56 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938445.267365:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388126d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22955:1871643350889984:192.168.202.54@tcp:105: 00000100:00100000:3.0:1784938445.267458:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24867a39c0 going to sleep for 11 seconds 00010000:00010000:0.0:1784938445.269186:0:25729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a59b7f1/0x7b044d4128f9d585 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664447 expref: 56 pid: 21152 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938445.269216:0:25729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:25729:1871643350889856:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938445.269244:0:25729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c3ec11b4/0x7b044d4128f9d58c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766444e expref: 55 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.269258:0:25729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c9f6200, rc 0) 00000100:00100000:0.0:1784938445.269373:0:25729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23880a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7ea6e988-18ba-4c98-b179-17995571b98b+55:17112:x1871643337493376:12345-192.168.202.54@tcp:101:cp.0 Request processed in 10592us (10780us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938445.269390:0:25729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 833 00000100:00100000:3.0:1784938445.275056:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388126d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22955:1871643350889984:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938445.275084:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938445.275408:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24829e0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+54:10958:x1871643337493504:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 9221us (9651us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938445.275420:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 416 00000100:00100000:1.0:1784938445.275639:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938445.276685:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337493760 00000100:00100000:0.0:1784938445.276695:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337493760 00000100:00100000:0.0:1784938445.276781:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 110 00000100:00100000:0.0:1784938445.276791:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23880a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+43:17112:x1871643337493760:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:0.0:1784938445.277070:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23880a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+44:17112:x1871643337493760:12345-192.168.202.54@tcp:35:cp.0 Request processed in 281us (1431us total) trans 8589934703 rc 0/0 00000100:00100000:0.0:1784938445.277078:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 110 00000100:00100000:2.0:1784938445.285471:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938445.286020:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337493888 00000100:00100000:0.0:1784938445.286030:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337493888 00000100:00100000:0.0:1784938445.286092:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 526 00000100:00100000:0.0:1784938445.286102:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+44:17112:x1871643337493888:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938445.286129:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938445.286186:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d593 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664455 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.286255:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d59a lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.286270:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d59a lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.286456:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d59a lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.286537:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558400/0x7b044d4128f9d5a1 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x48840fb6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.286551:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558400/0x7b044d4128f9d5a1 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.286559:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558400/0x7b044d4128f9d5a1 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.286595:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d59a lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.286602:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d59a lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.286609:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d59a lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.286615:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938445.286619:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d59a lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.286628:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d59a lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.286638:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938445.286642:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938445.286646:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d59a lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.286652:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d59a lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.286665:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558400/0x7b044d4128f9d5a1 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.286672:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558400/0x7b044d4128f9d5a1 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.286677:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558400/0x7b044d4128f9d5a1 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.286682:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c558400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938445.286685:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558400/0x7b044d4128f9d5a1 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.286691:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558400/0x7b044d4128f9d5a1 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.286698:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x48840fb6 (ffff9f24898ddb00) 00010000:00010000:1.0:1784938445.286701:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938445.286704:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558400/0x7b044d4128f9d5a1 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.286709:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558400/0x7b044d4128f9d5a1 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.286743:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d593 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664455 expref: 45 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.286754:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938445.286756:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938445.286760:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d593 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664455 expref: 45 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.286775:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c9f7600, rc 0) 00000100:00100000:1.0:1784938445.286838:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+44:17112:x1871643337493888:12345-192.168.202.54@tcp:101:cp.0 Request processed in 737us (1378us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938445.286846:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 526 00000100:00100000:1.0:1784938445.294692:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.294807:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337494016 00000100:00100000:3.0:1784938445.294818:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337494016 00000100:00100000:3.0:1784938445.295030:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 527 00000100:00100000:3.0:1784938445.295042:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23880a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+44:17112:x1871643337494016:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938445.295062:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938445.295082:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d5a8 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766445c expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.295407:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d5af lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.295423:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d5af lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.295435:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d5af lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.295451:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d5b6 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x48840fb6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.295458:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d5b6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.295465:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d5b6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.295506:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d5af lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.295513:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d5af lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.295520:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d5af lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.295529:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d5af lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.295535:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938445.295540:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d5af lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.295547:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d5af lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.295557:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938445.295561:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938445.295565:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d5af lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.295571:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d5af lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.295585:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d5b6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.295591:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d5b6 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.295596:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d5b6 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.295601:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938445.295604:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d5b6 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.295614:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d5b6 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.295621:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x48840fb6 (ffff9f238dcb3f00) 00010000:00010000:3.0:1784938445.295624:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938445.295627:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d5b6 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.295632:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d5b6 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.295665:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d5a8 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766445c expref: 45 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.295675:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938445.295677:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938445.295681:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d5a8 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766445c expref: 45 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.295691:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf1200, rc 0) 00000100:00100000:3.0:1784938445.295853:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23880a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+44:17112:x1871643337494016:12345-192.168.202.54@tcp:101:cp.0 Request processed in 812us (1170us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938445.295860:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 527 00000100:00100000:0.0:1784938445.299608:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938445.299698:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337494272 00000100:00100000:1.0:1784938445.299707:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337494272 00000100:00100000:1.0:1784938445.299794:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 528 00000100:00100000:1.0:1784938445.299804:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+44:17112:x1871643337494272:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938445.299826:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938445.299846:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559800/0x7b044d4128f9d5bd lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664463 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.299959:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9d5c4 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.299974:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9d5c4 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.299986:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9d5c4 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.300114:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9d5cb lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x48840fb6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.300124:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9d5cb lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.300170:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9d5cb lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938445.300578:0:24203:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x46:0x0], index 0: 0 00010000:00010000:1.0:1784938445.300716:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558400/0x7b044d4128f9d5d2 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.300726:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558400/0x7b044d4128f9d5d2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.300734:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558400/0x7b044d4128f9d5d2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.300764:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9d5c4 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.300772:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9d5c4 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.300779:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9d5c4 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.300785:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c559000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938445.300789:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9d5c4 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.300795:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9d5c4 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.300806:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938445.300810:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938445.300814:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9d5c4 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.300821:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9d5c4 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938445.300834:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000539043da reply state 000000001afe93b6 transno 8589934704 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9d5cb lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.300844:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9d5cb lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.300851:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x48840fb6 (ffff9f24898ddb00) 00010000:00010000:1.0:1784938445.300853:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938445.300855:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938445.300960:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559800/0x7b044d4128f9d5bd lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664463 expref: 47 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.300976:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558400/0x7b044d4128f9d5d2 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664463 expref: 46 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.300983:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0xb:0x0].0x0 (ffff9f24898dde00) 00010000:00010000:1.0:1784938445.300985:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938445.300988:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c558400, rc 0) 00000100:00100000:1.0:1784938445.301114:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+47:17112:x1871643337494272:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1311us (1514us total) trans 8589934704 rc 0/0 00000100:00100000:1.0:1784938445.301122:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 528 00000100:00100000:2.0:1784938445.304942:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.305125:0:25719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337494400 00000100:00100000:3.0:1784938445.305136:0:25719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337494400 00000100:00100000:2.0:1784938445.305683:0:25719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 834 00000100:00100000:2.0:1784938445.305706:0:25719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7ea6e988-18ba-4c98-b179-17995571b98b+51:10960:x1871643337494400:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.305724:0:25719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.305749:0:25719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003d010a8/0x7b044d4128f9d5e0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766446a expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938445.305775:0:25719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x46:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938445.305795:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46:0x0].0x0 since=711s v=(0 0) 00010000:00010000:2.0:1784938445.305801:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938445.305809:0:25719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003d010a8/0x7b044d4128f9d5e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766446a expref: 52 pid: 25719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.305826:0:25719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000003d010a8/0x7b044d4128f9d5e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766446a expref: 52 pid: 25719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.305839:0:25719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a7600, rc 0) 00000100:00100000:2.0:1784938445.305910:0:25719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7ea6e988-18ba-4c98-b179-17995571b98b+52:10960:x1871643337494400:12345-192.168.202.54@tcp:101:cp.0 Request processed in 217us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938445.305916:0:25719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 834 00000100:00100000:2.0:1784938445.313227:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938445.313389:0:25723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337494528 00000100:00100000:1.0:1784938445.313402:0:25723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337494528 00000100:00100000:1.0:1784938445.313464:0:25723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 835 00000100:00100000:1.0:1784938445.313473:0:25723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7ea6e988-18ba-4c98-b179-17995571b98b+52:17112:x1871643337494528:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938445.313491:0:25723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938445.313509:0:25723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003889d17a/0x7b044d4128f9d5e7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x46:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664471 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.313539:0:25723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000003d010a8/0x7b044d4128f9d5e0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766446a expref: 53 pid: 25719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.313548:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938445.313553:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938445.313558:0:25723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003889d17a/0x7b044d4128f9d5e7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x46:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664471 expref: 53 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.313588:0:25723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000003d010a8/0x7b044d4128f9d5e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e94766446a expref: 53 pid: 25719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.313601:0:25723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000003d010a8/0x7b044d4128f9d5e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766446a expref: 53 pid: 25719 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938445.313614:0:25723:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23880a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:25723:1871643350890112:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938445.313689:0:25723:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbe780 going to sleep for 11 seconds 00000100:00100000:1.0:1784938445.316140:0:25723:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23880a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:25723:1871643350890112:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938445.316211:0:25723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003889d17a/0x7b044d4128f9d5e7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x46:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664471 expref: 53 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.316231:0:25723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c559800, rc 0) 00000100:00100000:1.0:1784938445.316398:0:25723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7ea6e988-18ba-4c98-b179-17995571b98b+53:17112:x1871643337494528:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2924us (3180us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938445.316407:0:25723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 835 00000100:00100000:2.0:1784938445.318883:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938445.319841:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337494656 00000100:00100000:0.0:1784938445.319852:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337494656 00010000:00010000:0.0:1784938445.319958:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000003d010a8/0x7b044d4128f9d5e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766446a expref: 53 pid: 25719 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938445.320066:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 417 00000100:00100000:0.0:1784938445.320076:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+53:10960:x1871643337494656:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938445.320092:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938445.320115:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000003d010a8/0x7b044d4128f9d5e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766446a expref: 53 pid: 25719 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.320253:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000003d010a8/0x7b044d4128f9d5e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766446a expref: 53 pid: 25719 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.320288:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003d010a8/0x7b044d4128f9d5e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766446a expref: 53 pid: 25719 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.320314:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938445.320319:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938445.320330:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003889d17a/0x7b044d4128f9d5e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664471 expref: 52 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.320339:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003889d17a/0x7b044d4128f9d5e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664471 expref: 52 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.320381:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003889d17a/0x7b044d4128f9d5e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664471 expref: 52 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938445.320396:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350890240:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938445.320482:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238108ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938445.324818:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938445.325122:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350890240:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938445.325177:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938445.325238:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+52:10960:x1871643337494656:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 5163us (6372us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938445.325250:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 417 00000100:00100000:3.0:1784938445.326396:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337494912 00000100:00100000:3.0:1784938445.326406:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337494912 00000100:00100000:2.0:1784938445.326603:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 111 00000100:00100000:2.0:1784938445.326613:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24857fc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+47:17112:x1871643337494912:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:2.0:1784938445.327098:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24857fc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+48:17112:x1871643337494912:12345-192.168.202.54@tcp:35:cp.0 Request processed in 485us (2290us total) trans 8589934705 rc 0/0 00000100:00100000:2.0:1784938445.327106:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 111 00000100:00100000:0.0:1784938445.330784:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938445.331079:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337495040 00000100:00100000:1.0:1784938445.331089:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337495040 00000100:00100000:1.0:1784938445.331408:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 529 00000100:00100000:1.0:1784938445.331420:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+48:17112:x1871643337495040:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938445.331444:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938445.331464:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9d5ee lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664478 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.331524:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d5f5 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.331538:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d5f5 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.331549:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d5f5 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.331563:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d5fc lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x48e4a31f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.331570:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d5fc lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.331576:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d5fc lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.331616:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d5f5 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.331624:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d5f5 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.331630:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d5f5 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.331636:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d5f5 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.331642:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f7600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938445.331646:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d5f5 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.331654:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d5f5 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.331665:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938445.331668:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938445.331673:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d5f5 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.331679:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d5f5 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.331692:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d5fc lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.331697:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d5fc lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.331702:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d5fc lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.331707:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938445.331709:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d5fc lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.331714:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d5fc lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.331721:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x48e4a31f (ffff9f24898dd200) 00010000:00010000:1.0:1784938445.331723:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938445.331726:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d5fc lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.331731:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35200/0x7b044d4128f9d5fc lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.331762:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9d5ee lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664478 expref: 49 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.331771:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938445.331774:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938445.331777:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9d5ee lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664478 expref: 49 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.331787:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c559000, rc 0) 00000100:00100000:1.0:1784938445.331837:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+48:17112:x1871643337495040:12345-192.168.202.54@tcp:101:cp.0 Request processed in 420us (1063us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938445.331844:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 529 00000100:00100000:2.0:1784938445.335098:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.335531:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337495168 00000100:00100000:3.0:1784938445.335541:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337495168 00000100:00100000:3.0:1784938445.335631:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 530 00000100:00100000:3.0:1784938445.337221:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+48:17112:x1871643337495168:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938445.337250:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938445.337476:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d603 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766447f expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.337552:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d60a lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.337568:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d60a lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.337580:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d60a lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.337597:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d611 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x48e4a31f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.337604:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d611 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.337610:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d611 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.337648:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d60a lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.337656:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d60a lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.337662:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d60a lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.337667:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27ca00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938445.337672:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d60a lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.337679:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d60a lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.337690:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938445.337693:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938445.337697:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d60a lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.337703:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d60a lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.337716:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d611 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.337722:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d611 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.337727:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d611 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.337731:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938445.337734:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d611 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.337740:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d611 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.337750:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x48e4a31f (ffff9f238dcb3f00) 00010000:00010000:3.0:1784938445.337752:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938445.337754:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d611 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.337759:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d611 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.337790:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d603 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766447f expref: 49 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.337800:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938445.337802:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938445.337805:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d603 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766447f expref: 49 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.337815:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d27dc00, rc 0) 00000100:00100000:3.0:1784938445.337967:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+48:17112:x1871643337495168:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2326us (2879us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938445.337975:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 530 00000100:00100000:1.0:1784938445.342945:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.343387:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337495424 00000100:00100000:3.0:1784938445.343399:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337495424 00000100:00100000:3.0:1784938445.343494:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 531 00000100:00100000:3.0:1784938445.343504:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23880a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+48:17112:x1871643337495424:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938445.343527:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938445.343547:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d618 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664486 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.343657:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d61f lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.343671:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d61f lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.343681:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d61f lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.343697:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245c00/0x7b044d4128f9d626 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x48e4a31f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.343704:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245c00/0x7b044d4128f9d626 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.343712:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245c00/0x7b044d4128f9d626 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938445.344034:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x47:0x0], index 1: 0 00010000:00010000:3.0:1784938445.344219:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245000/0x7b044d4128f9d62d lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.344230:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245000/0x7b044d4128f9d62d lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.344237:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245000/0x7b044d4128f9d62d lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.344269:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d61f lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.344361:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d61f lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.344367:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d61f lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.344374:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d61f lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.344380:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938445.344385:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d61f lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.344397:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d61f lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.344411:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938445.344414:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938445.344418:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d61f lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.344424:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d61f lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938445.344439:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cf3fa7a2 reply state 0000000054609922 transno 8589934706 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245c00/0x7b044d4128f9d626 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.344451:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245c00/0x7b044d4128f9d626 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.344457:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x48e4a31f (ffff9f238dcb3a00) 00010000:00010000:3.0:1784938445.344460:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938445.344463:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938445.344491:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d618 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664486 expref: 51 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.344506:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245000/0x7b044d4128f9d62d lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664486 expref: 50 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.344513:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0xc:0x0].0x0 (ffff9f238dcb3b00) 00010000:00010000:3.0:1784938445.344515:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938445.344517:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f245000, rc 0) 00000100:00100000:3.0:1784938445.344585:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23880a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+51:17112:x1871643337495424:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1083us (1650us total) trans 8589934706 rc 0/0 00000100:00100000:3.0:1784938445.344593:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 531 00000100:00100000:0.0:1784938445.349225:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.349492:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337495552 00000100:00100000:3.0:1784938445.349503:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337495552 00000100:00100000:3.0:1784938445.349560:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 836 00000100:00100000:3.0:1784938445.349570:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+54:10957:x1871643337495552:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938445.349590:0:25716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938445.349609:0:25716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae3830fe/0x7b044d4128f9d63b lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766448d expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938445.349634:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x47:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938445.349655:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x47:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1784938445.349660:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x47:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938445.349669:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae3830fe/0x7b044d4128f9d63b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766448d expref: 55 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.349691:0:25716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ae3830fe/0x7b044d4128f9d63b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766448d expref: 55 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.349704:0:25716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f245600, rc 0) 00000100:00100000:3.0:1784938445.349837:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+55:10957:x1871643337495552:12345-192.168.202.54@tcp:101:cp.0 Request processed in 267us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938445.349845:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 836 00000100:00100000:0.0:1784938445.352680:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938445.352777:0:25726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337495680 00000100:00100000:1.0:1784938445.352786:0:25726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337495680 00000100:00100000:1.0:1784938445.352869:0:25726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 837 00000100:00100000:1.0:1784938445.352888:0:25726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7ea6e988-18ba-4c98-b179-17995571b98b+55:17112:x1871643337495680:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938445.352905:0:25726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938445.352923:0:25726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077eceeb9/0x7b044d4128f9d642 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x47:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664494 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.352952:0:25726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae3830fe/0x7b044d4128f9d63b lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766448d expref: 56 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.352961:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x47:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938445.352964:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x47:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938445.352969:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077eceeb9/0x7b044d4128f9d642 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x47:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664494 expref: 56 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.353010:0:25726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ae3830fe/0x7b044d4128f9d63b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e94766448d expref: 56 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.353025:0:25726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ae3830fe/0x7b044d4128f9d63b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766448d expref: 56 pid: 25716 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938445.353039:0:25726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23880a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:25726:1871643350890368:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938445.353119:0:25726:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbea80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938445.356833:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.357088:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337495808 00000100:00100000:2.0:1784938445.357097:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337495808 00010000:00010000:2.0:1784938445.357173:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ae3830fe/0x7b044d4128f9d63b lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766448d expref: 57 pid: 25716 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938445.357217:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 418 00000100:00100000:2.0:1784938445.357228:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23880a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+57:10958:x1871643337495808:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938445.357243:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938445.357266:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ae3830fe/0x7b044d4128f9d63b lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766448d expref: 57 pid: 25716 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.357427:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ae3830fe/0x7b044d4128f9d63b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766448d expref: 57 pid: 25716 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.357458:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x47:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938445.357463:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x47:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938445.357471:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000077eceeb9/0x7b044d4128f9d642 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664494 expref: 57 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.357482:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077eceeb9/0x7b044d4128f9d642 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664494 expref: 57 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.357526:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000077eceeb9/0x7b044d4128f9d642 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664494 expref: 57 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938445.357540:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37c9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350890496:192.168.202.54@tcp:105: 00000100:00100000:2.0:1784938445.357624:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2482d95780 going to sleep for 11 seconds 00010000:00010000:0.0:1784938445.359034:0:25726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae3830fe/0x7b044d4128f9d63b lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766448d expref: 57 pid: 25716 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938445.359055:0:25726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23880a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:25726:1871643350890368:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938445.359085:0:25726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000077eceeb9/0x7b044d4128f9d642 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664494 expref: 56 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.359103:0:25726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2488b35200, rc 0) 00000100:00100000:0.0:1784938445.359211:0:25726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7ea6e988-18ba-4c98-b179-17995571b98b+56:17112:x1871643337495680:12345-192.168.202.54@tcp:101:cp.0 Request processed in 6324us (6538us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938445.359221:0:25726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 837 00000100:00100000:2.0:1784938445.362512:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37c9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350890496:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938445.362539:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938445.362596:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23880a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+55:10958:x1871643337495808:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 5369us (5770us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938445.362606:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 418 00000100:00100000:2.0:1784938445.374591:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938445.374701:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337496064 00000100:00100000:0.0:1784938445.374712:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337496064 00000100:00100000:0.0:1784938445.374773:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 112 00000100:00100000:0.0:1784938445.374783:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+51:17112:x1871643337496064:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:0.0:1784938445.375092:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+52:17112:x1871643337496064:12345-192.168.202.54@tcp:35:cp.0 Request processed in 310us (510us total) trans 8589934707 rc 0/0 00000100:00100000:0.0:1784938445.375100:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 112 00000100:00100000:1.0:1784938445.378467:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.378639:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337496192 00000100:00100000:2.0:1784938445.378648:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337496192 00000100:00100000:2.0:1784938445.378709:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 532 00000100:00100000:2.0:1784938445.378719:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23880a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+52:17112:x1871643337496192:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.378742:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.378764:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d649 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766449b expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.378835:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d650 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.378850:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d650 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.378860:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d650 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.378887:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d657 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xbf79d746 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.378894:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d657 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.378900:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d657 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.378937:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d650 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.378946:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d650 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.378951:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d650 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.378957:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a6000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.378962:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d650 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.378968:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d650 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.378979:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.378982:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.378986:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d650 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.378992:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d650 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.379013:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d657 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.379019:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d657 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.379025:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d657 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.379029:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a6400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.379031:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d657 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.379037:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d657 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.379043:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xbf79d746 (ffff9f2382049900) 00010000:00010000:2.0:1784938445.379045:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.379048:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d657 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.379052:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d657 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.379087:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d649 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766449b expref: 53 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.379097:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.379099:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.379103:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d649 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766449b expref: 53 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.379111:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a7a00, rc 0) 00000100:00100000:2.0:1784938445.379231:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23880a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+52:17112:x1871643337496192:12345-192.168.202.54@tcp:101:cp.0 Request processed in 513us (772us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938445.379239:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 532 00000100:00100000:1.0:1784938445.385909:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.386062:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337496320 00000100:00100000:2.0:1784938445.386072:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337496320 00000100:00100000:2.0:1784938445.386140:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 533 00000100:00100000:2.0:1784938445.386182:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23880a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+52:17112:x1871643337496320:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.386204:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.386229:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d65e lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476644a2 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.386323:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d665 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.386337:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d665 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.386347:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d665 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.386360:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d66c lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xbf79d746 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.386366:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d66c lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.386371:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d66c lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.386423:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d665 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.386430:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d665 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.386436:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d665 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.386443:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d665 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.386449:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a6400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.386454:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d665 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.386461:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d665 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.386473:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.386475:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.386479:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d665 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.386485:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d665 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.386498:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d66c lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.386504:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d66c lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.386510:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d66c lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.386516:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a6000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.386518:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d66c lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.386525:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d66c lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.386531:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xbf79d746 (ffff9f2382049900) 00010000:00010000:2.0:1784938445.386534:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.386536:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d66c lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.386542:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6000/0x7b044d4128f9d66c lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.386572:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d65e lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476644a2 expref: 53 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.386582:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.386584:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.386588:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d65e lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476644a2 expref: 53 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.386597:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a7a00, rc 0) 00000100:00100000:2.0:1784938445.386659:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23880a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+52:17112:x1871643337496320:12345-192.168.202.54@tcp:101:cp.0 Request processed in 480us (760us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938445.386669:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 533 00000100:00100000:1.0:1784938445.391859:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.392017:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337496576 00000100:00100000:2.0:1784938445.392028:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337496576 00000100:00100000:2.0:1784938445.392091:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 534 00000100:00100000:2.0:1784938445.392101:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23880a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+52:17112:x1871643337496576:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.392122:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.392184:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d673 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476644a9 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.392983:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d67a lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.393010:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d67a lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.393022:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d67a lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.393037:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9d681 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0xbf79d746 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.393043:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9d681 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.393049:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9d681 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938445.393585:0:24203:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x47:0x0], index 0: 0 00010000:00010000:2.0:1784938445.393716:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a600/0x7b044d4128f9d688 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.393726:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a600/0x7b044d4128f9d688 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.393734:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a600/0x7b044d4128f9d688 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.393762:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d67a lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.393768:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d67a lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.393774:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d67a lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.393779:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17a800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.393782:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d67a lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.393788:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d67a lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.393799:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.393802:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.393806:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d67a lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.393812:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d67a lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938445.393823:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d40506e7 reply state 000000008c065178 transno 8589934708 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9d681 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.393833:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9d681 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.393839:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xbf79d746 (ffff9f2382049c00) 00010000:00010000:2.0:1784938445.393841:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938445.393843:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938445.394291:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d673 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476644a9 expref: 55 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.394318:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a600/0x7b044d4128f9d688 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476644a9 expref: 54 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.394326:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0xd:0x0].0x0 (ffff9f2382049900) 00010000:00010000:2.0:1784938445.394329:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938445.394332:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17a600, rc 0) 00000100:00100000:2.0:1784938445.394413:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23880a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+55:17112:x1871643337496576:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2314us (2564us total) trans 8589934708 rc 0/0 00000100:00100000:2.0:1784938445.394421:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 534 00000100:00100000:1.0:1784938445.399298:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.399426:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337496704 00000100:00100000:2.0:1784938445.399436:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337496704 00000100:00100000:2.0:1784938445.399491:0:25720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 838 00000100:00100000:2.0:1784938445.399501:0:25720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7ea6e988-18ba-4c98-b179-17995571b98b+52:10960:x1871643337496704:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.399518:0:25720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.399541:0:25720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d73d028a/0x7b044d4128f9d696 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476644b0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938445.399566:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x47:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938445.399586:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x47:0x0].0x0 since=711s v=(0 0) 00010000:00010000:2.0:1784938445.399590:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x47:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938445.399600:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d73d028a/0x7b044d4128f9d696 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476644b0 expref: 53 pid: 25720 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.399617:0:25720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d73d028a/0x7b044d4128f9d696 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476644b0 expref: 53 pid: 25720 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.399629:0:25720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a7a00, rc 0) 00000100:00100000:2.0:1784938445.399685:0:25720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7ea6e988-18ba-4c98-b179-17995571b98b+53:10960:x1871643337496704:12345-192.168.202.54@tcp:101:cp.0 Request processed in 185us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938445.399692:0:25720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 838 00000100:00100000:1.0:1784938445.403368:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.403443:0:25721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337496832 00000100:00100000:2.0:1784938445.403452:0:25721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337496832 00000100:00100000:2.0:1784938445.403514:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 839 00000100:00100000:2.0:1784938445.403523:0:25721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7ea6e988-18ba-4c98-b179-17995571b98b+53:17112:x1871643337496832:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.403540:0:25721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.403559:0:25721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4e6532c/0x7b044d4128f9d69d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x47:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476644b7 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.403589:0:25721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d73d028a/0x7b044d4128f9d696 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476644b0 expref: 54 pid: 25720 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.403598:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x47:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938445.403602:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x47:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938445.403607:0:25721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4e6532c/0x7b044d4128f9d69d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x47:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476644b7 expref: 54 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.403644:0:25721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d73d028a/0x7b044d4128f9d696 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e9476644b0 expref: 54 pid: 25720 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.403658:0:25721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d73d028a/0x7b044d4128f9d696 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476644b0 expref: 54 pid: 25720 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938445.403672:0:25721:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37cb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:25721:1871643350890624:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938445.403756:0:25721:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b672a180 going to sleep for 11 seconds 00000100:00100000:3.0:1784938445.407279:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.407473:0:25721:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37cb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:25721:1871643350890624:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938445.407506:0:25721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c4e6532c/0x7b044d4128f9d69d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x47:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476644b7 expref: 54 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.407529:0:25721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a6000, rc 0) 00000100:00100000:2.0:1784938445.407591:0:25721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7ea6e988-18ba-4c98-b179-17995571b98b+54:17112:x1871643337496832:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4068us (4231us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938445.407600:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 839 00000100:00100000:0.0:1784938445.407699:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337496960 00000100:00100000:0.0:1784938445.407706:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337496960 00010000:00010000:0.0:1784938445.407737:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d73d028a/0x7b044d4128f9d696 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476644b0 expref: 54 pid: 25720 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938445.407764:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 419 00000100:00100000:0.0:1784938445.407772:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388127100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+54:10959:x1871643337496960:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938445.407785:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938445.407807:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d73d028a/0x7b044d4128f9d696 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476644b0 expref: 54 pid: 25720 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.407820:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d73d028a/0x7b044d4128f9d696 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476644b0 expref: 54 pid: 25720 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.407848:0:22955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d73d028a/0x7b044d4128f9d696 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476644b0 expref: 54 pid: 25720 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.407864:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x47:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938445.407879:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x47:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938445.407887:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4e6532c/0x7b044d4128f9d69d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476644b7 expref: 53 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.407898:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4e6532c/0x7b044d4128f9d69d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476644b7 expref: 53 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.407932:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c4e6532c/0x7b044d4128f9d69d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476644b7 expref: 53 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938445.407945:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0eea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350890752:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938445.407995:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238108e600 going to sleep for 11 seconds 00000100:00100000:0.0:1784938445.411205:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0eea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350890752:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938445.411232:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938445.411294:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388127100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+53:10959:x1871643337496960:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3521us (4032us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938445.411314:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 419 00000100:00100000:1.0:1784938445.414503:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.414583:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337497216 00000100:00100000:2.0:1784938445.414593:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337497216 00000100:00100000:2.0:1784938445.414656:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 113 00000100:00100000:2.0:1784938445.414666:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+55:17112:x1871643337497216:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:2.0:1784938445.414970:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+56:17112:x1871643337497216:12345-192.168.202.54@tcp:35:cp.0 Request processed in 304us (478us total) trans 8589934709 rc 0/0 00000100:00100000:2.0:1784938445.414978:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 113 00000100:00100000:3.0:1784938445.418361:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.418455:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337497344 00000100:00100000:2.0:1784938445.418465:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337497344 00000100:00100000:2.0:1784938445.418528:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 535 00000100:00100000:2.0:1784938445.418539:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+56:17112:x1871643337497344:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.418564:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.418584:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d6a4 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476644be expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.418648:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d6ab lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.418662:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d6ab lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.418673:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d6ab lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.418688:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d6b2 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xb34b709f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.418694:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d6b2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.418700:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d6b2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.418744:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d6ab lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.418751:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d6ab lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.418762:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d6ab lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.418769:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d6ab lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.418776:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a6400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.418780:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d6ab lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.418788:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d6ab lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.418801:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.418834:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.418840:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d6ab lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.418846:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9d6ab lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.418860:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d6b2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.418866:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d6b2 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.418881:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d6b2 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.418887:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a7a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.418890:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d6b2 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.418896:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d6b2 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.418903:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xb34b709f (ffff9f2382049100) 00010000:00010000:2.0:1784938445.418905:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.418908:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d6b2 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.418913:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9d6b2 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.418942:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d6a4 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476644be expref: 57 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.418951:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.418953:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.418957:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9d6a4 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476644be expref: 57 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.418965:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a7600, rc 0) 00000100:00100000:2.0:1784938445.419024:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+56:17112:x1871643337497344:12345-192.168.202.54@tcp:101:cp.0 Request processed in 487us (671us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938445.419034:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 535 00000100:00100000:1.0:1784938445.421855:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.422026:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337497472 00000100:00100000:2.0:1784938445.422035:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337497472 00000100:00100000:2.0:1784938445.422091:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 536 00000100:00100000:2.0:1784938445.422100:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+56:17112:x1871643337497472:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.422120:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.422163:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d6b9 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476644c5 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.422234:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d6c0 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.422248:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d6c0 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.422259:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d6c0 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.422577:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d6c7 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xb34b709f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.422586:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d6c7 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.422594:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d6c7 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.422630:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d6c0 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.422637:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d6c0 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.422643:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d6c0 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.422648:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3f000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.422653:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d6c0 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.422661:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d6c0 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.422672:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.422676:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.422679:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d6c0 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.422686:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d6c0 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.422698:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d6c7 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.422704:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d6c7 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.422710:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d6c7 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.422714:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3ec00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.422717:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d6c7 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.422722:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d6c7 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.422728:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xb34b709f (ffff9f2382049a00) 00010000:00010000:2.0:1784938445.422731:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.422734:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d6c7 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.422739:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d6c7 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.422772:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d6b9 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476644c5 expref: 57 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.422782:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.422785:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.422788:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9d6b9 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476644c5 expref: 57 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.422798:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17a800, rc 0) 00000100:00100000:2.0:1784938445.422913:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+56:17112:x1871643337497472:12345-192.168.202.54@tcp:101:cp.0 Request processed in 812us (1066us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938445.422920:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 536 00000100:00100000:1.0:1784938445.428103:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.428215:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337497728 00000100:00100000:2.0:1784938445.428226:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337497728 00000100:00100000:2.0:1784938445.428295:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 537 00000100:00100000:2.0:1784938445.428313:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+56:17112:x1871643337497728:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.428336:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.428357:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ee00/0x7b044d4128f9d6ce lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476644cc expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.428486:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9d6d5 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.428504:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9d6d5 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.428516:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9d6d5 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.428531:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f9d6dc lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0xb34b709f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.428537:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f9d6dc lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.428543:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f9d6dc lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938445.428857:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x48:0x0], index 1: 0 00010000:00010000:2.0:1784938445.428995:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f800/0x7b044d4128f9d6e3 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.429004:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f800/0x7b044d4128f9d6e3 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.429012:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f800/0x7b044d4128f9d6e3 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.429045:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9d6d5 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.429052:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9d6d5 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.429059:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9d6d5 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.429065:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9d6d5 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.429071:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3ea00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.429075:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9d6d5 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.429082:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9d6d5 lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.429094:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.429097:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.429101:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9d6d5 lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.429108:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9d6d5 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938445.429121:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000823cb25f reply state 00000000b367534c transno 8589934710 ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f9d6dc lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.429132:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f9d6dc lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.429138:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xb34b709f (ffff9f2382049100) 00010000:00010000:2.0:1784938445.429140:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938445.429170:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938445.429199:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ee00/0x7b044d4128f9d6ce lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476644cc expref: 59 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.429214:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f800/0x7b044d4128f9d6e3 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476644cc expref: 58 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.429223:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0xe:0x0].0x0 (ffff9f2382048f00) 00010000:00010000:2.0:1784938445.429225:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938445.429227:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3f800, rc 0) 00000100:00100000:2.0:1784938445.429296:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+59:17112:x1871643337497728:12345-192.168.202.54@tcp:101:cp.0 Request processed in 992us (1206us total) trans 8589934710 rc 0/0 00000100:00100000:2.0:1784938445.429315:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 537 00000100:00100000:2.0:1784938445.433922:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.434051:0:25724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337497856 00000100:00100000:3.0:1784938445.434060:0:25724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337497856 00000100:00100000:3.0:1784938445.434121:0:25724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 840 00000100:00100000:3.0:1784938445.434141:0:25724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7ea6e988-18ba-4c98-b179-17995571b98b+55:10957:x1871643337497856:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938445.434182:0:25724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938445.434204:0:25724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9d6f1 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476644d3 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938445.434231:0:25724:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x48:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938445.434251:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x48:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1784938445.434256:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x48:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938445.434266:0:25724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9d6f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476644d3 expref: 56 pid: 25724 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.434295:0:25724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9d6f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476644d3 expref: 56 pid: 25724 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.434315:0:25724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f244a00, rc 0) 00000100:00100000:3.0:1784938445.434374:0:25724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7ea6e988-18ba-4c98-b179-17995571b98b+56:10957:x1871643337497856:12345-192.168.202.54@tcp:101:cp.0 Request processed in 237us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938445.434381:0:25724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 840 00000100:00100000:1.0:1784938445.440914:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.441044:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337497984 00000100:00100000:3.0:1784938445.441053:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337497984 00000100:00100000:3.0:1784938445.441113:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 841 00000100:00100000:3.0:1784938445.441123:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+56:17112:x1871643337497984:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938445.441180:0:25715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938445.441199:0:25715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c1f297b/0x7b044d4128f9d6f8 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x48:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476644da expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.441231:0:25715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9d6f1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476644d3 expref: 57 pid: 25724 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.441241:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x48:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938445.441245:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x48:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938445.441250:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c1f297b/0x7b044d4128f9d6f8 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x48:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476644da expref: 57 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.441299:0:25715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9d6f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e9476644d3 expref: 57 pid: 25724 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.441324:0:25715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9d6f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476644d3 expref: 57 pid: 25724 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938445.441342:0:25715:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388127800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25715:1871643350890880:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938445.441428:0:25715:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24867a3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938445.454260:0:25715:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388127800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25715:1871643350890880:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938445.454324:0:25715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008c1f297b/0x7b044d4128f9d6f8 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x48:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476644da expref: 57 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.454348:0:25715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f244c00, rc 0) 00000100:00100000:3.0:1784938445.454556:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+57:17112:x1871643337497984:12345-192.168.202.54@tcp:101:cp.0 Request processed in 13433us (13651us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938445.454565:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 841 00000100:00100000:1.0:1784938445.456726:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938445.457238:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337498112 00000100:00100000:0.0:1784938445.457248:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337498112 00010000:00010000:0.0:1784938445.457358:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9d6f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476644d3 expref: 57 pid: 25724 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938445.457560:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 420 00000100:00100000:0.0:1784938445.457572:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+57:10957:x1871643337498112:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938445.457590:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938445.457614:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9d6f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476644d3 expref: 57 pid: 25724 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.457629:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9d6f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476644d3 expref: 57 pid: 25724 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.457650:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064f68bad/0x7b044d4128f9d6f1 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476644d3 expref: 57 pid: 25724 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.457665:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x48:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938445.457670:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x48:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938445.457677:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008c1f297b/0x7b044d4128f9d6f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476644da expref: 56 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.457686:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c1f297b/0x7b044d4128f9d6f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476644da expref: 56 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.457724:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008c1f297b/0x7b044d4128f9d6f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476644da expref: 56 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938445.457737:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0eea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:19219:1871643350891008:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938445.457819:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238108e600 going to sleep for 11 seconds 00000100:00100000:1.0:1784938445.463089:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938445.463211:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0eea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:19219:1871643350891008:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938445.463237:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938445.463315:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+56:10957:x1871643337498112:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 5737us (6587us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938445.463327:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 420 00000100:00100000:3.0:1784938445.464071:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337498368 00000100:00100000:3.0:1784938445.464080:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337498368 00000100:00100000:3.0:1784938445.464128:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 114 00000100:00100000:3.0:1784938445.464138:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+59:17112:x1871643337498368:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938445.464748:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+60:17112:x1871643337498368:12345-192.168.202.54@tcp:35:cp.0 Request processed in 609us (1670us total) trans 8589934711 rc 0/0 00000100:00100000:3.0:1784938445.464757:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 114 00000100:00100000:1.0:1784938445.476084:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.476322:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337498496 00000100:00100000:3.0:1784938445.476332:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337498496 00000100:00100000:3.0:1784938445.476401:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 538 00000100:00100000:3.0:1784938445.476411:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+60:17112:x1871643337498496:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938445.476435:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938445.476457:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9d6ff lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476644e1 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.476534:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9d706 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.476550:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9d706 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.476561:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9d706 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.476577:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d70d lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9b815f19 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.476584:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d70d lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.476590:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d70d lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.476629:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9d706 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.476635:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9d706 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.476640:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9d706 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.476645:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938445.476649:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9d706 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.476661:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9d706 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.476674:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938445.476677:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938445.476681:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9d706 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.476688:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9d706 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.476703:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d70d lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.476709:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d70d lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.476715:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d70d lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.476720:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938445.476722:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d70d lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.476729:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d70d lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.476736:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x9b815f19 (ffff9f238dcb3700) 00010000:00010000:3.0:1784938445.476738:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938445.476741:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d70d lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.476751:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d70d lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.476784:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9d6ff lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476644e1 expref: 61 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.476794:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938445.476796:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938445.476801:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9d6ff lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476644e1 expref: 61 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.476811:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f245400, rc 0) 00000100:00100000:3.0:1784938445.476885:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+60:17112:x1871643337498496:12345-192.168.202.54@tcp:101:cp.0 Request processed in 475us (812us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938445.476893:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 538 00000100:00100000:1.0:1784938445.482245:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.482534:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337498624 00000100:00100000:2.0:1784938445.482545:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337498624 00000100:00100000:2.0:1784938445.482610:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 539 00000100:00100000:2.0:1784938445.482620:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+60:17112:x1871643337498624:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.482639:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.482658:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d714 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476644e8 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.482718:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d71b lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.482732:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d71b lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.482744:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d71b lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.482757:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d722 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9b815f19 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.482763:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d722 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.482769:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d722 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.482805:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d71b lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.482811:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d71b lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.482816:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d71b lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.482821:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d71b lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.482826:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3f000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.482829:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d71b lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.482836:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d71b lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.482846:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.482849:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.482853:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d71b lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.482859:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d71b lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.482970:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d722 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.482977:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d722 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.482982:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d722 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.482987:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3e800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.482990:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d722 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.482996:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d722 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.483015:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x9b815f19 (ffff9f2382048d00) 00010000:00010000:2.0:1784938445.483018:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.483021:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d722 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.483026:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d722 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.483061:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d714 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476644e8 expref: 61 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.483071:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.483074:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.483077:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d714 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476644e8 expref: 61 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.483091:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3ec00, rc 0) 00000100:00100000:2.0:1784938445.483411:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+60:17112:x1871643337498624:12345-192.168.202.54@tcp:101:cp.0 Request processed in 792us (1174us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938445.483420:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 539 00000100:00100000:0.0:1784938445.490229:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.490537:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337498880 00000100:00100000:3.0:1784938445.490547:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337498880 00000100:00100000:3.0:1784938445.490615:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 540 00000100:00100000:3.0:1784938445.490626:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+60:17112:x1871643337498880:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938445.490648:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938445.490672:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d729 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476644ef expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.490789:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d730 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.490808:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d730 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.490822:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d730 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.490841:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d737 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x9b815f19 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.490849:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d737 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.490856:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d737 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938445.491596:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x48:0x0], index 0: 0 00010000:00010000:3.0:1784938445.491736:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d73e lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.491748:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d73e lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.491757:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d73e lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.491791:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d730 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.491799:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d730 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.491805:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d730 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.491811:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938445.491816:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d730 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.491824:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d730 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.491836:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938445.491840:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938445.491844:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d730 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.491851:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d730 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938445.491864:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b34ab15d reply state 00000000016d3aa1 transno 8589934712 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d737 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.492209:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d737 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.492216:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x9b815f19 (ffff9f238dcb3300) 00010000:00010000:3.0:1784938445.492219:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938445.492222:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938445.492817:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d729 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476644ef expref: 63 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.492840:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d73e lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476644ef expref: 62 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.492848:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0xf:0x0].0x0 (ffff9f238dcb3e00) 00010000:00010000:2.0:1784938445.492851:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938445.492853:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d27ca00, rc 0) 00000100:00100000:2.0:1784938445.493113:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+63:17112:x1871643337498880:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2487us (2894us total) trans 8589934712 rc 0/0 00000100:00100000:2.0:1784938445.493122:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 540 00000100:00100000:0.0:1784938445.501045:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938445.501415:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337499008 00000100:00100000:1.0:1784938445.501426:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337499008 00000100:00100000:1.0:1784938445.501488:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 842 00000100:00100000:1.0:1784938445.501500:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+53:10960:x1871643337499008:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938445.501518:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938445.501540:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005979dcbb/0x7b044d4128f9d74c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476644f6 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938445.501566:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x48:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938445.501588:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x48:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1784938445.501593:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x48:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938445.501602:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005979dcbb/0x7b044d4128f9d74c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476644f6 expref: 54 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.501619:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005979dcbb/0x7b044d4128f9d74c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476644f6 expref: 54 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.501633:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c559000, rc 0) 00000100:00100000:1.0:1784938445.501694:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+54:10960:x1871643337499008:12345-192.168.202.54@tcp:101:cp.0 Request processed in 196us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938445.501701:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 842 00000100:00100000:1.0:1784938445.505092:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938445.505188:0:25729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337499136 00000100:00100000:0.0:1784938445.505198:0:25729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337499136 00000100:00100000:0.0:1784938445.505257:0:25729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 843 00000100:00100000:0.0:1784938445.505267:0:25729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7ea6e988-18ba-4c98-b179-17995571b98b+54:17112:x1871643337499136:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938445.505297:0:25729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938445.505324:0:25729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a322968/0x7b044d4128f9d753 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x48:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476644fd expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.505360:0:25729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005979dcbb/0x7b044d4128f9d74c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476644f6 expref: 55 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.505368:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x48:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938445.505372:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x48:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938445.505376:0:25729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a322968/0x7b044d4128f9d753 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x48:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476644fd expref: 55 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.505422:0:25729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005979dcbb/0x7b044d4128f9d74c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e9476644f6 expref: 55 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.505442:0:25729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005979dcbb/0x7b044d4128f9d74c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476644f6 expref: 55 pid: 21151 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938445.505456:0:25729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f180e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:25729:1871643350891136:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938445.505534:0:25729:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238108e600 going to sleep for 11 seconds 00000100:00100000:3.0:1784938445.517301:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.517481:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337499264 00000100:00100000:2.0:1784938445.517492:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337499264 00010000:00010000:2.0:1784938445.517533:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005979dcbb/0x7b044d4128f9d74c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476644f6 expref: 56 pid: 21151 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938445.517581:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 421 00000100:00100000:2.0:1784938445.517591:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388127800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+56:10959:x1871643337499264:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938445.517608:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938445.517631:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005979dcbb/0x7b044d4128f9d74c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476644f6 expref: 56 pid: 21151 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.517646:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005979dcbb/0x7b044d4128f9d74c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476644f6 expref: 56 pid: 21151 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.517673:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x48:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938445.517678:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x48:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938445.517688:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000a322968/0x7b044d4128f9d753 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476644fd expref: 56 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.517699:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a322968/0x7b044d4128f9d753 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476644fd expref: 56 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.517740:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000a322968/0x7b044d4128f9d753 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476644fd expref: 56 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938445.517755:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f2c8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:19221:1871643350891264:192.168.202.54@tcp:105: 00000100:00100000:2.0:1784938445.517845:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24985bb000 going to sleep for 11 seconds 00010000:00010000:1.0:1784938445.518584:0:25729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005979dcbb/0x7b044d4128f9d74c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476644f6 expref: 56 pid: 21151 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938445.518601:0:25729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f180e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:25729:1871643350891136:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938445.518627:0:25729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000a322968/0x7b044d4128f9d753 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476644fd expref: 55 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.518638:0:25729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d3c400, rc 0) 00000100:00100000:1.0:1784938445.518687:0:25729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7ea6e988-18ba-4c98-b179-17995571b98b+55:17112:x1871643337499136:12345-192.168.202.54@tcp:101:cp.0 Request processed in 13421us (13604us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938445.518696:0:25729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 843 00000100:00100000:3.0:1784938445.524742:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.524863:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f2c8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:19221:1871643350891264:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938445.524902:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938445.524967:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388127800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+54:10959:x1871643337499264:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 7376us (7675us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938445.524979:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 421 00000100:00100000:0.0:1784938445.525857:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337499520 00000100:00100000:0.0:1784938445.525877:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337499520 00000100:00100000:0.0:1784938445.525931:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 115 00000100:00100000:0.0:1784938445.525941:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+63:17112:x1871643337499520:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:0.0:1784938445.526577:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+64:17112:x1871643337499520:12345-192.168.202.54@tcp:35:cp.0 Request processed in 636us (1842us total) trans 8589934713 rc 0/0 00000100:00100000:0.0:1784938445.526585:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 115 00000100:00100000:3.0:1784938445.530978:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938445.531098:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337499648 00000100:00100000:1.0:1784938445.531108:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337499648 00000100:00100000:1.0:1784938445.531227:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 541 00000100:00100000:1.0:1784938445.531239:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+64:17112:x1871643337499648:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938445.531265:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938445.531478:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9d75a lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664504 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.531556:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d761 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.531570:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d761 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.531581:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d761 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.531597:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39400/0x7b044d4128f9d768 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe9fa0db8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.531604:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39400/0x7b044d4128f9d768 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.531609:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39400/0x7b044d4128f9d768 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.531646:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d761 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.531653:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d761 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.531659:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d761 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.531665:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d761 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.531670:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f7600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938445.531675:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d761 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.531682:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d761 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.531694:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938445.531697:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938445.531701:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d761 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.531708:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9d761 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.531721:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39400/0x7b044d4128f9d768 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.531727:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39400/0x7b044d4128f9d768 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.531732:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39400/0x7b044d4128f9d768 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.531736:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938445.531738:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39400/0x7b044d4128f9d768 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.531744:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39400/0x7b044d4128f9d768 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.531751:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xe9fa0db8 (ffff9f24898dda00) 00010000:00010000:1.0:1784938445.531753:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938445.531756:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39400/0x7b044d4128f9d768 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.531761:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39400/0x7b044d4128f9d768 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.531791:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9d75a lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664504 expref: 65 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.531800:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938445.531803:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938445.531806:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9d75a lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664504 expref: 65 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.531815:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c559000, rc 0) 00000100:00100000:1.0:1784938445.531930:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+64:17112:x1871643337499648:12345-192.168.202.54@tcp:101:cp.0 Request processed in 693us (961us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938445.531938:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 541 00000100:00100000:1.0:1784938445.535763:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.535859:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337499776 00000100:00100000:2.0:1784938445.535882:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337499776 00000100:00100000:2.0:1784938445.535947:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 542 00000100:00100000:2.0:1784938445.535958:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+64:17112:x1871643337499776:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.535978:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.535998:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d76f lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766450b expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.536074:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d776 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.536090:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d776 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.536101:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d776 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.536115:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d77d lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe9fa0db8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.536122:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d77d lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.536139:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d77d lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.536209:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d776 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.536216:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d776 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.536222:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d776 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.536232:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3e800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.536236:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d776 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.536244:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d776 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.536255:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.536258:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.536263:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d776 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.536280:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d776 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.536295:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d77d lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.536300:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d77d lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.536316:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d77d lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.536322:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3f000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.536325:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d77d lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.536332:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d77d lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.536344:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xe9fa0db8 (ffff9f2382048d00) 00010000:00010000:2.0:1784938445.536346:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.536349:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d77d lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.536355:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d77d lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.536388:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d76f lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766450b expref: 65 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.536399:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.536401:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.536405:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d76f lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766450b expref: 65 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.536414:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3ec00, rc 0) 00000100:00100000:2.0:1784938445.536470:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+64:17112:x1871643337499776:12345-192.168.202.54@tcp:101:cp.0 Request processed in 513us (717us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938445.536477:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 542 00000100:00100000:3.0:1784938445.544031:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.544120:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337500032 00000100:00100000:2.0:1784938445.544201:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337500032 00000100:00100000:2.0:1784938445.544261:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 543 00000100:00100000:2.0:1784938445.544281:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+64:17112:x1871643337500032:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.544302:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.544332:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d784 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664512 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.544452:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9d78b lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.544466:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9d78b lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.544477:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9d78b lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.544493:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9d792 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0xe9fa0db8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.544499:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9d792 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.544506:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9d792 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938445.544818:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x49:0x0], index 1: 0 00010000:00010000:2.0:1784938445.544956:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ee00/0x7b044d4128f9d799 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.544966:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ee00/0x7b044d4128f9d799 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.544974:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ee00/0x7b044d4128f9d799 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.545010:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9d78b lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.545022:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9d78b lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.545028:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9d78b lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.545035:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9d78b lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.545041:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3f200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.545045:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9d78b lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.545053:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9d78b lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.545066:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.545069:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.545073:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9d78b lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.545079:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9d78b lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938445.545093:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005f13f1e6 reply state 000000008a69ff73 transno 8589934714 ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9d792 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.545102:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9d792 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.545108:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xe9fa0db8 (ffff9f2382048400) 00010000:00010000:2.0:1784938445.545111:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938445.545113:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938445.545141:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d784 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664512 expref: 67 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.545188:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ee00/0x7b044d4128f9d799 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664512 expref: 66 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.545196:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x10:0x0].0x0 (ffff9f2382048b00) 00010000:00010000:2.0:1784938445.545197:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938445.545200:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3ee00, rc 0) 00000100:00100000:2.0:1784938445.545266:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+67:17112:x1871643337500032:12345-192.168.202.54@tcp:101:cp.0 Request processed in 996us (1245us total) trans 8589934714 rc 0/0 00000100:00100000:2.0:1784938445.545273:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 543 00010000:00010000:3.0:1784938445.548140:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938445.557488:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.557571:0:25719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337500160 00000100:00100000:2.0:1784938445.557583:0:25719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337500160 00000100:00100000:2.0:1784938445.557650:0:25719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 844 00000100:00100000:2.0:1784938445.557661:0:25719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7ea6e988-18ba-4c98-b179-17995571b98b+56:10957:x1871643337500160:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.557681:0:25719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.557704:0:25719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023ff2a33/0x7b044d4128f9d7a7 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664519 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938445.557728:0:25719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x49:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938445.557746:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x49:0x0].0x0 since=711s v=(0 0) 00010000:00010000:2.0:1784938445.557751:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x49:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938445.557759:0:25719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023ff2a33/0x7b044d4128f9d7a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664519 expref: 57 pid: 25719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.557782:0:25719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000023ff2a33/0x7b044d4128f9d7a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664519 expref: 57 pid: 25719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.557795:0:25719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3e600, rc 0) 00000100:00100000:2.0:1784938445.557856:0:25719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7ea6e988-18ba-4c98-b179-17995571b98b+57:10957:x1871643337500160:12345-192.168.202.54@tcp:101:cp.0 Request processed in 196us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938445.557863:0:25719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 844 00000100:00100000:0.0:1784938445.567645:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938445.567750:0:25723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337500288 00000100:00100000:1.0:1784938445.567760:0:25723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337500288 00000100:00100000:1.0:1784938445.567823:0:25723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 845 00000100:00100000:1.0:1784938445.567833:0:25723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7ea6e988-18ba-4c98-b179-17995571b98b+57:17112:x1871643337500288:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938445.567852:0:25723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938445.567879:0:25723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d109a39b/0x7b044d4128f9d7ae lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x49:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664520 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.567914:0:25723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000023ff2a33/0x7b044d4128f9d7a7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664519 expref: 58 pid: 25719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.567929:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x49:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938445.567933:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x49:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938445.567938:0:25723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d109a39b/0x7b044d4128f9d7ae lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x49:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664520 expref: 58 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.567977:0:25723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000023ff2a33/0x7b044d4128f9d7a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664519 expref: 58 pid: 25719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.567991:0:25723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000023ff2a33/0x7b044d4128f9d7a7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664519 expref: 58 pid: 25719 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938445.568013:0:25723:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b3f3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:25723:1871643350891392:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938445.568093:0:25723:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbe780 going to sleep for 11 seconds 00000100:00100000:3.0:1784938445.571762:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938445.571860:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337500416 00000100:00100000:0.0:1784938445.571869:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337500416 00010000:00010000:0.0:1784938445.571917:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000023ff2a33/0x7b044d4128f9d7a7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664519 expref: 59 pid: 25719 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938445.571960:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 422 00000100:00100000:0.0:1784938445.571970:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+59:10958:x1871643337500416:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938445.571984:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938445.572013:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000023ff2a33/0x7b044d4128f9d7a7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664519 expref: 59 pid: 25719 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.572028:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000023ff2a33/0x7b044d4128f9d7a7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664519 expref: 59 pid: 25719 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.572053:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x49:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938445.572058:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x49:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938445.572067:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d109a39b/0x7b044d4128f9d7ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664520 expref: 59 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.572078:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d109a39b/0x7b044d4128f9d7ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664520 expref: 59 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.572115:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d109a39b/0x7b044d4128f9d7ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664520 expref: 59 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938445.572140:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f180e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22955:1871643350891520:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938445.572244:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238108e6c0 going to sleep for 11 seconds 00010000:00010000:1.0:1784938445.573630:0:25723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023ff2a33/0x7b044d4128f9d7a7 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664519 expref: 59 pid: 25719 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938445.573650:0:25723:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b3f3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:25723:1871643350891392:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938445.573679:0:25723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d109a39b/0x7b044d4128f9d7ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664520 expref: 58 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.573692:0:25723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238db39400, rc 0) 00000100:00100000:1.0:1784938445.573754:0:25723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7ea6e988-18ba-4c98-b179-17995571b98b+58:17112:x1871643337500288:12345-192.168.202.54@tcp:101:cp.0 Request processed in 5922us (6119us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938445.573766:0:25723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 845 00000100:00100000:0.0:1784938445.582323:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f180e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22955:1871643350891520:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938445.582356:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938445.582486:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+57:10958:x1871643337500416:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 10516us (10732us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938445.582497:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 422 00000100:00100000:0.0:1784938445.597102:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.597236:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337500672 00000100:00100000:3.0:1784938445.597246:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337500672 00000100:00100000:3.0:1784938445.597351:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 116 00000100:00100000:3.0:1784938445.597362:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+67:17112:x1871643337500672:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938445.597667:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+68:17112:x1871643337500672:12345-192.168.202.54@tcp:35:cp.0 Request processed in 306us (574us total) trans 8589934715 rc 0/0 00000100:00100000:3.0:1784938445.597674:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 116 00000100:00100000:2.0:1784938445.603030:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938445.603187:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337500800 00000100:00100000:1.0:1784938445.603198:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337500800 00000100:00100000:1.0:1784938445.603250:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 544 00000100:00100000:1.0:1784938445.603260:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f2c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+68:17112:x1871643337500800:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938445.603295:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938445.603325:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39c00/0x7b044d4128f9d7b5 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664527 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.603410:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9d7bc lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.603425:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9d7bc lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.603436:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9d7bc lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.603451:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f9d7c3 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xc025ca7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.603458:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f9d7c3 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.603465:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f9d7c3 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.603503:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9d7bc lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.603513:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9d7bc lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.603518:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9d7bc lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.603524:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938445.603528:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9d7bc lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.603535:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9d7bc lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.603546:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938445.603549:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938445.603553:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9d7bc lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.603559:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9d7bc lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.603571:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f9d7c3 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.603575:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f9d7c3 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.603581:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f9d7c3 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.603586:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db38000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938445.603589:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f9d7c3 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.603594:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f9d7c3 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.603600:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xc025ca7 (ffff9f24898dda00) 00010000:00010000:1.0:1784938445.603602:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938445.603605:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f9d7c3 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.603610:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f9d7c3 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.603640:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39c00/0x7b044d4128f9d7b5 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664527 expref: 69 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.603650:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938445.603653:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938445.603656:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39c00/0x7b044d4128f9d7b5 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664527 expref: 69 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.603665:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238db39c00, rc 0) 00000100:00100000:1.0:1784938445.603734:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f2c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+68:17112:x1871643337500800:12345-192.168.202.54@tcp:101:cp.0 Request processed in 476us (715us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938445.603741:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 544 00000100:00100000:0.0:1784938445.607478:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.607667:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337500928 00000100:00100000:2.0:1784938445.607677:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337500928 00000100:00100000:2.0:1784938445.607742:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 545 00000100:00100000:2.0:1784938445.607753:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+68:17112:x1871643337500928:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.607774:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.607793:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d7ca lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766452e expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.607857:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f9d7d1 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.607882:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f9d7d1 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.607892:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f9d7d1 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.607906:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d7d8 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xc025ca7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.607913:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d7d8 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.607919:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d7d8 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.607956:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f9d7d1 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.607962:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f9d7d1 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.607968:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f9d7d1 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.607975:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f9d7d1 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.607981:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3fe00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.607985:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f9d7d1 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.607993:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f9d7d1 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.608012:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.608016:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.608020:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f9d7d1 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.608027:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f9d7d1 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.608041:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d7d8 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.608047:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d7d8 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.608052:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d7d8 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.608057:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3e400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.608060:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d7d8 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.608066:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d7d8 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.608074:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xc025ca7 (ffff9f2382048200) 00010000:00010000:2.0:1784938445.608076:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.608078:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d7d8 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.608084:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d7d8 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.608115:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d7ca lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766452e expref: 69 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.608732:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.608737:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.608742:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d7ca lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766452e expref: 69 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.608755:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3e800, rc 0) 00000100:00100000:2.0:1784938445.608826:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+68:17112:x1871643337500928:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1074us (1357us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938445.608835:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 545 00000100:00100000:2.0:1784938445.617687:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.618261:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337501184 00000100:00100000:3.0:1784938445.618282:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337501184 00000100:00100000:3.0:1784938445.618352:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 546 00000100:00100000:3.0:1784938445.618362:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+68:17112:x1871643337501184:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938445.618383:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938445.618403:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d7df lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664535 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.618509:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d7e6 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.618526:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d7e6 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.618538:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d7e6 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.618553:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d7ed lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0xc025ca7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.618559:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d7ed lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.618565:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d7ed lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938445.621613:0:24203:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x49:0x0], index 0: 0 00010000:00010000:2.0:1784938445.621859:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d7f4 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.621956:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d7f4 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.621969:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d7f4 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.622077:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d7e6 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.622086:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d7e6 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.622093:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d7e6 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.622098:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.622103:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d7e6 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.622110:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d7e6 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.622260:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.622264:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.622343:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d7e6 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.622351:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d7e6 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938445.622368:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bd96cba5 reply state 00000000f078ca93 transno 8589934716 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d7ed lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.622437:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d7ed lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.622446:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xc025ca7 (ffff9f238dcb3700) 00010000:00010000:2.0:1784938445.622448:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938445.622452:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938445.622499:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d7df lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664535 expref: 71 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.622516:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d7f4 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664535 expref: 70 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.622523:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x11:0x0].0x0 (ffff9f2382048000) 00010000:00010000:2.0:1784938445.622526:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938445.622528:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3f000, rc 0) 00000100:00100000:2.0:1784938445.622656:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+71:17112:x1871643337501184:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4294us (4977us total) trans 8589934716 rc 0/0 00000100:00100000:2.0:1784938445.622665:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 546 00000100:00100000:1.0:1784938445.626722:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.626794:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337501312 00000100:00100000:3.0:1784938445.626802:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337501312 00000100:00100000:3.0:1784938445.626862:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 846 00000100:00100000:3.0:1784938445.626872:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+54:10959:x1871643337501312:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938445.626903:0:25716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938445.626926:0:25716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba5ff4a4/0x7b044d4128f9d802 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766453c expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938445.626953:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x49:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938445.626976:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x49:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1784938445.626981:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x49:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938445.626990:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba5ff4a4/0x7b044d4128f9d802 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766453c expref: 55 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.627016:0:25716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ba5ff4a4/0x7b044d4128f9d802 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766453c expref: 55 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.627030:0:25716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c6000, rc 0) 00000100:00100000:3.0:1784938445.627097:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+55:10959:x1871643337501312:12345-192.168.202.54@tcp:101:cp.0 Request processed in 225us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938445.627105:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 846 00000100:00100000:0.0:1784938445.631670:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938445.631767:0:25726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337501440 00000100:00100000:1.0:1784938445.631777:0:25726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337501440 00000100:00100000:1.0:1784938445.631858:0:25726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 847 00000100:00100000:1.0:1784938445.631869:0:25726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f228380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7ea6e988-18ba-4c98-b179-17995571b98b+55:17112:x1871643337501440:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938445.631886:0:25726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938445.631905:0:25726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067784924/0x7b044d4128f9d809 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x49:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664543 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.631936:0:25726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba5ff4a4/0x7b044d4128f9d802 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766453c expref: 56 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.631945:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x49:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938445.631949:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x49:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938445.631954:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067784924/0x7b044d4128f9d809 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x49:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664543 expref: 56 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.631988:0:25726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba5ff4a4/0x7b044d4128f9d802 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e94766453c expref: 56 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.632013:0:25726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba5ff4a4/0x7b044d4128f9d802 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766453c expref: 56 pid: 25716 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938445.632030:0:25726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b3f3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:25726:1871643350891648:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938445.632179:0:25726:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbe780 going to sleep for 11 seconds 00000100:00100000:0.0:1784938445.634897:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.635022:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337501568 00000100:00100000:3.0:1784938445.635032:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337501568 00010000:00010000:3.0:1784938445.635070:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba5ff4a4/0x7b044d4128f9d802 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766453c expref: 57 pid: 25716 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938445.635122:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 423 00000100:00100000:3.0:1784938445.635140:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24829e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+57:10959:x1871643337501568:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938445.635181:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938445.635203:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba5ff4a4/0x7b044d4128f9d802 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766453c expref: 57 pid: 25716 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.635216:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba5ff4a4/0x7b044d4128f9d802 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766453c expref: 57 pid: 25716 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.635243:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x49:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938445.635247:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x49:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938445.635257:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067784924/0x7b044d4128f9d809 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664543 expref: 57 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.635267:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067784924/0x7b044d4128f9d809 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664543 expref: 57 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.635316:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000067784924/0x7b044d4128f9d809 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664543 expref: 57 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938445.635331:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd5a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350891776:192.168.202.54@tcp:105: 00000100:00100000:3.0:1784938445.635685:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24867a3000 going to sleep for 11 seconds 00000100:00100000:3.0:1784938445.637665:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd5a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350891776:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938445.637691:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938445.637743:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24829e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+57:10959:x1871643337501568:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 2605us (2854us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938445.637754:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 423 00010000:00010000:1.0:1784938445.638954:0:25726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba5ff4a4/0x7b044d4128f9d802 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766453c expref: 56 pid: 25716 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938445.638976:0:25726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b3f3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:25726:1871643350891648:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938445.639279:0:25726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067784924/0x7b044d4128f9d809 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664543 expref: 55 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.639297:0:25726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238db39c00, rc 0) 00000100:00100000:2.0:1784938445.639428:0:25726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f228380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7ea6e988-18ba-4c98-b179-17995571b98b+55:17112:x1871643337501440:12345-192.168.202.54@tcp:101:cp.0 Request processed in 7559us (7764us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938445.639437:0:25726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 847 00000100:00100000:0.0:1784938445.642342:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.642428:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337501824 00000100:00100000:2.0:1784938445.642439:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337501824 00000100:00100000:2.0:1784938445.642507:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 117 00000100:00100000:2.0:1784938445.642518:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24857fc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+71:17112:x1871643337501824:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:2.0:1784938445.642825:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24857fc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+72:17112:x1871643337501824:12345-192.168.202.54@tcp:35:cp.0 Request processed in 308us (491us total) trans 8589934717 rc 0/0 00000100:00100000:2.0:1784938445.642833:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 117 00000100:00100000:0.0:1784938445.646965:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938445.647714:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337501952 00000100:00100000:1.0:1784938445.647726:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337501952 00000100:00100000:0.0:1784938445.647974:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 547 00000100:00100000:0.0:1784938445.647987:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+72:17112:x1871643337501952:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938445.648024:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938445.648046:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9d810 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766454a expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.648118:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d800/0x7b044d4128f9d817 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.648162:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d800/0x7b044d4128f9d817 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.648175:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d800/0x7b044d4128f9d817 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.648191:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c200/0x7b044d4128f9d81e lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xecc4f14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.648198:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c200/0x7b044d4128f9d81e lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.648205:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c200/0x7b044d4128f9d81e lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.648243:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d800/0x7b044d4128f9d817 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.648250:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d800/0x7b044d4128f9d817 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.648258:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d800/0x7b044d4128f9d817 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.648265:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d800/0x7b044d4128f9d817 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.648271:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3d800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938445.648275:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d800/0x7b044d4128f9d817 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.648282:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d800/0x7b044d4128f9d817 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.648293:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938445.648297:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938445.648301:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d800/0x7b044d4128f9d817 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.648317:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d800/0x7b044d4128f9d817 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.648330:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c200/0x7b044d4128f9d81e lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.648336:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c200/0x7b044d4128f9d81e lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.648343:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c200/0x7b044d4128f9d81e lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.648347:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3c200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938445.648350:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c200/0x7b044d4128f9d81e lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.648355:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c200/0x7b044d4128f9d81e lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.648361:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xecc4f14 (ffff9f248fb6f100) 00010000:00010000:0.0:1784938445.648363:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938445.648366:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c200/0x7b044d4128f9d81e lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.648372:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c200/0x7b044d4128f9d81e lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.648405:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9d810 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766454a expref: 73 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.648415:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938445.648418:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938445.648421:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9d810 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766454a expref: 73 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.648430:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d3cc00, rc 0) 00000100:00100000:0.0:1784938445.648546:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+72:17112:x1871643337501952:12345-192.168.202.54@tcp:101:cp.0 Request processed in 561us (1589us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938445.648554:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 547 00000100:00100000:0.0:1784938445.651702:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.651791:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337502080 00000100:00100000:2.0:1784938445.651801:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337502080 00000100:00100000:2.0:1784938445.651964:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 548 00000100:00100000:2.0:1784938445.651975:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+72:17112:x1871643337502080:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.651994:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.652086:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d825 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664551 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.652210:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d82c lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.652226:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d82c lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.652237:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d82c lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.652253:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f9d833 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xecc4f14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.652262:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f9d833 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.652267:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f9d833 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.652317:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d82c lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.652324:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d82c lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.652331:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d82c lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.652337:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3e400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.652341:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d82c lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.652348:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d82c lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.652360:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.652363:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.652368:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d82c lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.652373:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d82c lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.652385:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f9d833 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.652391:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f9d833 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.652396:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f9d833 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.652401:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3fe00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.652404:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f9d833 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.652410:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f9d833 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.652416:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xecc4f14 (ffff9f2382048200) 00010000:00010000:2.0:1784938445.652418:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.652421:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f9d833 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.652428:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f9d833 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.652466:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d825 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664551 expref: 73 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.652476:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.652478:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.652481:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d825 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664551 expref: 73 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.652494:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3e800, rc 0) 00000100:00100000:2.0:1784938445.652571:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+72:17112:x1871643337502080:12345-192.168.202.54@tcp:101:cp.0 Request processed in 598us (879us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938445.652579:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 548 00000100:00100000:0.0:1784938445.658647:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.658730:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337502336 00000100:00100000:2.0:1784938445.658740:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337502336 00000100:00100000:2.0:1784938445.658819:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 549 00000100:00100000:2.0:1784938445.658829:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+72:17112:x1871643337502336:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.658849:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.658935:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d83a lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664558 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.659106:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d841 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.659122:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d841 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.659179:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d841 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.659196:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9d848 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0xecc4f14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.659203:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9d848 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.659210:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9d848 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938445.659512:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x4a:0x0], index 1: 0 00010000:00010000:2.0:1784938445.659649:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d84f lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.659659:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d84f lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.659667:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d84f lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.659699:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d841 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.659707:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d841 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.659713:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d841 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.659721:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d841 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.659727:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3e600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.659731:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d841 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.659738:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d841 lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.659749:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.659752:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.659757:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d841 lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.659763:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d841 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938445.659777:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b43ff11b reply state 00000000f3954af7 transno 8589934718 ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9d848 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.659788:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9d848 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.659794:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xecc4f14 (ffff9f2382048600) 00010000:00010000:2.0:1784938445.659797:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938445.659799:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938445.659825:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d83a lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664558 expref: 75 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.659839:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d84f lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664558 expref: 74 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.659847:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x12:0x0].0x0 (ffff9f2382048a00) 00010000:00010000:2.0:1784938445.659849:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938445.659852:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf1000, rc 0) 00000100:00100000:2.0:1784938445.660427:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+75:17112:x1871643337502336:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1596us (1787us total) trans 8589934718 rc 0/0 00000100:00100000:2.0:1784938445.660436:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 549 00000100:00100000:1.0:1784938445.664107:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.664433:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337502464 00000100:00100000:2.0:1784938445.664445:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337502464 00000100:00100000:2.0:1784938445.664758:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 848 00000100:00100000:2.0:1784938445.664769:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+57:10958:x1871643337502464:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.664788:0:25722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.664809:0:25722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5a6dfda/0x7b044d4128f9d85d lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766455f expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938445.664836:0:25722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x4a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938445.664857:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4a:0x0].0x0 since=711s v=(0 0) 00010000:00010000:2.0:1784938445.664861:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938445.664881:0:25722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5a6dfda/0x7b044d4128f9d85d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766455f expref: 58 pid: 25722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.664898:0:25722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d5a6dfda/0x7b044d4128f9d85d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766455f expref: 58 pid: 25722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.664911:0:25722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf1200, rc 0) 00000100:00100000:2.0:1784938445.664971:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+58:10958:x1871643337502464:12345-192.168.202.54@tcp:101:cp.0 Request processed in 204us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938445.664978:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 848 00000100:00100000:1.0:1784938445.667380:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.667469:0:25721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337502592 00000100:00100000:3.0:1784938445.667478:0:25721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337502592 00000100:00100000:3.0:1784938445.667535:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 849 00000100:00100000:3.0:1784938445.667545:0:25721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7ea6e988-18ba-4c98-b179-17995571b98b+58:17112:x1871643337502592:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938445.667563:0:25721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938445.667579:0:25721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061bd733a/0x7b044d4128f9d864 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664566 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.667606:0:25721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5a6dfda/0x7b044d4128f9d85d lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766455f expref: 59 pid: 25722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.667613:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938445.667617:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938445.667621:0:25721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061bd733a/0x7b044d4128f9d864 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664566 expref: 59 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.667650:0:25721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d5a6dfda/0x7b044d4128f9d85d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e94766455f expref: 59 pid: 25722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.667663:0:25721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d5a6dfda/0x7b044d4128f9d85d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766455f expref: 59 pid: 25722 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938445.667681:0:25721:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd5a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:25721:1871643350891904:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938445.667762:0:25721:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24867a33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938445.669915:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.670063:0:25721:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd5a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:25721:1871643350891904:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938445.670093:0:25721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000061bd733a/0x7b044d4128f9d864 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664566 expref: 59 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.670112:0:25721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c7a00, rc 0) 00000100:00100000:3.0:1784938445.670291:0:25721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7ea6e988-18ba-4c98-b179-17995571b98b+59:17112:x1871643337502592:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2746us (2917us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938445.670300:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 849 00000100:00100000:1.0:1784938445.670394:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337502720 00000100:00100000:1.0:1784938445.670401:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337502720 00010000:00010000:1.0:1784938445.670429:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d5a6dfda/0x7b044d4128f9d85d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766455f expref: 59 pid: 25722 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938445.670463:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 424 00000100:00100000:1.0:1784938445.670471:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f229500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+59:10957:x1871643337502720:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938445.670483:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938445.670502:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d5a6dfda/0x7b044d4128f9d85d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766455f expref: 59 pid: 25722 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.670514:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d5a6dfda/0x7b044d4128f9d85d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766455f expref: 59 pid: 25722 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.670535:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5a6dfda/0x7b044d4128f9d85d lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766455f expref: 59 pid: 25722 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.670548:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938445.670553:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938445.670561:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000061bd733a/0x7b044d4128f9d864 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664566 expref: 58 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.670571:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061bd733a/0x7b044d4128f9d864 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664566 expref: 58 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.670603:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000061bd733a/0x7b044d4128f9d864 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664566 expref: 58 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938445.670616:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b3f3c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350892032:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938445.670660:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbe780 going to sleep for 11 seconds 00000100:00100000:1.0:1784938445.673899:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.675321:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b3f3c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350892032:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938445.675348:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938445.675418:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f229500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+58:10957:x1871643337502720:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 4947us (5510us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938445.675430:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 424 00000100:00100000:0.0:1784938445.675580:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337502976 00000100:00100000:0.0:1784938445.675588:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337502976 00000100:00100000:0.0:1784938445.675635:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 118 00000100:00100000:0.0:1784938445.675644:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+75:17112:x1871643337502976:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:0.0:1784938445.676709:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+76:17112:x1871643337502976:12345-192.168.202.54@tcp:35:cp.0 Request processed in 1062us (2814us total) trans 8589934719 rc 0/0 00000100:00100000:0.0:1784938445.676719:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 118 00000100:00100000:0.0:1784938445.682543:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938445.682641:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337503104 00000100:00100000:1.0:1784938445.682652:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337503104 00000100:00100000:1.0:1784938445.682711:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 550 00000100:00100000:1.0:1784938445.682722:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+76:17112:x1871643337503104:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938445.682746:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938445.682766:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38400/0x7b044d4128f9d86b lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766456d expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.682829:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39000/0x7b044d4128f9d872 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.682843:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39000/0x7b044d4128f9d872 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.682855:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39000/0x7b044d4128f9d872 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.682868:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9d879 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x712be7d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.682886:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9d879 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.682892:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9d879 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.682927:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39000/0x7b044d4128f9d872 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.682934:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39000/0x7b044d4128f9d872 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.682940:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39000/0x7b044d4128f9d872 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.682946:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938445.682950:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39000/0x7b044d4128f9d872 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.682957:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39000/0x7b044d4128f9d872 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.682967:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938445.682971:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938445.682975:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39000/0x7b044d4128f9d872 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.682982:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39000/0x7b044d4128f9d872 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.682995:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9d879 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.683362:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9d879 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.683369:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9d879 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.683374:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938445.683377:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9d879 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.683383:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9d879 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.683393:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x712be7d1 (ffff9f24898dda00) 00010000:00010000:1.0:1784938445.683395:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938445.683398:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9d879 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.683404:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9d879 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.683440:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38400/0x7b044d4128f9d86b lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766456d expref: 77 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.683451:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938445.683453:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938445.683457:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38400/0x7b044d4128f9d86b lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766456d expref: 77 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.683466:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238db38400, rc 0) 00000100:00100000:1.0:1784938445.683524:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+76:17112:x1871643337503104:12345-192.168.202.54@tcp:101:cp.0 Request processed in 803us (991us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938445.683531:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 550 00000100:00100000:0.0:1784938445.688538:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.688640:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337503232 00000100:00100000:3.0:1784938445.688651:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337503232 00000100:00100000:3.0:1784938445.688765:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 551 00000100:00100000:3.0:1784938445.688776:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+76:17112:x1871643337503232:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938445.688797:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938445.688819:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7c00/0x7b044d4128f9d880 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664574 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.688900:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9d887 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.688914:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9d887 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.688925:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9d887 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.688939:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6c00/0x7b044d4128f9d88e lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x712be7d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.688946:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6c00/0x7b044d4128f9d88e lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.688951:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6c00/0x7b044d4128f9d88e lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.688991:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9d887 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.689476:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9d887 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.689485:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9d887 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.689491:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9d887 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.689497:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c7400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938445.689502:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9d887 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.689510:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9d887 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.689522:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938445.689525:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938445.689529:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9d887 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.689536:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9d887 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.689550:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6c00/0x7b044d4128f9d88e lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.689557:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6c00/0x7b044d4128f9d88e lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.689562:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6c00/0x7b044d4128f9d88e lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.689566:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c6c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938445.689569:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6c00/0x7b044d4128f9d88e lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.689574:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6c00/0x7b044d4128f9d88e lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.689580:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x712be7d1 (ffff9f238dcb3200) 00010000:00010000:3.0:1784938445.689582:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938445.689585:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6c00/0x7b044d4128f9d88e lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.689591:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6c00/0x7b044d4128f9d88e lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.689626:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7c00/0x7b044d4128f9d880 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664574 expref: 77 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.689635:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938445.689637:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938445.689641:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7c00/0x7b044d4128f9d880 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664574 expref: 77 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.689649:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c7c00, rc 0) 00000100:00100000:3.0:1784938445.689758:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+76:17112:x1871643337503232:12345-192.168.202.54@tcp:101:cp.0 Request processed in 985us (1231us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938445.689765:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 551 00000100:00100000:0.0:1784938445.693632:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938445.693732:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337503488 00000100:00100000:1.0:1784938445.693742:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337503488 00000100:00100000:1.0:1784938445.693806:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 552 00000100:00100000:1.0:1784938445.693816:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+76:17112:x1871643337503488:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938445.693837:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938445.693858:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38400/0x7b044d4128f9d895 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766457b expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.693971:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9d89c lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.693985:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9d89c lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.693996:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9d89c lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.694023:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39000/0x7b044d4128f9d8a3 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x712be7d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.694030:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39000/0x7b044d4128f9d8a3 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.694037:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39000/0x7b044d4128f9d8a3 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938445.694674:0:24203:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x4a:0x0], index 0: 0 00010000:00010000:0.0:1784938445.694819:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3de00/0x7b044d4128f9d8aa lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.694830:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3de00/0x7b044d4128f9d8aa lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.694839:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3de00/0x7b044d4128f9d8aa lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.694873:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9d89c lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.694880:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9d89c lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.694887:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9d89c lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.694893:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938445.694898:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9d89c lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.694907:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9d89c lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.694919:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938445.694923:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938445.694928:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9d89c lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.694934:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9d89c lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938445.694949:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000015f2b05 reply state 0000000060761a29 transno 8589934720 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39000/0x7b044d4128f9d8a3 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.694961:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39000/0x7b044d4128f9d8a3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.694968:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x712be7d1 (ffff9f24898dda00) 00010000:00010000:0.0:1784938445.694970:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938445.694973:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938445.695003:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38400/0x7b044d4128f9d895 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766457b expref: 79 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.695018:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3de00/0x7b044d4128f9d8aa lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766457b expref: 78 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.695025:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x13:0x0].0x0 (ffff9f248fb6f100) 00010000:00010000:0.0:1784938445.695027:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938445.695030:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d3de00, rc 0) 00000100:00100000:0.0:1784938445.695116:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+79:17112:x1871643337503488:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1293us (1485us total) trans 8589934720 rc 0/0 00000100:00100000:0.0:1784938445.695125:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 552 00000100:00100000:0.0:1784938445.703261:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.703431:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337503616 00000100:00100000:2.0:1784938445.703441:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337503616 00000100:00100000:2.0:1784938445.703502:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 850 00000100:00100000:2.0:1784938445.703512:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+55:10959:x1871643337503616:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.703529:0:21629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.703550:0:21629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9d8b8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664582 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938445.703574:0:21629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938445.703595:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a:0x0].0x0 since=711s v=(0 0) 00010000:00010000:2.0:1784938445.703599:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938445.703609:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9d8b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664582 expref: 56 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.703626:0:21629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9d8b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664582 expref: 56 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.703638:0:21629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf1200, rc 0) 00000100:00100000:2.0:1784938445.703691:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+56:10959:x1871643337503616:12345-192.168.202.54@tcp:101:cp.0 Request processed in 180us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938445.703698:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 850 00000100:00100000:1.0:1784938445.707776:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.708371:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337503744 00000100:00100000:3.0:1784938445.708391:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337503744 00000100:00100000:3.0:1784938445.708451:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 851 00000100:00100000:3.0:1784938445.708460:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+56:17112:x1871643337503744:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938445.708479:0:25715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938445.708497:0:25715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4ff9adf/0x7b044d4128f9d8bf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664589 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.708527:0:25715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9d8b8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664582 expref: 57 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.708541:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938445.708545:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938445.708551:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4ff9adf/0x7b044d4128f9d8bf lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664589 expref: 57 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.708583:0:25715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9d8b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664582 expref: 57 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.708595:0:25715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9d8b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664582 expref: 57 pid: 21629 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938445.708610:0:25715:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd5a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25715:1871643350892160:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938445.708687:0:25715:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24867a33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938445.712275:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938445.712433:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337503872 00000100:00100000:0.0:1784938445.712442:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337503872 00010000:00010000:0.0:1784938445.712478:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9d8b8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664582 expref: 58 pid: 21629 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938445.712521:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 425 00000100:00100000:0.0:1784938445.712530:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+58:10959:x1871643337503872:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938445.712543:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938445.712563:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9d8b8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664582 expref: 58 pid: 21629 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.712576:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9d8b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664582 expref: 58 pid: 21629 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.712601:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938445.712605:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938445.712613:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4ff9adf/0x7b044d4128f9d8bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664589 expref: 58 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.712623:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4ff9adf/0x7b044d4128f9d8bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664589 expref: 58 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.712660:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f4ff9adf/0x7b044d4128f9d8bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664589 expref: 58 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938445.712674:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350892288:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938445.712738:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238108e600 going to sleep for 11 seconds 00010000:00010000:3.0:1784938445.713290:0:25715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9d8b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664582 expref: 58 pid: 21629 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938445.713316:0:25715:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd5a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25715:1871643350892160:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938445.713340:0:25715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f4ff9adf/0x7b044d4128f9d8bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664589 expref: 57 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.713351:0:25715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c7c00, rc 0) 00000100:00100000:3.0:1784938445.713397:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+57:17112:x1871643337503744:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4937us (5627us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938445.713408:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 851 00000100:00100000:0.0:1784938445.717466:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350892288:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938445.717494:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938445.717548:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+56:10959:x1871643337503872:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 5018us (5280us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938445.717559:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 425 00000100:00100000:0.0:1784938445.722934:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.723079:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337504128 00000100:00100000:3.0:1784938445.723089:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337504128 00000100:00100000:3.0:1784938445.723194:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 119 00000100:00100000:3.0:1784938445.723204:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+79:17112:x1871643337504128:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938445.723494:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+80:17112:x1871643337504128:12345-192.168.202.54@tcp:35:cp.0 Request processed in 291us (571us total) trans 8589934721 rc 0/0 00000100:00100000:3.0:1784938445.723502:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 119 00000100:00100000:1.0:1784938445.729498:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.729600:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337504256 00000100:00100000:2.0:1784938445.729610:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337504256 00000100:00100000:2.0:1784938445.729667:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 553 00000100:00100000:2.0:1784938445.729675:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+80:17112:x1871643337504256:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.729700:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.729724:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d8c6 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664590 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.729790:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d8cd lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.729805:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d8cd lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.729815:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d8cd lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.729835:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d8d4 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x4ee593e6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.729842:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d8d4 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.729848:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d8d4 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.729898:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d8cd lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.729906:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d8cd lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.729912:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d8cd lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.729919:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d8cd lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.729926:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3ec00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.729929:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d8cd lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.729937:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d8cd lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.729950:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.729953:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.729959:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d8cd lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.729966:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d8cd lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.729981:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d8d4 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.729987:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d8d4 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.729993:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d8d4 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.730010:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3e600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.730013:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d8d4 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.730019:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d8d4 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.730026:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x4ee593e6 (ffff9f2382048c00) 00010000:00010000:2.0:1784938445.730028:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.730031:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d8d4 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.730036:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d8d4 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.730071:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d8c6 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664590 expref: 81 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.730085:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.730087:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.730091:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d8c6 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664590 expref: 81 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.730100:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf1200, rc 0) 00000100:00100000:2.0:1784938445.730600:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+80:17112:x1871643337504256:12345-192.168.202.54@tcp:101:cp.0 Request processed in 923us (1109us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938445.730609:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 553 00000100:00100000:1.0:1784938445.734689:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938445.734772:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337504384 00000100:00100000:0.0:1784938445.734782:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337504384 00000100:00100000:0.0:1784938445.734846:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 554 00000100:00100000:0.0:1784938445.734858:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+80:17112:x1871643337504384:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938445.734985:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938445.735018:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d600/0x7b044d4128f9d8db lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664597 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.735087:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9d8e2 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.735102:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9d8e2 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.735378:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9d8e2 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.735487:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9d8e9 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x4ee593e6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.735496:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9d8e9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.735503:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9d8e9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.735542:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9d8e2 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.735549:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9d8e2 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.735556:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9d8e2 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.735561:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3c600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938445.735565:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9d8e2 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.735572:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9d8e2 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.735583:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938445.735586:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938445.735591:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9d8e2 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.735597:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9d8e2 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.735610:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9d8e9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.735616:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9d8e9 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.735621:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9d8e9 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.735626:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3c800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938445.735629:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9d8e9 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.735634:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9d8e9 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.735641:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x4ee593e6 (ffff9f248fb6f700) 00010000:00010000:0.0:1784938445.735643:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938445.735646:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9d8e9 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.735652:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9d8e9 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.735681:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d600/0x7b044d4128f9d8db lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664597 expref: 81 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.735692:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938445.735694:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938445.735698:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d600/0x7b044d4128f9d8db lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664597 expref: 81 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.735706:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d3d600, rc 0) 00000100:00100000:0.0:1784938445.735767:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+80:17112:x1871643337504384:12345-192.168.202.54@tcp:101:cp.0 Request processed in 912us (1087us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938445.735775:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 554 00000100:00100000:1.0:1784938445.740413:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.740508:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337504640 00000100:00100000:2.0:1784938445.740519:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337504640 00000100:00100000:2.0:1784938445.740580:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 555 00000100:00100000:2.0:1784938445.740590:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+80:17112:x1871643337504640:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.740610:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.740630:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d8f0 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766459e expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.740729:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d8f7 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.740744:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d8f7 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.740755:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d8f7 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.740767:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d8fe lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x4ee593e6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.740774:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d8fe lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.740781:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d8fe lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938445.741103:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x4b:0x0], index 1: 0 00010000:00010000:2.0:1784938445.741290:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f9d905 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.741300:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f9d905 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.741320:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f9d905 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.741353:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d8f7 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.741361:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d8f7 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.741368:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d8f7 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.741373:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d8f7 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.741380:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3ec00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.741384:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d8f7 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.741396:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d8f7 lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.741407:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.741409:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.741413:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d8f7 lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.741418:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d8f7 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938445.741430:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000094953061 reply state 00000000b4fb9fc5 transno 8589934722 ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d8fe lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.741440:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d8fe lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.741446:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x4ee593e6 (ffff9f2382048c00) 00010000:00010000:2.0:1784938445.741448:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938445.741450:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938445.741476:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d8f0 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766459e expref: 83 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.741490:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f9d905 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766459e expref: 82 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.741497:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x14:0x0].0x0 (ffff9f2382048900) 00010000:00010000:2.0:1784938445.741499:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938445.741501:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3fe00, rc 0) 00000100:00100000:2.0:1784938445.741558:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+83:17112:x1871643337504640:12345-192.168.202.54@tcp:101:cp.0 Request processed in 969us (1155us total) trans 8589934722 rc 0/0 00000100:00100000:2.0:1784938445.741565:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 555 00000100:00100000:1.0:1784938445.745452:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.745890:0:25728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337504768 00000100:00100000:2.0:1784938445.745900:0:25728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337504768 00000100:00100000:2.0:1784938445.745950:0:25728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 852 00000100:00100000:2.0:1784938445.745960:0:25728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:7ea6e988-18ba-4c98-b179-17995571b98b+58:10957:x1871643337504768:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.745976:0:25728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.746010:0:25728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d902d1a6/0x7b044d4128f9d913 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476645a5 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938445.746035:0:25728:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x4b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938445.746055:0:25728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4b:0x0].0x0 since=711s v=(0 0) 00010000:00010000:2.0:1784938445.746060:0:25728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938445.746069:0:25728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d902d1a6/0x7b044d4128f9d913 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476645a5 expref: 59 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.746086:0:25728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d902d1a6/0x7b044d4128f9d913 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476645a5 expref: 59 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.746099:0:25728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3e400, rc 0) 00000100:00100000:2.0:1784938445.746191:0:25728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:7ea6e988-18ba-4c98-b179-17995571b98b+59:10957:x1871643337504768:12345-192.168.202.54@tcp:101:cp.0 Request processed in 232us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938445.746198:0:25728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 852 00000100:00100000:1.0:1784938445.770353:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938445.770500:0:25729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337504896 00000100:00100000:0.0:1784938445.770510:0:25729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337504896 00000100:00100000:0.0:1784938445.770575:0:25729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 853 00000100:00100000:0.0:1784938445.770585:0:25729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7ea6e988-18ba-4c98-b179-17995571b98b+59:17112:x1871643337504896:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938445.770603:0:25729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938445.770623:0:25729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024cec4ff/0x7b044d4128f9d91a lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476645ac expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.770658:0:25729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d902d1a6/0x7b044d4128f9d913 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476645a5 expref: 60 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.770668:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938445.770672:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938445.770677:0:25729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024cec4ff/0x7b044d4128f9d91a lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476645ac expref: 60 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.770714:0:25729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d902d1a6/0x7b044d4128f9d913 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e9476645a5 expref: 60 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.770727:0:25729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d902d1a6/0x7b044d4128f9d913 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476645a5 expref: 60 pid: 25728 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938445.770744:0:25729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:25729:1871643350892416:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938445.770826:0:25729:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238108e600 going to sleep for 11 seconds 00000100:00100000:3.0:1784938445.775214:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938445.775390:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337505024 00000100:00100000:1.0:1784938445.775400:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337505024 00010000:00010000:1.0:1784938445.775443:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d902d1a6/0x7b044d4128f9d913 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476645a5 expref: 61 pid: 25728 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938445.775487:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 426 00000100:00100000:1.0:1784938445.775497:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+61:10958:x1871643337505024:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938445.775510:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938445.775534:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d902d1a6/0x7b044d4128f9d913 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476645a5 expref: 61 pid: 25728 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.775546:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d902d1a6/0x7b044d4128f9d913 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476645a5 expref: 61 pid: 25728 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.775571:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938445.775576:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938445.775584:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000024cec4ff/0x7b044d4128f9d91a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476645ac expref: 61 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.775601:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024cec4ff/0x7b044d4128f9d91a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476645ac expref: 61 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.775640:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000024cec4ff/0x7b044d4128f9d91a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476645ac expref: 61 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938445.775654:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23882bf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:19219:1871643350892544:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938445.775739:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbee40 going to sleep for 11 seconds 00010000:00010000:0.0:1784938445.776098:0:25729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d902d1a6/0x7b044d4128f9d913 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476645a5 expref: 61 pid: 25728 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938445.776114:0:25729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:25729:1871643350892416:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938445.776187:0:25729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000024cec4ff/0x7b044d4128f9d91a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476645ac expref: 60 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.776199:0:25729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d3d600, rc 0) 00000100:00100000:0.0:1784938445.776245:0:25729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7ea6e988-18ba-4c98-b179-17995571b98b+60:17112:x1871643337504896:12345-192.168.202.54@tcp:101:cp.0 Request processed in 5660us (5900us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938445.776253:0:25729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 853 00000100:00100000:3.0:1784938445.779567:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938445.779859:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23882bf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:19219:1871643350892544:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938445.779895:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938445.779952:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+59:10958:x1871643337505024:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 4456us (4746us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938445.779961:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 426 00000100:00100000:2.0:1784938445.780052:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337505280 00000100:00100000:2.0:1784938445.780059:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337505280 00000100:00100000:2.0:1784938445.780105:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 120 00000100:00100000:2.0:1784938445.780114:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+83:17112:x1871643337505280:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:2.0:1784938445.780424:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+84:17112:x1871643337505280:12345-192.168.202.54@tcp:35:cp.0 Request processed in 311us (866us total) trans 8589934723 rc 0/0 00000100:00100000:2.0:1784938445.780431:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 120 00000100:00100000:2.0:1784938445.793632:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938445.793738:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337505408 00000100:00100000:0.0:1784938445.793750:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337505408 00000100:00100000:0.0:1784938445.793816:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 556 00000100:00100000:0.0:1784938445.793827:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+84:17112:x1871643337505408:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938445.793852:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938445.793887:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9d921 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476645b3 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.793954:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9d928 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.793975:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9d928 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.793986:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9d928 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.794012:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9d92f lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xf0a46efb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.794020:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9d92f lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.794026:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9d92f lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.794064:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9d928 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.794071:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9d928 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.794078:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9d928 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.794085:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3c600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938445.794089:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9d928 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.794097:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9d928 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.794109:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938445.794112:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938445.794117:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9d928 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.794123:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9d928 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.794138:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9d92f lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.794390:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9d92f lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.794400:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9d92f lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.794406:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3dc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938445.794408:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9d92f lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.794414:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9d92f lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.794423:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xf0a46efb (ffff9f248fb6f700) 00010000:00010000:0.0:1784938445.794426:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938445.794429:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9d92f lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.794434:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9d92f lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.794470:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9d921 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476645b3 expref: 85 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.794481:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938445.794484:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938445.794488:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9d921 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476645b3 expref: 85 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.794498:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d3c800, rc 0) 00000100:00100000:0.0:1784938445.794572:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+84:17112:x1871643337505408:12345-192.168.202.54@tcp:101:cp.0 Request processed in 746us (949us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938445.794579:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 556 00000100:00100000:3.0:1784938445.797575:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.797671:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337505536 00000100:00100000:2.0:1784938445.797683:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337505536 00000100:00100000:2.0:1784938445.797745:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 557 00000100:00100000:2.0:1784938445.797755:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+84:17112:x1871643337505536:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.797776:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.797799:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d936 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476645ba expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.797882:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d93d lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.797896:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d93d lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.797906:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d93d lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.797921:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d944 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xf0a46efb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.797928:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d944 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.797934:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d944 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.797971:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d93d lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.797977:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d93d lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.797983:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d93d lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.797989:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d93d lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.797995:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3ec00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.798008:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d93d lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.798016:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d93d lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.798028:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.798031:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.798036:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d93d lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.798042:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d93d lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.798056:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d944 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.798062:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d944 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.798068:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d944 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.798073:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3e600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.798075:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d944 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.798081:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d944 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.798088:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xf0a46efb (ffff9f2382049a00) 00010000:00010000:2.0:1784938445.798091:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.798094:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d944 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.798099:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d944 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.798133:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d936 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476645ba expref: 85 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.798366:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.798371:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.798376:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d936 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476645ba expref: 85 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.798386:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3e400, rc 0) 00000100:00100000:2.0:1784938445.798445:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+84:17112:x1871643337505536:12345-192.168.202.54@tcp:101:cp.0 Request processed in 691us (878us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938445.798455:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 557 00000100:00100000:3.0:1784938445.804364:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938445.805337:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337505792 00000100:00100000:0.0:1784938445.805350:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337505792 00000100:00100000:0.0:1784938445.805415:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 558 00000100:00100000:0.0:1784938445.805426:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23880a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+84:17112:x1871643337505792:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938445.805448:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938445.805472:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9d94b lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476645c1 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.805578:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9d952 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.805592:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9d952 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.805604:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9d952 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.805619:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9d959 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0xf0a46efb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.805626:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9d959 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.805632:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9d959 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938445.805938:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x4b:0x0], index 0: 0 00010000:00010000:0.0:1784938445.806430:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d800/0x7b044d4128f9d960 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.806441:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d800/0x7b044d4128f9d960 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.806451:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d800/0x7b044d4128f9d960 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.806488:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9d952 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.806495:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9d952 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.806502:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9d952 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.806509:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3dc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938445.806513:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9d952 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.806521:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9d952 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.806536:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938445.806539:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938445.806544:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9d952 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.806550:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9d952 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938445.806564:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000098b86da6 reply state 00000000f46aa485 transno 8589934724 ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9d959 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.806574:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9d959 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.806580:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xf0a46efb (ffff9f248fb6f700) 00010000:00010000:0.0:1784938445.806582:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938445.806585:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938445.806616:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9d94b lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476645c1 expref: 87 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.806631:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d800/0x7b044d4128f9d960 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476645c1 expref: 86 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.806638:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x15:0x0].0x0 (ffff9f248fb6fd00) 00010000:00010000:0.0:1784938445.806640:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938445.806642:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d3d800, rc 0) 00000100:00100000:0.0:1784938445.806720:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23880a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+87:17112:x1871643337505792:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1295us (2364us total) trans 8589934724 rc 0/0 00000100:00100000:0.0:1784938445.806729:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 558 00000100:00100000:1.0:1784938445.812827:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.812911:0:25730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337505920 00000100:00100000:2.0:1784938445.812921:0:25730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337505920 00000100:00100000:2.0:1784938445.812980:0:25730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 854 00000100:00100000:2.0:1784938445.812990:0:25730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:7ea6e988-18ba-4c98-b179-17995571b98b+56:10959:x1871643337505920:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.813024:0:25730:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.813050:0:25730:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d902d1a6/0x7b044d4128f9d96e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476645c8 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938445.813076:0:25730:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938445.813098:0:25730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b:0x0].0x0 since=711s v=(0 0) 00010000:00010000:2.0:1784938445.813102:0:25730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938445.813113:0:25730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d902d1a6/0x7b044d4128f9d96e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476645c8 expref: 57 pid: 25730 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.813132:0:25730:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d902d1a6/0x7b044d4128f9d96e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476645c8 expref: 57 pid: 25730 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.813472:0:25730:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3e400, rc 0) 00000100:00100000:2.0:1784938445.813538:0:25730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:7ea6e988-18ba-4c98-b179-17995571b98b+57:10959:x1871643337505920:12345-192.168.202.54@tcp:101:cp.0 Request processed in 549us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938445.813545:0:25730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 854 00000100:00100000:3.0:1784938445.828006:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938445.828237:0:25723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337506048 00000100:00100000:1.0:1784938445.828247:0:25723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337506048 00000100:00100000:1.0:1784938445.828318:0:25723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 855 00000100:00100000:1.0:1784938445.828328:0:25723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7ea6e988-18ba-4c98-b179-17995571b98b+57:17112:x1871643337506048:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938445.828355:0:25723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938445.828373:0:25723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1d7f9cb/0x7b044d4128f9d975 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476645cf expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.828402:0:25723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d902d1a6/0x7b044d4128f9d96e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476645c8 expref: 58 pid: 25730 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.828416:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938445.828421:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938445.828426:0:25723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d7f9cb/0x7b044d4128f9d975 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476645cf expref: 58 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.828458:0:25723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d902d1a6/0x7b044d4128f9d96e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e9476645c8 expref: 58 pid: 25730 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.828472:0:25723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d902d1a6/0x7b044d4128f9d96e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476645c8 expref: 58 pid: 25730 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938445.828485:0:25723:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23882bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:25723:1871643350892672:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938445.828570:0:25723:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbee40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938445.833239:0:25723:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23882bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:25723:1871643350892672:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938445.833277:0:25723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c1d7f9cb/0x7b044d4128f9d975 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476645cf expref: 58 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.833296:0:25723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238db38600, rc 0) 00000100:00100000:3.0:1784938445.833369:0:25723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7ea6e988-18ba-4c98-b179-17995571b98b+58:17112:x1871643337506048:12345-192.168.202.54@tcp:101:cp.0 Request processed in 5042us (5390us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938445.833378:0:25723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 855 00000100:00100000:1.0:1784938445.833766:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938445.833897:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337506176 00000100:00100000:0.0:1784938445.833904:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337506176 00010000:00010000:0.0:1784938445.833943:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d902d1a6/0x7b044d4128f9d96e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476645c8 expref: 59 pid: 25730 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938445.833986:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 427 00000100:00100000:0.0:1784938445.833997:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+59:10959:x1871643337506176:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938445.834020:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938445.834042:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d902d1a6/0x7b044d4128f9d96e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476645c8 expref: 59 pid: 25730 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.834056:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d902d1a6/0x7b044d4128f9d96e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476645c8 expref: 59 pid: 25730 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.834078:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d902d1a6/0x7b044d4128f9d96e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476645c8 expref: 59 pid: 25730 timeout: 811 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.834093:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938445.834098:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938445.834106:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1d7f9cb/0x7b044d4128f9d975 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476645cf expref: 58 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.834116:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d7f9cb/0x7b044d4128f9d975 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476645cf expref: 58 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.834193:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c1d7f9cb/0x7b044d4128f9d975 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476645cf expref: 58 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938445.834209:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:19221:1871643350892800:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938445.834268:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238108e240 going to sleep for 11 seconds 00000100:00100000:0.0:1784938445.837514:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:19221:1871643350892800:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938445.837541:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938445.837597:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+57:10959:x1871643337506176:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3602us (3831us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938445.837608:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 427 00000100:00100000:2.0:1784938445.846254:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938445.846426:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337506432 00000100:00100000:0.0:1784938445.846437:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337506432 00000100:00100000:0.0:1784938445.846496:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 121 00000100:00100000:0.0:1784938445.846506:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388245c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+87:17112:x1871643337506432:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:0.0:1784938445.846798:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388245c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+88:17112:x1871643337506432:12345-192.168.202.54@tcp:35:cp.0 Request processed in 292us (548us total) trans 8589934725 rc 0/0 00000100:00100000:0.0:1784938445.846806:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 121 00000100:00100000:1.0:1784938445.850719:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.850812:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337506560 00000100:00100000:2.0:1784938445.850822:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337506560 00000100:00100000:2.0:1784938445.850894:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 559 00000100:00100000:2.0:1784938445.850905:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+88:17112:x1871643337506560:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.850929:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.850949:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d97c lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476645d6 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.851032:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d983 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.851047:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d983 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.851060:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d983 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.851076:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d98a lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x267dbf88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.851083:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d98a lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.851090:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d98a lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.851131:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d983 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.851138:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d983 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.851363:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d983 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.851374:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d983 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.851391:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3e400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.851395:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d983 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.851404:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d983 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.851415:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.851419:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.851423:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d983 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.851429:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d983 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.851441:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d98a lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.851447:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d98a lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.851453:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d98a lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.851457:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3e600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.851460:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d98a lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.851470:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d98a lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.851476:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x267dbf88 (ffff9f23823dd800) 00010000:00010000:2.0:1784938445.851478:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.851480:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d98a lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.851486:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e600/0x7b044d4128f9d98a lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.851518:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d97c lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476645d6 expref: 89 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.851528:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.851530:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.851533:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d97c lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476645d6 expref: 89 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.851541:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3ec00, rc 0) 00000100:00100000:2.0:1784938445.851762:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+88:17112:x1871643337506560:12345-192.168.202.54@tcp:101:cp.0 Request processed in 859us (1052us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938445.851770:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 559 00000100:00100000:1.0:1784938445.861062:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938445.861129:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337506688 00000100:00100000:0.0:1784938445.861139:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337506688 00000100:00100000:1.0:1784938445.861420:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 560 00000100:00100000:1.0:1784938445.861431:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+88:17112:x1871643337506688:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938445.861454:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938445.861475:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9d991 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476645dd expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.861545:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9d998 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.861565:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9d998 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.861575:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9d998 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.861589:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9d99f lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x267dbf88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.861595:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9d99f lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.861601:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9d99f lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.861641:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9d998 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.861647:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9d998 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.861653:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9d998 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.861659:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db38a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938445.861664:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9d998 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.861671:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9d998 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.861682:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938445.861685:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938445.861689:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9d998 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.861695:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9d998 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.861707:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9d99f lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.861713:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9d99f lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.861719:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9d99f lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.861723:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938445.861725:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9d99f lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.861731:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9d99f lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.861737:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x267dbf88 (ffff9f24898ddc00) 00010000:00010000:1.0:1784938445.861739:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938445.861742:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9d99f lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.861747:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9d99f lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.861778:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9d991 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476645dd expref: 89 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.861789:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938445.861791:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938445.861794:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9d991 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476645dd expref: 89 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.861803:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238db39e00, rc 0) 00000100:00100000:1.0:1784938445.861867:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+88:17112:x1871643337506688:12345-192.168.202.54@tcp:101:cp.0 Request processed in 437us (815us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938445.861874:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 560 00000100:00100000:0.0:1784938445.865560:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.865646:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337506944 00000100:00100000:3.0:1784938445.865656:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337506944 00000100:00100000:3.0:1784938445.865717:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 561 00000100:00100000:3.0:1784938445.865729:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+88:17112:x1871643337506944:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938445.865751:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938445.865770:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6c00/0x7b044d4128f9d9a6 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476645e4 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.865882:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9d9ad lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.865898:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9d9ad lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.865911:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9d9ad lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.865925:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9d9b4 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x267dbf88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.865932:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9d9b4 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.865938:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9d9b4 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938445.866435:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x4c:0x0], index 1: 0 00010000:00010000:3.0:1784938445.866566:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6800/0x7b044d4128f9d9bb lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.866576:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6800/0x7b044d4128f9d9bb lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.866584:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6800/0x7b044d4128f9d9bb lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.866620:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9d9ad lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.866628:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9d9ad lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.866634:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9d9ad lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.866641:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9d9ad lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.866646:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c7400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938445.866650:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9d9ad lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.866662:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9d9ad lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.866674:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938445.866677:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938445.866682:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9d9ad lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.866687:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9d9ad lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938445.866701:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002f4ac89d reply state 00000000a6e581e5 transno 8589934726 ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9d9b4 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.866712:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9d9b4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.866719:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x267dbf88 (ffff9f238dcb3200) 00010000:00010000:3.0:1784938445.866722:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938445.866724:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938445.866751:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6c00/0x7b044d4128f9d9a6 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476645e4 expref: 91 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.866764:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6800/0x7b044d4128f9d9bb lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476645e4 expref: 90 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.866772:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x16:0x0].0x0 (ffff9f238dcb3100) 00010000:00010000:3.0:1784938445.866774:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938445.866777:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c6800, rc 0) 00000100:00100000:3.0:1784938445.866835:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+91:17112:x1871643337506944:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1108us (1284us total) trans 8589934726 rc 0/0 00000100:00100000:3.0:1784938445.866842:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 561 00000100:00100000:0.0:1784938445.871358:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.873340:0:25725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337507072 00000100:00100000:2.0:1784938445.873353:0:25725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337507072 00000100:00100000:2.0:1784938445.873427:0:25725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 856 00000100:00100000:2.0:1784938445.873439:0:25725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7ea6e988-18ba-4c98-b179-17995571b98b+59:10958:x1871643337507072:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.873459:0:25725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.873480:0:25725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c08077c/0x7b044d4128f9d9c9 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476645eb expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938445.873507:0:25725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x4c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938445.873527:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4c:0x0].0x0 since=712s v=(0 0) 00010000:00010000:2.0:1784938445.873532:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938445.873542:0:25725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c08077c/0x7b044d4128f9d9c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476645eb expref: 60 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.873560:0:25725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009c08077c/0x7b044d4128f9d9c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476645eb expref: 60 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.873572:0:25725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3ec00, rc 0) 00000100:00100000:2.0:1784938445.873634:0:25725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7ea6e988-18ba-4c98-b179-17995571b98b+60:10958:x1871643337507072:12345-192.168.202.54@tcp:101:cp.0 Request processed in 198us (2285us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938445.873641:0:25725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 856 00000100:00100000:1.0:1784938445.876768:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.877312:0:25726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337507200 00000100:00100000:2.0:1784938445.877321:0:25726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337507200 00000100:00100000:2.0:1784938445.877484:0:25726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 857 00000100:00100000:2.0:1784938445.877497:0:25726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7ea6e988-18ba-4c98-b179-17995571b98b+60:17112:x1871643337507200:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.877515:0:25726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.877533:0:25726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023ff2a33/0x7b044d4128f9d9d0 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x4c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476645f2 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.877564:0:25726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009c08077c/0x7b044d4128f9d9c9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476645eb expref: 61 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.877574:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938445.877578:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938445.877583:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023ff2a33/0x7b044d4128f9d9d0 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x4c:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476645f2 expref: 61 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.877615:0:25726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009c08077c/0x7b044d4128f9d9c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e9476645eb expref: 61 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.877627:0:25726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009c08077c/0x7b044d4128f9d9c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476645eb expref: 61 pid: 25725 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938445.877642:0:25726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388244000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:25726:1871643350892928:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938445.877722:0:25726:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34240 going to sleep for 11 seconds 00000100:00100000:0.0:1784938445.888553:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.888654:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337507328 00000100:00100000:3.0:1784938445.888663:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337507328 00010000:00010000:3.0:1784938445.888703:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009c08077c/0x7b044d4128f9d9c9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476645eb expref: 62 pid: 25725 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938445.888752:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 428 00000100:00100000:3.0:1784938445.888762:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+62:10957:x1871643337507328:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938445.888777:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938445.888799:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009c08077c/0x7b044d4128f9d9c9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476645eb expref: 62 pid: 25725 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.888819:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009c08077c/0x7b044d4128f9d9c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476645eb expref: 62 pid: 25725 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.888845:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938445.888850:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938445.888859:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000023ff2a33/0x7b044d4128f9d9d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476645f2 expref: 62 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.888943:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023ff2a33/0x7b044d4128f9d9d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476645f2 expref: 62 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.888982:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000023ff2a33/0x7b044d4128f9d9d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476645f2 expref: 62 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938445.889070:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388127800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22955:1871643350893056:192.168.202.54@tcp:105: 00000100:00100000:3.0:1784938445.889212:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b2d2cd80 going to sleep for 11 seconds 00010000:00010000:2.0:1784938445.889244:0:25726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c08077c/0x7b044d4128f9d9c9 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476645eb expref: 62 pid: 25725 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938445.889260:0:25726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388244000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:25726:1871643350892928:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938445.889290:0:25726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000023ff2a33/0x7b044d4128f9d9d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476645f2 expref: 61 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.889301:0:25726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3e600, rc 0) 00000100:00100000:2.0:1784938445.889341:0:25726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7ea6e988-18ba-4c98-b179-17995571b98b+61:17112:x1871643337507200:12345-192.168.202.54@tcp:101:cp.0 Request processed in 11847us (12581us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938445.889352:0:25726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 857 00000100:00100000:0.0:1784938445.904085:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938445.904190:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337507584 00000100:00100000:1.0:1784938445.904200:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337507584 00000100:00100000:1.0:1784938445.904256:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 122 00000100:00100000:1.0:1784938445.904267:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+91:17112:x1871643337507584:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938445.904427:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388127800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22955:1871643350893056:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938445.904448:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938445.904506:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+60:10957:x1871643337507328:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 15745us (15962us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938445.904516:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 428 00000100:00100000:1.0:1784938445.904523:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+92:17112:x1871643337507584:12345-192.168.202.54@tcp:35:cp.0 Request processed in 259us (449us total) trans 8589934727 rc 0/0 00000100:00100000:1.0:1784938445.904530:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 122 00000100:00100000:1.0:1784938445.910230:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.910758:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337507712 00000100:00100000:2.0:1784938445.910768:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337507712 00000100:00100000:2.0:1784938445.910835:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 562 00000100:00100000:2.0:1784938445.910844:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+92:17112:x1871643337507712:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.910995:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.911112:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d9d7 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476645f9 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.911250:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d9de lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.911264:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d9de lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.911275:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d9de lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.911289:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d9e5 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xd946e4d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.911295:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d9e5 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.911301:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d9e5 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.911350:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d9de lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.911361:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d9de lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.911366:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d9de lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.911372:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3ec00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.911376:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d9de lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.911383:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d9de lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.911395:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.911398:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.911403:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d9de lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.911408:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9d9de lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.911422:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d9e5 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.911428:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d9e5 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.911434:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d9e5 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.911439:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938445.911442:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d9e5 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.911448:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d9e5 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.911455:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xd946e4d2 (ffff9f23823dd000) 00010000:00010000:2.0:1784938445.911457:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.911460:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d9e5 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.911466:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1200/0x7b044d4128f9d9e5 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.911497:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d9d7 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476645f9 expref: 93 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.911507:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938445.911509:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938445.911513:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9d9d7 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476645f9 expref: 93 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.911522:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3e400, rc 0) 00000100:00100000:2.0:1784938445.911618:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+92:17112:x1871643337507712:12345-192.168.202.54@tcp:101:cp.0 Request processed in 774us (1396us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938445.911626:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 562 00000100:00100000:2.0:1784938445.919589:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938445.920101:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337507840 00000100:00100000:1.0:1784938445.920112:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337507840 00000100:00100000:1.0:1784938445.920385:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 563 00000100:00100000:1.0:1784938445.920398:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+92:17112:x1871643337507840:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938445.920422:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938445.920445:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9d9ec lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664600 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.920522:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9d9f3 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.920539:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9d9f3 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.920549:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9d9f3 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.920564:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39a00/0x7b044d4128f9d9fa lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xd946e4d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.920570:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39a00/0x7b044d4128f9d9fa lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.920577:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39a00/0x7b044d4128f9d9fa lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.920617:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9d9f3 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.920625:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9d9f3 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.920630:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9d9f3 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.920637:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9d9f3 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.920643:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db38a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938445.920648:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9d9f3 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.920656:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9d9f3 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.920667:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938445.920671:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938445.920675:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9d9f3 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.920682:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9d9f3 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.920695:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39a00/0x7b044d4128f9d9fa lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.920701:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39a00/0x7b044d4128f9d9fa lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.920707:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39a00/0x7b044d4128f9d9fa lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.920712:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938445.920715:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39a00/0x7b044d4128f9d9fa lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.920721:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39a00/0x7b044d4128f9d9fa lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.920728:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xd946e4d2 (ffff9f24898ddc00) 00010000:00010000:1.0:1784938445.920731:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938445.920735:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39a00/0x7b044d4128f9d9fa lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.920740:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39a00/0x7b044d4128f9d9fa lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.920772:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9d9ec lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664600 expref: 93 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.920781:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938445.920784:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938445.920788:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9d9ec lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664600 expref: 93 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.920797:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238db39200, rc 0) 00000100:00100000:1.0:1784938445.920903:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+92:17112:x1871643337507840:12345-192.168.202.54@tcp:101:cp.0 Request processed in 507us (1322us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938445.920911:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 563 00000100:00100000:2.0:1784938445.937420:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938445.937520:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337508096 00000100:00100000:0.0:1784938445.937530:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337508096 00000100:00100000:0.0:1784938445.937587:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 564 00000100:00100000:0.0:1784938445.937595:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+92:17112:x1871643337508096:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938445.937617:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938445.937636:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3da00/0x7b044d4128f9da01 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664607 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.937726:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9da08 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.937740:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9da08 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.937752:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9da08 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.937765:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9da0f lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0xd946e4d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.937771:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9da0f lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.937778:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9da0f lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938445.938316:0:24203:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x4c:0x0], index 0: 0 00010000:00010000:0.0:1784938445.938447:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c200/0x7b044d4128f9da16 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.938456:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c200/0x7b044d4128f9da16 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.938464:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c200/0x7b044d4128f9da16 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.938496:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9da08 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.938502:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9da08 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.938509:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9da08 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.938514:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3d200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938445.938518:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9da08 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.938525:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9da08 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.938535:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938445.938538:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938445.938543:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9da08 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.938548:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9da08 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938445.938560:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ccd7a950 reply state 00000000d7ba3c32 transno 8589934728 ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9da0f lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.938570:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9da0f lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.938576:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xd946e4d2 (ffff9f248fb6fe00) 00010000:00010000:0.0:1784938445.938580:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938445.938582:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938445.938607:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3da00/0x7b044d4128f9da01 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664607 expref: 95 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.938621:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c200/0x7b044d4128f9da16 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664607 expref: 94 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.938628:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x17:0x0].0x0 (ffff9f248fb6f600) 00010000:00010000:0.0:1784938445.938630:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938445.938633:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d3c200, rc 0) 00000100:00100000:0.0:1784938445.938691:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+95:17112:x1871643337508096:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1096us (1280us total) trans 8589934728 rc 0/0 00000100:00100000:0.0:1784938445.938699:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 564 00000100:00100000:2.0:1784938445.950244:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938445.950312:0:25724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337508224 00000100:00100000:0.0:1784938445.950323:0:25724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337508224 00000100:00100000:0.0:1784938445.950384:0:25724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 858 00000100:00100000:0.0:1784938445.950394:0:25724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7ea6e988-18ba-4c98-b179-17995571b98b+57:10960:x1871643337508224:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938445.950413:0:25724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938445.950434:0:25724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f7640b/0x7b044d4128f9da24 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766460e expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938445.950461:0:25724:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938445.950481:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4c:0x0].0x0 since=712s v=(0 0) 00010000:00010000:0.0:1784938445.950485:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938445.950495:0:25724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f7640b/0x7b044d4128f9da24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766460e expref: 58 pid: 25724 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.950520:0:25724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000006f7640b/0x7b044d4128f9da24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766460e expref: 58 pid: 25724 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938445.950535:0:25724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d3dc00, rc 0) 00000100:00100000:0.0:1784938445.950598:0:25724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7ea6e988-18ba-4c98-b179-17995571b98b+58:10960:x1871643337508224:12345-192.168.202.54@tcp:101:cp.0 Request processed in 206us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938445.950606:0:25724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 858 00000100:00100000:3.0:1784938445.967257:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938445.967449:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337508352 00000100:00100000:2.0:1784938445.967458:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337508352 00000100:00100000:2.0:1784938445.967515:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 859 00000100:00100000:2.0:1784938445.967524:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+58:17112:x1871643337508352:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938445.967543:0:25722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938445.967563:0:25722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9da2b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664615 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.967593:0:25722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000006f7640b/0x7b044d4128f9da24 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766460e expref: 59 pid: 25724 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.967602:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938445.967606:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938445.967611:0:25722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9da2b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664615 expref: 59 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.967644:0:25722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000006f7640b/0x7b044d4128f9da24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e94766460e expref: 59 pid: 25724 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938445.967657:0:25722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000006f7640b/0x7b044d4128f9da24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766460e expref: 59 pid: 25724 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938445.967671:0:25722:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387daf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25722:1871643350893184:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938445.967759:0:25722:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34240 going to sleep for 11 seconds 00000100:00100000:2.0:1784938445.976422:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938445.976556:0:25722:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387daf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25722:1871643350893184:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938445.976592:0:25722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9da2b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664615 expref: 59 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938445.976615:0:25722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf1200, rc 0) 00000100:00100000:1.0:1784938445.976679:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+59:17112:x1871643337508352:12345-192.168.202.54@tcp:101:cp.0 Request processed in 9155us (9432us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938445.976687:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 859 00000100:00100000:3.0:1784938445.977726:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337508480 00000100:00100000:3.0:1784938445.977737:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337508480 00010000:00010000:3.0:1784938445.977777:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000006f7640b/0x7b044d4128f9da24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766460e expref: 59 pid: 25724 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938445.977822:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 429 00000100:00100000:3.0:1784938445.977832:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+59:10960:x1871643337508480:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938445.977846:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938445.977868:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000006f7640b/0x7b044d4128f9da24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766460e expref: 59 pid: 25724 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.977882:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000006f7640b/0x7b044d4128f9da24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766460e expref: 59 pid: 25724 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.977904:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f7640b/0x7b044d4128f9da24 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766460e expref: 59 pid: 25724 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.977919:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938445.977924:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938445.977933:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9da2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664615 expref: 58 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.977944:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9da2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664615 expref: 58 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938445.977981:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9da2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664615 expref: 58 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938445.978011:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350893312:192.168.202.54@tcp:105: 00000100:00100000:3.0:1784938445.978090:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b2d2cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938445.991772:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938445.992115:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350893312:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938445.992139:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938445.992246:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+58:10960:x1871643337508480:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 14415us (15831us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938445.992259:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 429 00000100:00100000:0.0:1784938445.993194:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337508736 00000100:00100000:0.0:1784938445.993204:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337508736 00000100:00100000:0.0:1784938445.993262:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 123 00000100:00100000:0.0:1784938445.993271:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24857ff850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+95:17112:x1871643337508736:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:0.0:1784938445.993574:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24857ff850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+96:17112:x1871643337508736:12345-192.168.202.54@tcp:35:cp.0 Request processed in 303us (1811us total) trans 8589934729 rc 0/0 00000100:00100000:0.0:1784938445.993582:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 123 00000100:00100000:2.0:1784938446.000447:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.000655:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337508864 00000100:00100000:3.0:1784938446.000667:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337508864 00000100:00100000:3.0:1784938446.000752:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 565 00000100:00100000:3.0:1784938446.000764:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387daf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+96:17112:x1871643337508864:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938446.000789:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938446.000814:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6c00/0x7b044d4128f9da32 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766461c expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.000884:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9da39 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.000900:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9da39 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.000910:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9da39 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.000926:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6200/0x7b044d4128f9da40 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x7584afcd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.000937:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6200/0x7b044d4128f9da40 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.000943:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6200/0x7b044d4128f9da40 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.000986:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9da39 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.000994:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9da39 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.001012:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9da39 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.001019:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9da39 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.001026:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c7400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938446.001031:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9da39 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.001039:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9da39 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.001053:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938446.001056:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938446.001061:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9da39 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.001067:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9da39 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.001085:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6200/0x7b044d4128f9da40 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.001090:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6200/0x7b044d4128f9da40 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.001096:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6200/0x7b044d4128f9da40 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.001100:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c6200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938446.001103:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6200/0x7b044d4128f9da40 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.001109:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6200/0x7b044d4128f9da40 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.001117:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x7584afcd (ffff9f238dcb3500) 00010000:00010000:3.0:1784938446.001119:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938446.001122:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6200/0x7b044d4128f9da40 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.001128:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6200/0x7b044d4128f9da40 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.001216:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6c00/0x7b044d4128f9da32 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766461c expref: 97 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.001227:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938446.001230:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938446.001234:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6c00/0x7b044d4128f9da32 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766461c expref: 97 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.001244:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c6c00, rc 0) 00000100:00100000:3.0:1784938446.001317:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387daf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+96:17112:x1871643337508864:12345-192.168.202.54@tcp:101:cp.0 Request processed in 554us (881us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938446.001324:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 565 00000100:00080000:2.0:1784938446.001827:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784938446.004448:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.004549:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337508992 00000100:00100000:0.0:1784938446.004558:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337508992 00000100:00100000:0.0:1784938446.004614:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 566 00000100:00100000:0.0:1784938446.004623:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+96:17112:x1871643337508992:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938446.004643:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938446.004665:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3da00/0x7b044d4128f9da47 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664623 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.004726:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9da4e lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.004742:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9da4e lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.004752:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9da4e lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.004765:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9da55 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x7584afcd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.004772:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9da55 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.004778:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9da55 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.004816:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9da4e lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.004823:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9da4e lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.004828:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9da4e lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.004833:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3d200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.004837:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9da4e lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.004844:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9da4e lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.004855:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.004858:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.004863:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9da4e lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.004868:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9da4e lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.004882:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9da55 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.004887:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9da55 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.004892:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9da55 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.004897:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3c800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.004899:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9da55 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.004904:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9da55 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.004910:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x7584afcd (ffff9f248fb6ff00) 00010000:00010000:0.0:1784938446.004913:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.004915:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9da55 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.004920:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9da55 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.004952:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3da00/0x7b044d4128f9da47 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664623 expref: 97 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.004961:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.004964:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.004968:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3da00/0x7b044d4128f9da47 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664623 expref: 97 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.004976:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d3da00, rc 0) 00000100:00100000:0.0:1784938446.005041:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+96:17112:x1871643337508992:12345-192.168.202.54@tcp:101:cp.0 Request processed in 419us (602us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938446.005048:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 566 00000100:00100000:3.0:1784938446.008543:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.009142:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337509248 00000100:00100000:0.0:1784938446.009184:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337509248 00000100:00100000:0.0:1784938446.009241:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 567 00000100:00100000:0.0:1784938446.009251:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+96:17112:x1871643337509248:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938446.009272:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938446.009295:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9da5c lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766462a expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.009436:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9da63 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.009451:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9da63 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.009461:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9da63 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.009478:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9da6a lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x7584afcd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.009486:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9da6a lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.009492:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9da6a lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938446.009829:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x4d:0x0], index 1: 0 00010000:00010000:0.0:1784938446.009969:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f244a00/0x7b044d4128f9da71 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.009978:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f244a00/0x7b044d4128f9da71 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.009986:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f244a00/0x7b044d4128f9da71 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.010030:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9da63 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.010038:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9da63 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.010044:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9da63 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.010050:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9da63 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.010055:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.010059:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9da63 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.010071:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9da63 lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.010083:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.010086:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.010091:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9da63 lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.010098:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9da63 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938446.010112:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000068d2eaa4 reply state 00000000b87c8108 transno 8589934730 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9da6a lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.010123:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9da6a lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.010130:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x7584afcd (ffff9f248fb6f500) 00010000:00010000:0.0:1784938446.010132:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938446.010135:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938446.010212:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9da5c lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766462a expref: 99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.010228:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f244a00/0x7b044d4128f9da71 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766462a expref: 98 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.010235:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x18:0x0].0x0 (ffff9f248fb6f000) 00010000:00010000:0.0:1784938446.010237:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938446.010239:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f244a00, rc 0) 00000100:00100000:0.0:1784938446.010297:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+99:17112:x1871643337509248:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1047us (1763us total) trans 8589934730 rc 0/0 00000100:00100000:0.0:1784938446.010315:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 567 00000100:00100000:1.0:1784938446.021198:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.022531:0:21152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337509376 00000100:00100000:0.0:1784938446.022546:0:21152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337509376 00000100:00100000:0.0:1784938446.022626:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 860 00000100:00100000:0.0:1784938446.022637:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+60:10958:x1871643337509376:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938446.022656:0:21152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938446.022679:0:21152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012221821/0x7b044d4128f9da7f lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664631 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938446.022705:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x4d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938446.022726:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4d:0x0].0x0 since=712s v=(0 0) 00010000:00010000:0.0:1784938446.022731:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938446.022740:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012221821/0x7b044d4128f9da7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664631 expref: 61 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.022758:0:21152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000012221821/0x7b044d4128f9da7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664631 expref: 61 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.022771:0:21152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f245400, rc 0) 00000100:00100000:0.0:1784938446.022842:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+61:10958:x1871643337509376:12345-192.168.202.54@tcp:101:cp.0 Request processed in 206us (1699us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938446.022849:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 860 00000100:00100000:2.0:1784938446.025725:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.025876:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337509504 00000100:00100000:3.0:1784938446.025886:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337509504 00000100:00100000:3.0:1784938446.025981:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 861 00000100:00100000:3.0:1784938446.025993:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+61:17112:x1871643337509504:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938446.026020:0:25715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938446.026039:0:25715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b85dfb87/0x7b044d4128f9da86 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x4d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664638 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.026070:0:25715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000012221821/0x7b044d4128f9da7f lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664631 expref: 62 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.026080:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938446.026085:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938446.026091:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b85dfb87/0x7b044d4128f9da86 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x4d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664638 expref: 62 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.026124:0:25715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000012221821/0x7b044d4128f9da7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664631 expref: 62 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.026171:0:25715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000012221821/0x7b044d4128f9da7f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664631 expref: 62 pid: 21152 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938446.026188:0:25715:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25715:1871643350893440:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938446.026261:0:25715:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b2d2cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938446.035000:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.035128:0:25715:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25715:1871643350893440:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938446.035184:0:25715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b85dfb87/0x7b044d4128f9da86 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x4d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664638 expref: 62 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.035208:0:25715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c6c00, rc 0) 00000100:00100000:0.0:1784938446.035271:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+62:17112:x1871643337509504:12345-192.168.202.54@tcp:101:cp.0 Request processed in 9280us (9555us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938446.035281:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 861 00000100:00100000:1.0:1784938446.035389:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337509632 00000100:00100000:1.0:1784938446.035396:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337509632 00010000:00010000:1.0:1784938446.035431:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000012221821/0x7b044d4128f9da7f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664631 expref: 62 pid: 21152 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938446.035467:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 430 00000100:00100000:1.0:1784938446.035477:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2498337450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+62:10958:x1871643337509632:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938446.035495:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938446.035515:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000012221821/0x7b044d4128f9da7f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664631 expref: 62 pid: 21152 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.035528:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000012221821/0x7b044d4128f9da7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664631 expref: 62 pid: 21152 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.035551:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012221821/0x7b044d4128f9da7f lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x4d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664631 expref: 62 pid: 21152 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.035564:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938446.035569:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938446.035577:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b85dfb87/0x7b044d4128f9da86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664638 expref: 61 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.035588:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b85dfb87/0x7b044d4128f9da86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664638 expref: 61 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.035624:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b85dfb87/0x7b044d4128f9da86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664638 expref: 61 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938446.035644:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd254a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350893568:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938446.035694:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbe840 going to sleep for 11 seconds 00000100:00100000:0.0:1784938446.038718:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd254a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350893568:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938446.038743:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938446.038801:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2498337450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+61:10958:x1871643337509632:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3326us (3826us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938446.038812:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 430 00000100:00100000:2.0:1784938446.041229:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.041318:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337509888 00000100:00100000:0.0:1784938446.041326:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337509888 00000100:00100000:0.0:1784938446.041386:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 124 00000100:00100000:0.0:1784938446.041395:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+99:17112:x1871643337509888:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:0.0:1784938446.041656:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+100:17112:x1871643337509888:12345-192.168.202.54@tcp:35:cp.0 Request processed in 261us (434us total) trans 8589934731 rc 0/0 00000100:00100000:0.0:1784938446.041663:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 124 00000100:00100000:3.0:1784938446.046535:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.046626:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337510016 00000100:00100000:0.0:1784938446.046636:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337510016 00000100:00100000:0.0:1784938446.046705:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 568 00000100:00100000:0.0:1784938446.046716:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+100:17112:x1871643337510016:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938446.046744:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938446.046767:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9da8d lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766463f expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.046847:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9da94 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.046862:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9da94 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.046883:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9da94 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.046899:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3da00/0x7b044d4128f9da9b lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xf4c8ca43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.046907:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3da00/0x7b044d4128f9da9b lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.046914:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3da00/0x7b044d4128f9da9b lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.046949:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9da94 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.046957:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9da94 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.046964:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9da94 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.046970:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3dc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.046974:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9da94 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.047297:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9da94 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.047322:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.047326:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.047330:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9da94 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.047337:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9da94 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.047351:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3da00/0x7b044d4128f9da9b lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.047356:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3da00/0x7b044d4128f9da9b lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.047363:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3da00/0x7b044d4128f9da9b lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.047368:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3da00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.047370:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3da00/0x7b044d4128f9da9b lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.047376:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3da00/0x7b044d4128f9da9b lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.047383:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xf4c8ca43 (ffff9f248fb6ec00) 00010000:00010000:0.0:1784938446.047385:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.047388:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3da00/0x7b044d4128f9da9b lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.047399:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3da00/0x7b044d4128f9da9b lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.047435:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9da8d lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766463f expref: 101 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.047445:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.047447:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.047450:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9da8d lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766463f expref: 101 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.047460:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f245400, rc 0) 00000100:00100000:0.0:1784938446.047559:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+100:17112:x1871643337510016:12345-192.168.202.54@tcp:101:cp.0 Request processed in 845us (1032us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938446.047566:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 568 00000100:00100000:1.0:1784938446.061476:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.061579:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337510144 00000100:00100000:0.0:1784938446.061589:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337510144 00000100:00100000:0.0:1784938446.061650:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 569 00000100:00100000:0.0:1784938446.061660:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+100:17112:x1871643337510144:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938446.061680:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938446.061701:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3da00/0x7b044d4128f9daa2 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664646 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.061769:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9daa9 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.061783:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9daa9 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.061795:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9daa9 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.061808:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9dab0 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xf4c8ca43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.061815:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9dab0 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.061822:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9dab0 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.061875:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9daa9 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.061882:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9daa9 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.061889:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9daa9 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.061895:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9daa9 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.061902:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3dc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.061906:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9daa9 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.061915:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9daa9 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.061926:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.061930:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.061934:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9daa9 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.061940:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9daa9 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.061955:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9dab0 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.061961:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9dab0 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.061966:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9dab0 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.061971:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3c800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.061974:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9dab0 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.061980:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9dab0 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.062006:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xf4c8ca43 (ffff9f248fb6ec00) 00010000:00010000:0.0:1784938446.062009:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.062012:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9dab0 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.062017:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c800/0x7b044d4128f9dab0 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.062052:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3da00/0x7b044d4128f9daa2 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664646 expref: 101 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.062062:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.062065:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.062069:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3da00/0x7b044d4128f9daa2 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664646 expref: 101 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.062079:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d3da00, rc 0) 00000100:00100000:0.0:1784938446.062202:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+100:17112:x1871643337510144:12345-192.168.202.54@tcp:101:cp.0 Request processed in 542us (737us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938446.062210:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 569 00000100:00100000:2.0:1784938446.073576:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938446.075697:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337510400 00000100:00100000:1.0:1784938446.075711:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337510400 00000100:00100000:1.0:1784938446.075820:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 570 00000100:00100000:1.0:1784938446.075831:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+100:17112:x1871643337510400:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938446.075853:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938446.075884:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9dab7 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766464d expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.076448:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9dabe lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.076466:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9dabe lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.076477:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9dabe lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.076492:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f9dac5 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0xf4c8ca43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.076499:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f9dac5 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.076506:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f9dac5 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938446.076857:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x4d:0x0], index 0: 0 00010000:00010000:1.0:1784938446.077010:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38400/0x7b044d4128f9dacc lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.077020:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38400/0x7b044d4128f9dacc lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.077028:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38400/0x7b044d4128f9dacc lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.077060:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9dabe lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.077067:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9dabe lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.077074:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9dabe lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.077080:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938446.077084:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9dabe lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.077091:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9dabe lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.077101:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938446.077104:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938446.077108:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9dabe lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.077117:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9dabe lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938446.077130:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000072c9a258 reply state 00000000b088cb07 transno 8589934732 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f9dac5 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.077140:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f9dac5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.077502:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xf4c8ca43 (ffff9f24898ddc00) 00010000:00010000:1.0:1784938446.077506:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938446.077508:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938446.077544:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9dab7 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766464d expref: 103 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.077559:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38400/0x7b044d4128f9dacc lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766464d expref: 102 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.077566:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x19:0x0].0x0 (ffff9f24898dd900) 00010000:00010000:1.0:1784938446.077568:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938446.077570:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238db38400, rc 0) 00000100:00100000:1.0:1784938446.082334:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+103:17112:x1871643337510400:12345-192.168.202.54@tcp:101:cp.0 Request processed in 6493us (8756us total) trans 8589934732 rc 0/0 00000100:00100000:1.0:1784938446.082350:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 570 00000100:00100000:3.0:1784938446.093207:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.093295:0:25727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337510528 00000100:00100000:0.0:1784938446.093314:0:25727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337510528 00000100:00100000:0.0:1784938446.093377:0:25727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 862 00000100:00100000:0.0:1784938446.093389:0:25727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7ea6e988-18ba-4c98-b179-17995571b98b+58:10960:x1871643337510528:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938446.093407:0:25727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938446.093431:0:25727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f556fa2a/0x7b044d4128f9dada lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664654 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938446.093458:0:25727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938446.093479:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4d:0x0].0x0 since=712s v=(0 0) 00010000:00010000:0.0:1784938446.093484:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938446.093493:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f556fa2a/0x7b044d4128f9dada lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664654 expref: 59 pid: 25727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.093510:0:25727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f556fa2a/0x7b044d4128f9dada lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664654 expref: 59 pid: 25727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.093530:0:25727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d3da00, rc 0) 00000100:00100000:0.0:1784938446.093592:0:25727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7ea6e988-18ba-4c98-b179-17995571b98b+59:10960:x1871643337510528:12345-192.168.202.54@tcp:101:cp.0 Request processed in 205us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938446.093598:0:25727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 862 00000100:00100000:2.0:1784938446.100797:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.101439:0:25729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337510656 00000100:00100000:0.0:1784938446.101450:0:25729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337510656 00000100:00100000:0.0:1784938446.101510:0:25729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 863 00000100:00100000:0.0:1784938446.101520:0:25729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7ea6e988-18ba-4c98-b179-17995571b98b+59:17112:x1871643337510656:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938446.101540:0:25729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938446.101560:0:25729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0e9597c/0x7b044d4128f9dae1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766465b expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.101592:0:25729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f556fa2a/0x7b044d4128f9dada lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664654 expref: 60 pid: 25727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.101602:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938446.101606:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938446.101611:0:25729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0e9597c/0x7b044d4128f9dae1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766465b expref: 60 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.101650:0:25729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f556fa2a/0x7b044d4128f9dada lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664654 expref: 60 pid: 25727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.101665:0:25729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f556fa2a/0x7b044d4128f9dada lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664654 expref: 60 pid: 25727 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938446.101681:0:25729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:25729:1871643350893696:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938446.101781:0:25729:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248fb1c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938446.110508:0:25729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:25729:1871643350893696:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938446.110549:0:25729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d0e9597c/0x7b044d4128f9dae1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766465b expref: 60 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.110571:0:25729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d3c800, rc 0) 00000100:00100000:0.0:1784938446.110634:0:25729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7ea6e988-18ba-4c98-b179-17995571b98b+60:17112:x1871643337510656:12345-192.168.202.54@tcp:101:cp.0 Request processed in 9115us (9847us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938446.110645:0:25729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 863 00000100:00100000:3.0:1784938446.118399:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.118614:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337510784 00000100:00100000:0.0:1784938446.118624:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337510784 00010000:00010000:0.0:1784938446.118663:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f556fa2a/0x7b044d4128f9dada lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664654 expref: 60 pid: 25727 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938446.118711:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 431 00000100:00100000:0.0:1784938446.118720:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d144e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+60:10959:x1871643337510784:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938446.118734:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938446.118754:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f556fa2a/0x7b044d4128f9dada lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664654 expref: 60 pid: 25727 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.118769:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f556fa2a/0x7b044d4128f9dada lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664654 expref: 60 pid: 25727 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.118795:0:22955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f556fa2a/0x7b044d4128f9dada lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664654 expref: 60 pid: 25727 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.118812:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938446.118816:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938446.118824:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d0e9597c/0x7b044d4128f9dae1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766465b expref: 59 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.118834:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0e9597c/0x7b044d4128f9dae1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766465b expref: 59 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.118872:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d0e9597c/0x7b044d4128f9dae1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766465b expref: 59 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938446.118886:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350893824:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938446.118967:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248fb1c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938446.123712:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350893824:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938446.123738:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938446.123797:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d144e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+59:10959:x1871643337510784:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 5077us (5408us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938446.123808:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 431 00000100:00100000:3.0:1784938446.127131:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938446.127571:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337511040 00000100:00100000:1.0:1784938446.127582:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337511040 00000100:00100000:1.0:1784938446.127686:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 125 00000100:00100000:1.0:1784938446.127696:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d3adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+103:17112:x1871643337511040:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:1.0:1784938446.129108:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d3adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+104:17112:x1871643337511040:12345-192.168.202.54@tcp:35:cp.0 Request processed in 1407us (1980us total) trans 8589934733 rc 0/0 00000100:00100000:1.0:1784938446.129124:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 125 00000100:00100000:3.0:1784938446.135254:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.135366:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337511168 00000100:00100000:0.0:1784938446.135383:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337511168 00000100:00100000:0.0:1784938446.135452:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 571 00000100:00100000:0.0:1784938446.135463:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b35f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+104:17112:x1871643337511168:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938446.135488:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938446.135510:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3da00/0x7b044d4128f9dae8 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664662 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.135576:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9daef lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.135591:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9daef lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.135603:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9daef lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.135618:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9daf6 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x130bf32a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.135625:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9daf6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.135631:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9daf6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.135673:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9daef lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.135680:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9daef lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.135686:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9daef lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.135696:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9daef lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.135702:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3dc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.135706:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9daef lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.135713:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9daef lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.135724:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.135728:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.135732:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9daef lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.135739:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3dc00/0x7b044d4128f9daef lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.135753:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9daf6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.135759:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9daf6 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.135764:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9daf6 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.135769:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3d200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.135772:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9daf6 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.135781:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9daf6 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.135788:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x130bf32a (ffff9f248fb6e500) 00010000:00010000:0.0:1784938446.135791:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.135794:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9daf6 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.135800:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9daf6 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.135833:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3da00/0x7b044d4128f9dae8 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664662 expref: 105 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.135844:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.135846:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.135849:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3da00/0x7b044d4128f9dae8 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664662 expref: 105 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.135859:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d3da00, rc 0) 00000100:00100000:0.0:1784938446.135937:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b35f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+104:17112:x1871643337511168:12345-192.168.202.54@tcp:101:cp.0 Request processed in 475us (693us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938446.135944:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 571 00000100:00100000:2.0:1784938446.139136:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.139432:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337511296 00000100:00100000:0.0:1784938446.139444:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337511296 00000100:00100000:0.0:1784938446.139512:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 572 00000100:00100000:0.0:1784938446.139523:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+104:17112:x1871643337511296:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938446.139546:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938446.139571:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9dafd lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664669 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.139639:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9db04 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.139654:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9db04 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.139666:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9db04 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.139680:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9db0b lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x130bf32a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.139686:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9db0b lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.139692:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9db0b lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.139729:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9db04 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.139736:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9db04 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.139741:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9db04 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.139747:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24ca00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.139751:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9db04 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.139758:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9db04 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.139769:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.139772:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.139776:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9db04 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.139782:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9db04 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.139795:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9db0b lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.139801:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9db0b lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.139807:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9db0b lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.139811:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24d400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.139814:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9db0b lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.139819:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9db0b lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.139827:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x130bf32a (ffff9f248fb6e300) 00010000:00010000:0.0:1784938446.139829:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.139832:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9db0b lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.139838:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9db0b lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.140430:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9dafd lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664669 expref: 105 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.140444:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.140446:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.140450:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9dafd lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664669 expref: 105 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.140463:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f245400, rc 0) 00000100:00100000:0.0:1784938446.140582:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+104:17112:x1871643337511296:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1061us (1465us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938446.140590:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 572 00000100:00100000:3.0:1784938446.151879:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.151969:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337511552 00000100:00100000:0.0:1784938446.151980:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337511552 00000100:00100000:0.0:1784938446.152040:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 573 00000100:00100000:0.0:1784938446.152050:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b35f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+104:17112:x1871643337511552:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938446.152072:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938446.152093:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9db12 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664670 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.152236:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9db19 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.152260:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9db19 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.152271:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9db19 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.152288:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9db20 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x130bf32a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.152295:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9db20 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.152309:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9db20 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938446.152634:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x4e:0x0], index 1: 0 00010000:00010000:0.0:1784938446.152783:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3da00/0x7b044d4128f9db27 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.152792:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3da00/0x7b044d4128f9db27 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.152800:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3da00/0x7b044d4128f9db27 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.152837:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9db19 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.152844:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9db19 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.152850:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9db19 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.152857:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9db19 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.152862:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24dc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.152866:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9db19 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.152873:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9db19 lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.152884:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.152887:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.152890:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9db19 lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.152896:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9db19 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938446.152910:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008b5eb54e reply state 00000000e3c808bf transno 8589934734 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9db20 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.152921:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9db20 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.152927:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x130bf32a (ffff9f248fb6e500) 00010000:00010000:0.0:1784938446.152929:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938446.152931:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938446.152956:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9db12 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664670 expref: 107 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.152970:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3da00/0x7b044d4128f9db27 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664670 expref: 106 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.152977:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1a:0x0].0x0 (ffff9f248fb6ef00) 00010000:00010000:0.0:1784938446.152979:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938446.152981:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d3da00, rc 0) 00000100:00100000:0.0:1784938446.153042:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b35f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+107:17112:x1871643337511552:12345-192.168.202.54@tcp:101:cp.0 Request processed in 992us (1184us total) trans 8589934734 rc 0/0 00000100:00100000:0.0:1784938446.153049:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 573 00000100:00100000:3.0:1784938446.174913:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.175117:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337511680 00000100:00100000:2.0:1784938446.175128:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337511680 00000100:00100000:2.0:1784938446.175234:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 864 00000100:00100000:2.0:1784938446.175244:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b35f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+61:10957:x1871643337511680:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938446.175272:0:21149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938446.175298:0:21149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c08077c/0x7b044d4128f9db35 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664677 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938446.175334:0:21149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x4e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938446.175355:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4e:0x0].0x0 since=712s v=(0 0) 00010000:00010000:2.0:1784938446.175359:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.175369:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c08077c/0x7b044d4128f9db35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664677 expref: 62 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.175387:0:21149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009c08077c/0x7b044d4128f9db35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664677 expref: 62 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.175400:0:21149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3ec00, rc 0) 00000100:00100000:2.0:1784938446.175452:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b35f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+62:10957:x1871643337511680:12345-192.168.202.54@tcp:101:cp.0 Request processed in 210us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938446.175462:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 864 00000100:00100000:1.0:1784938446.187200:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.187310:0:25723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337511808 00000100:00100000:3.0:1784938446.187321:0:25723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337511808 00000100:00100000:3.0:1784938446.187382:0:25723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 865 00000100:00100000:3.0:1784938446.187391:0:25723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7ea6e988-18ba-4c98-b179-17995571b98b+62:17112:x1871643337511808:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938446.187410:0:25723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938446.187427:0:25723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073ebaa12/0x7b044d4128f9db3c lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x4e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766467e expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.187459:0:25723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009c08077c/0x7b044d4128f9db35 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664677 expref: 63 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.187473:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938446.187478:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938446.187482:0:25723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073ebaa12/0x7b044d4128f9db3c lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x4e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766467e expref: 63 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.187515:0:25723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009c08077c/0x7b044d4128f9db35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664677 expref: 63 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.187528:0:25723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009c08077c/0x7b044d4128f9db35 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664677 expref: 63 pid: 21149 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938446.187542:0:25723:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b35f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:25723:1871643350893952:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938446.187624:0:25723:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b2d2cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938446.196651:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938446.196874:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337511936 00000100:00100000:1.0:1784938446.196883:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337511936 00010000:00010000:1.0:1784938446.196923:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009c08077c/0x7b044d4128f9db35 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664677 expref: 64 pid: 21149 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938446.196962:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 432 00000100:00100000:1.0:1784938446.196972:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+64:10957:x1871643337511936:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938446.197003:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938446.197027:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009c08077c/0x7b044d4128f9db35 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664677 expref: 64 pid: 21149 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.197041:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009c08077c/0x7b044d4128f9db35 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664677 expref: 64 pid: 21149 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.197069:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938446.197073:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938446.197083:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000073ebaa12/0x7b044d4128f9db3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766467e expref: 64 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.197094:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073ebaa12/0x7b044d4128f9db3c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766467e expref: 64 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.197320:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000073ebaa12/0x7b044d4128f9db3c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766467e expref: 64 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938446.197336:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd257800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:19219:1871643350894080:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938446.197429:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbea80 going to sleep for 11 seconds 00010000:00010000:3.0:1784938446.197687:0:25723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c08077c/0x7b044d4128f9db35 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664677 expref: 64 pid: 21149 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938446.197703:0:25723:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b35f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:25723:1871643350893952:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938446.197729:0:25723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000073ebaa12/0x7b044d4128f9db3c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766467e expref: 63 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.197741:0:25723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c6200, rc 0) 00000100:00100000:3.0:1784938446.197786:0:25723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7ea6e988-18ba-4c98-b179-17995571b98b+63:17112:x1871643337511808:12345-192.168.202.54@tcp:101:cp.0 Request processed in 10396us (10594us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938446.197798:0:25723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 865 00000100:00100000:3.0:1784938446.202434:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd257800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:19219:1871643350894080:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938446.202463:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938446.202526:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+62:10957:x1871643337511936:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 5554us (5883us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938446.202538:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 432 00000100:00100000:0.0:1784938446.206314:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.206407:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337512192 00000100:00100000:2.0:1784938446.206416:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337512192 00000100:00100000:2.0:1784938446.206470:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 126 00000100:00100000:2.0:1784938446.206478:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+107:17112:x1871643337512192:12345-192.168.202.54@tcp:35:cp.0 00000001:00080000:2.0:1784938446.206675:0:25710:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934735 00000100:00100000:2.0:1784938446.208164:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+109:17112:x1871643337512192:12345-192.168.202.54@tcp:35:cp.0 Request processed in 1666us (1846us total) trans 8589934736 rc 0/0 00000100:00100000:2.0:1784938446.208177:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 126 00000020:00080000:2.0:1784938446.208184:0:25710:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784938446.230467:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.230547:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337512320 00000100:00100000:2.0:1784938446.230559:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337512320 00000100:00100000:2.0:1784938446.230625:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 574 00000100:00100000:2.0:1784938446.230635:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+109:17112:x1871643337512320:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938446.230660:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938446.230682:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9db43 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664685 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.230768:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9db4a lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.230783:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9db4a lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.230794:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9db4a lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.230809:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9db51 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe00215d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.230817:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9db51 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.230823:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9db51 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.230872:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9db4a lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.230880:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9db4a lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.230887:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9db4a lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.230893:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3ec00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938446.230898:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9db4a lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.230906:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9db4a lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.230918:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938446.230921:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.230926:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9db4a lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.230932:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9db4a lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.230943:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9db51 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.230949:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9db51 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.230954:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9db51 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.230958:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17a800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938446.230961:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9db51 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.230967:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9db51 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.230973:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xe00215d9 (ffff9f23823dda00) 00010000:00010000:2.0:1784938446.230976:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.230978:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9db51 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.231002:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9db51 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.231035:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9db43 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664685 expref: 110 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.231046:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938446.231048:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.231051:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9db43 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664685 expref: 110 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.231065:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3e400, rc 0) 00000100:00100000:2.0:1784938446.231368:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+109:17112:x1871643337512320:12345-192.168.202.54@tcp:101:cp.0 Request processed in 493us (668us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938446.231376:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 574 00000100:00100000:0.0:1784938446.239540:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.239683:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337512448 00000100:00100000:3.0:1784938446.239692:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337512448 00000100:00100000:3.0:1784938446.239752:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 575 00000100:00100000:3.0:1784938446.239762:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+109:17112:x1871643337512448:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938446.239782:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938446.239803:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9db58 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766468c expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.239906:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9db5f lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.239920:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9db5f lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.239933:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9db5f lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.239948:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9db66 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe00215d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.239955:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9db66 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.239966:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9db66 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.240450:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9db5f lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.240460:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9db5f lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.240467:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9db5f lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.240474:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9db5f lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.240480:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c7e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938446.240484:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9db5f lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.240491:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9db5f lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.240503:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938446.240506:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938446.240511:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9db5f lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.240517:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9db5f lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.240532:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9db66 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.240539:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9db66 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.240544:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9db66 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.240549:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c6400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938446.240552:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9db66 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.240558:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9db66 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.240564:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xe00215d9 (ffff9f238dcb3500) 00010000:00010000:3.0:1784938446.240566:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938446.240569:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9db66 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.240574:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9db66 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.240608:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9db58 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766468c expref: 110 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.240618:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938446.240620:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938446.240623:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9db58 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766468c expref: 110 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.240637:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c7400, rc 0) 00000100:00100000:3.0:1784938446.240707:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+109:17112:x1871643337512448:12345-192.168.202.54@tcp:101:cp.0 Request processed in 945us (1175us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938446.240714:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 575 00000100:00100000:1.0:1784938446.244327:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.244409:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337512704 00000100:00100000:2.0:1784938446.244421:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337512704 00000100:00100000:2.0:1784938446.244481:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 576 00000100:00100000:2.0:1784938446.244491:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+109:17112:x1871643337512704:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938446.244510:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938446.244532:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9db6d lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664693 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.244631:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9db74 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.244644:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9db74 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.244654:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9db74 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.244668:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9db7b lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0xe00215d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.244674:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9db7b lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.244680:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9db7b lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938446.246271:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x4e:0x0], index 0: 0 00010000:00010000:2.0:1784938446.247251:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9db82 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.247268:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9db82 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.247279:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9db82 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.247326:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9db74 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.247334:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9db74 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.247340:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9db74 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.247347:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3e400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938446.247352:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9db74 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.247359:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9db74 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.247372:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938446.247374:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.247379:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9db74 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.247389:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9db74 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938446.247402:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000087e65e91 reply state 00000000c7ac6daa transno 8589934737 ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9db7b lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.247413:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9db7b lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.247419:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xe00215d9 (ffff9f23823dda00) 00010000:00010000:2.0:1784938446.247422:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938446.247425:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938446.247464:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9db6d lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664693 expref: 112 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.247481:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9db82 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664693 expref: 111 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.247488:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1b:0x0].0x0 (ffff9f23823dd100) 00010000:00010000:2.0:1784938446.247490:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938446.247493:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a7600, rc 0) 00000100:00100000:2.0:1784938446.247562:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+112:17112:x1871643337512704:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3072us (3244us total) trans 8589934737 rc 0/0 00000100:00100000:2.0:1784938446.247570:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 576 00000100:00100000:1.0:1784938446.251936:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.252585:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337512832 00000100:00100000:3.0:1784938446.252596:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337512832 00000100:00100000:3.0:1784938446.252646:0:25720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 866 00000100:00100000:3.0:1784938446.252656:0:25720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7ea6e988-18ba-4c98-b179-17995571b98b+59:10960:x1871643337512832:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938446.252674:0:25720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938446.252696:0:25720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba5ff4a4/0x7b044d4128f9db90 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766469a expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938446.252721:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938446.252741:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4e:0x0].0x0 since=712s v=(0 0) 00010000:00010000:3.0:1784938446.252746:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938446.252756:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba5ff4a4/0x7b044d4128f9db90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766469a expref: 60 pid: 25720 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.252773:0:25720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ba5ff4a4/0x7b044d4128f9db90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766469a expref: 60 pid: 25720 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.252786:0:25720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c6000, rc 0) 00000100:00100000:3.0:1784938446.252848:0:25720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7ea6e988-18ba-4c98-b179-17995571b98b+60:10960:x1871643337512832:12345-192.168.202.54@tcp:101:cp.0 Request processed in 193us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938446.252867:0:25720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 866 00000100:00100000:1.0:1784938446.258757:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.258834:0:25726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337512960 00000100:00100000:2.0:1784938446.258843:0:25726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337512960 00000100:00100000:2.0:1784938446.258920:0:25726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 867 00000100:00100000:2.0:1784938446.258930:0:25726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7ea6e988-18ba-4c98-b179-17995571b98b+60:17112:x1871643337512960:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938446.258951:0:25726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938446.258969:0:25726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d73d028a/0x7b044d4128f9db97 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476646a1 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.259019:0:25726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba5ff4a4/0x7b044d4128f9db90 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766469a expref: 61 pid: 25720 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.259028:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.259033:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.259038:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d73d028a/0x7b044d4128f9db97 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 3 type: EXT [0->57343] (req 0->57343) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476646a1 expref: 61 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.259073:0:25726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba5ff4a4/0x7b044d4128f9db90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e94766469a expref: 61 pid: 25720 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.259087:0:25726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba5ff4a4/0x7b044d4128f9db90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766469a expref: 61 pid: 25720 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938446.259101:0:25726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2482b29c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:25726:1871643350894208:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938446.259201:0:25726:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34540 going to sleep for 11 seconds 00000100:00100000:2.0:1784938446.262216:0:25726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2482b29c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:25726:1871643350894208:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938446.262254:0:25726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d73d028a/0x7b044d4128f9db97 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 3 type: EXT [0->57343] (req 0->57343) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476646a1 expref: 61 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.262278:0:25726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a7a00, rc 0) 00000100:00100000:2.0:1784938446.262354:0:25726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7ea6e988-18ba-4c98-b179-17995571b98b+61:17112:x1871643337512960:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3424us (3604us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938446.262363:0:25726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 867 00000100:00100000:1.0:1784938446.265186:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.265312:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337513088 00000100:00100000:0.0:1784938446.265322:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337513088 00010000:00010000:0.0:1784938446.265365:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba5ff4a4/0x7b044d4128f9db90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766469a expref: 61 pid: 25720 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938446.265406:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 433 00000100:00100000:0.0:1784938446.265415:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+61:10959:x1871643337513088:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938446.265430:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938446.265453:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba5ff4a4/0x7b044d4128f9db90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766469a expref: 61 pid: 25720 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.265466:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba5ff4a4/0x7b044d4128f9db90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766469a expref: 61 pid: 25720 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.265488:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba5ff4a4/0x7b044d4128f9db90 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766469a expref: 61 pid: 25720 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.265506:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938446.265510:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938446.265518:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d73d028a/0x7b044d4128f9db97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476646a1 expref: 60 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.265527:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d73d028a/0x7b044d4128f9db97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476646a1 expref: 60 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.265565:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d73d028a/0x7b044d4128f9db97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476646a1 expref: 60 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938446.265580:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:19221:1871643350894336:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938446.265668:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d3a4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938446.270751:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:19221:1871643350894336:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938446.270780:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938446.270835:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+60:10959:x1871643337513088:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 5420us (5706us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938446.270846:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 433 00000100:00100000:2.0:1784938446.285366:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938446.285894:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337513344 00000100:00100000:1.0:1784938446.285905:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337513344 00000100:00100000:1.0:1784938446.285972:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 127 00000100:00100000:1.0:1784938446.285982:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+112:17112:x1871643337513344:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:1.0:1784938446.287689:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+113:17112:x1871643337513344:12345-192.168.202.54@tcp:35:cp.0 Request processed in 1699us (2323us total) trans 8589934738 rc 0/0 00000100:00100000:1.0:1784938446.287700:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 127 00000100:00100000:1.0:1784938446.293230:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.293435:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337513472 00000100:00100000:2.0:1784938446.293446:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337513472 00000100:00100000:2.0:1784938446.293518:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 577 00000100:00100000:2.0:1784938446.293528:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+113:17112:x1871643337513472:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938446.293553:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938446.293577:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9db9e lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476646a8 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.293645:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9dba5 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.293659:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9dba5 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.293670:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9dba5 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.293686:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9dbac lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x868dff87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.293693:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9dbac lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.293700:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9dbac lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.293738:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9dba5 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.293745:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9dba5 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.293752:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9dba5 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.293757:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9dba5 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.293763:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17a800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938446.293767:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9dba5 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.293774:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9dba5 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.293785:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938446.293789:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.293793:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9dba5 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.293799:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9dba5 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.293812:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9dbac lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.293817:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9dbac lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.293823:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9dbac lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.293829:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3e400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938446.293832:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9dbac lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.293838:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9dbac lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.293846:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x868dff87 (ffff9f23823dd500) 00010000:00010000:2.0:1784938446.293848:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.293851:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9dbac lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.293857:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9dbac lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.294612:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9db9e lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476646a8 expref: 114 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.294627:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938446.294629:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.294633:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6400/0x7b044d4128f9db9e lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476646a8 expref: 114 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.294641:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a6400, rc 0) 00000100:00100000:2.0:1784938446.294714:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+113:17112:x1871643337513472:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1187us (1493us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938446.294723:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 577 00000100:00100000:2.0:1784938446.299395:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938446.299613:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337513600 00000100:00100000:1.0:1784938446.299625:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337513600 00000100:00100000:1.0:1784938446.299688:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 578 00000100:00100000:1.0:1784938446.299698:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+113:17112:x1871643337513600:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938446.299719:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938446.299739:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9dbb3 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476646af expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.299812:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9dbba lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.299827:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9dbba lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.299838:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9dbba lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.299853:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9dbc1 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x868dff87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.299859:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9dbc1 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.299874:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9dbc1 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.299910:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9dbba lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.299916:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9dbba lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.299923:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9dbba lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.299928:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938446.299933:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9dbba lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.299944:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9dbba lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.299956:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938446.299959:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938446.299963:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9dbba lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.299969:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9dbba lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.299981:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9dbc1 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.299987:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9dbc1 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.300100:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9dbc1 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.300108:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938446.300111:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9dbc1 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.300118:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9dbc1 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.300126:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x868dff87 (ffff9f24898ddd00) 00010000:00010000:1.0:1784938446.300129:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938446.300132:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9dbc1 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.300143:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9dbc1 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.300257:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9dbb3 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476646af expref: 114 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.300495:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938446.300498:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938446.300502:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9dbb3 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476646af expref: 114 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.300512:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238db39200, rc 0) 00000100:00100000:1.0:1784938446.300621:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+113:17112:x1871643337513600:12345-192.168.202.54@tcp:101:cp.0 Request processed in 924us (1236us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938446.300629:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 578 00000100:00100000:1.0:1784938446.311962:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.312113:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337513856 00000100:00100000:3.0:1784938446.312122:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337513856 00000100:00100000:3.0:1784938446.312614:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 579 00000100:00100000:3.0:1784938446.312625:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+113:17112:x1871643337513856:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938446.312649:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938446.312671:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9dbc8 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476646b6 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.312771:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9dbcf lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.312787:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9dbcf lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.312799:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9dbcf lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.312816:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9dbd6 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x868dff87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.312823:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9dbd6 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.312829:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9dbd6 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938446.313790:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x4f:0x0], index 1: 0 00010000:00010000:2.0:1784938446.314092:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9dbdd lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.314105:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9dbdd lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.314113:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9dbdd lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.314689:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9dbcf lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.314698:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9dbcf lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.314705:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9dbcf lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.314712:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9dbcf lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.314720:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c6400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938446.314725:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9dbcf lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.314732:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9dbcf lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.314744:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938446.314747:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.314751:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9dbcf lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.314761:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9dbcf lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938446.314777:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005e6d16a4 reply state 00000000051a28d0 transno 8589934739 ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9dbd6 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.314789:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9dbd6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.314796:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x868dff87 (ffff9f2484afd200) 00010000:00010000:2.0:1784938446.314798:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938446.314801:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938446.314836:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9dbc8 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476646b6 expref: 116 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.314852:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9dbdd lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476646b6 expref: 115 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.314859:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1c:0x0].0x0 (ffff9f23823dd500) 00010000:00010000:2.0:1784938446.314933:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938446.314937:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17a800, rc 0) 00000100:00100000:2.0:1784938446.315113:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+116:17112:x1871643337513856:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2489us (3158us total) trans 8589934739 rc 0/0 00000100:00100000:2.0:1784938446.315123:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 579 00000100:00100000:2.0:1784938446.319989:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.320401:0:25724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337513984 00000100:00100000:0.0:1784938446.320412:0:25724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337513984 00000100:00100000:0.0:1784938446.320515:0:25724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 868 00000100:00100000:0.0:1784938446.320526:0:25724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7ea6e988-18ba-4c98-b179-17995571b98b+62:10958:x1871643337513984:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938446.320547:0:25724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938446.320571:0:25724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067911722/0x7b044d4128f9dbeb lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476646bd expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938446.320603:0:25724:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x4f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938446.320627:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4f:0x0].0x0 since=712s v=(0 0) 00010000:00010000:0.0:1784938446.320631:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938446.320643:0:25724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067911722/0x7b044d4128f9dbeb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476646bd expref: 63 pid: 25724 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.320662:0:25724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000067911722/0x7b044d4128f9dbeb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476646bd expref: 63 pid: 25724 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.320676:0:25724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d3d200, rc 0) 00000100:00100000:0.0:1784938446.320744:0:25724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7ea6e988-18ba-4c98-b179-17995571b98b+63:10958:x1871643337513984:12345-192.168.202.54@tcp:101:cp.0 Request processed in 219us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938446.320751:0:25724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 868 00000100:00100000:1.0:1784938446.327011:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.327420:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337514112 00000100:00100000:2.0:1784938446.327430:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337514112 00000100:00100000:2.0:1784938446.327483:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 869 00000100:00100000:2.0:1784938446.327492:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381360850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+63:17112:x1871643337514112:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938446.327509:0:25722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938446.327527:0:25722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e022c2b/0x7b044d4128f9dbf2 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476646c4 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.327558:0:25722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000067911722/0x7b044d4128f9dbeb lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476646bd expref: 64 pid: 25724 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.327566:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.327571:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.327576:0:25722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e022c2b/0x7b044d4128f9dbf2 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476646c4 expref: 64 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.327609:0:25722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000067911722/0x7b044d4128f9dbeb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e9476646bd expref: 64 pid: 25724 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.327623:0:25722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000067911722/0x7b044d4128f9dbeb lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476646bd expref: 64 pid: 25724 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938446.327636:0:25722:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2482b2a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25722:1871643350894464:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938446.327715:0:25722:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34540 going to sleep for 11 seconds 00000100:00100000:2.0:1784938446.332559:0:25722:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2482b2a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25722:1871643350894464:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938446.332592:0:25722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005e022c2b/0x7b044d4128f9dbf2 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476646c4 expref: 64 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.332618:0:25722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a6400, rc 0) 00000100:00100000:2.0:1784938446.332677:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381360850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+64:17112:x1871643337514112:12345-192.168.202.54@tcp:101:cp.0 Request processed in 5185us (5686us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938446.332687:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 869 00000100:00100000:1.0:1784938446.338670:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.338766:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337514240 00000100:00100000:0.0:1784938446.338777:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337514240 00010000:00010000:0.0:1784938446.338821:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000067911722/0x7b044d4128f9dbeb lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476646bd expref: 64 pid: 25724 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938446.338872:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 434 00000100:00100000:0.0:1784938446.338883:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+64:10957:x1871643337514240:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938446.338900:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938446.338922:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000067911722/0x7b044d4128f9dbeb lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476646bd expref: 64 pid: 25724 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.338941:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000067911722/0x7b044d4128f9dbeb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476646bd expref: 64 pid: 25724 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.338965:0:22955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067911722/0x7b044d4128f9dbeb lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476646bd expref: 64 pid: 25724 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.338985:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938446.338990:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938446.339066:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005e022c2b/0x7b044d4128f9dbf2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476646c4 expref: 63 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.339075:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e022c2b/0x7b044d4128f9dbf2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476646c4 expref: 63 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.339111:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005e022c2b/0x7b044d4128f9dbf2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476646c4 expref: 63 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938446.339125:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22955:1871643350894592:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938446.339256:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d3a4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938446.344815:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22955:1871643350894592:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938446.344846:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938446.344908:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+63:10957:x1871643337514240:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 6026us (6246us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938446.344919:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 434 00000100:00100000:1.0:1784938446.350649:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.350894:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337514496 00000100:00100000:2.0:1784938446.350904:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337514496 00000100:00100000:2.0:1784938446.350959:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 128 00000100:00100000:2.0:1784938446.350969:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+116:17112:x1871643337514496:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:2.0:1784938446.351766:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+117:17112:x1871643337514496:12345-192.168.202.54@tcp:35:cp.0 Request processed in 794us (1122us total) trans 8589934740 rc 0/0 00000100:00100000:2.0:1784938446.351775:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 128 00000100:00100000:1.0:1784938446.355079:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.355185:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337514624 00000100:00100000:3.0:1784938446.355195:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337514624 00000100:00100000:3.0:1784938446.355253:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 580 00000100:00100000:3.0:1784938446.355276:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+117:17112:x1871643337514624:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938446.355309:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938446.355330:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9dbf9 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476646cb expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.355398:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9dc00 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.355412:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9dc00 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.355423:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9dc00 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.355438:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9dc07 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x39c3d8fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.355445:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9dc07 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.355451:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9dc07 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.355490:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9dc00 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.355497:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9dc00 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.355502:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9dc00 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.355511:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c6400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938446.355515:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9dc00 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.355522:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9dc00 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.355533:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938446.355536:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938446.355540:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9dc00 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.355545:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9dc00 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.355559:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9dc07 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.355564:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9dc07 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.355569:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9dc07 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.355573:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c6000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938446.355576:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9dc07 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.355581:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9dc07 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.355591:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x39c3d8fe (ffff9f2484afd700) 00010000:00010000:3.0:1784938446.355593:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938446.355595:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9dc07 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.355600:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9dc07 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.355630:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9dbf9 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476646cb expref: 118 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.355640:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938446.355644:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938446.355647:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9dbf9 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476646cb expref: 118 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.355656:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c7400, rc 0) 00000100:00100000:3.0:1784938446.355726:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+117:17112:x1871643337514624:12345-192.168.202.54@tcp:101:cp.0 Request processed in 465us (657us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938446.355733:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 580 00000100:00100000:1.0:1784938446.363821:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.364037:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337514752 00000100:00100000:2.0:1784938446.364048:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337514752 00000100:00100000:2.0:1784938446.364120:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 581 00000100:00100000:2.0:1784938446.364141:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+117:17112:x1871643337514752:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938446.364484:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938446.364509:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9dc0e lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476646d2 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.364583:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ffa00/0x7b044d4128f9dc15 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.364599:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ffa00/0x7b044d4128f9dc15 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.364612:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ffa00/0x7b044d4128f9dc15 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.364627:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fea00/0x7b044d4128f9dc1c lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x39c3d8fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.364634:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fea00/0x7b044d4128f9dc1c lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.364639:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fea00/0x7b044d4128f9dc1c lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.364681:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ffa00/0x7b044d4128f9dc15 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.364690:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ffa00/0x7b044d4128f9dc15 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.364696:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ffa00/0x7b044d4128f9dc15 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.364702:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ffa00/0x7b044d4128f9dc15 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.364708:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823ffa00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938446.364713:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ffa00/0x7b044d4128f9dc15 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.364720:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ffa00/0x7b044d4128f9dc15 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.364732:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938446.364735:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.364739:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ffa00/0x7b044d4128f9dc15 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.364745:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ffa00/0x7b044d4128f9dc15 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.364757:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fea00/0x7b044d4128f9dc1c lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.364763:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fea00/0x7b044d4128f9dc1c lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.364770:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fea00/0x7b044d4128f9dc1c lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.364775:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fea00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938446.364778:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fea00/0x7b044d4128f9dc1c lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.364784:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fea00/0x7b044d4128f9dc1c lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.364790:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x39c3d8fe (ffff9f23823dde00) 00010000:00010000:2.0:1784938446.364792:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.364794:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fea00/0x7b044d4128f9dc1c lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.364800:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fea00/0x7b044d4128f9dc1c lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.364829:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9dc0e lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476646d2 expref: 118 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.364844:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938446.364846:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.364849:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e400/0x7b044d4128f9dc0e lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476646d2 expref: 118 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.364858:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3e400, rc 0) 00000100:00100000:2.0:1784938446.365135:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+117:17112:x1871643337514752:12345-192.168.202.54@tcp:101:cp.0 Request processed in 995us (3999us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938446.365175:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 581 00000100:00100000:1.0:1784938446.371046:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.371380:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337515008 00000100:00100000:3.0:1784938446.371390:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337515008 00000100:00100000:3.0:1784938446.371454:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 582 00000100:00100000:3.0:1784938446.371465:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+117:17112:x1871643337515008:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938446.371485:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938446.371505:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9dc23 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476646d9 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.371617:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9dc2a lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.371633:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9dc2a lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.371643:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9dc2a lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.371659:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9dc31 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x39c3d8fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.371667:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9dc31 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.371674:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9dc31 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938446.372064:0:24203:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x4f:0x0], index 0: 0 00010000:00010000:2.0:1784938446.372968:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fea00/0x7b044d4128f9dc38 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.372984:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fea00/0x7b044d4128f9dc38 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.373003:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fea00/0x7b044d4128f9dc38 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.373040:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9dc2a lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.373047:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9dc2a lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.373053:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9dc2a lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.373059:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c6000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938446.373063:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9dc2a lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.373072:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9dc2a lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.373085:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938446.373087:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.373092:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9dc2a lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.373097:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9dc2a lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938446.373110:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006bd47abc reply state 0000000030d544d0 transno 8589934741 ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9dc31 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.373120:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9dc31 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.373125:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x39c3d8fe (ffff9f2484afd700) 00010000:00010000:2.0:1784938446.373127:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938446.373130:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938446.373476:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9dc23 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476646d9 expref: 120 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.373493:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fea00/0x7b044d4128f9dc38 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476646d9 expref: 119 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.373500:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1d:0x0].0x0 (ffff9f23823dde00) 00010000:00010000:2.0:1784938446.373503:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938446.373505:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fea00, rc 0) 00000100:00100000:2.0:1784938446.373579:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+120:17112:x1871643337515008:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2116us (2544us total) trans 8589934741 rc 0/0 00000100:00100000:2.0:1784938446.373588:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 582 00000100:00100000:1.0:1784938446.379055:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.379426:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337515136 00000100:00100000:3.0:1784938446.379437:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337515136 00000100:00100000:0.0:1784938446.379553:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 870 00000100:00100000:0.0:1784938446.379564:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+60:10959:x1871643337515136:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938446.379584:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938446.379608:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067911722/0x7b044d4128f9dc46 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476646e0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938446.379637:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938446.379660:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f:0x0].0x0 since=712s v=(0 0) 00010000:00010000:0.0:1784938446.379664:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938446.379676:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067911722/0x7b044d4128f9dc46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476646e0 expref: 61 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.379695:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067911722/0x7b044d4128f9dc46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476646e0 expref: 61 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.379711:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d3d200, rc 0) 00000100:00100000:0.0:1784938446.379775:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+61:10959:x1871643337515136:12345-192.168.202.54@tcp:101:cp.0 Request processed in 212us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938446.379782:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 870 00000100:00100000:1.0:1784938446.385810:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.385974:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337515264 00000100:00100000:0.0:1784938446.385984:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337515264 00000100:00100000:0.0:1784938446.386093:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 871 00000100:00100000:0.0:1784938446.386104:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+61:17112:x1871643337515264:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938446.386124:0:25715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938446.386196:0:25715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f7640b/0x7b044d4128f9dc4d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476646e7 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.386235:0:25715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067911722/0x7b044d4128f9dc46 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476646e0 expref: 62 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.386244:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938446.386248:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938446.386253:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f7640b/0x7b044d4128f9dc4d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476646e7 expref: 62 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.386308:0:25715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000067911722/0x7b044d4128f9dc46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e9476646e0 expref: 62 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.386323:0:25715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000067911722/0x7b044d4128f9dc46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476646e0 expref: 62 pid: 21151 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938446.386337:0:25715:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25715:1871643350894720:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938446.386409:0:25715:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d3a4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938446.392365:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.392536:0:25715:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25715:1871643350894720:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938446.392571:0:25715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000006f7640b/0x7b044d4128f9dc4d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476646e7 expref: 62 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.392593:0:25715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d3dc00, rc 0) 00000100:00100000:0.0:1784938446.392651:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+62:17112:x1871643337515264:12345-192.168.202.54@tcp:101:cp.0 Request processed in 6548us (6851us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938446.392663:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 871 00000100:00100000:3.0:1784938446.393488:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337515392 00000100:00100000:3.0:1784938446.393495:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337515392 00010000:00010000:3.0:1784938446.393528:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000067911722/0x7b044d4128f9dc46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476646e0 expref: 62 pid: 21151 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938446.393566:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 435 00000100:00100000:3.0:1784938446.393576:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+62:10960:x1871643337515392:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938446.393590:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938446.393614:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000067911722/0x7b044d4128f9dc46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476646e0 expref: 62 pid: 21151 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.393627:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000067911722/0x7b044d4128f9dc46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476646e0 expref: 62 pid: 21151 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.393648:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067911722/0x7b044d4128f9dc46 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476646e0 expref: 62 pid: 21151 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.393663:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938446.393668:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938446.393676:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000006f7640b/0x7b044d4128f9dc4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476646e7 expref: 61 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.393686:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f7640b/0x7b044d4128f9dc4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476646e7 expref: 61 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.393718:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000006f7640b/0x7b044d4128f9dc4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476646e7 expref: 61 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938446.393732:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b35f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350894848:192.168.202.54@tcp:105: 00000100:00100000:3.0:1784938446.393859:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f249164b180 going to sleep for 11 seconds 00000100:00100000:0.0:1784938446.405697:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.405789:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337515648 00000100:00100000:2.0:1784938446.405799:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337515648 00000100:00100000:2.0:1784938446.405871:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 129 00000100:00100000:2.0:1784938446.405883:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24857fc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+120:17112:x1871643337515648:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:2.0:1784938446.406375:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24857fc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+121:17112:x1871643337515648:12345-192.168.202.54@tcp:35:cp.0 Request processed in 493us (686us total) trans 8589934742 rc 0/0 00000100:00100000:2.0:1784938446.408314:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 129 00000100:00100000:3.0:1784938446.411732:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b35f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350894848:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938446.411760:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938446.412232:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+61:10960:x1871643337515392:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 18655us (19877us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938446.412245:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 435 00000100:00100000:0.0:1784938446.412644:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938446.413724:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337515776 00000100:00100000:1.0:1784938446.413734:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337515776 00000100:00100000:1.0:1784938446.413789:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 583 00000100:00100000:1.0:1784938446.413797:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+121:17112:x1871643337515776:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938446.413821:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938446.413839:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9dc54 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476646ee expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.413928:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9dc5b lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.413943:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9dc5b lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.413953:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9dc5b lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.413966:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9dc62 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x5b30f298 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.413973:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9dc62 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.413980:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9dc62 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.414103:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9dc5b lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.414112:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9dc5b lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.414117:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9dc5b lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.414375:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9dc5b lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.414382:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938446.414386:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9dc5b lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.414395:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9dc5b lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.414407:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938446.414410:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938446.414414:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9dc5b lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.414420:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9dc5b lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.414433:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9dc62 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.414439:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9dc62 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.414445:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9dc62 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.414450:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938446.414453:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9dc62 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.414463:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9dc62 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.414469:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x5b30f298 (ffff9f24898ddd00) 00010000:00010000:1.0:1784938446.414471:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938446.414473:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9dc62 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.414478:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9dc62 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.414508:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9dc54 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476646ee expref: 122 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.414518:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938446.414520:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938446.414523:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9dc54 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476646ee expref: 122 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.414531:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238db39e00, rc 0) 00000100:00100000:1.0:1784938446.414586:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+121:17112:x1871643337515776:12345-192.168.202.54@tcp:101:cp.0 Request processed in 789us (1943us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938446.414593:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 583 00000100:00100000:0.0:1784938446.422060:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938446.422235:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337515904 00000100:00100000:1.0:1784938446.422246:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337515904 00000100:00100000:1.0:1784938446.422356:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 584 00000100:00100000:1.0:1784938446.422366:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+121:17112:x1871643337515904:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938446.422404:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938446.422424:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39a00/0x7b044d4128f9dc69 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476646f5 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.422491:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9dc70 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.422505:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9dc70 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.422516:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9dc70 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.422533:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9dc77 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x5b30f298 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.422540:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9dc77 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.422547:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9dc77 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.422584:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9dc70 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.422591:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9dc70 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.422597:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9dc70 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.422602:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db38a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938446.422607:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9dc70 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.422615:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9dc70 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.422625:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938446.422628:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938446.422631:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9dc70 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.422637:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9dc70 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.422648:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9dc77 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.422653:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9dc77 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.422659:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9dc77 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.422663:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c559000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938446.422665:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9dc77 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.422670:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9dc77 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.422676:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x5b30f298 (ffff9f24b67c7f00) 00010000:00010000:1.0:1784938446.422679:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938446.422681:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9dc77 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.422687:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9dc77 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.422717:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39a00/0x7b044d4128f9dc69 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476646f5 expref: 122 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.422727:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938446.422729:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938446.422734:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39a00/0x7b044d4128f9dc69 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476646f5 expref: 122 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.422743:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238db39a00, rc 0) 00000100:00100000:1.0:1784938446.422804:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+121:17112:x1871643337515904:12345-192.168.202.54@tcp:101:cp.0 Request processed in 439us (814us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938446.422811:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 584 00000100:00100000:3.0:1784938446.427259:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.427870:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337516160 00000100:00100000:2.0:1784938446.427880:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337516160 00000100:00100000:2.0:1784938446.427957:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 585 00000100:00100000:2.0:1784938446.427967:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b35f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+121:17112:x1871643337516160:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938446.427988:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938446.428234:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9dc7e lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476646fc expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.428570:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dc85 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.428585:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dc85 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.428597:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dc85 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.428614:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fe600/0x7b044d4128f9dc8c lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x5b30f298 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.428621:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fe600/0x7b044d4128f9dc8c lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.428628:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fe600/0x7b044d4128f9dc8c lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938446.428952:0:24203:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x50:0x0], index 1: 0 00010000:00010000:2.0:1784938446.430059:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff600/0x7b044d4128f9dc93 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.430075:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff600/0x7b044d4128f9dc93 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.430084:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff600/0x7b044d4128f9dc93 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.430118:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dc85 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.430138:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dc85 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.430164:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dc85 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.430171:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fec00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938446.430176:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dc85 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.430183:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dc85 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.430200:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938446.430203:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.430208:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dc85 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.430213:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dc85 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938446.430225:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000072ba722c reply state 00000000e97f295a transno 8589934743 ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fe600/0x7b044d4128f9dc8c lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.430236:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fe600/0x7b044d4128f9dc8c lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.430243:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x5b30f298 (ffff9f23823ddc00) 00010000:00010000:2.0:1784938446.430246:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938446.430248:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938446.430369:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9dc7e lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476646fc expref: 124 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.430487:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff600/0x7b044d4128f9dc93 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476646fc expref: 123 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.430495:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1e:0x0].0x0 (ffff9f23823dd900) 00010000:00010000:2.0:1784938446.430497:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938446.430500:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823ff600, rc 0) 00000100:00100000:2.0:1784938446.430596:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b35f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+124:17112:x1871643337516160:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2630us (3344us total) trans 8589934743 rc 0/0 00000100:00100000:2.0:1784938446.430605:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 585 00000100:00100000:3.0:1784938446.436888:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.436967:0:25719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337516288 00000100:00100000:2.0:1784938446.436976:0:25719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337516288 00000100:00100000:2.0:1784938446.437046:0:25719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 872 00000100:00100000:2.0:1784938446.437058:0:25719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b35f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7ea6e988-18ba-4c98-b179-17995571b98b+63:10958:x1871643337516288:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938446.437077:0:25719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938446.437097:0:25719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000baaa6dd1/0x7b044d4128f9dca1 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664703 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938446.437123:0:25719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x50:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938446.437179:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x50:0x0].0x0 since=712s v=(0 0) 00010000:00010000:2.0:1784938446.437184:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x50:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.437195:0:25719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baaa6dd1/0x7b044d4128f9dca1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664703 expref: 64 pid: 25719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.437213:0:25719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000baaa6dd1/0x7b044d4128f9dca1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664703 expref: 64 pid: 25719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.437227:0:25719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823ffa00, rc 0) 00000100:00100000:2.0:1784938446.437292:0:25719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b35f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7ea6e988-18ba-4c98-b179-17995571b98b+64:10958:x1871643337516288:12345-192.168.202.54@tcp:101:cp.0 Request processed in 236us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938446.437308:0:25719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 872 00000100:00100000:1.0:1784938446.444088:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.444214:0:25729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337516416 00000100:00100000:2.0:1784938446.444228:0:25729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337516416 00000100:00100000:2.0:1784938446.444297:0:25729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 873 00000100:00100000:2.0:1784938446.444316:0:25729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7ea6e988-18ba-4c98-b179-17995571b98b+64:17112:x1871643337516416:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938446.444334:0:25729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938446.444356:0:25729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d902d1a6/0x7b044d4128f9dca8 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x50:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766470a expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.444390:0:25729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000baaa6dd1/0x7b044d4128f9dca1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664703 expref: 65 pid: 25719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.444399:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x50:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.444403:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x50:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.444408:0:25729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d902d1a6/0x7b044d4128f9dca8 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x50:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766470a expref: 65 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.444442:0:25729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000baaa6dd1/0x7b044d4128f9dca1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664703 expref: 65 pid: 25719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.444456:0:25729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000baaa6dd1/0x7b044d4128f9dca1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664703 expref: 65 pid: 25719 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938446.444470:0:25729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2482b29c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:25729:1871643350894976:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938446.444545:0:25729:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938446.450882:0:25729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2482b29c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:25729:1871643350894976:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938446.450918:0:25729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d902d1a6/0x7b044d4128f9dca8 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x50:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766470a expref: 65 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.450937:0:25729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3e400, rc 0) 00000100:00100000:2.0:1784938446.451004:0:25729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7ea6e988-18ba-4c98-b179-17995571b98b+65:17112:x1871643337516416:12345-192.168.202.54@tcp:101:cp.0 Request processed in 6689us (6930us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938446.451017:0:25729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 873 00000100:00100000:1.0:1784938446.454556:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.454643:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337516544 00000100:00100000:0.0:1784938446.454652:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337516544 00010000:00010000:0.0:1784938446.454694:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000baaa6dd1/0x7b044d4128f9dca1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664703 expref: 65 pid: 25719 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938446.454743:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 436 00000100:00100000:0.0:1784938446.454752:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+65:10957:x1871643337516544:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938446.454768:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938446.454788:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000baaa6dd1/0x7b044d4128f9dca1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x50:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664703 expref: 65 pid: 25719 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.454802:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000baaa6dd1/0x7b044d4128f9dca1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x50:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664703 expref: 65 pid: 25719 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.454824:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baaa6dd1/0x7b044d4128f9dca1 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x50:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664703 expref: 65 pid: 25719 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.454842:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x50:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938446.454846:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x50:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938446.454857:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d902d1a6/0x7b044d4128f9dca8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766470a expref: 64 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.454878:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d902d1a6/0x7b044d4128f9dca8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766470a expref: 64 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.458501:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d902d1a6/0x7b044d4128f9dca8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766470a expref: 64 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938446.458532:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350895104:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938446.458640:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d3a4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938446.463856:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.464015:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350895104:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938446.464038:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938446.464096:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+64:10957:x1871643337516544:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 9344us (9549us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938446.464107:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 436 00000100:00100000:2.0:1784938446.464759:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337516800 00000100:00100000:2.0:1784938446.464768:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337516800 00000100:00100000:2.0:1784938446.464819:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 130 00000100:00100000:2.0:1784938446.464828:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+124:17112:x1871643337516800:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:2.0:1784938446.465688:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+125:17112:x1871643337516800:12345-192.168.202.54@tcp:35:cp.0 Request processed in 858us (1838us total) trans 8589934744 rc 0/0 00000100:00100000:2.0:1784938446.465697:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 130 00000100:00100000:1.0:1784938446.469973:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.470203:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337516928 00000100:00100000:3.0:1784938446.470212:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337516928 00000100:00100000:3.0:1784938446.470275:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 586 00000100:00100000:3.0:1784938446.470285:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+125:17112:x1871643337516928:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938446.470319:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938446.470341:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9dcaf lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664711 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.470415:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9dcb6 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.470431:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9dcb6 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.470442:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9dcb6 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.470458:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbe00/0x7b044d4128f9dcbd lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x2893e4db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.470465:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbe00/0x7b044d4128f9dcbd lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.470471:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbe00/0x7b044d4128f9dcbd lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.470515:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9dcb6 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.470522:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9dcb6 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.470532:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9dcb6 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.470538:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9dcb6 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.470544:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c6000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938446.470549:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9dcb6 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.470555:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9dcb6 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.470566:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938446.470570:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938446.470574:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9dcb6 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.470580:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9dcb6 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.470594:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbe00/0x7b044d4128f9dcbd lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.470600:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbe00/0x7b044d4128f9dcbd lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.470605:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbe00/0x7b044d4128f9dcbd lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.470609:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5dbe00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938446.470612:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbe00/0x7b044d4128f9dcbd lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.470618:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbe00/0x7b044d4128f9dcbd lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.470625:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x2893e4db (ffff9f2484afdc00) 00010000:00010000:3.0:1784938446.470627:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938446.470629:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbe00/0x7b044d4128f9dcbd lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.470634:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbe00/0x7b044d4128f9dcbd lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.470666:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9dcaf lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664711 expref: 126 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.470676:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938446.470678:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938446.470682:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9dcaf lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664711 expref: 126 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.470692:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c7400, rc 0) 00000100:00100000:3.0:1784938446.470754:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+125:17112:x1871643337516928:12345-192.168.202.54@tcp:101:cp.0 Request processed in 470us (790us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938446.470761:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 586 00000100:00100000:3.0:1784938446.475469:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.475587:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337517056 00000100:00100000:2.0:1784938446.475598:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337517056 00000100:00100000:2.0:1784938446.475683:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 587 00000100:00100000:2.0:1784938446.475697:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b35f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+125:17112:x1871643337517056:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938446.475728:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938446.475759:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ffa00/0x7b044d4128f9dcc4 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664718 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.475849:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9dccb lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.475882:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9dccb lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.475895:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9dccb lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.475911:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dcd2 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x2893e4db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.475923:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dcd2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.475930:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dcd2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.475995:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9dccb lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.476005:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9dccb lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.476013:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9dccb lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.476018:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823ff000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938446.476022:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9dccb lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.476030:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9dccb lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.476042:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938446.476046:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.476051:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9dccb lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.476057:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9dccb lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.476070:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dcd2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.476077:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dcd2 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.476083:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dcd2 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.476087:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fec00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938446.476090:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dcd2 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.476096:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dcd2 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.476103:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x2893e4db (ffff9f23823ddf00) 00010000:00010000:2.0:1784938446.476106:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.476109:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dcd2 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.476114:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dcd2 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.476188:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ffa00/0x7b044d4128f9dcc4 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664718 expref: 126 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.476199:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938446.476201:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.476205:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ffa00/0x7b044d4128f9dcc4 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664718 expref: 126 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.476220:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823ffa00, rc 0) 00000100:00100000:2.0:1784938446.476276:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b35f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+125:17112:x1871643337517056:12345-192.168.202.54@tcp:101:cp.0 Request processed in 584us (818us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938446.476283:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 587 00000100:00100000:0.0:1784938446.485962:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.486057:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337517312 00000100:00100000:3.0:1784938446.486066:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337517312 00000100:00100000:3.0:1784938446.486137:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 588 00000100:00100000:3.0:1784938446.486179:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+125:17112:x1871643337517312:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938446.486201:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938446.486221:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbe00/0x7b044d4128f9dcd9 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766471f expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.486332:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5db400/0x7b044d4128f9dce0 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.486347:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5db400/0x7b044d4128f9dce0 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.486357:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5db400/0x7b044d4128f9dce0 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.486374:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9dce7 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x2893e4db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.486381:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9dce7 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.486388:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9dce7 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938446.486682:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x50:0x0], index 0: 0 00010000:00010000:3.0:1784938446.486813:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5db000/0x7b044d4128f9dcee lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.486822:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5db000/0x7b044d4128f9dcee lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.486828:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5db000/0x7b044d4128f9dcee lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.486857:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5db400/0x7b044d4128f9dce0 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.486864:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5db400/0x7b044d4128f9dce0 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.486870:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5db400/0x7b044d4128f9dce0 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.486876:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5db400/0x7b044d4128f9dce0 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.486882:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5db400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938446.486886:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5db400/0x7b044d4128f9dce0 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.486892:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5db400/0x7b044d4128f9dce0 lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.486902:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938446.486905:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938446.486909:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5db400/0x7b044d4128f9dce0 lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.486914:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5db400/0x7b044d4128f9dce0 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938446.486927:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006e208787 reply state 00000000a6efe5fc transno 8589934745 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9dce7 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.486937:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9dce7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.486944:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x2893e4db (ffff9f2484afdc00) 00010000:00010000:3.0:1784938446.486946:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938446.486948:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938446.486976:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbe00/0x7b044d4128f9dcd9 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766471f expref: 128 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.487008:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5db000/0x7b044d4128f9dcee lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766471f expref: 127 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.487016:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1f:0x0].0x0 (ffff9f238dcb3500) 00010000:00010000:3.0:1784938446.487018:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938446.487021:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d5db000, rc 0) 00000100:00100000:3.0:1784938446.487093:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+128:17112:x1871643337517312:12345-192.168.202.54@tcp:101:cp.0 Request processed in 947us (1142us total) trans 8589934745 rc 0/0 00000100:00100000:3.0:1784938446.487101:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 588 00000100:00100000:1.0:1784938446.494553:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.494684:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337517440 00000100:00100000:3.0:1784938446.494693:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337517440 00000100:00100000:3.0:1784938446.494760:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 874 00000100:00100000:3.0:1784938446.494771:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+61:10960:x1871643337517440:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938446.494795:0:25716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938446.494827:0:25716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000af2a948/0x7b044d4128f9dcfc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664726 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938446.494859:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x50:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938446.494893:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50:0x0].0x0 since=712s v=(0 0) 00010000:00010000:3.0:1784938446.494898:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938446.494909:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000af2a948/0x7b044d4128f9dcfc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664726 expref: 62 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.494926:0:25716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000af2a948/0x7b044d4128f9dcfc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664726 expref: 62 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.494939:0:25716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d5dbe00, rc 0) 00000100:00100000:3.0:1784938446.495264:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+62:10960:x1871643337517440:12345-192.168.202.54@tcp:101:cp.0 Request processed in 493us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938446.495272:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 874 00000100:00100000:1.0:1784938446.501672:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.501765:0:25723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337517568 00000100:00100000:3.0:1784938446.501775:0:25723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337517568 00000100:00100000:3.0:1784938446.501839:0:25723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 875 00000100:00100000:3.0:1784938446.501850:0:25723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7ea6e988-18ba-4c98-b179-17995571b98b+62:17112:x1871643337517568:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938446.501882:0:25723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938446.501903:0:25723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c14136c/0x7b044d4128f9dd03 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x50:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766472d expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.501937:0:25723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000af2a948/0x7b044d4128f9dcfc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664726 expref: 63 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.501946:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938446.501951:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938446.501956:0:25723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c14136c/0x7b044d4128f9dd03 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x50:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766472d expref: 63 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.501992:0:25723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000af2a948/0x7b044d4128f9dcfc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664726 expref: 63 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.502020:0:25723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000af2a948/0x7b044d4128f9dcfc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664726 expref: 63 pid: 25716 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938446.502035:0:25723:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b35f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:25723:1871643350895232:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938446.502124:0:25723:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238cd3fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938446.505939:0:25723:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b35f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:25723:1871643350895232:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938446.505976:0:25723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c14136c/0x7b044d4128f9dd03 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x50:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766472d expref: 63 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.506004:0:25723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d5db400, rc 0) 00000100:00100000:3.0:1784938446.506073:0:25723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7ea6e988-18ba-4c98-b179-17995571b98b+63:17112:x1871643337517568:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4223us (4409us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938446.506082:0:25723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 875 00000100:00100000:0.0:1784938446.506398:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.506536:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337517696 00000100:00100000:2.0:1784938446.506543:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337517696 00010000:00010000:2.0:1784938446.506574:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000af2a948/0x7b044d4128f9dcfc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664726 expref: 63 pid: 25716 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938446.506610:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 437 00000100:00100000:2.0:1784938446.506619:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2498335850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+63:10960:x1871643337517696:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938446.506632:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938446.506652:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000af2a948/0x7b044d4128f9dcfc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x50:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664726 expref: 63 pid: 25716 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.506665:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000af2a948/0x7b044d4128f9dcfc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x50:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664726 expref: 63 pid: 25716 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.506688:0:22955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000af2a948/0x7b044d4128f9dcfc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x50:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664726 expref: 63 pid: 25716 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.506702:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.506706:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.506715:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c14136c/0x7b044d4128f9dd03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766472d expref: 62 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.506726:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c14136c/0x7b044d4128f9dd03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766472d expref: 62 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.506758:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000c14136c/0x7b044d4128f9dd03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766472d expref: 62 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938446.506771:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2482b29c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350895360:192.168.202.54@tcp:105: 00000100:00100000:2.0:1784938446.506827:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938446.514932:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.515190:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2482b29c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350895360:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938446.515224:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938446.515296:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2498335850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+62:10960:x1871643337517696:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 8677us (8898us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938446.515318:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 437 00000100:00100000:3.0:1784938446.516277:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337517952 00000100:00100000:3.0:1784938446.516287:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337517952 00000100:00100000:3.0:1784938446.516352:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 131 00000100:00100000:3.0:1784938446.516362:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+128:17112:x1871643337517952:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938446.516962:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+129:17112:x1871643337517952:12345-192.168.202.54@tcp:35:cp.0 Request processed in 600us (2038us total) trans 8589934746 rc 0/0 00000100:00100000:3.0:1784938446.516970:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 131 00000100:00100000:0.0:1784938446.535558:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.536450:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337518080 00000100:00100000:2.0:1784938446.536465:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337518080 00000100:00100000:2.0:1784938446.536543:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 589 00000100:00100000:2.0:1784938446.536553:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+129:17112:x1871643337518080:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938446.536579:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938446.536600:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ffa00/0x7b044d4128f9dd0a lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664734 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.536668:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dd11 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.536683:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dd11 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.536695:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dd11 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.536710:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9dd18 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x49aa722d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.536716:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9dd18 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.536723:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9dd18 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.536765:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dd11 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.536772:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dd11 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.536779:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dd11 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.536785:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fec00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938446.536789:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dd11 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.536796:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dd11 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.536809:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938446.536812:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.536816:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dd11 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.536823:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dd11 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.536837:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9dd18 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.536842:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9dd18 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.536848:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9dd18 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.536853:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823ff000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938446.536856:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9dd18 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.536862:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9dd18 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.536869:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x49aa722d (ffff9f23823ddf00) 00010000:00010000:2.0:1784938446.536871:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.536874:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9dd18 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.536880:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9dd18 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.536914:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ffa00/0x7b044d4128f9dd0a lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664734 expref: 130 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.536929:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938446.536931:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.536935:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ffa00/0x7b044d4128f9dd0a lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664734 expref: 130 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.536944:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823ffa00, rc 0) 00000100:00100000:2.0:1784938446.537094:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+129:17112:x1871643337518080:12345-192.168.202.54@tcp:101:cp.0 Request processed in 542us (1558us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938446.537104:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 589 00000100:00100000:1.0:1784938446.543683:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.543766:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337518208 00000100:00100000:3.0:1784938446.543776:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337518208 00000100:00100000:3.0:1784938446.543837:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 590 00000100:00100000:3.0:1784938446.543849:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+129:17112:x1871643337518208:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938446.543879:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938446.543900:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5db800/0x7b044d4128f9dd1f lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766473b expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.543967:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9dd26 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.543981:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9dd26 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.544004:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9dd26 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.544021:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbc00/0x7b044d4128f9dd2d lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x49aa722d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.544029:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbc00/0x7b044d4128f9dd2d lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.544036:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbc00/0x7b044d4128f9dd2d lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.544080:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9dd26 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.544087:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9dd26 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.544093:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9dd26 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.544103:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9dd26 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.544108:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5da400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938446.544112:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9dd26 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.544118:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9dd26 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.544140:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938446.544177:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938446.544182:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9dd26 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.544189:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9dd26 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.544204:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbc00/0x7b044d4128f9dd2d lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.544210:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbc00/0x7b044d4128f9dd2d lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.544215:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbc00/0x7b044d4128f9dd2d lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.544219:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5dbc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938446.544222:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbc00/0x7b044d4128f9dd2d lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.544231:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbc00/0x7b044d4128f9dd2d lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.544237:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x49aa722d (ffff9f23861f8000) 00010000:00010000:3.0:1784938446.544239:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938446.544242:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbc00/0x7b044d4128f9dd2d lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.544247:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbc00/0x7b044d4128f9dd2d lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.544278:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5db800/0x7b044d4128f9dd1f lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766473b expref: 130 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.544287:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938446.544290:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938446.544293:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5db800/0x7b044d4128f9dd1f lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766473b expref: 130 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.544313:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d5db800, rc 0) 00000100:00100000:3.0:1784938446.544361:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+129:17112:x1871643337518208:12345-192.168.202.54@tcp:101:cp.0 Request processed in 515us (688us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938446.544368:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 590 00000100:00100000:3.0:1784938446.557665:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.557882:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337518464 00000100:00100000:2.0:1784938446.557891:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337518464 00000100:00100000:2.0:1784938446.557954:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 591 00000100:00100000:2.0:1784938446.557963:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b35f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+129:17112:x1871643337518464:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938446.557998:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938446.558021:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ffa00/0x7b044d4128f9dd34 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664742 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.558119:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9dd3b lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.558176:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9dd3b lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.558187:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9dd3b lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.558202:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dd42 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x49aa722d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.558209:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dd42 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.558215:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dd42 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938446.559227:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x51:0x0], index 1: 0 00010000:00010000:2.0:1784938446.559405:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039a00/0x7b044d4128f9dd49 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.559418:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039a00/0x7b044d4128f9dd49 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.559428:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039a00/0x7b044d4128f9dd49 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.559463:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9dd3b lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.559470:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9dd3b lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.559477:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9dd3b lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.559484:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823ff000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938446.559488:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9dd3b lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.559496:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9dd3b lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.559513:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938446.560369:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.560379:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9dd3b lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.560388:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9dd3b lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938446.560407:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ac545f3e reply state 00000000450e6f89 transno 8589934747 ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dd42 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.560420:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dd42 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.560429:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x49aa722d (ffff9f23823ddf00) 00010000:00010000:2.0:1784938446.560431:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938446.560434:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938446.560477:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ffa00/0x7b044d4128f9dd34 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664742 expref: 132 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.560492:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039a00/0x7b044d4128f9dd49 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664742 expref: 131 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.560499:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x20:0x0].0x0 (ffff9f23823ddd00) 00010000:00010000:2.0:1784938446.560502:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938446.560504:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382039a00, rc 0) 00000100:00100000:2.0:1784938446.561510:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b35f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+132:17112:x1871643337518464:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3544us (3850us total) trans 8589934747 rc 0/0 00000100:00100000:2.0:1784938446.561529:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 591 00010000:00010000:3.0:1784938446.569757:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938446.571528:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.571617:0:25718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337518592 00000100:00100000:3.0:1784938446.571627:0:25718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337518592 00000100:00100000:3.0:1784938446.571686:0:25718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 876 00000100:00100000:3.0:1784938446.571695:0:25718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ea6e988-18ba-4c98-b179-17995571b98b+64:10958:x1871643337518592:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938446.571714:0:25718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938446.571736:0:25718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b7dca5e/0x7b044d4128f9dd57 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664749 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938446.571762:0:25718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x51:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938446.571783:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x51:0x0].0x0 since=712s v=(0 0) 00010000:00010000:3.0:1784938446.571788:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x51:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938446.571798:0:25718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b7dca5e/0x7b044d4128f9dd57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664749 expref: 65 pid: 25718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.571817:0:25718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002b7dca5e/0x7b044d4128f9dd57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664749 expref: 65 pid: 25718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.571830:0:25718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d5da800, rc 0) 00000100:00100000:3.0:1784938446.571901:0:25718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ea6e988-18ba-4c98-b179-17995571b98b+65:10958:x1871643337518592:12345-192.168.202.54@tcp:101:cp.0 Request processed in 207us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938446.571909:0:25718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 876 00000100:00100000:0.0:1784938446.576320:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.576415:0:25726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337518720 00000100:00100000:2.0:1784938446.576424:0:25726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337518720 00000100:00100000:2.0:1784938446.576470:0:25726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 877 00000100:00100000:2.0:1784938446.576479:0:25726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7ea6e988-18ba-4c98-b179-17995571b98b+65:17112:x1871643337518720:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938446.576496:0:25726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938446.576513:0:25726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4e718c3/0x7b044d4128f9dd5e lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x51:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664750 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.576555:0:25726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002b7dca5e/0x7b044d4128f9dd57 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664749 expref: 66 pid: 25718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.576563:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x51:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.576567:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x51:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.576572:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4e718c3/0x7b044d4128f9dd5e lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x51:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664750 expref: 66 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.576603:0:25726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002b7dca5e/0x7b044d4128f9dd57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664749 expref: 66 pid: 25718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.576616:0:25726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002b7dca5e/0x7b044d4128f9dd57 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664749 expref: 66 pid: 25718 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938446.576629:0:25726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2482b29c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:25726:1871643350895488:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938446.576712:0:25726:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34780 going to sleep for 11 seconds 00000100:00100000:2.0:1784938446.581063:0:25726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2482b29c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:25726:1871643350895488:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938446.581099:0:25726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a4e718c3/0x7b044d4128f9dd5e lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x51:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664750 expref: 66 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.581121:0:25726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382039c00, rc 0) 00000100:00100000:2.0:1784938446.581203:0:25726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7ea6e988-18ba-4c98-b179-17995571b98b+66:17112:x1871643337518720:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4724us (4891us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938446.581213:0:25726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 877 00000100:00100000:1.0:1784938446.585576:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.585820:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337518848 00000100:00100000:0.0:1784938446.585831:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337518848 00010000:00010000:0.0:1784938446.585887:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002b7dca5e/0x7b044d4128f9dd57 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664749 expref: 66 pid: 25718 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938446.585932:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 438 00000100:00100000:0.0:1784938446.585943:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+66:10957:x1871643337518848:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938446.585960:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938446.585982:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002b7dca5e/0x7b044d4128f9dd57 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664749 expref: 66 pid: 25718 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.586008:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002b7dca5e/0x7b044d4128f9dd57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664749 expref: 66 pid: 25718 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.586034:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b7dca5e/0x7b044d4128f9dd57 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664749 expref: 66 pid: 25718 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.586053:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x51:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938446.586057:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x51:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938446.586066:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a4e718c3/0x7b044d4128f9dd5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664750 expref: 65 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.586076:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4e718c3/0x7b044d4128f9dd5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664750 expref: 65 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.586112:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a4e718c3/0x7b044d4128f9dd5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664750 expref: 65 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938446.586139:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:19219:1871643350895616:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938446.586271:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d3a4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938446.595528:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:19219:1871643350895616:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938446.595557:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938446.595617:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+65:10957:x1871643337518848:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 9675us (10050us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938446.595629:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 438 00000100:00100000:2.0:1784938446.610565:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938446.610669:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337519104 00000100:00100000:1.0:1784938446.610678:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337519104 00000100:00100000:1.0:1784938446.610730:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 132 00000100:00100000:1.0:1784938446.610739:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+132:17112:x1871643337519104:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:1.0:1784938446.611280:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+133:17112:x1871643337519104:12345-192.168.202.54@tcp:35:cp.0 Request processed in 540us (723us total) trans 8589934748 rc 0/0 00000100:00100000:1.0:1784938446.611288:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 132 00000100:00100000:0.0:1784938446.618976:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.620930:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337519232 00000100:00100000:2.0:1784938446.620947:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337519232 00000100:00100000:2.0:1784938446.621286:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 592 00000100:00100000:2.0:1784938446.621308:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+133:17112:x1871643337519232:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938446.621335:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938446.621357:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9dd65 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664757 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.621449:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039400/0x7b044d4128f9dd6c lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.621466:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039400/0x7b044d4128f9dd6c lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.621478:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039400/0x7b044d4128f9dd6c lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.621494:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038a00/0x7b044d4128f9dd73 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x4c7a76ee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.621502:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038a00/0x7b044d4128f9dd73 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.621513:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038a00/0x7b044d4128f9dd73 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.621555:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039400/0x7b044d4128f9dd6c lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.621562:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039400/0x7b044d4128f9dd6c lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.621569:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039400/0x7b044d4128f9dd6c lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.621576:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382039400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938446.621580:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039400/0x7b044d4128f9dd6c lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.621587:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039400/0x7b044d4128f9dd6c lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.621599:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938446.621602:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.621621:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039400/0x7b044d4128f9dd6c lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.621629:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039400/0x7b044d4128f9dd6c lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.621643:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038a00/0x7b044d4128f9dd73 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.621650:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038a00/0x7b044d4128f9dd73 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.621656:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038a00/0x7b044d4128f9dd73 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.621662:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382038a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938446.621665:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038a00/0x7b044d4128f9dd73 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.621671:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038a00/0x7b044d4128f9dd73 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.621679:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x4c7a76ee (ffff9f23823dd400) 00010000:00010000:2.0:1784938446.621682:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.621684:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038a00/0x7b044d4128f9dd73 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.621690:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038a00/0x7b044d4128f9dd73 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.621724:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9dd65 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664757 expref: 134 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.621734:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938446.621737:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.621741:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9dd65 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664757 expref: 134 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.621751:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382038200, rc 0) 00000100:00100000:2.0:1784938446.621813:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+133:17112:x1871643337519232:12345-192.168.202.54@tcp:101:cp.0 Request processed in 516us (2845us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938446.621823:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 592 00000100:00100000:0.0:1784938446.626799:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.626893:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337519360 00000100:00100000:2.0:1784938446.626908:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337519360 00000100:00100000:2.0:1784938446.626968:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 593 00000100:00100000:2.0:1784938446.626978:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+133:17112:x1871643337519360:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938446.627006:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938446.627027:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038000/0x7b044d4128f9dd7a lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766475e expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.627090:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9dd81 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.627104:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9dd81 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.627114:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9dd81 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.627170:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038600/0x7b044d4128f9dd88 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x4c7a76ee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.627179:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038600/0x7b044d4128f9dd88 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.627186:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038600/0x7b044d4128f9dd88 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.627226:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9dd81 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.627238:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9dd81 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.627244:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9dd81 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.627250:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9dd81 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.627255:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382038c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938446.627260:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9dd81 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.627266:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9dd81 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.627278:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938446.627281:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.627286:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9dd81 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.627292:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9dd81 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.627316:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038600/0x7b044d4128f9dd88 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.627322:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038600/0x7b044d4128f9dd88 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.627327:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038600/0x7b044d4128f9dd88 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.627332:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382038600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938446.627335:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038600/0x7b044d4128f9dd88 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.627340:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038600/0x7b044d4128f9dd88 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.627346:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x4c7a76ee (ffff9f248fb6ad00) 00010000:00010000:2.0:1784938446.627349:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.627351:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038600/0x7b044d4128f9dd88 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.627357:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038600/0x7b044d4128f9dd88 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.627389:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038000/0x7b044d4128f9dd7a lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766475e expref: 134 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.627400:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938446.627402:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.627405:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038000/0x7b044d4128f9dd7a lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766475e expref: 134 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.627415:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382038000, rc 0) 00000100:00100000:2.0:1784938446.627472:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+133:17112:x1871643337519360:12345-192.168.202.54@tcp:101:cp.0 Request processed in 496us (683us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938446.627479:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 593 00000100:00100000:1.0:1784938446.638255:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.638448:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337519616 00000100:00100000:3.0:1784938446.638458:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337519616 00000100:00100000:3.0:1784938446.638519:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 594 00000100:00100000:3.0:1784938446.638529:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+133:17112:x1871643337519616:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938446.638550:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938446.638569:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5db800/0x7b044d4128f9dd8f lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664765 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.638676:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbc00/0x7b044d4128f9dd96 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.638692:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbc00/0x7b044d4128f9dd96 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.638704:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbc00/0x7b044d4128f9dd96 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.638719:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9dd9d lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x4c7a76ee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.638726:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9dd9d lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.638733:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9dd9d lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938446.639068:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x51:0x0], index 0: 0 00010000:00010000:3.0:1784938446.639644:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dba00/0x7b044d4128f9dda4 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.639657:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dba00/0x7b044d4128f9dda4 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.639666:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dba00/0x7b044d4128f9dda4 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.639696:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbc00/0x7b044d4128f9dd96 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.639708:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbc00/0x7b044d4128f9dd96 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.639713:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbc00/0x7b044d4128f9dd96 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.639720:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbc00/0x7b044d4128f9dd96 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.639726:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5dbc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938446.639729:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbc00/0x7b044d4128f9dd96 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.639737:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbc00/0x7b044d4128f9dd96 lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.639747:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938446.639750:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938446.639754:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbc00/0x7b044d4128f9dd96 lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.639761:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbc00/0x7b044d4128f9dd96 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938446.639774:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000024daa6ca reply state 00000000b0fdea13 transno 8589934749 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9dd9d lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.639784:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9dd9d lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.639790:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x4c7a76ee (ffff9f23861f8000) 00010000:00010000:3.0:1784938446.639793:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938446.639796:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938446.639825:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5db800/0x7b044d4128f9dd8f lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664765 expref: 136 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.639840:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dba00/0x7b044d4128f9dda4 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664765 expref: 135 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.639848:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x21:0x0].0x0 (ffff9f23861f8b00) 00010000:00010000:3.0:1784938446.639850:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938446.639852:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d5dba00, rc 0) 00000100:00100000:3.0:1784938446.640133:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+136:17112:x1871643337519616:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1604us (1887us total) trans 8589934749 rc 0/0 00000100:00100000:3.0:1784938446.640142:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 594 00000100:00100000:0.0:1784938446.650798:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.650941:0:21152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337519744 00000100:00100000:3.0:1784938446.650951:0:21152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337519744 00000100:00100000:3.0:1784938446.651176:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 878 00000100:00100000:3.0:1784938446.651187:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+62:10960:x1871643337519744:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938446.651205:0:21152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938446.651226:0:21152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062c58f3a/0x7b044d4128f9ddb2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766476c expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938446.651251:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x51:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938446.651274:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51:0x0].0x0 since=712s v=(0 0) 00010000:00010000:3.0:1784938446.651278:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938446.651287:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062c58f3a/0x7b044d4128f9ddb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766476c expref: 63 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.651319:0:21152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000062c58f3a/0x7b044d4128f9ddb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766476c expref: 63 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.651333:0:21152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d5da600, rc 0) 00000100:00100000:3.0:1784938446.651389:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+63:10960:x1871643337519744:12345-192.168.202.54@tcp:101:cp.0 Request processed in 203us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938446.651396:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 878 00000100:00100000:0.0:1784938446.653952:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.654331:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337519872 00000100:00100000:2.0:1784938446.654341:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337519872 00000100:00100000:2.0:1784938446.654432:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 879 00000100:00100000:2.0:1784938446.654443:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+63:17112:x1871643337519872:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938446.654462:0:25722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938446.654480:0:25722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000692e1c3/0x7b044d4128f9ddb9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x51:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664773 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.654511:0:25722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000062c58f3a/0x7b044d4128f9ddb2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766476c expref: 64 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.654520:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.654524:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.654529:0:25722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000692e1c3/0x7b044d4128f9ddb9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x51:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664773 expref: 64 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.654562:0:25722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000062c58f3a/0x7b044d4128f9ddb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e94766476c expref: 64 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.654576:0:25722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000062c58f3a/0x7b044d4128f9ddb2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766476c expref: 64 pid: 21152 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938446.654590:0:25722:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2482b28000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25722:1871643350895744:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938446.654666:0:25722:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34840 going to sleep for 11 seconds 00000100:00100000:1.0:1784938446.658821:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.659713:0:25722:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2482b28000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25722:1871643350895744:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938446.659746:0:25722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000692e1c3/0x7b044d4128f9ddb9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x51:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664773 expref: 64 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.659769:0:25722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382038000, rc 0) 00000100:00100000:3.0:1784938446.659824:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+64:17112:x1871643337519872:12345-192.168.202.54@tcp:101:cp.0 Request processed in 5383us (5882us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938446.659834:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 879 00000100:00100000:0.0:1784938446.661693:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337520000 00000100:00100000:0.0:1784938446.661707:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337520000 00010000:00010000:0.0:1784938446.661755:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000062c58f3a/0x7b044d4128f9ddb2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766476c expref: 64 pid: 21152 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938446.661790:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 439 00000100:00100000:0.0:1784938446.661799:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+64:10960:x1871643337520000:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938446.661813:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938446.661834:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000062c58f3a/0x7b044d4128f9ddb2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766476c expref: 64 pid: 21152 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.661846:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000062c58f3a/0x7b044d4128f9ddb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766476c expref: 64 pid: 21152 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.662099:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062c58f3a/0x7b044d4128f9ddb2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766476c expref: 64 pid: 21152 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.662116:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938446.662121:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938446.662140:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000692e1c3/0x7b044d4128f9ddb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664773 expref: 63 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.662290:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000692e1c3/0x7b044d4128f9ddb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664773 expref: 63 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.664349:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000692e1c3/0x7b044d4128f9ddb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664773 expref: 63 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938446.664381:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23823b8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:19221:1871643350895872:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938446.664515:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbee40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938446.669008:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.669083:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337520256 00000100:00100000:3.0:1784938446.669093:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337520256 00000100:00100000:3.0:1784938446.669167:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 133 00000100:00100000:3.0:1784938446.669177:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+136:17112:x1871643337520256:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938446.669472:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+137:17112:x1871643337520256:12345-192.168.202.54@tcp:35:cp.0 Request processed in 296us (479us total) trans 8589934750 rc 0/0 00000100:00100000:3.0:1784938446.669480:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 133 00000100:00100000:1.0:1784938446.672329:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.672419:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337520384 00000100:00100000:2.0:1784938446.672427:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337520384 00000100:00100000:2.0:1784938446.672483:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 595 00000100:00100000:2.0:1784938446.672492:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+137:17112:x1871643337520384:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938446.672514:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938446.672535:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038600/0x7b044d4128f9ddc0 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766477a expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.672597:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9ddc7 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.672611:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9ddc7 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.672623:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9ddc7 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.672638:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9ddce lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x610aa076 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.672646:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9ddce lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.672652:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9ddce lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.672692:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9ddc7 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.672700:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9ddc7 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.672706:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9ddc7 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.672713:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9ddc7 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.672719:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382038c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938446.672724:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9ddc7 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.672731:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9ddc7 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.672744:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938446.672746:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.672751:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9ddc7 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.672757:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9ddc7 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.672770:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9ddce lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.672776:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9ddce lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.672782:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9ddce lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.672787:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382038200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938446.672789:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9ddce lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.672795:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9ddce lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.672807:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x610aa076 (ffff9f248fb6ad00) 00010000:00010000:2.0:1784938446.672809:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.672812:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9ddce lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.672817:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9ddce lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.672849:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038600/0x7b044d4128f9ddc0 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766477a expref: 138 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.672858:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938446.672860:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.672864:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038600/0x7b044d4128f9ddc0 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766477a expref: 138 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.672871:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382038600, rc 0) 00000100:00100000:2.0:1784938446.672932:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+137:17112:x1871643337520384:12345-192.168.202.54@tcp:101:cp.0 Request processed in 440us (611us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938446.672939:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 595 00000100:00100000:1.0:1784938446.678493:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.678574:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337520512 00000100:00100000:2.0:1784938446.678584:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337520512 00000100:00100000:2.0:1784938446.678643:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 596 00000100:00100000:2.0:1784938446.678653:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+137:17112:x1871643337520512:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938446.678673:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938446.678695:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038a00/0x7b044d4128f9ddd5 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664781 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.678766:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039400/0x7b044d4128f9dddc lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.678780:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039400/0x7b044d4128f9dddc lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.678791:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039400/0x7b044d4128f9dddc lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.678806:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9dde3 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x610aa076 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.678812:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9dde3 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.678818:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9dde3 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.678865:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039400/0x7b044d4128f9dddc lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.678873:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039400/0x7b044d4128f9dddc lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.678880:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039400/0x7b044d4128f9dddc lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.678886:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382039400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938446.678890:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039400/0x7b044d4128f9dddc lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.678902:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039400/0x7b044d4128f9dddc lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.678914:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938446.678917:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.678921:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039400/0x7b044d4128f9dddc lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.678927:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039400/0x7b044d4128f9dddc lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.678939:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9dde3 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.678944:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9dde3 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.678950:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9dde3 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.678955:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382039e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938446.678958:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9dde3 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.678963:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9dde3 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.678969:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x610aa076 (ffff9f248fb6a000) 00010000:00010000:2.0:1784938446.678972:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.678975:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9dde3 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.678983:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9dde3 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.679425:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038a00/0x7b044d4128f9ddd5 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664781 expref: 138 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.679436:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938446.679438:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.679442:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038a00/0x7b044d4128f9ddd5 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664781 expref: 138 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.679452:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382038a00, rc 0) 00000100:00100000:2.0:1784938446.679515:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+137:17112:x1871643337520512:12345-192.168.202.54@tcp:101:cp.0 Request processed in 863us (1031us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938446.679522:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 596 00000100:00100000:0.0:1784938446.680456:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23823b8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:19221:1871643350895872:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938446.680478:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938446.680581:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+63:10960:x1871643337520000:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 18781us (21769us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938446.680592:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 439 00000100:00100000:1.0:1784938446.685633:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.685702:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337520768 00000100:00100000:2.0:1784938446.685712:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337520768 00000100:00100000:2.0:1784938446.685761:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 597 00000100:00100000:2.0:1784938446.685770:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+137:17112:x1871643337520768:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938446.685790:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938446.685809:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038600/0x7b044d4128f9ddea lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664788 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.685925:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9ddf1 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.685939:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9ddf1 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.685949:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9ddf1 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.685962:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9ddf8 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x610aa076 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.685969:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9ddf8 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.685975:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9ddf8 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938446.686466:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x52:0x0], index 1: 0 00010000:00010000:2.0:1784938446.686583:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039600/0x7b044d4128f9ddff lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.686594:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039600/0x7b044d4128f9ddff lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.686601:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039600/0x7b044d4128f9ddff lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.686628:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9ddf1 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.686640:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9ddf1 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.686646:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9ddf1 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.686652:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9ddf1 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.686658:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382038200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938446.686662:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9ddf1 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.686670:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9ddf1 lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.686681:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938446.686683:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.686687:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9ddf1 lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.686693:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9ddf1 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938446.686707:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e1673a44 reply state 000000004d8be471 transno 8589934751 ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9ddf8 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.686717:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9ddf8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.686723:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x610aa076 (ffff9f248fb6ad00) 00010000:00010000:2.0:1784938446.686726:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938446.686729:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938446.686753:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038600/0x7b044d4128f9ddea lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664788 expref: 140 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.686766:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039600/0x7b044d4128f9ddff lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664788 expref: 139 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.686773:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x22:0x0].0x0 (ffff9f248fb6a100) 00010000:00010000:2.0:1784938446.686775:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938446.686777:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382039600, rc 0) 00000100:00100000:2.0:1784938446.686828:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+140:17112:x1871643337520768:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1060us (1203us total) trans 8589934751 rc 0/0 00000100:00100000:2.0:1784938446.686835:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 597 00000100:00100000:1.0:1784938446.686945:0:24948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d4e1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24948:1871643350896000:192.168.202.154@tcp:5:osp-pre-1-1.0 00000100:00100000:1.0:1784938446.687008:0:24948:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbee40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938446.687223:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938446.688071:0:25728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350896000 00000100:00100000:2.0:1784938446.688080:0:25728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350896000 00000100:00100000:2.0:1784938446.688164:0:25728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 880 00000100:00100000:2.0:1784938446.688173:0:25728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:24948:x1871643350896000:12345-192.168.202.154@tcp:5:osp-pre-1-1.0 00002000:00080000:2.0:1784938446.688210:0:25728:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x2c0000400 at 98 00002000:00080000:2.0:1784938446.688693:0:25728:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x2c0000400 at 106 00000001:00080000:2.0:1784938446.689001:0:25728:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967483 00002000:00080000:2.0:1784938446.689016:0:25728:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x2c0000400 at 114 00000001:00080000:2.0:1784938446.689423:0:25728:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967484 00002000:00080000:2.0:1784938446.689438:0:25728:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x2c0000400 at 122 00000001:00080000:2.0:1784938446.689739:0:25728:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967485 00000100:00100000:2.0:1784938446.689834:0:25728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+9:24948:x1871643350896000:12345-192.168.202.154@tcp:5:osp-pre-1-1.0 Request processed in 1658us (2608us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1784938446.689844:0:25728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 880 00000020:00080000:2.0:1784938446.689850:0:25728:0:(tgt_main.c:784:tgt_ses_key_exit()) total 4 transactions per RPC 00000100:00080000:0.0:1784938446.690446:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784938446.691230:0:24948:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967437 gen 2 00000004:00080000:1.0:1784938446.691239:0:24948:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f22c000, transno 4294967405 00000004:00080000:1.0:1784938446.691252:0:24948:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f22d500, transno 4294967406 00000004:00080000:1.0:1784938446.691255:0:24948:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f22f480, transno 4294967407 00000004:00080000:1.0:1784938446.691257:0:24948:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f22c380, transno 4294967408 00000004:00080000:1.0:1784938446.691259:0:24948:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f22ea00, transno 4294967409 00000004:00080000:1.0:1784938446.691262:0:24948:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f22ca80, transno 4294967410 00000004:00080000:1.0:1784938446.691264:0:24948:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f22fb80, transno 4294967411 00000004:00080000:1.0:1784938446.691267:0:24948:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f22dc00, transno 4294967412 00000004:00080000:1.0:1784938446.691269:0:24948:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f22e300, transno 4294967413 00000004:00080000:1.0:1784938446.691271:0:24948:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f22f800, transno 4294967414 00000004:00080000:1.0:1784938446.691274:0:24948:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f1b7b80, transno 4294967415 00000004:00080000:1.0:1784938446.691276:0:24948:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f24a680, transno 4294967416 00000004:00080000:1.0:1784938446.691279:0:24948:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f1b6300, transno 4294967417 00000004:00080000:1.0:1784938446.691282:0:24948:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f1b4e00, transno 4294967418 00000004:00080000:1.0:1784938446.691285:0:24948:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f2489ae4000, transno 4294967419 00000004:00080000:1.0:1784938446.691287:0:24948:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f24bb80, transno 4294967420 00000004:00080000:1.0:1784938446.691289:0:24948:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f249500, transno 4294967421 00000004:00080000:1.0:1784938446.691292:0:24948:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f24b100, transno 4294967422 00000004:00080000:1.0:1784938446.691294:0:24948:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f19ad80, transno 4294967423 00000004:00080000:1.0:1784938446.691307:0:24948:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f248000, transno 4294967424 00000004:00080000:1.0:1784938446.691310:0:24948:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f19b800, transno 4294967425 00000004:00080000:1.0:1784938446.691312:0:24948:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f249c00, transno 4294967426 00000004:00080000:1.0:1784938446.691315:0:24948:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f19b480, transno 4294967427 00000004:00080000:1.0:1784938446.691317:0:24948:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24bd5a7800, transno 4294967428 00000004:00080000:1.0:1784938446.691320:0:24948:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f2489ae5180, transno 4294967429 00000004:00080000:1.0:1784938446.691322:0:24948:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f22c700, transno 4294967430 00000004:00080000:1.0:1784938446.691324:0:24948:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f22df80, transno 4294967431 00000004:00080000:1.0:1784938446.691327:0:24948:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f182680, transno 4294967432 00000004:00080000:1.0:1784938446.691329:0:24948:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f2489ae6300, transno 4294967433 00000004:00080000:1.0:1784938446.691332:0:24948:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f2381d2b480, transno 4294967434 00000004:00080000:1.0:1784938446.691334:0:24948:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f1b4700, transno 4294967435 00000004:00080000:1.0:1784938446.691337:0:24948:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f2489ae5880, transno 4294967436 00000004:00080000:1.0:1784938446.691339:0:24948:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f2381d29880, transno 4294967437 00000100:00100000:1.0:1784938446.691348:0:24948:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9f238d4e1c00 x1871643350896000/t4294967486(4294967486) o5->lustre-OST0001-osc-MDT0001@192.168.202.154@tcp:28/4 lens 432/432 e 0 to 0 dl 1784938462 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938446.691360:0:24948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d4e1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24948:1871643350896000:192.168.202.154@tcp:5:osp-pre-1-1.0 00000004:00080000:1.0:1784938446.691377:0:24948:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x52:0x0]-[0x2c0000400:0x81:0x0] 00000004:00080000:0.0:1784938446.691644:0:24947:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 6 changes, 0 in progress, 0 in flight, 33 done 00000100:00100000:2.0:1784938446.705933:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.706201:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337520896 00000100:00100000:0.0:1784938446.706210:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337520896 00000100:00100000:0.0:1784938446.706268:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 881 00000100:00100000:0.0:1784938446.706279:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+65:10958:x1871643337520896:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938446.706306:0:25715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938446.706331:0:25715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067911722/0x7b044d4128f9de0d lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766478f expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938446.706356:0:25715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x52:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938446.706379:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x52:0x0].0x0 since=712s v=(0 0) 00010000:00010000:0.0:1784938446.706383:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x52:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938446.706392:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067911722/0x7b044d4128f9de0d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766478f expref: 66 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.706408:0:25715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000067911722/0x7b044d4128f9de0d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766478f expref: 66 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.706421:0:25715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d3d200, rc 0) 00000100:00100000:0.0:1784938446.706481:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+66:10958:x1871643337520896:12345-192.168.202.54@tcp:101:cp.0 Request processed in 204us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938446.706490:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 881 00000100:00100000:1.0:1784938446.709214:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.709365:0:25719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337521024 00000100:00100000:2.0:1784938446.709375:0:25719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337521024 00000100:00100000:2.0:1784938446.709437:0:25719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 882 00000100:00100000:2.0:1784938446.709447:0:25719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7ea6e988-18ba-4c98-b179-17995571b98b+66:17112:x1871643337521024:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938446.709465:0:25719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938446.709484:0:25719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000baaa6dd1/0x7b044d4128f9de14 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x52:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664796 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.709527:0:25719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000067911722/0x7b044d4128f9de0d lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766478f expref: 67 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.709537:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x52:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.709542:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x52:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.709547:0:25719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baaa6dd1/0x7b044d4128f9de14 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x52:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664796 expref: 67 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.709580:0:25719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000067911722/0x7b044d4128f9de0d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e94766478f expref: 67 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.709594:0:25719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000067911722/0x7b044d4128f9de0d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766478f expref: 67 pid: 25715 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938446.709610:0:25719:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2482b2a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:25719:1871643350896128:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938446.709693:0:25719:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34840 going to sleep for 11 seconds 00000100:00100000:1.0:1784938446.713407:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.713534:0:25719:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2482b2a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:25719:1871643350896128:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938446.713567:0:25719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000baaa6dd1/0x7b044d4128f9de14 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x52:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664796 expref: 67 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.713588:0:25719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823ffa00, rc 0) 00000100:00100000:2.0:1784938446.713654:0:25719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7ea6e988-18ba-4c98-b179-17995571b98b+67:17112:x1871643337521024:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4208us (4450us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938446.713662:0:25719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 882 00000100:00100000:0.0:1784938446.714946:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337521152 00000100:00100000:0.0:1784938446.714956:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337521152 00010000:00010000:2.0:1784938446.715227:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000067911722/0x7b044d4128f9de0d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766478f expref: 67 pid: 25715 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938446.715319:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 440 00000100:00100000:2.0:1784938446.715330:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+67:10958:x1871643337521152:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938446.715345:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938446.715369:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000067911722/0x7b044d4128f9de0d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766478f expref: 67 pid: 25715 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.715382:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000067911722/0x7b044d4128f9de0d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766478f expref: 67 pid: 25715 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.715405:0:22955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067911722/0x7b044d4128f9de0d lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766478f expref: 67 pid: 25715 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.715422:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x52:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.715426:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x52:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.715436:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000baaa6dd1/0x7b044d4128f9de14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664796 expref: 66 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.715447:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baaa6dd1/0x7b044d4128f9de14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664796 expref: 66 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.715482:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000baaa6dd1/0x7b044d4128f9de14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664796 expref: 66 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938446.715497:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2482b2a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22955:1871643350896256:192.168.202.54@tcp:105: 00000100:00100000:2.0:1784938446.715576:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34840 going to sleep for 11 seconds 00000100:00100000:1.0:1784938446.719024:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.719101:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337521408 00000100:00100000:0.0:1784938446.719111:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337521408 00000100:00100000:0.0:1784938446.719192:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 134 00000100:00100000:0.0:1784938446.719201:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+140:17112:x1871643337521408:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:0.0:1784938446.719496:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+141:17112:x1871643337521408:12345-192.168.202.54@tcp:35:cp.0 Request processed in 296us (481us total) trans 8589934752 rc 0/0 00000100:00100000:0.0:1784938446.719503:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 134 00000100:00100000:1.0:1784938446.722506:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.722598:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337521536 00000100:00100000:3.0:1784938446.722608:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337521536 00000100:00100000:3.0:1784938446.722671:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 598 00000100:00100000:3.0:1784938446.722681:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+141:17112:x1871643337521536:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938446.722704:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938446.722726:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5db800/0x7b044d4128f9de1b lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766479d expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.722815:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbc00/0x7b044d4128f9de22 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.722831:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbc00/0x7b044d4128f9de22 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.722844:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbc00/0x7b044d4128f9de22 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.722874:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5daa00/0x7b044d4128f9de29 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x72a71b3d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.722881:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5daa00/0x7b044d4128f9de29 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.722888:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5daa00/0x7b044d4128f9de29 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.722933:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbc00/0x7b044d4128f9de22 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.722941:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbc00/0x7b044d4128f9de22 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.722946:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbc00/0x7b044d4128f9de22 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.722953:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbc00/0x7b044d4128f9de22 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.722958:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5dbc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938446.722963:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbc00/0x7b044d4128f9de22 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.722970:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbc00/0x7b044d4128f9de22 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.722981:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938446.722984:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938446.722989:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbc00/0x7b044d4128f9de22 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.723004:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbc00/0x7b044d4128f9de22 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.723023:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5daa00/0x7b044d4128f9de29 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.723028:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5daa00/0x7b044d4128f9de29 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.723033:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5daa00/0x7b044d4128f9de29 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.723038:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5daa00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938446.723040:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5daa00/0x7b044d4128f9de29 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.723048:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5daa00/0x7b044d4128f9de29 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.723055:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x72a71b3d (ffff9f23861f8200) 00010000:00010000:3.0:1784938446.723057:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938446.723060:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5daa00/0x7b044d4128f9de29 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.723065:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5daa00/0x7b044d4128f9de29 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.723100:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5db800/0x7b044d4128f9de1b lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766479d expref: 142 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.723110:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938446.723112:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938446.723116:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5db800/0x7b044d4128f9de1b lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766479d expref: 142 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.723124:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d5db800, rc 0) 00000100:00100000:3.0:1784938446.723212:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+141:17112:x1871643337521536:12345-192.168.202.54@tcp:101:cp.0 Request processed in 532us (716us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938446.723220:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 598 00000100:00100000:2.0:1784938446.725282:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2482b2a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22955:1871643350896256:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938446.725317:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938446.725380:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+66:10958:x1871643337521152:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 10052us (11982us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938446.725391:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 440 00000100:00100000:1.0:1784938446.726931:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.727009:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337521664 00000100:00100000:2.0:1784938446.727019:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337521664 00000100:00100000:2.0:1784938446.727075:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 599 00000100:00100000:2.0:1784938446.727085:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+141:17112:x1871643337521664:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938446.727105:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938446.727140:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9de30 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476647a4 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.727232:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038600/0x7b044d4128f9de37 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.727249:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038600/0x7b044d4128f9de37 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.727261:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038600/0x7b044d4128f9de37 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.727276:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9de3e lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x72a71b3d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.727284:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9de3e lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.727291:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9de3e lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.727343:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038600/0x7b044d4128f9de37 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.727350:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038600/0x7b044d4128f9de37 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.727356:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038600/0x7b044d4128f9de37 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.727362:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038600/0x7b044d4128f9de37 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.727368:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382038600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938446.727372:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038600/0x7b044d4128f9de37 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.727380:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038600/0x7b044d4128f9de37 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.727392:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938446.727395:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.727400:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038600/0x7b044d4128f9de37 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.727406:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038600/0x7b044d4128f9de37 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.727419:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9de3e lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.727426:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9de3e lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.727432:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9de3e lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.727437:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382038200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938446.727440:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9de3e lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.727446:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9de3e lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.727452:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x72a71b3d (ffff9f248fb6a000) 00010000:00010000:2.0:1784938446.727454:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.727456:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9de3e lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.727461:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9de3e lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.727500:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9de30 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476647a4 expref: 142 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.727509:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938446.727511:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.727514:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9de30 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476647a4 expref: 142 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.727522:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823ff000, rc 0) 00000100:00100000:2.0:1784938446.727567:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+141:17112:x1871643337521664:12345-192.168.202.54@tcp:101:cp.0 Request processed in 483us (645us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938446.727574:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 599 00000100:00100000:1.0:1784938446.730335:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.730597:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337521920 00000100:00100000:3.0:1784938446.730607:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337521920 00000100:00100000:3.0:1784938446.730672:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 600 00000100:00100000:3.0:1784938446.730682:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+141:17112:x1871643337521920:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938446.730708:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938446.730730:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5db600/0x7b044d4128f9de45 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476647ab expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.730835:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9de4c lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.730850:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9de4c lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.730873:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9de4c lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.730887:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da800/0x7b044d4128f9de53 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x72a71b3d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.730894:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da800/0x7b044d4128f9de53 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.730900:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da800/0x7b044d4128f9de53 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938446.731657:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x52:0x0], index 0: 0 00010000:00010000:3.0:1784938446.731809:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbe00/0x7b044d4128f9de5a lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.731820:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbe00/0x7b044d4128f9de5a lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.731827:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbe00/0x7b044d4128f9de5a lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.731875:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9de4c lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.731883:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9de4c lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.731889:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9de4c lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.731895:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9de4c lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.731901:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5da600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938446.731905:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9de4c lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.731912:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9de4c lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.731923:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938446.731926:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938446.731931:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9de4c lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.731937:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9de4c lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938446.731951:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f18a9738 reply state 000000003d922ce2 transno 8589934753 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da800/0x7b044d4128f9de53 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.731960:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da800/0x7b044d4128f9de53 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.731966:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x72a71b3d (ffff9f23861f8800) 00010000:00010000:3.0:1784938446.731968:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938446.731970:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938446.732007:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5db600/0x7b044d4128f9de45 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476647ab expref: 144 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.732022:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbe00/0x7b044d4128f9de5a lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476647ab expref: 143 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.732030:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x23:0x0].0x0 (ffff9f23861f8d00) 00010000:00010000:3.0:1784938446.732033:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938446.732035:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d5dbe00, rc 0) 00000100:00100000:3.0:1784938446.732104:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+144:17112:x1871643337521920:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1423us (1777us total) trans 8589934753 rc 0/0 00000100:00100000:3.0:1784938446.732112:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 600 00000100:00100000:1.0:1784938446.735339:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.735432:0:25729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337522048 00000100:00100000:0.0:1784938446.735440:0:25729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337522048 00000100:00100000:0.0:1784938446.735498:0:25729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 883 00000100:00100000:0.0:1784938446.735509:0:25729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7ea6e988-18ba-4c98-b179-17995571b98b+63:10959:x1871643337522048:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938446.735526:0:25729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938446.735550:0:25729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012221821/0x7b044d4128f9de68 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476647b2 expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938446.735577:0:25729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x52:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938446.735598:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x52:0x0].0x0 since=712s v=(0 0) 00010000:00010000:0.0:1784938446.735602:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x52:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938446.735613:0:25729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012221821/0x7b044d4128f9de68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476647b2 expref: 64 pid: 25729 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.735630:0:25729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012221821/0x7b044d4128f9de68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476647b2 expref: 64 pid: 25729 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.735648:0:25729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f245400, rc 0) 00000100:00100000:0.0:1784938446.735706:0:25729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7ea6e988-18ba-4c98-b179-17995571b98b+64:10959:x1871643337522048:12345-192.168.202.54@tcp:101:cp.0 Request processed in 200us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938446.735713:0:25729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 883 00000100:00100000:1.0:1784938446.737931:0:24946:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d4e3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24946:1871643350896384:192.168.202.154@tcp:5:osp-pre-0-1.0 00000100:00100000:1.0:1784938446.738024:0:24946:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbee40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938446.738265:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938446.738511:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350896384 00000100:00100000:3.0:1784938446.738520:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350896384 00000100:00100000:3.0:1784938446.738588:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 884 00000100:00100000:3.0:1784938446.738598:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:24946:x1871643350896384:12345-192.168.202.154@tcp:5:osp-pre-0-1.0 00002000:00080000:3.0:1784938446.738638:0:25716:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x280000400 at 98 00002000:00080000:3.0:1784938446.739176:0:25716:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x280000400 at 106 00000001:00080000:3.0:1784938446.739555:0:25716:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00002000:00080000:3.0:1784938446.739571:0:25716:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x280000400 at 114 00000001:00080000:3.0:1784938446.739900:0:25716:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00002000:00080000:3.0:1784938446.739914:0:25716:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x280000400 at 122 00000001:00080000:3.0:1784938446.740259:0:25716:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1784938446.740363:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+9:24946:x1871643350896384:12345-192.168.202.154@tcp:5:osp-pre-0-1.0 Request processed in 1763us (2095us total) trans 4294967491 rc 0/0 00000100:00100000:3.0:1784938446.740373:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 884 00000020:00080000:3.0:1784938446.740378:0:25716:0:(tgt_main.c:784:tgt_ses_key_exit()) total 4 transactions per RPC 00000100:00080000:0.0:1784938446.740907:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938446.744429:0:24946:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967444 gen 2 00000004:00080000:3.0:1784938446.744442:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24b68da680, transno 4294967405 00000004:00080000:3.0:1784938446.744458:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24b68dad80, transno 4294967406 00000004:00080000:3.0:1784938446.744461:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24b68daa00, transno 4294967407 00000004:00080000:3.0:1784938446.744463:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24b68d9c00, transno 4294967408 00000004:00080000:3.0:1784938446.744466:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24b68db800, transno 4294967409 00000004:00080000:3.0:1784938446.744468:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24b68d9880, transno 4294967410 00000004:00080000:3.0:1784938446.744470:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24b68db100, transno 4294967411 00000004:00080000:3.0:1784938446.744473:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24b68d9f80, transno 4294967412 00000004:00080000:3.0:1784938446.744475:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f22ed80, transno 4294967413 00000004:00080000:3.0:1784938446.744478:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f243b80, transno 4294967414 00000004:00080000:3.0:1784938446.744480:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f241180, transno 4294967415 00000004:00080000:3.0:1784938446.744482:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f22f100, transno 4294967416 00000004:00080000:3.0:1784938446.744484:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f241500, transno 4294967417 00000004:00080000:3.0:1784938446.744486:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f243800, transno 4294967418 00000004:00080000:3.0:1784938446.744489:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f249f80, transno 4294967419 00000004:00080000:3.0:1784938446.744491:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24bd55fb80, transno 4294967420 00000004:00080000:3.0:1784938446.744494:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f182300, transno 4294967421 00000004:00080000:3.0:1784938446.744496:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f248a80, transno 4294967422 00000004:00080000:3.0:1784938446.744498:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f24ad80, transno 4294967423 00000004:00080000:3.0:1784938446.744500:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f24aa00, transno 4294967424 00000004:00080000:3.0:1784938446.744502:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f248380, transno 4294967425 00000004:00080000:3.0:1784938446.744504:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f2386361c00, transno 4294967426 00000004:00080000:3.0:1784938446.744507:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f249880, transno 4294967427 00000004:00080000:3.0:1784938446.744509:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f2386363800, transno 4294967428 00000004:00080000:3.0:1784938446.744511:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f2386363b80, transno 4294967429 00000004:00080000:3.0:1784938446.744514:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f240380, transno 4294967430 00000004:00080000:3.0:1784938446.744516:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f241c00, transno 4294967431 00000004:00080000:3.0:1784938446.744518:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24b68dbb80, transno 4294967432 00000004:00080000:3.0:1784938446.744520:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238d3ac700, transno 4294967433 00000004:00080000:3.0:1784938446.744523:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f2cb480, transno 4294967434 00000004:00080000:3.0:1784938446.744526:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f2cb100, transno 4294967435 00000004:00080000:3.0:1784938446.744528:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24b68d9180, transno 4294967436 00000004:00080000:3.0:1784938446.744531:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238d3ad500, transno 4294967437 00000004:00080000:3.0:1784938446.744533:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f2cad80, transno 4294967438 00000004:00080000:3.0:1784938446.744535:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238d3ad880, transno 4294967439 00000004:00080000:3.0:1784938446.744536:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238d3af800, transno 4294967440 00000004:00080000:3.0:1784938446.744539:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f2386362300, transno 4294967441 00000004:00080000:3.0:1784938446.744541:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238d3ac000, transno 4294967442 00000004:00080000:3.0:1784938446.744544:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f2c9c00, transno 4294967443 00000004:00080000:3.0:1784938446.744546:0:24946:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238d3aca80, transno 4294967444 00000100:00100000:3.0:1784938446.744557:0:24946:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9f238d4e3800 x1871643350896384/t4294967491(4294967491) o5->lustre-OST0000-osc-MDT0001@192.168.202.154@tcp:28/4 lens 432/432 e 0 to 0 dl 1784938462 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938446.744570:0:24946:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d4e3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24946:1871643350896384:192.168.202.154@tcp:5:osp-pre-0-1.0 00000004:00080000:3.0:1784938446.744586:0:24946:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x52:0x0]-[0x280000400:0x81:0x0] 00000004:00080000:0.0:1784938446.748924:0:24944:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 40 done 00000100:00100000:1.0:1784938446.749446:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.749540:0:25723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337522176 00000100:00100000:3.0:1784938446.749549:0:25723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337522176 00000100:00100000:3.0:1784938446.749637:0:25723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 885 00000100:00100000:3.0:1784938446.749647:0:25723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7ea6e988-18ba-4c98-b179-17995571b98b+64:17112:x1871643337522176:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938446.749664:0:25723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938446.749684:0:25723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023cf0f55/0x7b044d4128f9de6f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x52:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476647b9 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.749715:0:25723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012221821/0x7b044d4128f9de68 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476647b2 expref: 65 pid: 25729 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.749725:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x52:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938446.749729:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x52:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938446.749734:0:25723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023cf0f55/0x7b044d4128f9de6f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x52:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476647b9 expref: 65 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.749769:0:25723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000012221821/0x7b044d4128f9de68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e9476647b2 expref: 65 pid: 25729 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.749784:0:25723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000012221821/0x7b044d4128f9de68 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476647b2 expref: 65 pid: 25729 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938446.749798:0:25723:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b35f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:25723:1871643350896512:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938446.749949:0:25723:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2497582e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938446.753425:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938446.753572:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337522304 00000100:00100000:1.0:1784938446.753581:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337522304 00010000:00010000:1.0:1784938446.753618:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000012221821/0x7b044d4128f9de68 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476647b2 expref: 66 pid: 25729 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938446.753659:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 441 00000100:00100000:1.0:1784938446.753667:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+66:10960:x1871643337522304:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938446.753681:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938446.753702:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000012221821/0x7b044d4128f9de68 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476647b2 expref: 66 pid: 25729 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.753723:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000012221821/0x7b044d4128f9de68 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476647b2 expref: 66 pid: 25729 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.753746:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x52:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938446.753750:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x52:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938446.753758:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000023cf0f55/0x7b044d4128f9de6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476647b9 expref: 66 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.753768:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023cf0f55/0x7b044d4128f9de6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476647b9 expref: 66 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.753802:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000023cf0f55/0x7b044d4128f9de6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476647b9 expref: 66 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938446.753816:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350896640:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938446.753893:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbea80 going to sleep for 11 seconds 00010000:00010000:3.0:1784938446.754827:0:25723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012221821/0x7b044d4128f9de68 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476647b2 expref: 66 pid: 25729 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938446.754845:0:25723:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b35f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:25723:1871643350896512:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938446.754881:0:25723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000023cf0f55/0x7b044d4128f9de6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476647b9 expref: 65 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.754893:0:25723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d5db600, rc 0) 00000100:00100000:3.0:1784938446.754939:0:25723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7ea6e988-18ba-4c98-b179-17995571b98b+65:17112:x1871643337522176:12345-192.168.202.54@tcp:101:cp.0 Request processed in 5293us (5496us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938446.754950:0:25723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 885 00000100:00100000:1.0:1784938446.765456:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350896640:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938446.765482:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938446.765534:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+64:10960:x1871643337522304:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 11867us (12119us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938446.765545:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 441 00000100:00100000:1.0:1784938446.768380:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.768461:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337522560 00000100:00100000:3.0:1784938446.768470:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337522560 00000100:00100000:3.0:1784938446.768520:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 135 00000100:00100000:3.0:1784938446.768528:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24857fec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+144:17112:x1871643337522560:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938446.768787:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24857fec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+145:17112:x1871643337522560:12345-192.168.202.54@tcp:35:cp.0 Request processed in 259us (416us total) trans 8589934754 rc 0/0 00000100:00100000:3.0:1784938446.768794:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 135 00000100:00100000:2.0:1784938446.772334:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.772443:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337522688 00000100:00100000:0.0:1784938446.772454:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337522688 00000100:00100000:0.0:1784938446.772516:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 601 00000100:00100000:0.0:1784938446.772525:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+145:17112:x1871643337522688:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938446.772553:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938446.772576:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9de76 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476647c0 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.772663:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9de7d lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.772681:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9de7d lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.772694:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9de7d lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.772711:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9de84 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa9dd9870 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.772718:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9de84 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.772726:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9de84 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.772770:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9de7d lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.772778:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9de7d lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.772785:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9de7d lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.772791:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9de7d lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.772797:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24cc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.772801:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9de7d lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.772808:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9de7d lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.772819:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.772822:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.772826:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9de7d lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.772833:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9de7d lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.772847:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9de84 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.772853:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9de84 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.772873:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9de84 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.772878:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24dc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.772881:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9de84 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.772887:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9de84 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.772893:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xa9dd9870 (ffff9f248fb6ed00) 00010000:00010000:0.0:1784938446.772895:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.772898:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9de84 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.772903:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9de84 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.772933:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9de76 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476647c0 expref: 146 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.772944:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.772946:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.772949:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9de76 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476647c0 expref: 146 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.772964:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f245400, rc 0) 00000100:00100000:0.0:1784938446.773485:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+145:17112:x1871643337522688:12345-192.168.202.54@tcp:101:cp.0 Request processed in 959us (1158us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938446.773494:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 601 00000100:00100000:2.0:1784938446.776674:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.776741:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337522816 00000100:00100000:0.0:1784938446.776751:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337522816 00000100:00100000:0.0:1784938446.776805:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 602 00000100:00100000:0.0:1784938446.776814:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+145:17112:x1871643337522816:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938446.776834:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938446.776855:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9de8b lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476647c7 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.776927:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9de92 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.776942:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9de92 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.776952:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9de92 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.776971:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9de99 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa9dd9870 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.776978:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9de99 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.776984:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9de99 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.777042:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9de92 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.777050:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9de92 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.777056:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9de92 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.777061:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24ca00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.777065:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9de92 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.777072:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9de92 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.777083:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.777086:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.777090:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9de92 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.777096:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9de92 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.777108:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9de99 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.777114:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9de99 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.777119:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9de99 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.777125:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b29a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.777128:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9de99 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.777133:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9de99 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.777141:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xa9dd9870 (ffff9f2496483600) 00010000:00010000:0.0:1784938446.777183:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.777187:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9de99 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.777193:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9de99 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.777224:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9de8b lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476647c7 expref: 146 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.777234:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.777236:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.777240:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9de8b lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476647c7 expref: 146 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.777249:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24d400, rc 0) 00000100:00100000:0.0:1784938446.777309:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+145:17112:x1871643337522816:12345-192.168.202.54@tcp:101:cp.0 Request processed in 495us (643us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938446.777316:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 602 00000100:00100000:1.0:1784938446.780469:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.780540:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337523072 00000100:00100000:0.0:1784938446.780549:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337523072 00000100:00100000:0.0:1784938446.780603:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 603 00000100:00100000:0.0:1784938446.780611:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+145:17112:x1871643337523072:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938446.780631:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938446.780650:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b28c00/0x7b044d4128f9dea0 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476647ce expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.780754:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9dea7 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.780769:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9dea7 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.780778:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9dea7 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.780795:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f9deae lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0xa9dd9870 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.780802:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f9deae lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.780809:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f9deae lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938446.781199:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x53:0x0], index 1: 0 00010000:00010000:0.0:1784938446.781349:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29200/0x7b044d4128f9deb5 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.781358:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29200/0x7b044d4128f9deb5 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.781370:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29200/0x7b044d4128f9deb5 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.781401:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9dea7 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.781408:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9dea7 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.781415:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9dea7 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.781422:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9dea7 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.781428:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b29c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.781431:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9dea7 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.781439:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9dea7 lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.781451:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.781454:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.781459:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9dea7 lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.781464:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9dea7 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938446.781478:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e8739d3f reply state 0000000018a9e0ec transno 8589934755 ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f9deae lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.781489:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f9deae lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.781495:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xa9dd9870 (ffff9f2496483c00) 00010000:00010000:0.0:1784938446.781498:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938446.781500:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938446.781527:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b28c00/0x7b044d4128f9dea0 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476647ce expref: 148 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.781541:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29200/0x7b044d4128f9deb5 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476647ce expref: 147 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.781547:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x24:0x0].0x0 (ffff9f248fb6ed00) 00010000:00010000:0.0:1784938446.781549:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938446.781551:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24c5b29200, rc 0) 00000100:00100000:0.0:1784938446.781619:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+148:17112:x1871643337523072:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1008us (1158us total) trans 8589934755 rc 0/0 00000100:00100000:0.0:1784938446.781627:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 603 00000100:00100000:2.0:1784938446.785500:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.785681:0:25721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337523200 00000100:00100000:3.0:1784938446.785691:0:25721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337523200 00000100:00100000:3.0:1784938446.785748:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 886 00000100:00100000:3.0:1784938446.785759:0:25721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7ea6e988-18ba-4c98-b179-17995571b98b+66:10957:x1871643337523200:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938446.785779:0:25721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938446.785802:0:25721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062c58f3a/0x7b044d4128f9dec3 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476647d5 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938446.785828:0:25721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x53:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938446.785850:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x53:0x0].0x0 since=712s v=(0 0) 00010000:00010000:3.0:1784938446.785855:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x53:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938446.785878:0:25721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062c58f3a/0x7b044d4128f9dec3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476647d5 expref: 67 pid: 25721 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.785896:0:25721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000062c58f3a/0x7b044d4128f9dec3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476647d5 expref: 67 pid: 25721 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.785913:0:25721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d5da600, rc 0) 00000100:00100000:3.0:1784938446.785975:0:25721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7ea6e988-18ba-4c98-b179-17995571b98b+67:10957:x1871643337523200:12345-192.168.202.54@tcp:101:cp.0 Request processed in 219us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938446.785982:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 886 00000100:00100000:1.0:1784938446.789064:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.789240:0:25726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337523328 00000100:00100000:2.0:1784938446.789250:0:25726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337523328 00000100:00100000:2.0:1784938446.789337:0:25726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 887 00000100:00100000:2.0:1784938446.789347:0:25726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7ea6e988-18ba-4c98-b179-17995571b98b+67:17112:x1871643337523328:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938446.789363:0:25726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938446.789381:0:25726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037f49eba/0x7b044d4128f9deca lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x53:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476647dc expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.789411:0:25726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000062c58f3a/0x7b044d4128f9dec3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476647d5 expref: 68 pid: 25721 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.789421:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x53:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.789425:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x53:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.789430:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037f49eba/0x7b044d4128f9deca lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x53:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476647dc expref: 68 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.789464:0:25726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000062c58f3a/0x7b044d4128f9dec3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e9476647d5 expref: 68 pid: 25721 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.789476:0:25726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000062c58f3a/0x7b044d4128f9dec3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476647d5 expref: 68 pid: 25721 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938446.789490:0:25726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2482b28a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:25726:1871643350896768:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938446.789573:0:25726:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34840 going to sleep for 11 seconds 00000100:00100000:2.0:1784938446.792481:0:25726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2482b28a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:25726:1871643350896768:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938446.792515:0:25726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000037f49eba/0x7b044d4128f9deca lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x53:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476647dc expref: 68 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.792537:0:25726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382039400, rc 0) 00000100:00100000:2.0:1784938446.792597:0:25726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7ea6e988-18ba-4c98-b179-17995571b98b+68:17112:x1871643337523328:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3250us (3541us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938446.792606:0:25726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 887 00000100:00100000:1.0:1784938446.794762:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.794855:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337523456 00000100:00100000:2.0:1784938446.794874:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337523456 00010000:00010000:2.0:1784938446.794913:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000062c58f3a/0x7b044d4128f9dec3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476647d5 expref: 68 pid: 25721 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938446.794963:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 442 00000100:00100000:2.0:1784938446.794972:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+68:10957:x1871643337523456:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938446.794988:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938446.795019:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000062c58f3a/0x7b044d4128f9dec3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476647d5 expref: 68 pid: 25721 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.795032:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000062c58f3a/0x7b044d4128f9dec3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476647d5 expref: 68 pid: 25721 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.795053:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062c58f3a/0x7b044d4128f9dec3 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476647d5 expref: 68 pid: 25721 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.795070:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x53:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.795075:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x53:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.795084:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000037f49eba/0x7b044d4128f9deca lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476647dc expref: 67 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.795093:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037f49eba/0x7b044d4128f9deca lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476647dc expref: 67 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.795128:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000037f49eba/0x7b044d4128f9deca lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476647dc expref: 67 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938446.795142:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2482b28a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350896896:192.168.202.54@tcp:105: 00000100:00100000:2.0:1784938446.795428:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34840 going to sleep for 11 seconds 00000100:00100000:2.0:1784938446.797515:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2482b28a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350896896:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938446.797540:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938446.797598:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+67:10957:x1871643337523456:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 2626us (2842us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938446.797608:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 442 00000100:00100000:1.0:1784938446.800272:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.800407:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337523712 00000100:00100000:3.0:1784938446.800416:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337523712 00000100:00100000:3.0:1784938446.800475:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 136 00000100:00100000:3.0:1784938446.800485:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+148:17112:x1871643337523712:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938446.800787:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+149:17112:x1871643337523712:12345-192.168.202.54@tcp:35:cp.0 Request processed in 303us (523us total) trans 8589934756 rc 0/0 00000100:00100000:3.0:1784938446.800795:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 136 00000100:00100000:1.0:1784938446.804213:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.804304:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337523840 00000100:00100000:0.0:1784938446.804313:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337523840 00000100:00100000:0.0:1784938446.804371:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 604 00000100:00100000:0.0:1784938446.804380:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+149:17112:x1871643337523840:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938446.804405:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938446.804427:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b28c00/0x7b044d4128f9ded1 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476647e3 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.804485:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9ded8 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.804499:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9ded8 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.804509:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9ded8 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.804524:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9dedf lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x839e9634 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.804531:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9dedf lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.804537:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9dedf lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.804570:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9ded8 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.804576:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9ded8 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.804583:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9ded8 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.804589:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b29c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.804593:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9ded8 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.804600:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9ded8 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.804611:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.804615:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.804620:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9ded8 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.804626:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9ded8 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.804638:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9dedf lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.804644:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9dedf lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.804649:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9dedf lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.804654:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b29a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.804657:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9dedf lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.804662:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9dedf lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.804668:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x839e9634 (ffff9f2496483600) 00010000:00010000:0.0:1784938446.804671:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.804673:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9dedf lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.804678:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9dedf lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.804707:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b28c00/0x7b044d4128f9ded1 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476647e3 expref: 150 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.804717:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.804719:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.804723:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b28c00/0x7b044d4128f9ded1 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476647e3 expref: 150 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.804731:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24c5b28c00, rc 0) 00000100:00100000:0.0:1784938446.804786:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+149:17112:x1871643337523840:12345-192.168.202.54@tcp:101:cp.0 Request processed in 407us (581us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938446.804793:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 604 00000100:00100000:2.0:1784938446.806919:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.807001:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337523968 00000100:00100000:0.0:1784938446.807010:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337523968 00000100:00100000:0.0:1784938446.807071:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 605 00000100:00100000:0.0:1784938446.807082:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+149:17112:x1871643337523968:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938446.807102:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938446.807137:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b28600/0x7b044d4128f9dee6 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476647ea expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.807232:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9deed lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.807246:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9deed lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.807256:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9deed lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.807272:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9def4 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x839e9634 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.807280:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9def4 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.807286:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9def4 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.807332:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9deed lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.807339:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9deed lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.807345:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9deed lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.807350:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9deed lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.807356:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.807361:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9deed lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.807368:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9deed lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.807379:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.807382:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.807386:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9deed lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.807393:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9deed lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.807406:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9def4 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.807411:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9def4 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.807416:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9def4 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.807421:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24d400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.807423:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9def4 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.807428:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9def4 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.807435:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x839e9634 (ffff9f23823e0000) 00010000:00010000:0.0:1784938446.807437:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.807439:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9def4 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.807444:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9def4 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.807474:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b28600/0x7b044d4128f9dee6 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476647ea expref: 150 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.807484:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.807486:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.807490:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b28600/0x7b044d4128f9dee6 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476647ea expref: 150 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.807501:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24c5b28600, rc 0) 00000100:00100000:0.0:1784938446.807552:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+149:17112:x1871643337523968:12345-192.168.202.54@tcp:101:cp.0 Request processed in 471us (642us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938446.807559:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 605 00000100:00100000:1.0:1784938446.811078:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.811199:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337524224 00000100:00100000:0.0:1784938446.811210:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337524224 00000100:00100000:0.0:1784938446.811269:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 606 00000100:00100000:0.0:1784938446.811279:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+149:17112:x1871643337524224:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938446.811309:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938446.811332:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9defb lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476647f1 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.811443:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9df02 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.811457:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9df02 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.811468:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9df02 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.811482:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9df09 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x839e9634 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.811488:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9df09 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.811494:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9df09 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938446.811818:0:24203:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x53:0x0], index 0: 0 00010000:00010000:0.0:1784938446.811967:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b28c00/0x7b044d4128f9df10 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.811977:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b28c00/0x7b044d4128f9df10 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.811985:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b28c00/0x7b044d4128f9df10 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.812257:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9df02 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.812265:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9df02 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.812271:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9df02 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.812276:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24dc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.812280:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9df02 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.812287:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9df02 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.812311:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.812314:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.812318:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9df02 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.812328:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9df02 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938446.812343:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d0911004 reply state 000000003df462bb transno 8589934757 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9df09 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.812353:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9df09 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.812359:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x839e9634 (ffff9f23823e0200) 00010000:00010000:0.0:1784938446.812361:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938446.812363:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938446.812393:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9defb lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476647f1 expref: 152 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.812407:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b28c00/0x7b044d4128f9df10 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476647f1 expref: 151 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.812414:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x25:0x0].0x0 (ffff9f23823e0500) 00010000:00010000:0.0:1784938446.812416:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938446.812418:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24c5b28c00, rc 0) 00000100:00100000:0.0:1784938446.812489:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+152:17112:x1871643337524224:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1211us (1421us total) trans 8589934757 rc 0/0 00000100:00100000:0.0:1784938446.812497:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 606 00000100:00100000:1.0:1784938446.818417:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.818500:0:21152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337524352 00000100:00100000:3.0:1784938446.818510:0:21152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337524352 00000100:00100000:3.0:1784938446.818565:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 888 00000100:00100000:3.0:1784938446.818576:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+64:10959:x1871643337524352:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938446.818594:0:21152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938446.818615:0:21152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb99348e/0x7b044d4128f9df1e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476647f8 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938446.818641:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x53:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938446.818662:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x53:0x0].0x0 since=712s v=(0 0) 00010000:00010000:3.0:1784938446.818667:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x53:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938446.818676:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb99348e/0x7b044d4128f9df1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476647f8 expref: 65 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.818697:0:21152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cb99348e/0x7b044d4128f9df1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476647f8 expref: 65 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.818710:0:21152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d5db800, rc 0) 00000100:00100000:3.0:1784938446.818810:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+65:10959:x1871643337524352:12345-192.168.202.54@tcp:101:cp.0 Request processed in 235us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938446.818818:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 888 00000100:00100000:2.0:1784938446.821672:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.821768:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337524480 00000100:00100000:3.0:1784938446.821776:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337524480 00000100:00100000:3.0:1784938446.821872:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 889 00000100:00100000:3.0:1784938446.821882:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+65:17112:x1871643337524480:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938446.821899:0:25722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938446.821915:0:25722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a6a8420/0x7b044d4128f9df25 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x53:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476647ff expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.821948:0:25722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb99348e/0x7b044d4128f9df1e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476647f8 expref: 66 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.821957:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x53:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938446.821960:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x53:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938446.821965:0:25722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a6a8420/0x7b044d4128f9df25 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x53:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476647ff expref: 66 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.822005:0:25722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cb99348e/0x7b044d4128f9df1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e9476647f8 expref: 66 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.822020:0:25722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cb99348e/0x7b044d4128f9df1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476647f8 expref: 66 pid: 21152 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938446.822034:0:25722:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b35f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25722:1871643350897024:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938446.822115:0:25722:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2482b066c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938446.825169:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.825407:0:25722:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b35f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25722:1871643350897024:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938446.825449:0:25722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006a6a8420/0x7b044d4128f9df25 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x53:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476647ff expref: 66 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.825469:0:25722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d5daa00, rc 0) 00000100:00100000:3.0:1784938446.825521:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+66:17112:x1871643337524480:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3641us (3858us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938446.825529:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 889 00000100:00100000:2.0:1784938446.825626:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337524608 00000100:00100000:2.0:1784938446.825633:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337524608 00010000:00010000:2.0:1784938446.825661:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cb99348e/0x7b044d4128f9df1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476647f8 expref: 66 pid: 21152 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938446.825691:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 443 00000100:00100000:2.0:1784938446.825699:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+66:10960:x1871643337524608:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938446.825710:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938446.825732:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cb99348e/0x7b044d4128f9df1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476647f8 expref: 66 pid: 21152 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.825745:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cb99348e/0x7b044d4128f9df1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476647f8 expref: 66 pid: 21152 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.825769:0:22955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb99348e/0x7b044d4128f9df1e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476647f8 expref: 66 pid: 21152 timeout: 812 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.825789:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x53:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.825793:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x53:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.825800:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006a6a8420/0x7b044d4128f9df25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476647ff expref: 65 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.825811:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a6a8420/0x7b044d4128f9df25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476647ff expref: 65 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.825840:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006a6a8420/0x7b044d4128f9df25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476647ff expref: 65 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938446.825852:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2482b29880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350897152:192.168.202.54@tcp:105: 00000100:00100000:2.0:1784938446.825908:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34840 going to sleep for 11 seconds 00000100:00100000:1.0:1784938446.829472:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.829631:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2482b29880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350897152:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938446.829655:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938446.829722:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+65:10960:x1871643337524608:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 4023us (4578us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938446.829733:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 443 00000100:00100000:0.0:1784938446.831070:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337524864 00000100:00100000:0.0:1784938446.831083:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337524864 00000100:00100000:0.0:1784938446.831168:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 137 00000100:00100000:0.0:1784938446.831178:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+152:17112:x1871643337524864:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:0.0:1784938446.831483:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+153:17112:x1871643337524864:12345-192.168.202.54@tcp:35:cp.0 Request processed in 307us (2020us total) trans 8589934758 rc 0/0 00000100:00100000:0.0:1784938446.831490:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 137 00000100:00100000:1.0:1784938446.834380:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.834468:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337524992 00000100:00100000:0.0:1784938446.834477:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337524992 00000100:00100000:0.0:1784938446.834532:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 607 00000100:00100000:0.0:1784938446.834540:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+153:17112:x1871643337524992:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938446.834563:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938446.834583:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b28600/0x7b044d4128f9df2c lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664806 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.834640:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9df33 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.834653:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9df33 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.834665:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9df33 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.834679:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9df3a lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9e90f16b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.834686:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9df3a lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.834692:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9df3a lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.834727:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9df33 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.834734:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9df33 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.834741:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9df33 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.834747:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9df33 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.834752:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b29a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.834757:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9df33 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.834764:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9df33 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.834774:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.834777:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.834782:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9df33 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.834788:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9df33 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.834802:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9df3a lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.834808:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9df3a lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.834814:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9df3a lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.834819:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b29c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.834822:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9df3a lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.834828:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9df3a lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.834834:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x9e90f16b (ffff9f23823e0000) 00010000:00010000:0.0:1784938446.834836:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.834838:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9df3a lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.834844:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9df3a lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.834883:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b28600/0x7b044d4128f9df2c lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664806 expref: 154 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.834893:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.834895:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.834898:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b28600/0x7b044d4128f9df2c lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664806 expref: 154 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.834907:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24c5b28600, rc 0) 00000100:00100000:0.0:1784938446.834961:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+153:17112:x1871643337524992:12345-192.168.202.54@tcp:101:cp.0 Request processed in 421us (591us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938446.834967:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 607 00000100:00100000:1.0:1784938446.837430:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.837526:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337525120 00000100:00100000:0.0:1784938446.837537:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337525120 00000100:00100000:0.0:1784938446.837595:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 608 00000100:00100000:0.0:1784938446.837606:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+153:17112:x1871643337525120:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938446.837627:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938446.837651:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9df41 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766480d expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.837716:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9df48 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.837732:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9df48 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.837744:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9df48 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.837760:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9df4f lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9e90f16b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.837766:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9df4f lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.837772:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9df4f lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.837828:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9df48 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.837835:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9df48 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.837841:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9df48 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.837848:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24dc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.837852:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9df48 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.837859:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9df48 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.837884:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.837887:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.837892:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9df48 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.837898:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9df48 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.837916:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9df4f lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.837921:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9df4f lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.837927:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9df4f lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.837932:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24d400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.837934:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9df4f lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.837940:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9df4f lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.837950:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x9e90f16b (ffff9f23823e0c00) 00010000:00010000:0.0:1784938446.837952:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.837955:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9df4f lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.837960:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9df4f lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.837994:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9df41 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766480d expref: 154 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.838016:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.838018:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.838022:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9df41 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766480d expref: 154 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.838032:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24ca00, rc 0) 00000100:00100000:0.0:1784938446.838082:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+153:17112:x1871643337525120:12345-192.168.202.54@tcp:101:cp.0 Request processed in 478us (660us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938446.838090:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 608 00000100:00100000:1.0:1784938446.841527:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.841607:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337525376 00000100:00100000:0.0:1784938446.841618:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337525376 00000100:00100000:0.0:1784938446.841680:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 609 00000100:00100000:0.0:1784938446.841690:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+153:17112:x1871643337525376:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938446.841712:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938446.841735:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b28600/0x7b044d4128f9df56 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664814 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.841875:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9df5d lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.841890:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9df5d lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.841901:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9df5d lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.841914:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9df64 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x9e90f16b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.841920:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9df64 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.841926:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9df64 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938446.842309:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x54:0x0], index 1: 0 00010000:00010000:0.0:1784938446.842452:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9df6b lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.842461:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9df6b lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.842469:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9df6b lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.842501:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9df5d lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.842513:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9df5d lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.842518:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9df5d lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.842525:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9df5d lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.842530:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b29c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.842535:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9df5d lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.842541:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9df5d lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.842553:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.842556:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.842560:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9df5d lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.842566:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9df5d lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938446.842581:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000362ebbb3 reply state 00000000b955153a transno 8589934759 ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9df64 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.842591:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9df64 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.842596:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x9e90f16b (ffff9f23823e0000) 00010000:00010000:0.0:1784938446.842599:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938446.842602:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938446.842633:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b28600/0x7b044d4128f9df56 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664814 expref: 156 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.842648:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9df6b lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664814 expref: 155 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.842655:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x26:0x0].0x0 (ffff9f23823e0300) 00010000:00010000:0.0:1784938446.842657:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938446.842660:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f245400, rc 0) 00000100:00100000:0.0:1784938446.842726:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+156:17112:x1871643337525376:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1038us (1208us total) trans 8589934759 rc 0/0 00000100:00100000:0.0:1784938446.842736:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 609 00000100:00100000:1.0:1784938446.846875:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.847531:0:25727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337525504 00000100:00100000:0.0:1784938446.847541:0:25727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337525504 00000100:00100000:0.0:1784938446.847648:0:25727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 890 00000100:00100000:0.0:1784938446.847660:0:25727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7ea6e988-18ba-4c98-b179-17995571b98b+67:10957:x1871643337525504:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938446.847679:0:25727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938446.847704:0:25727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4d7eeea/0x7b044d4128f9df79 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766481b expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938446.847733:0:25727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x54:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938446.847755:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x54:0x0].0x0 since=713s v=(0 0) 00010000:00010000:0.0:1784938446.847760:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x54:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938446.847770:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4d7eeea/0x7b044d4128f9df79 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766481b expref: 68 pid: 25727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.847795:0:25727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d4d7eeea/0x7b044d4128f9df79 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766481b expref: 68 pid: 25727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.847809:0:25727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24ca00, rc 0) 00000100:00100000:0.0:1784938446.847885:0:25727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7ea6e988-18ba-4c98-b179-17995571b98b+68:10957:x1871643337525504:12345-192.168.202.54@tcp:101:cp.0 Request processed in 227us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938446.847893:0:25727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 890 00000100:00100000:1.0:1784938446.850823:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.850968:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337525632 00000100:00100000:3.0:1784938446.850982:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337525632 00000100:00100000:3.0:1784938446.851108:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 891 00000100:00100000:3.0:1784938446.851118:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+68:17112:x1871643337525632:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938446.851138:0:21149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938446.851449:0:21149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f2d18e0/0x7b044d4128f9df80 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x54:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664822 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.851483:0:21149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4d7eeea/0x7b044d4128f9df79 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766481b expref: 69 pid: 25727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.851497:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x54:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938446.851501:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x54:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938446.851506:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f2d18e0/0x7b044d4128f9df80 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x54:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664822 expref: 69 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.851537:0:21149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d4d7eeea/0x7b044d4128f9df79 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e94766481b expref: 69 pid: 25727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.851551:0:21149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d4d7eeea/0x7b044d4128f9df79 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766481b expref: 69 pid: 25727 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938446.851565:0:21149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b35f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:21149:1871643350897280:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938446.851651:0:21149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2482b066c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938446.854755:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.854833:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337525760 00000100:00100000:0.0:1784938446.854843:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337525760 00010000:00010000:0.0:1784938446.854892:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d4d7eeea/0x7b044d4128f9df79 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766481b expref: 70 pid: 25727 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938446.854938:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 444 00000100:00100000:0.0:1784938446.854948:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24a6e60450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+70:10958:x1871643337525760:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938446.854962:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938446.854984:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d4d7eeea/0x7b044d4128f9df79 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766481b expref: 70 pid: 25727 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.855006:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d4d7eeea/0x7b044d4128f9df79 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766481b expref: 70 pid: 25727 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.855031:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x54:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938446.855035:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x54:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938446.855044:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008f2d18e0/0x7b044d4128f9df80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664822 expref: 70 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.855056:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f2d18e0/0x7b044d4128f9df80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664822 expref: 70 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.855094:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008f2d18e0/0x7b044d4128f9df80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664822 expref: 70 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938446.855108:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:19219:1871643350897408:192.168.202.54@tcp:105: 00000100:00100000:2.0:1784938446.855478:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248529f600 going to sleep for 11 seconds 00010000:00010000:3.0:1784938446.855682:0:21149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4d7eeea/0x7b044d4128f9df79 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766481b expref: 70 pid: 25727 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938446.855697:0:21149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b35f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:21149:1871643350897280:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938446.855734:0:21149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008f2d18e0/0x7b044d4128f9df80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664822 expref: 69 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.855746:0:21149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d5dbc00, rc 0) 00000100:00100000:3.0:1784938446.855790:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+69:17112:x1871643337525632:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4673us (4975us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938446.855801:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 891 00000100:00100000:1.0:1784938446.859651:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.859724:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337526016 00000100:00100000:3.0:1784938446.859733:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337526016 00000100:00100000:3.0:1784938446.859786:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 138 00000100:00100000:3.0:1784938446.859795:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+156:17112:x1871643337526016:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938446.860351:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+157:17112:x1871643337526016:12345-192.168.202.54@tcp:35:cp.0 Request processed in 556us (708us total) trans 8589934760 rc 0/0 00000100:00100000:3.0:1784938446.860359:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 138 00000100:00100000:2.0:1784938446.860765:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:19219:1871643350897408:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938446.860787:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938446.860825:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24a6e60450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+68:10958:x1871643337525760:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 5878us (6079us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938446.860835:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 444 00000100:00100000:1.0:1784938446.865121:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.865312:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337526144 00000100:00100000:0.0:1784938446.865321:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337526144 00000100:00100000:0.0:1784938446.865382:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 610 00000100:00100000:0.0:1784938446.865392:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+157:17112:x1871643337526144:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938446.865416:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938446.865439:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9df87 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664829 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.865502:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9df8e lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.865515:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9df8e lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.865526:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9df8e lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.865539:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9df95 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x10fe8da8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.865549:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9df95 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.865556:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9df95 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.865594:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9df8e lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.865601:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9df8e lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.865606:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9df8e lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.865612:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24ca00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.865615:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9df8e lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.865622:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9df8e lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.865633:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.865636:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.865640:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9df8e lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.865645:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24ca00/0x7b044d4128f9df8e lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.865660:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9df95 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.865667:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9df95 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.865673:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9df95 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.865678:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24d400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.865681:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9df95 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.865686:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9df95 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.865693:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x10fe8da8 (ffff9f23823e0400) 00010000:00010000:0.0:1784938446.865695:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.865698:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9df95 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.865704:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9df95 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.865733:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9df87 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664829 expref: 158 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.865743:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.865745:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.865748:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9df87 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664829 expref: 158 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.865761:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24dc00, rc 0) 00000100:00100000:0.0:1784938446.865823:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+157:17112:x1871643337526144:12345-192.168.202.54@tcp:101:cp.0 Request processed in 432us (713us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938446.865830:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 610 00000100:00100000:1.0:1784938446.868644:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.868729:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337526272 00000100:00100000:0.0:1784938446.868741:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337526272 00000100:00100000:0.0:1784938446.868804:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 611 00000100:00100000:0.0:1784938446.868814:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+157:17112:x1871643337526272:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938446.868835:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938446.868858:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b28600/0x7b044d4128f9df9c lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664830 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.868930:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9dfa3 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.868943:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9dfa3 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.868953:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9dfa3 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.868970:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9dfaa lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x10fe8da8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.868976:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9dfaa lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.868983:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9dfaa lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.869036:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9dfa3 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.869043:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9dfa3 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.869049:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9dfa3 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.869056:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9dfa3 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.869061:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b29c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.869065:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9dfa3 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.869072:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9dfa3 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.869083:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.869086:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.869091:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9dfa3 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.869097:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9dfa3 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.869111:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9dfaa lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.869117:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9dfaa lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.869123:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9dfaa lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.869139:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217c800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.869142:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9dfaa lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.869179:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9dfaa lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.869186:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x10fe8da8 (ffff9f2496483600) 00010000:00010000:0.0:1784938446.869189:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.869191:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9dfaa lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.869197:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9dfaa lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.869230:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b28600/0x7b044d4128f9df9c lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664830 expref: 158 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.869240:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.869242:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.869245:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b28600/0x7b044d4128f9df9c lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664830 expref: 158 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.869255:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24c5b28600, rc 0) 00000100:00100000:0.0:1784938446.869317:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+157:17112:x1871643337526272:12345-192.168.202.54@tcp:101:cp.0 Request processed in 505us (682us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938446.869327:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 611 00000100:00100000:1.0:1784938446.872579:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.872691:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337526528 00000100:00100000:0.0:1784938446.872701:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337526528 00000100:00100000:0.0:1784938446.872762:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 612 00000100:00100000:0.0:1784938446.872772:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+157:17112:x1871643337526528:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938446.872793:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938446.872814:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9dfb1 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664837 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.873048:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9dfb8 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.873063:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9dfb8 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.873074:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9dfb8 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.873092:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217de00/0x7b044d4128f9dfbf lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x10fe8da8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.873099:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217de00/0x7b044d4128f9dfbf lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.873106:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217de00/0x7b044d4128f9dfbf lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938446.873471:0:24203:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x54:0x0], index 0: 0 00010000:00010000:0.0:1784938446.873605:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217dc00/0x7b044d4128f9dfc6 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.873615:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217dc00/0x7b044d4128f9dfc6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.873622:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217dc00/0x7b044d4128f9dfc6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.873654:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9dfb8 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.873663:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9dfb8 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.873669:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9dfb8 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.873675:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217ce00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.873679:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9dfb8 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.873687:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9dfb8 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.873698:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.873701:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.873705:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9dfb8 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.873710:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9dfb8 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938446.873726:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bdbaf8e9 reply state 000000005d1dd68d transno 8589934761 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217de00/0x7b044d4128f9dfbf lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.873737:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217de00/0x7b044d4128f9dfbf lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.873742:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x10fe8da8 (ffff9f23823e0400) 00010000:00010000:0.0:1784938446.873745:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938446.873748:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938446.873777:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9dfb1 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664837 expref: 160 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.873791:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217dc00/0x7b044d4128f9dfc6 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664837 expref: 159 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.873798:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x27:0x0].0x0 (ffff9f248390a800) 00010000:00010000:0.0:1784938446.873800:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938446.873803:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217dc00, rc 0) 00000100:00100000:0.0:1784938446.873873:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+160:17112:x1871643337526528:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1102us (1302us total) trans 8589934761 rc 0/0 00000100:00100000:0.0:1784938446.873882:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 612 00000100:00100000:1.0:1784938446.881392:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.881500:0:25719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337526656 00000100:00100000:2.0:1784938446.881512:0:25719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337526656 00000100:00100000:2.0:1784938446.881575:0:25719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 892 00000100:00100000:2.0:1784938446.881586:0:25719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7ea6e988-18ba-4c98-b179-17995571b98b+65:10960:x1871643337526656:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938446.881611:0:25719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938446.881641:0:25719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000712946f6/0x7b044d4128f9dfd4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766483e expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938446.881672:0:25719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x54:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938446.881699:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x54:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1784938446.881703:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x54:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.881714:0:25719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000712946f6/0x7b044d4128f9dfd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766483e expref: 66 pid: 25719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.881735:0:25719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000712946f6/0x7b044d4128f9dfd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766483e expref: 66 pid: 25719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.881748:0:25719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382038a00, rc 0) 00000100:00100000:2.0:1784938446.881819:0:25719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7ea6e988-18ba-4c98-b179-17995571b98b+66:10960:x1871643337526656:12345-192.168.202.54@tcp:101:cp.0 Request processed in 236us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938446.881828:0:25719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 892 00000100:00100000:1.0:1784938446.884577:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.884658:0:25725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337526784 00000100:00100000:3.0:1784938446.884667:0:25725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337526784 00000100:00100000:3.0:1784938446.884731:0:25725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 893 00000100:00100000:3.0:1784938446.884742:0:25725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7ea6e988-18ba-4c98-b179-17995571b98b+66:17112:x1871643337526784:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938446.884761:0:25725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938446.884780:0:25725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb99348e/0x7b044d4128f9dfdb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x54:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664845 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.884810:0:25725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000712946f6/0x7b044d4128f9dfd4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766483e expref: 67 pid: 25719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.884819:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x54:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938446.884823:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x54:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938446.884829:0:25725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb99348e/0x7b044d4128f9dfdb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x54:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664845 expref: 67 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.884871:0:25725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000712946f6/0x7b044d4128f9dfd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e94766483e expref: 67 pid: 25719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.884886:0:25725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000712946f6/0x7b044d4128f9dfd4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766483e expref: 67 pid: 25719 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938446.884900:0:25725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b35f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:25725:1871643350897536:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938446.884980:0:25725:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2482b06600 going to sleep for 11 seconds 00000100:00100000:1.0:1784938446.887791:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.887890:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337526912 00000100:00100000:2.0:1784938446.887898:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337526912 00010000:00010000:2.0:1784938446.887938:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000712946f6/0x7b044d4128f9dfd4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766483e expref: 68 pid: 25719 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938446.887981:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 445 00000100:00100000:2.0:1784938446.887998:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+68:10959:x1871643337526912:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938446.888015:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938446.888038:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000712946f6/0x7b044d4128f9dfd4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766483e expref: 68 pid: 25719 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.888053:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000712946f6/0x7b044d4128f9dfd4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766483e expref: 68 pid: 25719 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.888078:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x54:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.888083:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x54:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.888091:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb99348e/0x7b044d4128f9dfdb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664845 expref: 68 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.888101:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb99348e/0x7b044d4128f9dfdb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664845 expref: 68 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.888175:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cb99348e/0x7b044d4128f9dfdb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664845 expref: 68 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938446.888190:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2482b2a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:19221:1871643350897664:192.168.202.54@tcp:105: 00000100:00100000:2.0:1784938446.888263:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34540 going to sleep for 11 seconds 00010000:00010000:3.0:1784938446.888794:0:25725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000712946f6/0x7b044d4128f9dfd4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766483e expref: 68 pid: 25719 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938446.888808:0:25725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b35f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:25725:1871643350897536:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938446.888840:0:25725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cb99348e/0x7b044d4128f9dfdb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664845 expref: 67 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.888849:0:25725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d5db800, rc 0) 00000100:00100000:3.0:1784938446.888903:0:25725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7ea6e988-18ba-4c98-b179-17995571b98b+67:17112:x1871643337526784:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4163us (4334us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938446.888910:0:25725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 893 00000100:00100000:1.0:1784938446.892776:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.892922:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2482b2a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:19221:1871643350897664:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938446.892942:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938446.893001:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+66:10959:x1871643337526912:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 5012us (5219us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938446.893016:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 445 00000100:00100000:3.0:1784938446.894948:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337527168 00000100:00100000:3.0:1784938446.894966:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337527168 00000100:00100000:2.0:1784938446.895240:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 139 00000100:00100000:2.0:1784938446.895252:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+160:17112:x1871643337527168:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:2.0:1784938446.895628:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+161:17112:x1871643337527168:12345-192.168.202.54@tcp:35:cp.0 Request processed in 377us (2862us total) trans 8589934762 rc 0/0 00000100:00100000:2.0:1784938446.895636:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 139 00000100:00100000:1.0:1784938446.899269:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.899505:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337527296 00000100:00100000:0.0:1784938446.899515:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337527296 00000100:00100000:0.0:1784938446.899589:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 613 00000100:00100000:0.0:1784938446.899600:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+161:17112:x1871643337527296:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938446.899632:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938446.899659:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9dfe2 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766484c expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.899747:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9dfe9 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.899768:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9dfe9 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.899782:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9dfe9 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.899802:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9dff0 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x6b7bd7c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.899809:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9dff0 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.899815:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9dff0 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.899864:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9dfe9 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.899871:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9dfe9 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.899877:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9dfe9 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.899884:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9dfe9 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.899890:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217ce00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.899895:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9dfe9 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.899902:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9dfe9 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.899914:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.899918:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.899924:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9dfe9 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.899930:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9dfe9 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.899946:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9dff0 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.899952:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9dff0 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.899957:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9dff0 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.899962:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217c800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.899964:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9dff0 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.899970:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9dff0 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.899977:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x6b7bd7c (ffff9f248390aa00) 00010000:00010000:0.0:1784938446.899979:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.899982:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9dff0 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.899988:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9dff0 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.900103:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9dfe2 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766484c expref: 162 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.900113:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.900116:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.900120:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9dfe2 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766484c expref: 162 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.900289:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217d800, rc 0) 00000100:00100000:0.0:1784938446.900354:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+161:17112:x1871643337527296:12345-192.168.202.54@tcp:101:cp.0 Request processed in 755us (1097us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938446.900361:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 613 00000100:00100000:1.0:1784938446.902749:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.902911:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337527424 00000100:00100000:3.0:1784938446.902920:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337527424 00000100:00100000:3.0:1784938446.902975:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 614 00000100:00100000:3.0:1784938446.902985:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+161:17112:x1871643337527424:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938446.903018:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938446.903043:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9dff7 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664853 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.903120:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9dffe lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.903308:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9dffe lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.903321:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9dffe lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.903337:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9e005 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x6b7bd7c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.903344:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9e005 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.903350:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9e005 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.903394:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9dffe lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.903402:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9dffe lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.903409:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9dffe lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.903416:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9dffe lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.903422:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c7400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938446.903427:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9dffe lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.903436:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9dffe lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.903447:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938446.903451:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938446.903455:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9dffe lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.903461:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9dffe lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.903476:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9e005 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.903482:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9e005 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.903488:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9e005 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.903493:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c6000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938446.903496:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9e005 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.903502:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9e005 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.903509:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x6b7bd7c (ffff9f23861f8500) 00010000:00010000:3.0:1784938446.903511:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938446.903515:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9e005 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.903520:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9e005 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.903553:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9dff7 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664853 expref: 162 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.903563:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938446.903565:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938446.903568:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9dff7 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664853 expref: 162 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.903579:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d5da600, rc 0) 00000100:00100000:3.0:1784938446.903651:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+161:17112:x1871643337527424:12345-192.168.202.54@tcp:101:cp.0 Request processed in 667us (911us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938446.903659:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 614 00000100:00100000:1.0:1784938446.907524:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.907617:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337527680 00000100:00100000:3.0:1784938446.907628:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337527680 00000100:00100000:3.0:1784938446.907691:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 615 00000100:00100000:3.0:1784938446.907702:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+161:17112:x1871643337527680:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938446.907729:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938446.907757:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65800/0x7b044d4128f9e00c lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766485a expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.907862:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f9e013 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.907881:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f9e013 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.907892:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f9e013 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.907907:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65400/0x7b044d4128f9e01a lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x6b7bd7c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.907913:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65400/0x7b044d4128f9e01a lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.907919:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65400/0x7b044d4128f9e01a lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938446.908518:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x55:0x0], index 1: 0 00010000:00010000:2.0:1784938446.908677:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038a00/0x7b044d4128f9e021 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.908687:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038a00/0x7b044d4128f9e021 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.908695:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038a00/0x7b044d4128f9e021 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.908731:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f9e013 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.908738:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f9e013 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.908744:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f9e013 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.908750:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dc65e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938446.908754:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f9e013 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.908765:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f9e013 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.908779:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938446.908782:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938446.908788:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f9e013 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.908793:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f9e013 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938446.908807:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b8c07245 reply state 00000000ffd2abc3 transno 8589934763 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65400/0x7b044d4128f9e01a lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.908820:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65400/0x7b044d4128f9e01a lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.908826:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x6b7bd7c (ffff9f23861f8c00) 00010000:00010000:2.0:1784938446.908829:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938446.908832:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938446.908865:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65800/0x7b044d4128f9e00c lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766485a expref: 164 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.908881:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038a00/0x7b044d4128f9e021 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766485a expref: 163 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.908887:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x28:0x0].0x0 (ffff9f248fb6a900) 00010000:00010000:2.0:1784938446.908890:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938446.908892:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382038a00, rc 0) 00000100:00100000:2.0:1784938446.908989:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+164:17112:x1871643337527680:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1287us (1474us total) trans 8589934763 rc 0/0 00000100:00100000:2.0:1784938446.908999:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 615 00000100:00100000:1.0:1784938446.917232:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.917340:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337527808 00000100:00100000:2.0:1784938446.917349:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337527808 00000100:00100000:2.0:1784938446.917407:0:25720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 894 00000100:00100000:2.0:1784938446.917416:0:25720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7ea6e988-18ba-4c98-b179-17995571b98b+68:10957:x1871643337527808:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938446.917434:0:25720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938446.917454:0:25720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cea9ecd/0x7b044d4128f9e02f lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664861 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938446.917479:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x55:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938446.917498:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x55:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1784938446.917503:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x55:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.917511:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cea9ecd/0x7b044d4128f9e02f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664861 expref: 69 pid: 25720 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.917528:0:25720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000cea9ecd/0x7b044d4128f9e02f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664861 expref: 69 pid: 25720 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.917541:0:25720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382038200, rc 0) 00000100:00100000:2.0:1784938446.917592:0:25720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7ea6e988-18ba-4c98-b179-17995571b98b+69:10957:x1871643337527808:12345-192.168.202.54@tcp:101:cp.0 Request processed in 178us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938446.917599:0:25720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 894 00000100:00100000:1.0:1784938446.920326:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.920486:0:25723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337527936 00000100:00100000:3.0:1784938446.920500:0:25723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337527936 00000100:00100000:3.0:1784938446.920557:0:25723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 895 00000100:00100000:3.0:1784938446.920566:0:25723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7ea6e988-18ba-4c98-b179-17995571b98b+69:17112:x1871643337527936:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938446.920584:0:25723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938446.920604:0:25723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b66bf565/0x7b044d4128f9e036 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x55:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664868 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.920635:0:25723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000cea9ecd/0x7b044d4128f9e02f lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664861 expref: 70 pid: 25720 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.920644:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x55:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938446.920649:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x55:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938446.920654:0:25723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b66bf565/0x7b044d4128f9e036 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x55:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664868 expref: 70 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.920686:0:25723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000cea9ecd/0x7b044d4128f9e02f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664861 expref: 70 pid: 25720 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.920700:0:25723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000cea9ecd/0x7b044d4128f9e02f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664861 expref: 70 pid: 25720 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938446.920713:0:25723:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b35f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:25723:1871643350897792:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938446.920795:0:25723:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2482b06b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938446.923532:0:25723:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b35f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:25723:1871643350897792:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938446.923586:0:25723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b66bf565/0x7b044d4128f9e036 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x55:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664868 expref: 70 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.923611:0:25723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dc64c00, rc 0) 00000100:00100000:3.0:1784938446.923676:0:25723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7ea6e988-18ba-4c98-b179-17995571b98b+70:17112:x1871643337527936:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3109us (3388us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938446.923685:0:25723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 895 00000100:00100000:1.0:1784938446.924871:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.925787:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337528064 00000100:00100000:2.0:1784938446.925797:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337528064 00010000:00010000:2.0:1784938446.925841:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000cea9ecd/0x7b044d4128f9e02f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664861 expref: 70 pid: 25720 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938446.925996:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 446 00000100:00100000:2.0:1784938446.926007:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+70:10957:x1871643337528064:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938446.926023:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938446.926047:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000cea9ecd/0x7b044d4128f9e02f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664861 expref: 70 pid: 25720 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.926061:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000cea9ecd/0x7b044d4128f9e02f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664861 expref: 70 pid: 25720 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.926084:0:22955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cea9ecd/0x7b044d4128f9e02f lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664861 expref: 70 pid: 25720 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.926100:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x55:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.926105:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x55:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.926113:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b66bf565/0x7b044d4128f9e036 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664868 expref: 69 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.926123:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b66bf565/0x7b044d4128f9e036 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664868 expref: 69 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.926215:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b66bf565/0x7b044d4128f9e036 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664868 expref: 69 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938446.926234:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2482b2a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22955:1871643350897920:192.168.202.54@tcp:105: 00000100:00100000:2.0:1784938446.926552:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb343c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938446.930715:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2482b2a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22955:1871643350897920:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938446.930740:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938446.930838:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+69:10957:x1871643337528064:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 4831us (5983us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938446.930849:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 446 00000100:00100000:2.0:1784938446.932537:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.932619:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337528320 00000100:00100000:3.0:1784938446.932628:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337528320 00000100:00100000:3.0:1784938446.932679:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 140 00000100:00100000:3.0:1784938446.932688:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+164:17112:x1871643337528320:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938446.932978:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+165:17112:x1871643337528320:12345-192.168.202.54@tcp:35:cp.0 Request processed in 290us (445us total) trans 8589934764 rc 0/0 00000100:00100000:3.0:1784938446.932984:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 140 00000100:00100000:1.0:1784938446.935520:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.935623:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337528448 00000100:00100000:0.0:1784938446.935632:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337528448 00000100:00100000:0.0:1784938446.935693:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 616 00000100:00100000:0.0:1784938446.935703:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+165:17112:x1871643337528448:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938446.935726:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938446.935747:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e03d lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766486f expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.935809:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e044 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.935823:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e044 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.935835:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e044 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.935854:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e04b lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x37dcc2d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.935862:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e04b lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.935868:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e04b lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.935909:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e044 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.935915:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e044 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.935921:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e044 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.935927:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217c400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.935931:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e044 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.935938:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e044 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.935949:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.935952:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.935957:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e044 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.935962:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e044 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.935977:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e04b lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.936276:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e04b lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.936282:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e04b lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.936288:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217c200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.936291:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e04b lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.936308:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e04b lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.936317:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x37dcc2d3 (ffff9f248390aa00) 00010000:00010000:0.0:1784938446.936320:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.936323:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e04b lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.936329:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e04b lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.936366:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e03d lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766486f expref: 166 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.936376:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.936378:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.936382:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e03d lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766486f expref: 166 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.936391:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217ce00, rc 0) 00000100:00100000:0.0:1784938446.936447:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+165:17112:x1871643337528448:12345-192.168.202.54@tcp:101:cp.0 Request processed in 745us (934us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938446.936455:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 616 00000100:00100000:0.0:1784938446.941576:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938446.941998:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337528576 00000100:00100000:1.0:1784938446.942011:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337528576 00000100:00100000:1.0:1784938446.942079:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 617 00000100:00100000:1.0:1784938446.942089:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+165:17112:x1871643337528576:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938446.942111:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938446.942170:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39a00/0x7b044d4128f9e052 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664876 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.942235:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9e059 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.942251:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9e059 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.942264:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9e059 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.942279:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9e060 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x37dcc2d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.942286:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9e060 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.942292:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9e060 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.942354:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9e059 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.942361:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9e059 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.942372:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9e059 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.942379:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9e059 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.942385:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938446.942390:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9e059 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.942398:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9e059 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.942409:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938446.942412:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938446.942417:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9e059 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.942422:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9e059 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.942437:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9e060 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.942443:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9e060 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.942449:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9e060 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.942454:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db38a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938446.942457:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9e060 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.942463:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9e060 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.942470:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x37dcc2d3 (ffff9f24b67c7f00) 00010000:00010000:1.0:1784938446.942472:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938446.942475:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9e060 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.942481:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38a00/0x7b044d4128f9e060 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.942516:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39a00/0x7b044d4128f9e052 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664876 expref: 166 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.942527:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938446.942529:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938446.942533:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39a00/0x7b044d4128f9e052 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664876 expref: 166 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938446.942542:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238db39a00, rc 0) 00000100:00100000:1.0:1784938446.942611:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+165:17112:x1871643337528576:12345-192.168.202.54@tcp:101:cp.0 Request processed in 523us (1045us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938446.942619:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 617 00000100:00100000:1.0:1784938446.945942:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.946028:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337528832 00000100:00100000:3.0:1784938446.946040:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337528832 00000100:00100000:3.0:1784938446.946103:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 618 00000100:00100000:3.0:1784938446.946114:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+165:17112:x1871643337528832:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938446.946171:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938446.946193:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65800/0x7b044d4128f9e067 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766487d expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.946309:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f9e06e lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.946333:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f9e06e lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.946344:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f9e06e lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.946361:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9e075 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x37dcc2d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.946367:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9e075 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.946374:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9e075 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938446.946713:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x55:0x0], index 0: 0 00010000:00010000:3.0:1784938446.946855:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9e07c lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.946865:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9e07c lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.946872:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9e07c lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.946907:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f9e06e lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.946914:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f9e06e lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.946920:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f9e06e lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.946927:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f9e06e lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.946933:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dc65e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938446.946937:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f9e06e lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.946945:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f9e06e lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.946956:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938446.946959:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938446.946963:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f9e06e lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.946969:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f9e06e lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938446.946982:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002165fc3c reply state 0000000025e35203 transno 8589934765 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9e075 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.946992:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9e075 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.946999:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x37dcc2d3 (ffff9f23861f8500) 00010000:00010000:3.0:1784938446.947001:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938446.947003:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938446.947032:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65800/0x7b044d4128f9e067 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766487d expref: 168 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.947046:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9e07c lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766487d expref: 167 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.947053:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x29:0x0].0x0 (ffff9f249863ba00) 00010000:00010000:3.0:1784938446.947055:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938446.947058:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c6000, rc 0) 00000100:00100000:3.0:1784938446.947123:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+168:17112:x1871643337528832:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1011us (1190us total) trans 8589934765 rc 0/0 00000100:00100000:3.0:1784938446.947131:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 618 00000100:00100000:3.0:1784938446.952911:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.953448:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337528960 00000100:00100000:2.0:1784938446.953457:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337528960 00000100:00100000:2.0:1784938446.953517:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 896 00000100:00100000:2.0:1784938446.953527:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b35f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+66:10959:x1871643337528960:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938446.953546:0:21629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938446.953569:0:21629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cea9ecd/0x7b044d4128f9e08a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664884 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938446.953597:0:21629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x55:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938446.953619:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x55:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1784938446.953624:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x55:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.953634:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cea9ecd/0x7b044d4128f9e08a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664884 expref: 67 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.953652:0:21629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cea9ecd/0x7b044d4128f9e08a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664884 expref: 67 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.953664:0:21629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382038200, rc 0) 00000100:00100000:2.0:1784938446.953720:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b35f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+67:10959:x1871643337528960:12345-192.168.202.54@tcp:101:cp.0 Request processed in 194us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938446.953727:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 896 00000100:00100000:1.0:1784938446.959492:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.959578:0:25726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337529088 00000100:00100000:2.0:1784938446.959590:0:25726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337529088 00000100:00100000:2.0:1784938446.959667:0:25726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 897 00000100:00100000:2.0:1784938446.959681:0:25726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f229500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7ea6e988-18ba-4c98-b179-17995571b98b+67:17112:x1871643337529088:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938446.959712:0:25726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938446.959742:0:25726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d60587d/0x7b044d4128f9e091 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x55:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766488b expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.959785:0:25726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cea9ecd/0x7b044d4128f9e08a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664884 expref: 68 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.959794:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x55:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.959798:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x55:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.959803:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d60587d/0x7b044d4128f9e091 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x55:0x0].0x0 rrc: 3 type: EXT [0->114687] (req 0->114687) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766488b expref: 68 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.959851:0:25726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000cea9ecd/0x7b044d4128f9e08a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664884 expref: 68 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.959876:0:25726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000cea9ecd/0x7b044d4128f9e08a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664884 expref: 68 pid: 21629 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938446.959892:0:25726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2482b28e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:25726:1871643350898048:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938446.960003:0:25726:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938446.963402:0:25726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2482b28e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:25726:1871643350898048:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938446.963439:0:25726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009d60587d/0x7b044d4128f9e091 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x55:0x0].0x0 rrc: 3 type: EXT [0->114687] (req 0->114687) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766488b expref: 68 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.963461:0:25726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382038600, rc 0) 00000100:00100000:2.0:1784938446.963525:0:25726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f229500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7ea6e988-18ba-4c98-b179-17995571b98b+68:17112:x1871643337529088:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3846us (4044us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938446.963533:0:25726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 897 00000100:00100000:1.0:1784938446.965230:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938446.965504:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337529216 00000100:00100000:2.0:1784938446.965513:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337529216 00010000:00010000:2.0:1784938446.965550:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000cea9ecd/0x7b044d4128f9e08a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664884 expref: 68 pid: 21629 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938446.965581:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 447 00000100:00100000:2.0:1784938446.965590:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+68:10960:x1871643337529216:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938446.965605:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938446.965627:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000cea9ecd/0x7b044d4128f9e08a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664884 expref: 68 pid: 21629 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.965640:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000cea9ecd/0x7b044d4128f9e08a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664884 expref: 68 pid: 21629 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.965663:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cea9ecd/0x7b044d4128f9e08a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664884 expref: 68 pid: 21629 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.965681:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x55:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.965686:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x55:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938446.965695:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d60587d/0x7b044d4128f9e091 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766488b expref: 67 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.965706:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d60587d/0x7b044d4128f9e091 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766488b expref: 67 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938446.965747:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009d60587d/0x7b044d4128f9e091 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766488b expref: 67 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938446.965762:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2482b28e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350898176:192.168.202.54@tcp:105: 00000100:00100000:2.0:1784938446.965844:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938446.969516:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2482b28e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350898176:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938446.969545:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938446.969614:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+67:10960:x1871643337529216:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 4024us (4392us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938446.969625:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 447 00000100:00100000:1.0:1784938446.974759:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.974837:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337529472 00000100:00100000:3.0:1784938446.974846:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337529472 00000100:00100000:3.0:1784938446.974901:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 141 00000100:00100000:3.0:1784938446.974909:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24857ffc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+168:17112:x1871643337529472:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938446.975221:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24857ffc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+169:17112:x1871643337529472:12345-192.168.202.54@tcp:35:cp.0 Request processed in 312us (470us total) trans 8589934766 rc 0/0 00000100:00100000:3.0:1784938446.975229:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 141 00000100:00100000:1.0:1784938446.980708:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.980839:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337529600 00000100:00100000:0.0:1784938446.980852:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337529600 00000100:00100000:0.0:1784938446.980944:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 619 00000100:00100000:0.0:1784938446.980955:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+169:17112:x1871643337529600:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938446.980994:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938446.981027:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e098 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664892 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.981098:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e09f lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.981114:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e09f lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.981290:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e09f lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.981318:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e0a6 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa4bfea24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.981327:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e0a6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.981338:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e0a6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.981384:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e09f lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.981392:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e09f lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.981686:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e09f lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.981695:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e09f lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.981702:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217c400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.981706:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e09f lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.981714:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e09f lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.981727:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.981730:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.981734:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e09f lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.981741:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e09f lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.981759:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e0a6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.981767:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e0a6 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.981773:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e0a6 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.981777:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217ce00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938446.981780:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e0a6 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.981785:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e0a6 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.981791:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xa4bfea24 (ffff9f248390aa00) 00010000:00010000:0.0:1784938446.981794:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.981796:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e0a6 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.981801:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e0a6 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.981836:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e098 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664892 expref: 170 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.981845:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938446.981847:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938446.981851:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e098 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664892 expref: 170 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.981877:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217c200, rc 0) 00000100:00100000:1.0:1784938446.982577:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+169:17112:x1871643337529600:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1619us (1878us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938446.982586:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 619 00000100:00100000:0.0:1784938446.985544:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.985649:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337529728 00000100:00100000:3.0:1784938446.985658:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337529728 00000100:00100000:3.0:1784938446.985717:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 620 00000100:00100000:3.0:1784938446.985727:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+169:17112:x1871643337529728:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938446.985748:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938446.985769:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9e0ad lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664899 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.985834:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65800/0x7b044d4128f9e0b4 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.985848:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65800/0x7b044d4128f9e0b4 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.985870:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65800/0x7b044d4128f9e0b4 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.985884:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f9e0bb lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa4bfea24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.985891:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f9e0bb lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.985897:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f9e0bb lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.985937:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65800/0x7b044d4128f9e0b4 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.985944:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65800/0x7b044d4128f9e0b4 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.985950:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65800/0x7b044d4128f9e0b4 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.985956:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65800/0x7b044d4128f9e0b4 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.985961:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dc65800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938446.985965:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65800/0x7b044d4128f9e0b4 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.985971:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65800/0x7b044d4128f9e0b4 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.985982:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938446.985985:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938446.986002:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65800/0x7b044d4128f9e0b4 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.986009:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65800/0x7b044d4128f9e0b4 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.986022:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f9e0bb lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.986028:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f9e0bb lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.986034:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f9e0bb lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.986038:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dc65e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938446.986041:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f9e0bb lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.986047:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f9e0bb lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.986054:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xa4bfea24 (ffff9f249863b000) 00010000:00010000:3.0:1784938446.986056:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938446.986058:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f9e0bb lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.986063:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65e00/0x7b044d4128f9e0bb lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.986095:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9e0ad lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664899 expref: 170 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.986104:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938446.986107:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938446.986110:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9e0ad lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664899 expref: 170 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.986119:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c7400, rc 0) 00000100:00100000:3.0:1784938446.986228:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+169:17112:x1871643337529728:12345-192.168.202.54@tcp:101:cp.0 Request processed in 501us (693us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938446.986238:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 620 00000100:00100000:2.0:1784938446.988999:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.989140:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337529984 00000100:00100000:3.0:1784938446.989172:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337529984 00000100:00100000:3.0:1784938446.989225:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 621 00000100:00100000:3.0:1784938446.989234:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+169:17112:x1871643337529984:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938446.989253:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938446.989273:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a800/0x7b044d4128f9e0c2 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476648a0 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.989379:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e0c9 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.989394:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e0c9 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.989405:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e0c9 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.989419:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e0d0 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0xa4bfea24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.989425:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e0d0 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.989433:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e0d0 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938446.989715:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x56:0x0], index 1: 0 00010000:00010000:3.0:1784938446.989834:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61bc00/0x7b044d4128f9e0d7 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.989844:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61bc00/0x7b044d4128f9e0d7 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.989851:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61bc00/0x7b044d4128f9e0d7 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.989891:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e0c9 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.989898:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e0c9 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.989905:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e0c9 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.989910:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61b000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938446.989914:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e0c9 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.989922:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e0c9 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.989932:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938446.989934:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938446.989939:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e0c9 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.989945:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e0c9 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938446.989958:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c1f14a67 reply state 00000000fe83aa08 transno 8589934767 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e0d0 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.989968:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e0d0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.989975:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xa4bfea24 (ffff9f249863b100) 00010000:00010000:3.0:1784938446.989977:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938446.989979:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938446.990427:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a800/0x7b044d4128f9e0c2 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648a0 expref: 172 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.990444:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61bc00/0x7b044d4128f9e0d7 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648a0 expref: 171 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.990451:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2a:0x0].0x0 (ffff9f249863b200) 00010000:00010000:3.0:1784938446.990453:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938446.990455:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61bc00, rc 0) 00000100:00100000:3.0:1784938446.990512:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+172:17112:x1871643337529984:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1278us (1529us total) trans 8589934767 rc 0/0 00000100:00100000:3.0:1784938446.990520:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 621 00000100:00100000:1.0:1784938446.993935:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938446.994031:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337530112 00000100:00100000:0.0:1784938446.994042:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337530112 00000100:00100000:0.0:1784938446.994104:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 898 00000100:00100000:0.0:1784938446.994114:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+69:10958:x1871643337530112:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938446.994142:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938446.994194:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ac78920/0x7b044d4128f9e0e5 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476648a7 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938446.994219:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x56:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938446.994240:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x56:0x0].0x0 since=713s v=(0 0) 00010000:00010000:0.0:1784938446.994243:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x56:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938446.994253:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ac78920/0x7b044d4128f9e0e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648a7 expref: 70 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.994269:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002ac78920/0x7b044d4128f9e0e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648a7 expref: 70 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938446.994282:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217ce00, rc 0) 00000100:00100000:0.0:1784938446.994344:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+70:10958:x1871643337530112:12345-192.168.202.54@tcp:101:cp.0 Request processed in 231us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938446.994351:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 898 00000100:00100000:0.0:1784938446.997671:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938446.997750:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337530240 00000100:00100000:3.0:1784938446.997760:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337530240 00000100:00100000:3.0:1784938446.997837:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 899 00000100:00100000:3.0:1784938446.997848:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+70:17112:x1871643337530240:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938446.997876:0:25722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938446.997895:0:25722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005777c505/0x7b044d4128f9e0ec lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x56:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476648ae expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.997927:0:25722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002ac78920/0x7b044d4128f9e0e5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648a7 expref: 71 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.997936:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x56:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938446.997940:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x56:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938446.997945:0:25722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005777c505/0x7b044d4128f9e0ec lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x56:0x0].0x0 rrc: 3 type: EXT [0->36863] (req 0->36863) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648ae expref: 71 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.997985:0:25722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002ac78920/0x7b044d4128f9e0e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e9476648a7 expref: 71 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938446.997999:0:25722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002ac78920/0x7b044d4128f9e0e5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476648a7 expref: 71 pid: 21151 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938446.998016:0:25722:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b35f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25722:1871643350898304:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938446.998124:0:25722:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485cc9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938447.002242:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.002331:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337530368 00000100:00100000:2.0:1784938447.002342:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337530368 00010000:00010000:2.0:1784938447.002400:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002ac78920/0x7b044d4128f9e0e5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476648a7 expref: 72 pid: 21151 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938447.002444:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 448 00000100:00100000:2.0:1784938447.002454:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+72:10958:x1871643337530368:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938447.002469:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938447.002491:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002ac78920/0x7b044d4128f9e0e5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476648a7 expref: 72 pid: 21151 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.002509:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002ac78920/0x7b044d4128f9e0e5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476648a7 expref: 72 pid: 21151 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.002535:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x56:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.002539:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x56:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.002547:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005777c505/0x7b044d4128f9e0ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648ae expref: 72 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.002557:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005777c505/0x7b044d4128f9e0ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648ae expref: 72 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.002596:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005777c505/0x7b044d4128f9e0ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648ae expref: 72 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938447.002613:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2482b2b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350898432:192.168.202.54@tcp:105: 00000100:00100000:2.0:1784938447.002698:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34f00 going to sleep for 11 seconds 00010000:00010000:3.0:1784938447.002959:0:25722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ac78920/0x7b044d4128f9e0e5 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476648a7 expref: 72 pid: 21151 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938447.002974:0:25722:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b35f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25722:1871643350898304:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938447.003000:0:25722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005777c505/0x7b044d4128f9e0ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476648ae expref: 71 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.003011:0:25722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61a800, rc 0) 00000100:00100000:3.0:1784938447.003042:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+71:17112:x1871643337530240:12345-192.168.202.54@tcp:101:cp.0 Request processed in 5197us (5381us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938447.003054:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 899 00000100:00080000:0.0:1784938447.003264:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784938447.007845:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.007935:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337530624 00000100:00100000:3.0:1784938447.007944:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337530624 00000100:00100000:3.0:1784938447.008009:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 142 00000100:00100000:3.0:1784938447.008020:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+172:17112:x1871643337530624:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938447.008376:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+173:17112:x1871643337530624:12345-192.168.202.54@tcp:35:cp.0 Request processed in 358us (543us total) trans 8589934768 rc 0/0 00000100:00100000:3.0:1784938447.008384:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 142 00000100:00100000:2.0:1784938447.009045:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2482b2b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350898432:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938447.009066:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938447.009104:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+70:10958:x1871643337530368:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 6652us (6873us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938447.009113:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 448 00000100:00100000:1.0:1784938447.012778:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.012896:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337530752 00000100:00100000:3.0:1784938447.012908:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337530752 00000100:00100000:3.0:1784938447.012971:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 622 00000100:00100000:3.0:1784938447.012980:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+173:17112:x1871643337530752:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938447.013012:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938447.013035:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e0f3 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476648b5 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.013110:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e0fa lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.013125:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e0fa lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.013135:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e0fa lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.013187:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9e101 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xc2bba7e5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.013199:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9e101 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.013205:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9e101 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.013243:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e0fa lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.013251:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e0fa lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.013257:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e0fa lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.013264:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e0fa lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.013270:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61b600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938447.013275:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e0fa lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.013283:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e0fa lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.013303:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938447.013306:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.013310:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e0fa lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.013317:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e0fa lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.013333:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9e101 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.013339:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9e101 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.013344:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9e101 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.013349:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61ba00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938447.013353:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9e101 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.013359:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9e101 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.013367:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xc2bba7e5 (ffff9f249863b000) 00010000:00010000:3.0:1784938447.013369:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.013372:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9e101 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.013377:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9e101 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.013415:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e0f3 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648b5 expref: 174 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.013425:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938447.013428:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.013432:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e0f3 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648b5 expref: 174 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.013441:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61b000, rc 0) 00000100:00100000:3.0:1784938447.013507:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+173:17112:x1871643337530752:12345-192.168.202.54@tcp:101:cp.0 Request processed in 528us (740us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938447.013515:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 622 00000100:00100000:0.0:1784938447.016448:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.017639:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337530880 00000100:00100000:2.0:1784938447.017651:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337530880 00000100:00100000:2.0:1784938447.017708:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 623 00000100:00100000:2.0:1784938447.017720:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+173:17112:x1871643337530880:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938447.017746:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938447.017774:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e108 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476648bc expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.017851:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e10f lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.017878:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e10f lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.017893:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e10f lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.017912:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9e116 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xc2bba7e5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.017918:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9e116 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.017925:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9e116 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.017976:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e10f lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.017983:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e10f lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.018101:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e10f lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.018114:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e10f lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.018121:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382038200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938447.018255:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e10f lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.018265:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e10f lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.018279:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938447.018282:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.018287:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e10f lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.018303:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e10f lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.018316:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9e116 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.018322:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9e116 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.018326:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9e116 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.018331:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823ff000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938447.018334:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9e116 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.018342:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9e116 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.018350:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xc2bba7e5 (ffff9f248fb6a600) 00010000:00010000:2.0:1784938447.018352:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.018355:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9e116 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.018361:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9e116 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.018397:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e108 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648bc expref: 174 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.018407:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938447.018409:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.018413:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e108 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648bc expref: 174 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.018421:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382039e00, rc 0) 00000100:00100000:2.0:1784938447.018702:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+173:17112:x1871643337530880:12345-192.168.202.54@tcp:101:cp.0 Request processed in 983us (2261us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938447.018710:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 623 00000100:00100000:1.0:1784938447.027247:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.027375:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337531136 00000100:00100000:3.0:1784938447.027387:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337531136 00000100:00100000:3.0:1784938447.027454:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 624 00000100:00100000:3.0:1784938447.027466:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+173:17112:x1871643337531136:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938447.027489:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938447.027516:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e11d lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476648c3 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.027664:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9e124 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.027678:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9e124 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.027688:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9e124 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.027702:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e12b lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0xc2bba7e5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.027709:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e12b lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.027715:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e12b lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938447.028042:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x56:0x0], index 0: 0 00010000:00010000:2.0:1784938447.029037:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9e132 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.029057:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9e132 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.029072:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9e132 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.029114:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9e124 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.029121:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9e124 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.029328:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9e124 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.029335:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9e124 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.029341:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61ba00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938447.029346:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9e124 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.029354:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9e124 lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.029367:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938447.029371:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.029377:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9e124 lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.029384:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9e124 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938447.029398:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001ca78333 reply state 00000000fc73f75e transno 8589934769 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e12b lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.029410:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e12b lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.029417:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xc2bba7e5 (ffff9f249863b000) 00010000:00010000:2.0:1784938447.029420:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938447.029422:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938447.029460:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e11d lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648c3 expref: 176 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.029475:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9e132 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648c3 expref: 175 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.029481:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2b:0x0].0x0 (ffff9f248fb6ae00) 00010000:00010000:2.0:1784938447.029483:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938447.029485:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d3d200, rc 0) 00000100:00100000:2.0:1784938447.029607:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+176:17112:x1871643337531136:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2143us (2369us total) trans 8589934769 rc 0/0 00000100:00100000:2.0:1784938447.029616:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 624 00000100:00100000:1.0:1784938447.033540:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.033634:0:25727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337531264 00000100:00100000:0.0:1784938447.033646:0:25727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337531264 00000100:00100000:0.0:1784938447.033788:0:25727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 900 00000100:00100000:0.0:1784938447.033800:0:25727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7ea6e988-18ba-4c98-b179-17995571b98b+67:10960:x1871643337531264:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938447.033823:0:25727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938447.033848:0:25727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3d5cba0/0x7b044d4128f9e140 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476648ca expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938447.033889:0:25727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x56:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938447.033912:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x56:0x0].0x0 since=713s v=(0 0) 00010000:00010000:0.0:1784938447.033916:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x56:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938447.033926:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3d5cba0/0x7b044d4128f9e140 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648ca expref: 68 pid: 25727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.033944:0:25727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e3d5cba0/0x7b044d4128f9e140 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648ca expref: 68 pid: 25727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.033957:0:25727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217d800, rc 0) 00000100:00080000:2.0:1784938447.034064:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938447.034250:0:25727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7ea6e988-18ba-4c98-b179-17995571b98b+68:10960:x1871643337531264:12345-192.168.202.54@tcp:101:cp.0 Request processed in 451us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938447.034258:0:25727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 900 00000100:00100000:3.0:1784938447.036874:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938447.037557:0:25730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337531392 00000100:00100000:1.0:1784938447.037573:0:25730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337531392 00000100:00100000:1.0:1784938447.037650:0:25730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 901 00000100:00100000:1.0:1784938447.037659:0:25730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b35f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:7ea6e988-18ba-4c98-b179-17995571b98b+68:17112:x1871643337531392:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938447.037679:0:25730:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938447.037701:0:25730:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de3acb31/0x7b044d4128f9e147 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x56:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476648d1 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.037737:0:25730:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e3d5cba0/0x7b044d4128f9e140 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648ca expref: 69 pid: 25727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.037747:0:25730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x56:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938447.037752:0:25730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x56:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938447.037757:0:25730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de3acb31/0x7b044d4128f9e147 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x56:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648d1 expref: 69 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.037793:0:25730:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e3d5cba0/0x7b044d4128f9e140 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e9476648ca expref: 69 pid: 25727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.037808:0:25730:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e3d5cba0/0x7b044d4128f9e140 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476648ca expref: 69 pid: 25727 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938447.037823:0:25730:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b3f3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:25730:1871643350898560:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938447.037927:0:25730:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbea80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938447.040419:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.040619:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337531520 00000100:00100000:0.0:1784938447.040628:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337531520 00010000:00010000:0.0:1784938447.040670:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e3d5cba0/0x7b044d4128f9e140 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476648ca expref: 70 pid: 25727 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938447.040721:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 449 00000100:00100000:0.0:1784938447.040730:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b35f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+70:10959:x1871643337531520:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938447.040744:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938447.040767:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e3d5cba0/0x7b044d4128f9e140 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476648ca expref: 70 pid: 25727 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.040782:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e3d5cba0/0x7b044d4128f9e140 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476648ca expref: 70 pid: 25727 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.040808:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x56:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938447.040813:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x56:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938447.040823:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000de3acb31/0x7b044d4128f9e147 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648d1 expref: 70 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.040833:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de3acb31/0x7b044d4128f9e147 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648d1 expref: 70 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.040886:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000de3acb31/0x7b044d4128f9e147 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648d1 expref: 70 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938447.040901:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350898688:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938447.040972:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248529f840 going to sleep for 11 seconds 00000100:00100000:0.0:1784938447.043180:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350898688:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938447.043209:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938447.043261:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b35f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+70:10959:x1871643337531520:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 2532us (2852us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938447.043273:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 449 00010000:00010000:1.0:1784938447.043557:0:25730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3d5cba0/0x7b044d4128f9e140 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476648ca expref: 69 pid: 25727 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938447.043578:0:25730:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b3f3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:25730:1871643350898560:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938447.043598:0:25730:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000de3acb31/0x7b044d4128f9e147 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476648d1 expref: 68 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.043612:0:25730:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238db39a00, rc 0) 00000100:00100000:1.0:1784938447.043652:0:25730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b35f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:7ea6e988-18ba-4c98-b179-17995571b98b+68:17112:x1871643337531392:12345-192.168.202.54@tcp:101:cp.0 Request processed in 5994us (6799us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938447.043660:0:25730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 901 00000100:00100000:3.0:1784938447.046457:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938447.046530:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337531776 00000100:00100000:1.0:1784938447.046539:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337531776 00000100:00100000:1.0:1784938447.046597:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 143 00000100:00100000:1.0:1784938447.046608:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b35f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+176:17112:x1871643337531776:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:1.0:1784938447.046921:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b35f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+177:17112:x1871643337531776:12345-192.168.202.54@tcp:35:cp.0 Request processed in 313us (470us total) trans 8589934770 rc 0/0 00000100:00100000:1.0:1784938447.046929:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 143 00000100:00100000:3.0:1784938447.050602:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.050684:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337531904 00000100:00100000:2.0:1784938447.050693:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337531904 00000100:00100000:2.0:1784938447.050749:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 625 00000100:00100000:2.0:1784938447.050759:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b35f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+177:17112:x1871643337531904:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938447.050782:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938447.050802:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9e14e lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476648d8 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.050884:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e155 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.050899:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e155 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.050911:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e155 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.050927:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e15c lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x2fbacb41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.050933:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e15c lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.050940:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e15c lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.050981:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e155 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.050988:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e155 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.050995:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e155 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.051001:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e155 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.051007:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382039e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938447.051012:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e155 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.051019:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e155 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.051032:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938447.051035:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.051040:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e155 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.051046:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e155 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.051059:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e15c lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.051064:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e15c lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.051070:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e15c lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.051074:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382038200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938447.051077:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e15c lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.051083:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e15c lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.051090:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x2fbacb41 (ffff9f248fb6a600) 00010000:00010000:2.0:1784938447.051092:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.051096:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e15c lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.051101:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e15c lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.051180:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9e14e lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648d8 expref: 178 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.051191:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938447.051194:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.051197:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9e14e lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648d8 expref: 178 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.051207:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823ff000, rc 0) 00000100:00100000:2.0:1784938447.051263:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b35f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+177:17112:x1871643337531904:12345-192.168.202.54@tcp:101:cp.0 Request processed in 504us (674us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938447.051270:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 625 00000100:00100000:0.0:1784938447.055794:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.055885:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337532032 00000100:00100000:2.0:1784938447.055895:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337532032 00000100:00100000:2.0:1784938447.055958:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 626 00000100:00100000:2.0:1784938447.055968:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+177:17112:x1871643337532032:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938447.056123:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938447.056219:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e163 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476648df expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.056326:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e16a lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.056346:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e16a lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.056359:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e16a lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.056378:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00200/0x7b044d4128f9e171 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x2fbacb41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.056384:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00200/0x7b044d4128f9e171 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.056392:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00200/0x7b044d4128f9e171 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.056436:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e16a lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.056444:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e16a lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.056452:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e16a lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.056458:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382039e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938447.056463:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e16a lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.056471:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e16a lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.056483:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938447.056487:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.056492:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e16a lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.056499:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e16a lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.056516:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00200/0x7b044d4128f9e171 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.056521:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00200/0x7b044d4128f9e171 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.056527:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00200/0x7b044d4128f9e171 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.056533:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d00200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938447.056535:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00200/0x7b044d4128f9e171 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.056541:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00200/0x7b044d4128f9e171 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.056548:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x2fbacb41 (ffff9f248fb6a600) 00010000:00010000:2.0:1784938447.056551:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.056553:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00200/0x7b044d4128f9e171 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.056558:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00200/0x7b044d4128f9e171 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.056603:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e163 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648df expref: 178 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.056614:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938447.056616:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.056619:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e163 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648df expref: 178 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.056628:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382038200, rc 0) 00000100:00100000:2.0:1784938447.056746:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+177:17112:x1871643337532032:12345-192.168.202.54@tcp:101:cp.0 Request processed in 779us (959us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938447.056754:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 626 00000100:00100000:3.0:1784938447.059593:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.059649:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337532288 00000100:00100000:2.0:1784938447.059657:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337532288 00000100:00100000:2.0:1784938447.059714:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 627 00000100:00100000:2.0:1784938447.059724:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b35f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+177:17112:x1871643337532288:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938447.059742:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938447.059762:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01600/0x7b044d4128f9e178 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476648e6 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.059878:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e17f lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.059893:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e17f lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.059903:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e17f lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.059919:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01e00/0x7b044d4128f9e186 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x2fbacb41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.059927:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01e00/0x7b044d4128f9e186 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.059933:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01e00/0x7b044d4128f9e186 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938447.060272:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x57:0x0], index 1: 0 00010000:00010000:2.0:1784938447.060423:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01a00/0x7b044d4128f9e18d lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.060432:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01a00/0x7b044d4128f9e18d lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.060440:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01a00/0x7b044d4128f9e18d lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.060473:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e17f lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.060480:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e17f lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.060485:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e17f lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.060491:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e17f lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.060497:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d01c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938447.060501:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e17f lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.060512:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e17f lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.060523:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938447.060526:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.060531:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e17f lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.060536:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e17f lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938447.060552:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f4e034bc reply state 000000006e0c0b05 transno 8589934771 ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01e00/0x7b044d4128f9e186 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.060562:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01e00/0x7b044d4128f9e186 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.060567:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x2fbacb41 (ffff9f248fb6a700) 00010000:00010000:2.0:1784938447.060569:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938447.060572:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938447.060600:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01600/0x7b044d4128f9e178 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648e6 expref: 180 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.060615:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01a00/0x7b044d4128f9e18d lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648e6 expref: 179 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.060621:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2c:0x0].0x0 (ffff9f248fb6af00) 00010000:00010000:2.0:1784938447.060624:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938447.060626:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d01a00, rc 0) 00000100:00100000:2.0:1784938447.061175:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b35f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+180:17112:x1871643337532288:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1451us (1589us total) trans 8589934771 rc 0/0 00000100:00100000:2.0:1784938447.061184:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 627 00000100:00100000:3.0:1784938447.064531:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.064705:0:25729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337532416 00000100:00100000:2.0:1784938447.064716:0:25729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337532416 00000100:00100000:2.0:1784938447.064809:0:25729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 902 00000100:00100000:2.0:1784938447.064819:0:25729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b35f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7ea6e988-18ba-4c98-b179-17995571b98b+70:10957:x1871643337532416:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938447.064837:0:25729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938447.064870:0:25729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000dda476a/0x7b044d4128f9e19b lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476648ed expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938447.064894:0:25729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x57:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938447.064917:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x57:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1784938447.064921:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x57:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.064930:0:25729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000dda476a/0x7b044d4128f9e19b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648ed expref: 71 pid: 25729 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.064945:0:25729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000dda476a/0x7b044d4128f9e19b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648ed expref: 71 pid: 25729 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.064959:0:25729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d00000, rc 0) 00000100:00100000:2.0:1784938447.065027:0:25729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b35f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7ea6e988-18ba-4c98-b179-17995571b98b+71:10957:x1871643337532416:12345-192.168.202.54@tcp:101:cp.0 Request processed in 210us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938447.065035:0:25729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 902 00000100:00100000:1.0:1784938447.068655:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.068741:0:25725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337532544 00000100:00100000:3.0:1784938447.068753:0:25725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337532544 00000100:00100000:3.0:1784938447.068810:0:25725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 903 00000100:00100000:3.0:1784938447.068820:0:25725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7ea6e988-18ba-4c98-b179-17995571b98b+71:17112:x1871643337532544:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938447.068841:0:25725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938447.068872:0:25725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a481461f/0x7b044d4128f9e1a2 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x57:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476648f4 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.068908:0:25725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000dda476a/0x7b044d4128f9e19b lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648ed expref: 72 pid: 25729 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.068916:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x57:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938447.068920:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x57:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938447.068924:0:25725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a481461f/0x7b044d4128f9e1a2 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x57:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648f4 expref: 72 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.068960:0:25725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000dda476a/0x7b044d4128f9e19b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e9476648ed expref: 72 pid: 25729 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.068980:0:25725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000dda476a/0x7b044d4128f9e19b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476648ed expref: 72 pid: 25729 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938447.069005:0:25725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b35f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:25725:1871643350898816:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938447.069107:0:25725:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485cc9300 going to sleep for 11 seconds 00000100:00100000:3.0:1784938447.072417:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938447.072529:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337532672 00000100:00100000:1.0:1784938447.072538:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337532672 00010000:00010000:1.0:1784938447.072577:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000dda476a/0x7b044d4128f9e19b lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476648ed expref: 73 pid: 25729 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938447.072618:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 450 00000100:00100000:1.0:1784938447.072628:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b35f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+73:10958:x1871643337532672:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938447.072644:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938447.072669:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000dda476a/0x7b044d4128f9e19b lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476648ed expref: 73 pid: 25729 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.072683:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000dda476a/0x7b044d4128f9e19b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476648ed expref: 73 pid: 25729 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.072709:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x57:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938447.072714:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x57:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938447.072722:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a481461f/0x7b044d4128f9e1a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648f4 expref: 73 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.072732:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a481461f/0x7b044d4128f9e1a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648f4 expref: 73 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.072767:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a481461f/0x7b044d4128f9e1a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648f4 expref: 73 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938447.072786:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b3f3d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:19219:1871643350898944:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938447.072876:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbee40 going to sleep for 11 seconds 00010000:00010000:2.0:1784938447.073413:0:25725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000dda476a/0x7b044d4128f9e19b lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476648ed expref: 73 pid: 25729 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938447.073436:0:25725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b35f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:25725:1871643350898816:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938447.073460:0:25725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a481461f/0x7b044d4128f9e1a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476648f4 expref: 72 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.073471:0:25725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61b800, rc 0) 00000100:00100000:2.0:1784938447.073518:0:25725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7ea6e988-18ba-4c98-b179-17995571b98b+72:17112:x1871643337532544:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4699us (4873us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938447.073526:0:25725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 903 00000100:00100000:1.0:1784938447.076035:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b3f3d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:19219:1871643350898944:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938447.076067:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938447.076127:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b35f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+71:10958:x1871643337532672:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3500us (3718us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938447.076137:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 450 00000100:00100000:1.0:1784938447.079119:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.079252:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337532928 00000100:00100000:0.0:1784938447.079264:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337532928 00000100:00100000:0.0:1784938447.079338:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 144 00000100:00100000:0.0:1784938447.079349:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+180:17112:x1871643337532928:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:0.0:1784938447.079675:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+181:17112:x1871643337532928:12345-192.168.202.54@tcp:35:cp.0 Request processed in 328us (565us total) trans 8589934772 rc 0/0 00000100:00100000:0.0:1784938447.079683:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 144 00000100:00100000:2.0:1784938447.083838:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.084005:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337533056 00000100:00100000:0.0:1784938447.084016:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337533056 00000100:00100000:0.0:1784938447.084084:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 628 00000100:00100000:0.0:1784938447.084096:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+181:17112:x1871643337533056:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938447.084134:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938447.084200:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e1a9 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476648fb expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.084264:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e1b0 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.084278:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e1b0 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.084291:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e1b0 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.084318:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e1b7 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xff118af2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.084326:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e1b7 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.084332:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e1b7 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.084375:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e1b0 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.084382:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e1b0 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.084388:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e1b0 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.084395:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e1b0 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.084401:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217ce00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.084405:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e1b0 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.084413:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e1b0 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.084425:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938447.084428:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.084433:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e1b0 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.084440:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e1b0 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.084455:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e1b7 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.084461:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e1b7 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.084467:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e1b7 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.084471:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217c400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.084474:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e1b7 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.084479:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e1b7 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.084485:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xff118af2 (ffff9f238d49e500) 00010000:00010000:0.0:1784938447.084487:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.084490:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e1b7 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.084495:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e1b7 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.084526:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e1a9 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648fb expref: 182 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.084541:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938447.084543:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.084546:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e1a9 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648fb expref: 182 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.084555:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217d000, rc 0) 00000100:00100000:0.0:1784938447.084609:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+181:17112:x1871643337533056:12345-192.168.202.54@tcp:101:cp.0 Request processed in 516us (780us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938447.084617:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 628 00000100:00100000:3.0:1784938447.087493:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.087569:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337533184 00000100:00100000:0.0:1784938447.087579:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337533184 00000100:00100000:0.0:1784938447.087636:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 629 00000100:00100000:0.0:1784938447.087645:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b35f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+181:17112:x1871643337533184:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938447.087664:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938447.087684:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e1be lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664902 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.087767:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e1c5 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.087781:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e1c5 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.087791:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e1c5 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.087806:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9e1cc lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xff118af2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.087812:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9e1cc lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.087818:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9e1cc lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.087853:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e1c5 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.087859:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e1c5 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.087877:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e1c5 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.087883:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217d800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.087887:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e1c5 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.087894:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e1c5 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.087905:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938447.087908:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.087912:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e1c5 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.087918:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e1c5 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.087931:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9e1cc lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.087937:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9e1cc lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.087942:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9e1cc lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.087946:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217c800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.087949:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9e1cc lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.087954:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9e1cc lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.087960:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xff118af2 (ffff9f238d49e800) 00010000:00010000:0.0:1784938447.087962:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.087965:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9e1cc lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.087970:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9e1cc lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.088011:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e1be lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664902 expref: 182 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.088022:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938447.088024:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.088027:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e1be lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664902 expref: 182 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.088041:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217c200, rc 0) 00000100:00100000:0.0:1784938447.088103:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b35f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+181:17112:x1871643337533184:12345-192.168.202.54@tcp:101:cp.0 Request processed in 459us (624us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938447.088111:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 629 00000100:00100000:1.0:1784938447.091403:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.091483:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337533440 00000100:00100000:0.0:1784938447.091493:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337533440 00000100:00100000:0.0:1784938447.091560:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 630 00000100:00100000:0.0:1784938447.091571:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+181:17112:x1871643337533440:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938447.091591:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938447.091611:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e1d3 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664909 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.091718:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e1da lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.091732:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e1da lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.091743:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e1da lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.091759:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e1e1 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0xff118af2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.091765:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e1e1 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.091772:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e1e1 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938447.092088:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x57:0x0], index 0: 0 00010000:00010000:0.0:1784938447.092252:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b28600/0x7b044d4128f9e1e8 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.092261:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b28600/0x7b044d4128f9e1e8 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.092268:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b28600/0x7b044d4128f9e1e8 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.092312:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e1da lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.092319:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e1da lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.092325:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e1da lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.092331:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e1da lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.092336:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217c400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.092340:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e1da lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.092347:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e1da lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.092358:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938447.092361:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.092366:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e1da lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.092373:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e1da lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938447.092386:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eb83436e reply state 000000007d79065a transno 8589934773 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e1e1 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.092396:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e1e1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.092402:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xff118af2 (ffff9f238d49e500) 00010000:00010000:0.0:1784938447.092405:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938447.092407:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938447.092431:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e1d3 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664909 expref: 184 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.092446:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b28600/0x7b044d4128f9e1e8 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664909 expref: 183 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.092453:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2d:0x0].0x0 (ffff9f238727cb00) 00010000:00010000:0.0:1784938447.092455:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938447.092457:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24c5b28600, rc 0) 00000100:00100000:0.0:1784938447.092584:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+184:17112:x1871643337533440:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1014us (1191us total) trans 8589934773 rc 0/0 00000100:00100000:0.0:1784938447.092591:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 630 00000100:00100000:1.0:1784938447.097532:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.097870:0:25718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337533568 00000100:00100000:3.0:1784938447.097883:0:25718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337533568 00000100:00100000:3.0:1784938447.097955:0:25718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 904 00000100:00100000:3.0:1784938447.097965:0:25718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ea6e988-18ba-4c98-b179-17995571b98b+68:10959:x1871643337533568:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938447.097986:0:25718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938447.098283:0:25718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea074bdc/0x7b044d4128f9e1f6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664910 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938447.098319:0:25718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x57:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938447.098339:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x57:0x0].0x0 since=713s v=(0 0) 00010000:00010000:3.0:1784938447.098343:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x57:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938447.098352:0:25718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea074bdc/0x7b044d4128f9e1f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664910 expref: 69 pid: 25718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.098368:0:25718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ea074bdc/0x7b044d4128f9e1f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664910 expref: 69 pid: 25718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.098386:0:25718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61ae00, rc 0) 00000100:00100000:3.0:1784938447.098440:0:25718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ea6e988-18ba-4c98-b179-17995571b98b+69:10959:x1871643337533568:12345-192.168.202.54@tcp:101:cp.0 Request processed in 477us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938447.098447:0:25718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 904 00000100:00100000:3.0:1784938447.101550:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938447.102126:0:25723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337533696 00000100:00100000:1.0:1784938447.102137:0:25723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337533696 00000100:00100000:1.0:1784938447.102229:0:25723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 905 00000100:00100000:1.0:1784938447.102239:0:25723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b35f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7ea6e988-18ba-4c98-b179-17995571b98b+69:17112:x1871643337533696:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938447.102256:0:25723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938447.102273:0:25723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007634da25/0x7b044d4128f9e1fd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x57:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664917 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.102315:0:25723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea074bdc/0x7b044d4128f9e1f6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664910 expref: 70 pid: 25718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.102324:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x57:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938447.102329:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x57:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938447.102333:0:25723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007634da25/0x7b044d4128f9e1fd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x57:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664917 expref: 70 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.102370:0:25723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ea074bdc/0x7b044d4128f9e1f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664910 expref: 70 pid: 25718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.102385:0:25723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ea074bdc/0x7b044d4128f9e1f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664910 expref: 70 pid: 25718 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938447.102400:0:25723:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387dac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:25723:1871643350899072:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938447.102477:0:25723:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbee40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938447.105628:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.105707:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337533824 00000100:00100000:2.0:1784938447.105718:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337533824 00010000:00010000:2.0:1784938447.105756:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ea074bdc/0x7b044d4128f9e1f6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664910 expref: 71 pid: 25718 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938447.105801:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 451 00000100:00100000:2.0:1784938447.105811:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24a6e63c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+71:10960:x1871643337533824:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938447.105828:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938447.105866:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ea074bdc/0x7b044d4128f9e1f6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664910 expref: 71 pid: 25718 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.105882:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ea074bdc/0x7b044d4128f9e1f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664910 expref: 71 pid: 25718 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.105912:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x57:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.105917:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x57:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.105925:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007634da25/0x7b044d4128f9e1fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664917 expref: 71 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.105936:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007634da25/0x7b044d4128f9e1fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664917 expref: 71 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.105979:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007634da25/0x7b044d4128f9e1fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664917 expref: 71 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938447.106004:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2482b29180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:19221:1871643350899200:192.168.202.54@tcp:105: 00000100:00100000:2.0:1784938447.106087:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb343c0 going to sleep for 11 seconds 00010000:00010000:3.0:1784938447.106890:0:25723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea074bdc/0x7b044d4128f9e1f6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664910 expref: 71 pid: 25718 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938447.106909:0:25723:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387dac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:25723:1871643350899072:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938447.106935:0:25723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007634da25/0x7b044d4128f9e1fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664917 expref: 70 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.106946:0:25723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238db38a00, rc 0) 00000100:00100000:3.0:1784938447.107528:0:25723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b35f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7ea6e988-18ba-4c98-b179-17995571b98b+70:17112:x1871643337533696:12345-192.168.202.54@tcp:101:cp.0 Request processed in 5287us (5983us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938447.107539:0:25723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 905 00000100:00100000:2.0:1784938447.114702:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2482b29180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:19221:1871643350899200:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938447.114735:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938447.114805:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24a6e63c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+69:10960:x1871643337533824:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 8994us (9189us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938447.114818:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 451 00000100:00100000:1.0:1784938447.123441:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.123530:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337534080 00000100:00100000:3.0:1784938447.123541:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337534080 00000100:00100000:3.0:1784938447.123607:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 145 00000100:00100000:3.0:1784938447.123617:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+184:17112:x1871643337534080:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938447.123930:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+185:17112:x1871643337534080:12345-192.168.202.54@tcp:35:cp.0 Request processed in 314us (497us total) trans 8589934774 rc 0/0 00000100:00100000:3.0:1784938447.123938:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 145 00000100:00100000:1.0:1784938447.127091:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.127212:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337534208 00000100:00100000:0.0:1784938447.127221:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337534208 00000100:00100000:0.0:1784938447.127280:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 631 00000100:00100000:0.0:1784938447.127290:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+185:17112:x1871643337534208:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938447.127341:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938447.127367:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9e204 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766491e expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.127431:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e20b lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.127445:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e20b lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.127456:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e20b lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.127471:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e212 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xb2d5a33e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.127478:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e212 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.127484:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e212 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.127522:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e20b lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.127530:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e20b lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.127537:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e20b lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.127543:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217d000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.127547:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e20b lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.127555:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e20b lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.127566:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938447.127570:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.127574:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e20b lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.127581:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e20b lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.127594:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e212 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.127600:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e212 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.127605:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e212 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.127610:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217c400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.127613:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e212 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.127619:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e212 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.127627:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xb2d5a33e (ffff9f238727c300) 00010000:00010000:0.0:1784938447.127629:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.127632:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e212 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.127638:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e212 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.127671:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9e204 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766491e expref: 186 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.127681:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938447.127683:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.127686:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9e204 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766491e expref: 186 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.127698:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24c5b29c00, rc 0) 00000100:00100000:0.0:1784938447.127756:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+185:17112:x1871643337534208:12345-192.168.202.54@tcp:101:cp.0 Request processed in 466us (679us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938447.127763:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 631 00000100:00100000:1.0:1784938447.130435:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.130514:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337534336 00000100:00100000:0.0:1784938447.130524:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337534336 00000100:00100000:0.0:1784938447.130588:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 632 00000100:00100000:0.0:1784938447.130597:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+185:17112:x1871643337534336:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938447.130619:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938447.130639:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e219 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664925 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.130701:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9e220 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.130720:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9e220 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.130730:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9e220 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.130746:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e227 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xb2d5a33e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.130753:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e227 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.130759:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e227 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.130797:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9e220 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.130803:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9e220 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.130808:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9e220 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.130814:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9e220 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.130820:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217c800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.130824:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9e220 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.130831:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9e220 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.130843:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938447.130846:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.130850:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9e220 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.130868:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9e220 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.130884:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e227 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.130890:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e227 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.130895:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e227 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.130900:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217d800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.130903:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e227 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.130908:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e227 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.130915:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xb2d5a33e (ffff9f238727c500) 00010000:00010000:0.0:1784938447.130917:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.130919:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e227 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.130924:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e227 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.130959:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e219 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664925 expref: 186 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.130969:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938447.130972:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.130975:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e219 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664925 expref: 186 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.130983:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217c200, rc 0) 00000100:00100000:0.0:1784938447.131266:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+185:17112:x1871643337534336:12345-192.168.202.54@tcp:101:cp.0 Request processed in 669us (840us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938447.131273:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 632 00000100:00100000:1.0:1784938447.134379:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.134458:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337534592 00000100:00100000:0.0:1784938447.134468:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337534592 00000100:00100000:0.0:1784938447.134524:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 633 00000100:00100000:0.0:1784938447.134534:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+185:17112:x1871643337534592:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938447.134555:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938447.134575:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e22e lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766492c expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.134677:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e235 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.134691:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e235 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.134702:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e235 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.134716:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9e23c lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0xb2d5a33e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.134723:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9e23c lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.134728:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9e23c lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938447.135061:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x58:0x0], index 1: 0 00010000:00010000:0.0:1784938447.135563:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9e243 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.135574:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9e243 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.135583:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9e243 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.135615:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e235 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.135622:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e235 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.135629:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e235 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.135635:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217d000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.135639:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e235 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.135651:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e235 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.135663:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938447.135666:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.135670:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e235 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.135677:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e235 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938447.135690:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008b48a59b reply state 000000009a2254e9 transno 8589934775 ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9e23c lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.135700:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9e23c lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.135706:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xb2d5a33e (ffff9f238727c300) 00010000:00010000:0.0:1784938447.135708:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938447.135710:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938447.135740:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e22e lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766492c expref: 188 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.135755:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9e243 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766492c expref: 187 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.135762:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9f238727c100) 00010000:00010000:0.0:1784938447.135764:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938447.135766:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24dc00, rc 0) 00000100:00100000:0.0:1784938447.135887:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+188:17112:x1871643337534592:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1354us (1517us total) trans 8589934775 rc 0/0 00000100:00100000:0.0:1784938447.135895:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 633 00000100:00100000:1.0:1784938447.139966:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.140117:0:25724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337534720 00000100:00100000:0.0:1784938447.140399:0:25724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337534720 00000100:00100000:0.0:1784938447.140511:0:25724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 906 00000100:00100000:0.0:1784938447.140522:0:25724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7ea6e988-18ba-4c98-b179-17995571b98b+71:10957:x1871643337534720:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938447.140543:0:25724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938447.140570:0:25724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d89d376/0x7b044d4128f9e251 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664933 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938447.140598:0:25724:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x58:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938447.140623:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x58:0x0].0x0 since=713s v=(0 0) 00010000:00010000:0.0:1784938447.140628:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x58:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938447.140637:0:25724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d89d376/0x7b044d4128f9e251 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664933 expref: 72 pid: 25724 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.140653:0:25724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004d89d376/0x7b044d4128f9e251 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664933 expref: 72 pid: 25724 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.140668:0:25724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24d400, rc 0) 00000100:00100000:0.0:1784938447.140768:0:25724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7ea6e988-18ba-4c98-b179-17995571b98b+72:10957:x1871643337534720:12345-192.168.202.54@tcp:101:cp.0 Request processed in 247us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938447.140775:0:25724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 906 00000100:00100000:1.0:1784938447.143714:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.143791:0:25726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337534848 00000100:00100000:0.0:1784938447.143801:0:25726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337534848 00000100:00100000:0.0:1784938447.143876:0:25726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 907 00000100:00100000:0.0:1784938447.143889:0:25726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7ea6e988-18ba-4c98-b179-17995571b98b+72:17112:x1871643337534848:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938447.143916:0:25726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938447.143937:0:25726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4d7eeea/0x7b044d4128f9e258 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x58:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766493a expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.143970:0:25726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004d89d376/0x7b044d4128f9e251 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664933 expref: 73 pid: 25724 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.143979:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x58:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938447.143984:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x58:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938447.143998:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4d7eeea/0x7b044d4128f9e258 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x58:0x0].0x0 rrc: 3 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766493a expref: 73 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.144035:0:25726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004d89d376/0x7b044d4128f9e251 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664933 expref: 73 pid: 25724 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.144051:0:25726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004d89d376/0x7b044d4128f9e251 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664933 expref: 73 pid: 25724 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938447.144066:0:25726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:25726:1871643350899328:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938447.144603:0:25726:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24867ea240 going to sleep for 11 seconds 00000100:00100000:1.0:1784938447.147721:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.147825:0:25726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:25726:1871643350899328:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938447.147877:0:25726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d4d7eeea/0x7b044d4128f9e258 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x58:0x0].0x0 rrc: 3 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766493a expref: 73 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.147904:0:25726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24ca00, rc 0) 00000100:00100000:0.0:1784938447.147964:0:25726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7ea6e988-18ba-4c98-b179-17995571b98b+73:17112:x1871643337534848:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4079us (4260us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938447.147972:0:25726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 907 00000100:00100000:3.0:1784938447.148348:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337534976 00000100:00100000:3.0:1784938447.148356:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337534976 00010000:00010000:3.0:1784938447.148387:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004d89d376/0x7b044d4128f9e251 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664933 expref: 73 pid: 25724 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938447.148414:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 452 00000100:00100000:3.0:1784938447.148423:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+73:10958:x1871643337534976:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938447.148436:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938447.148457:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004d89d376/0x7b044d4128f9e251 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664933 expref: 73 pid: 25724 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.148469:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004d89d376/0x7b044d4128f9e251 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664933 expref: 73 pid: 25724 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.148491:0:22955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d89d376/0x7b044d4128f9e251 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664933 expref: 73 pid: 25724 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.148505:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x58:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938447.148509:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x58:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938447.148517:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4d7eeea/0x7b044d4128f9e258 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766493a expref: 72 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.148528:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4d7eeea/0x7b044d4128f9e258 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766493a expref: 72 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.148560:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d4d7eeea/0x7b044d4128f9e258 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766493a expref: 72 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938447.148575:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b35f1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22955:1871643350899456:192.168.202.54@tcp:105: 00000100:00100000:3.0:1784938447.148632:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485cc9900 going to sleep for 11 seconds 00000100:00100000:3.0:1784938447.152087:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b35f1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22955:1871643350899456:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938447.152113:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938447.152193:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+72:10958:x1871643337534976:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3769us (4484us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938447.152204:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 452 00000100:00100000:2.0:1784938447.155773:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938447.155886:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337535232 00000100:00100000:1.0:1784938447.155898:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337535232 00000100:00100000:1.0:1784938447.155958:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 146 00000100:00100000:1.0:1784938447.155969:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+188:17112:x1871643337535232:12345-192.168.202.54@tcp:35:cp.0 00000001:00080000:1.0:1784938447.156399:0:24205:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934776 00000100:00100000:1.0:1784938447.156550:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+190:17112:x1871643337535232:12345-192.168.202.54@tcp:35:cp.0 Request processed in 582us (787us total) trans 8589934777 rc 0/0 00000100:00100000:1.0:1784938447.156559:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 146 00000020:00080000:1.0:1784938447.156565:0:24205:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1784938447.161091:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.161257:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337535360 00000100:00100000:0.0:1784938447.161266:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337535360 00000100:00100000:0.0:1784938447.161333:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 634 00000100:00100000:0.0:1784938447.161343:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+190:17112:x1871643337535360:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938447.161368:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938447.161391:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e25f lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664941 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.161457:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e266 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.161471:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e266 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.161481:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e266 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.161496:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e26d lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x4958ff4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.161504:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e26d lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.161510:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e26d lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.161549:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e266 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.161557:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e266 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.161562:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e266 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.161568:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217c200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.161573:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e266 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.161580:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e266 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.161591:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938447.161595:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.161599:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e266 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.161605:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e266 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.161619:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e26d lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.161624:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e26d lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.161630:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e26d lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.161635:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217d800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.161638:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e26d lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.161644:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e26d lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.161651:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x4958ff4 (ffff9f238727c500) 00010000:00010000:0.0:1784938447.161654:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.161656:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e26d lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.161662:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e26d lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.161695:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e25f lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664941 expref: 191 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.161705:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938447.161707:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.161711:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e25f lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664941 expref: 191 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.161721:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217d000, rc 0) 00000100:00100000:0.0:1784938447.161785:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+190:17112:x1871643337535360:12345-192.168.202.54@tcp:101:cp.0 Request processed in 443us (704us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938447.161792:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 634 00000100:00100000:0.0:1784938447.165066:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.165183:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337535488 00000100:00100000:2.0:1784938447.165193:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337535488 00000100:00100000:2.0:1784938447.165251:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 635 00000100:00100000:2.0:1784938447.165260:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+190:17112:x1871643337535488:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938447.165282:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938447.165314:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e274 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664948 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.165379:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00200/0x7b044d4128f9e27b lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.165394:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00200/0x7b044d4128f9e27b lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.165404:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00200/0x7b044d4128f9e27b lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.165421:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01800/0x7b044d4128f9e282 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x4958ff4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.165429:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01800/0x7b044d4128f9e282 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.165435:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01800/0x7b044d4128f9e282 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.165475:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00200/0x7b044d4128f9e27b lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.165482:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00200/0x7b044d4128f9e27b lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.165488:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00200/0x7b044d4128f9e27b lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.165494:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00200/0x7b044d4128f9e27b lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.165500:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d00200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938447.165504:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00200/0x7b044d4128f9e27b lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.165511:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00200/0x7b044d4128f9e27b lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.165523:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938447.165526:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.165531:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00200/0x7b044d4128f9e27b lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.165537:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00200/0x7b044d4128f9e27b lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.165548:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01800/0x7b044d4128f9e282 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.165553:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01800/0x7b044d4128f9e282 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.165558:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01800/0x7b044d4128f9e282 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.165563:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d01800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938447.165566:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01800/0x7b044d4128f9e282 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.165571:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01800/0x7b044d4128f9e282 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.165582:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x4958ff4 (ffff9f23823dc800) 00010000:00010000:2.0:1784938447.165585:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.165587:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01800/0x7b044d4128f9e282 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.165593:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01800/0x7b044d4128f9e282 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.165628:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e274 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664948 expref: 191 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.165639:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938447.165641:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.165645:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e274 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664948 expref: 191 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.165654:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d01c00, rc 0) 00000100:00100000:2.0:1784938447.165722:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+190:17112:x1871643337535488:12345-192.168.202.54@tcp:101:cp.0 Request processed in 462us (663us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938447.165729:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 635 00000100:00100000:3.0:1784938447.169423:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.169611:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337535744 00000100:00100000:0.0:1784938447.169623:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337535744 00000100:00100000:0.0:1784938447.169683:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 636 00000100:00100000:0.0:1784938447.169693:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b35f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+190:17112:x1871643337535744:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938447.169713:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938447.169735:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9e289 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766494f expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.169850:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e290 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.169878:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e290 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.169892:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e290 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.169911:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394a00/0x7b044d4128f9e297 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x4958ff4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.169917:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394a00/0x7b044d4128f9e297 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.169923:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394a00/0x7b044d4128f9e297 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938447.170320:0:24203:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x58:0x0], index 0: 0 00010000:00010000:0.0:1784938447.170455:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394000/0x7b044d4128f9e29e lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.170464:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394000/0x7b044d4128f9e29e lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.170472:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394000/0x7b044d4128f9e29e lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.170503:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e290 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.170509:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e290 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.170516:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e290 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.170522:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217c400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.170526:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e290 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.170534:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e290 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.170546:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938447.170550:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.170554:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e290 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.170560:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e290 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938447.170574:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007524724d reply state 000000002f99f0f3 transno 8589934778 ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394a00/0x7b044d4128f9e297 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.170585:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394a00/0x7b044d4128f9e297 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.170591:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x4958ff4 (ffff9f23872e6300) 00010000:00010000:0.0:1784938447.170594:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938447.170596:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938447.170625:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9e289 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766494f expref: 193 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.170638:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394000/0x7b044d4128f9e29e lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766494f expref: 192 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.170646:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2f:0x0].0x0 (ffff9f23872e6100) 00010000:00010000:0.0:1784938447.170648:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938447.170650:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382394000, rc 0) 00000100:00100000:0.0:1784938447.170707:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b35f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+193:17112:x1871643337535744:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1015us (1297us total) trans 8589934778 rc 0/0 00000100:00100000:0.0:1784938447.170715:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 636 00000100:00100000:1.0:1784938447.175478:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.175617:0:25728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337535872 00000100:00100000:2.0:1784938447.175627:0:25728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337535872 00000100:00100000:2.0:1784938447.175721:0:25728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 908 00000100:00100000:2.0:1784938447.175737:0:25728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:7ea6e988-18ba-4c98-b179-17995571b98b+69:10959:x1871643337535872:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938447.175765:0:25728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938447.175798:0:25728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d41c9e94/0x7b044d4128f9e2ac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664956 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938447.175831:0:25728:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x58:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938447.175853:0:25728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x58:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1784938447.175953:0:25728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x58:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.175963:0:25728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d41c9e94/0x7b044d4128f9e2ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664956 expref: 70 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.175982:0:25728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d41c9e94/0x7b044d4128f9e2ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664956 expref: 70 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.176058:0:25728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d01c00, rc 0) 00000100:00100000:2.0:1784938447.176310:0:25728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:7ea6e988-18ba-4c98-b179-17995571b98b+70:10959:x1871643337535872:12345-192.168.202.54@tcp:101:cp.0 Request processed in 578us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938447.176319:0:25728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 908 00000100:00100000:1.0:1784938447.179333:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.179448:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337536000 00000100:00100000:3.0:1784938447.179459:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337536000 00000100:00100000:3.0:1784938447.179519:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 909 00000100:00100000:3.0:1784938447.179529:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+70:17112:x1871643337536000:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938447.179547:0:25722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938447.179563:0:25722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea074bdc/0x7b044d4128f9e2b3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x58:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766495d expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.179596:0:25722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d41c9e94/0x7b044d4128f9e2ac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664956 expref: 71 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.179605:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x58:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938447.179609:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x58:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938447.179614:0:25722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea074bdc/0x7b044d4128f9e2b3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x58:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766495d expref: 71 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.179652:0:25722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d41c9e94/0x7b044d4128f9e2ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664956 expref: 71 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.179666:0:25722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d41c9e94/0x7b044d4128f9e2ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664956 expref: 71 pid: 25728 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938447.179681:0:25722:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b35f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25722:1871643350899584:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938447.179766:0:25722:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485cc9900 going to sleep for 11 seconds 00000100:00100000:3.0:1784938447.182354:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.182524:0:25722:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b35f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25722:1871643350899584:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938447.182563:0:25722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ea074bdc/0x7b044d4128f9e2b3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x58:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766495d expref: 71 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.182589:0:25722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61ae00, rc 0) 00000100:00100000:2.0:1784938447.182654:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+71:17112:x1871643337536000:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3126us (3330us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938447.182662:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 909 00000100:00100000:1.0:1784938447.183112:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337536128 00000100:00100000:1.0:1784938447.183119:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337536128 00010000:00010000:1.0:1784938447.183171:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d41c9e94/0x7b044d4128f9e2ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664956 expref: 71 pid: 25728 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938447.183199:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 453 00000100:00100000:1.0:1784938447.183208:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+71:10960:x1871643337536128:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938447.183221:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938447.183244:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d41c9e94/0x7b044d4128f9e2ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664956 expref: 71 pid: 25728 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.183256:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d41c9e94/0x7b044d4128f9e2ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664956 expref: 71 pid: 25728 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.183281:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d41c9e94/0x7b044d4128f9e2ac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664956 expref: 71 pid: 25728 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.183307:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x58:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938447.183311:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x58:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938447.183320:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea074bdc/0x7b044d4128f9e2b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766495d expref: 70 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.183330:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea074bdc/0x7b044d4128f9e2b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766495d expref: 70 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.183368:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ea074bdc/0x7b044d4128f9e2b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766495d expref: 70 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938447.183382:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388245c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350899712:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938447.183445:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbee40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938447.187930:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388245c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350899712:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938447.187968:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938447.188042:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+70:10960:x1871643337536128:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 4835us (5697us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938447.188055:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 453 00000100:00100000:2.0:1784938447.190241:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.190388:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337536384 00000100:00100000:0.0:1784938447.190399:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337536384 00000100:00100000:0.0:1784938447.190468:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 147 00000100:00100000:0.0:1784938447.190479:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24857ff450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+193:17112:x1871643337536384:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:0.0:1784938447.190784:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24857ff450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+194:17112:x1871643337536384:12345-192.168.202.54@tcp:35:cp.0 Request processed in 306us (552us total) trans 8589934779 rc 0/0 00000100:00100000:0.0:1784938447.190791:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 147 00000100:00100000:0.0:1784938447.194489:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.194651:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337536512 00000100:00100000:2.0:1784938447.194661:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337536512 00000100:00100000:2.0:1784938447.194725:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 637 00000100:00100000:2.0:1784938447.194735:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+194:17112:x1871643337536512:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938447.194764:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938447.194787:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00c00/0x7b044d4128f9e2ba lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664964 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.194869:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e2c1 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.194885:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e2c1 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.194897:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e2c1 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.194911:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01200/0x7b044d4128f9e2c8 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x57ba1cca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.194917:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01200/0x7b044d4128f9e2c8 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.194923:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01200/0x7b044d4128f9e2c8 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.194963:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e2c1 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.194970:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e2c1 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.194975:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e2c1 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.194985:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e2c1 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.194991:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d00600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938447.195004:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e2c1 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.195012:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e2c1 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.195024:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938447.195027:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.195031:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e2c1 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.195037:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e2c1 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.195052:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01200/0x7b044d4128f9e2c8 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.195058:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01200/0x7b044d4128f9e2c8 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.195065:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01200/0x7b044d4128f9e2c8 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.195069:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d01200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938447.195072:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01200/0x7b044d4128f9e2c8 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.195082:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01200/0x7b044d4128f9e2c8 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.195089:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x57ba1cca (ffff9f23823dc100) 00010000:00010000:2.0:1784938447.195091:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.195093:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01200/0x7b044d4128f9e2c8 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.195098:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01200/0x7b044d4128f9e2c8 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.195448:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00c00/0x7b044d4128f9e2ba lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664964 expref: 195 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.195459:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938447.195462:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.195466:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00c00/0x7b044d4128f9e2ba lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664964 expref: 195 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.195476:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d00c00, rc 0) 00000100:00100000:2.0:1784938447.195543:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+194:17112:x1871643337536512:12345-192.168.202.54@tcp:101:cp.0 Request processed in 809us (1063us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938447.195551:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 637 00000100:00100000:2.0:1784938447.198188:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.198262:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337536640 00000100:00100000:0.0:1784938447.198272:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337536640 00000100:00100000:0.0:1784938447.198335:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 638 00000100:00100000:0.0:1784938447.198345:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+194:17112:x1871643337536640:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938447.198365:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938447.198385:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e2cf lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766496b expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.198450:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395800/0x7b044d4128f9e2d6 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.198468:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395800/0x7b044d4128f9e2d6 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.198481:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395800/0x7b044d4128f9e2d6 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.198497:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395000/0x7b044d4128f9e2dd lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x57ba1cca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.198505:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395000/0x7b044d4128f9e2dd lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.198511:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395000/0x7b044d4128f9e2dd lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.198560:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395800/0x7b044d4128f9e2d6 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.198567:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395800/0x7b044d4128f9e2d6 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.198574:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395800/0x7b044d4128f9e2d6 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.198586:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382395800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.198591:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395800/0x7b044d4128f9e2d6 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.198599:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395800/0x7b044d4128f9e2d6 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.198611:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938447.198614:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.198619:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395800/0x7b044d4128f9e2d6 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.198625:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395800/0x7b044d4128f9e2d6 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.198643:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395000/0x7b044d4128f9e2dd lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.198649:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395000/0x7b044d4128f9e2dd lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.198655:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395000/0x7b044d4128f9e2dd lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.198660:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382395000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.198662:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395000/0x7b044d4128f9e2dd lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.198668:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395000/0x7b044d4128f9e2dd lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.198678:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x57ba1cca (ffff9f23872e6600) 00010000:00010000:0.0:1784938447.198681:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.198683:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395000/0x7b044d4128f9e2dd lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.198688:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395000/0x7b044d4128f9e2dd lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.198719:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e2cf lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766496b expref: 195 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.198729:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938447.198731:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.198735:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e2cf lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766496b expref: 195 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.198744:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382394200, rc 0) 00000100:00100000:0.0:1784938447.198816:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+194:17112:x1871643337536640:12345-192.168.202.54@tcp:101:cp.0 Request processed in 472us (637us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938447.198823:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 638 00000100:00100000:3.0:1784938447.202184:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.202264:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337536896 00000100:00100000:0.0:1784938447.202275:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337536896 00000100:00100000:0.0:1784938447.202341:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 639 00000100:00100000:0.0:1784938447.202350:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+194:17112:x1871643337536896:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938447.202369:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938447.202388:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e2e4 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664972 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.202502:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e2eb lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.202516:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e2eb lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.202527:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e2eb lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.202540:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394400/0x7b044d4128f9e2f2 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x57ba1cca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.202547:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394400/0x7b044d4128f9e2f2 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.202554:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394400/0x7b044d4128f9e2f2 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938447.202875:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x59:0x0], index 1: 0 00010000:00010000:0.0:1784938447.203001:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395c00/0x7b044d4128f9e2f9 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.203009:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395c00/0x7b044d4128f9e2f9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.203016:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395c00/0x7b044d4128f9e2f9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.203051:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e2eb lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.203063:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e2eb lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.203070:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e2eb lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.203076:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.203081:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e2eb lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.203089:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e2eb lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.203101:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938447.203104:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.203109:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e2eb lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.203116:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e2eb lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938447.203135:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001719cbcd reply state 0000000068e9dea6 transno 8589934780 ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394400/0x7b044d4128f9e2f2 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.203367:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394400/0x7b044d4128f9e2f2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.203375:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x57ba1cca (ffff9f23872e6800) 00010000:00010000:0.0:1784938447.203377:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938447.203379:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938447.203412:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e2e4 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664972 expref: 197 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.203430:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395c00/0x7b044d4128f9e2f9 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664972 expref: 196 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.203436:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x30:0x0].0x0 (ffff9f23872e6400) 00010000:00010000:0.0:1784938447.203439:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938447.203441:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382395c00, rc 0) 00000100:00100000:0.0:1784938447.203551:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+197:17112:x1871643337536896:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1201us (1403us total) trans 8589934780 rc 0/0 00000100:00100000:0.0:1784938447.203559:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 639 00000100:00100000:1.0:1784938447.207920:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.208009:0:25727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337537024 00000100:00100000:0.0:1784938447.208020:0:25727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337537024 00000100:00100000:0.0:1784938447.208086:0:25727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 910 00000100:00100000:0.0:1784938447.208097:0:25727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7ea6e988-18ba-4c98-b179-17995571b98b+72:10958:x1871643337537024:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938447.208115:0:25727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938447.208187:0:25727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009df84ed0/0x7b044d4128f9e307 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664979 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938447.208213:0:25727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x59:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938447.208237:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x59:0x0].0x0 since=713s v=(0 0) 00010000:00010000:0.0:1784938447.208241:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x59:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938447.208251:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009df84ed0/0x7b044d4128f9e307 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664979 expref: 73 pid: 25727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.208268:0:25727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009df84ed0/0x7b044d4128f9e307 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664979 expref: 73 pid: 25727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.208286:0:25727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382395a00, rc 0) 00000100:00100000:0.0:1784938447.208350:0:25727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7ea6e988-18ba-4c98-b179-17995571b98b+73:10958:x1871643337537024:12345-192.168.202.54@tcp:101:cp.0 Request processed in 255us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938447.208356:0:25727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 910 00000100:00100000:2.0:1784938447.211685:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.211770:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337537152 00000100:00100000:3.0:1784938447.211780:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337537152 00000100:00100000:3.0:1784938447.211848:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 911 00000100:00100000:3.0:1784938447.211859:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+73:17112:x1871643337537152:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938447.211887:0:21149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938447.211907:0:21149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fcd2670/0x7b044d4128f9e30e lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x59:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664980 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.211940:0:21149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009df84ed0/0x7b044d4128f9e307 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664979 expref: 74 pid: 25727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.211949:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x59:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938447.211952:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x59:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938447.211957:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fcd2670/0x7b044d4128f9e30e lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x59:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664980 expref: 74 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.211991:0:21149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009df84ed0/0x7b044d4128f9e307 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664979 expref: 74 pid: 25727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.212005:0:21149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009df84ed0/0x7b044d4128f9e307 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664979 expref: 74 pid: 25727 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938447.212020:0:21149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2489ae5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:21149:1871643350899840:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938447.212111:0:21149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485cc9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938447.215271:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.215451:0:21149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2489ae5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:21149:1871643350899840:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938447.215486:0:21149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003fcd2670/0x7b044d4128f9e30e lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x59:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664980 expref: 74 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.215508:0:21149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61b400, rc 0) 00000100:00100000:2.0:1784938447.215572:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+74:17112:x1871643337537152:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3715us (3898us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938447.215580:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 911 00000100:00100000:1.0:1784938447.215669:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337537280 00000100:00100000:1.0:1784938447.215676:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337537280 00010000:00010000:1.0:1784938447.215707:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009df84ed0/0x7b044d4128f9e307 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664979 expref: 74 pid: 25727 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938447.215744:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 454 00000100:00100000:1.0:1784938447.215753:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+74:10957:x1871643337537280:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938447.215765:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938447.215787:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009df84ed0/0x7b044d4128f9e307 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x59:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664979 expref: 74 pid: 25727 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.215799:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009df84ed0/0x7b044d4128f9e307 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x59:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664979 expref: 74 pid: 25727 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.215820:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009df84ed0/0x7b044d4128f9e307 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x59:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664979 expref: 74 pid: 25727 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.215835:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x59:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938447.215839:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x59:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938447.215847:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003fcd2670/0x7b044d4128f9e30e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664980 expref: 73 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.215869:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fcd2670/0x7b044d4128f9e30e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664980 expref: 73 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.215904:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003fcd2670/0x7b044d4128f9e30e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664980 expref: 73 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938447.215917:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350899968:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938447.215965:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbee40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938447.219752:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350899968:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938447.219779:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938447.219841:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+73:10957:x1871643337537280:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 4088us (4580us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938447.219852:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 454 00000100:00100000:3.0:1784938447.222640:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938447.222822:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337537536 00000100:00100000:1.0:1784938447.222832:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337537536 00000100:00100000:1.0:1784938447.222928:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 148 00000100:00100000:1.0:1784938447.222940:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+197:17112:x1871643337537536:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:1.0:1784938447.223347:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+198:17112:x1871643337537536:12345-192.168.202.54@tcp:35:cp.0 Request processed in 407us (716us total) trans 8589934781 rc 0/0 00000100:00100000:1.0:1784938447.223355:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 148 00000100:00100000:3.0:1784938447.227959:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.228173:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337537664 00000100:00100000:0.0:1784938447.228183:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337537664 00000100:00100000:0.0:1784938447.228339:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 640 00000100:00100000:0.0:1784938447.228349:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+198:17112:x1871643337537664:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938447.228375:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938447.228397:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e315 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664987 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.228462:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e31c lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.228475:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e31c lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.228486:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e31c lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.228500:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e323 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x407c6222 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.228507:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e323 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.228513:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e323 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.228554:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e31c lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.228562:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e31c lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.228568:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e31c lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.228574:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.228579:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e31c lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.228587:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e31c lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.228598:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938447.228602:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.228606:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e31c lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.228612:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e31c lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.228628:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e323 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.228633:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e323 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.228639:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e323 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.228645:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.228647:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e323 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.228654:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e323 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.228661:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x407c6222 (ffff9f23872e6600) 00010000:00010000:0.0:1784938447.228663:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.228665:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e323 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.228671:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e323 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.228705:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e315 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664987 expref: 199 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.228714:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938447.228716:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.228719:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e315 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664987 expref: 199 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.228729:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382395200, rc 0) 00000100:00100000:0.0:1784938447.228792:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+198:17112:x1871643337537664:12345-192.168.202.54@tcp:101:cp.0 Request processed in 444us (845us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938447.228799:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 640 00000100:00100000:3.0:1784938447.231514:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.232120:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337537792 00000100:00100000:2.0:1784938447.232138:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337537792 00000100:00100000:2.0:1784938447.232220:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 641 00000100:00100000:2.0:1784938447.232230:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+198:17112:x1871643337537792:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938447.232251:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938447.232272:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e32a lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766498e expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.232350:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01400/0x7b044d4128f9e331 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.232365:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01400/0x7b044d4128f9e331 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.232376:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01400/0x7b044d4128f9e331 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.232394:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01000/0x7b044d4128f9e338 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x407c6222 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.232401:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01000/0x7b044d4128f9e338 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.232408:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01000/0x7b044d4128f9e338 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.232450:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01400/0x7b044d4128f9e331 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.232458:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01400/0x7b044d4128f9e331 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.232465:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01400/0x7b044d4128f9e331 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.232472:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01400/0x7b044d4128f9e331 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.232478:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d01400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938447.232484:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01400/0x7b044d4128f9e331 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.232492:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01400/0x7b044d4128f9e331 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.232505:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938447.232508:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.232513:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01400/0x7b044d4128f9e331 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.232520:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01400/0x7b044d4128f9e331 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.232534:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01000/0x7b044d4128f9e338 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.232540:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01000/0x7b044d4128f9e338 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.232546:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01000/0x7b044d4128f9e338 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.232551:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d01000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938447.232554:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01000/0x7b044d4128f9e338 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.232559:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01000/0x7b044d4128f9e338 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.232566:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x407c6222 (ffff9f23823dc100) 00010000:00010000:2.0:1784938447.232568:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.232570:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01000/0x7b044d4128f9e338 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.232575:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01000/0x7b044d4128f9e338 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.232608:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e32a lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766498e expref: 199 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.232624:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938447.232626:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.232630:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e32a lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766498e expref: 199 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.232639:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d00600, rc 0) 00000100:00100000:2.0:1784938447.232697:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+198:17112:x1871643337537792:12345-192.168.202.54@tcp:101:cp.0 Request processed in 469us (1195us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938447.232704:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 641 00000100:00100000:2.0:1784938447.235867:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938447.237372:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337538048 00000100:00100000:1.0:1784938447.237387:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337538048 00000100:00100000:0.0:1784938447.237589:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 642 00000100:00100000:0.0:1784938447.237602:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+198:17112:x1871643337538048:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938447.237625:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938447.237645:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e33f lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664995 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.237753:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e346 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.237768:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e346 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.237779:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e346 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.237792:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e34d lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x407c6222 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.237799:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e34d lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.237805:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e34d lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938447.238463:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x59:0x0], index 0: 0 00010000:00010000:0.0:1784938447.238618:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395000/0x7b044d4128f9e354 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.238629:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395000/0x7b044d4128f9e354 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.238638:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395000/0x7b044d4128f9e354 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.238668:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e346 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.238677:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e346 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.238684:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e346 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.238691:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e346 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.238697:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.238701:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e346 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.238708:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e346 lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.238719:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938447.238722:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.238726:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e346 lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.238732:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e346 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938447.238751:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b209fcd7 reply state 00000000b15e5c22 transno 8589934782 ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e34d lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.238761:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e34d lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.238768:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x407c6222 (ffff9f23872e6600) 00010000:00010000:0.0:1784938447.238771:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938447.238773:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938447.238806:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e33f lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664995 expref: 201 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.238820:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395000/0x7b044d4128f9e354 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664995 expref: 200 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.238827:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x31:0x0].0x0 (ffff9f23872e6000) 00010000:00010000:0.0:1784938447.238829:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938447.238831:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382395000, rc 0) 00000100:00100000:0.0:1784938447.238961:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+201:17112:x1871643337538048:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1361us (3114us total) trans 8589934782 rc 0/0 00000100:00100000:0.0:1784938447.238969:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 642 00000100:00100000:2.0:1784938447.242822:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.242917:0:25729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337538176 00000100:00100000:3.0:1784938447.242928:0:25729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337538176 00000100:00100000:3.0:1784938447.242984:0:25729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 912 00000100:00100000:3.0:1784938447.243003:0:25729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7ea6e988-18ba-4c98-b179-17995571b98b+70:10960:x1871643337538176:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938447.243021:0:25729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938447.243042:0:25729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b04cfea/0x7b044d4128f9e362 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e94766499c expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938447.243069:0:25729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x59:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938447.243091:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x59:0x0].0x0 since=713s v=(0 0) 00010000:00010000:3.0:1784938447.243096:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x59:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938447.243106:0:25729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b04cfea/0x7b044d4128f9e362 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766499c expref: 71 pid: 25729 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.243126:0:25729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006b04cfea/0x7b044d4128f9e362 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766499c expref: 71 pid: 25729 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.243141:0:25729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61b200, rc 0) 00000100:00100000:3.0:1784938447.243219:0:25729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7ea6e988-18ba-4c98-b179-17995571b98b+71:10960:x1871643337538176:12345-192.168.202.54@tcp:101:cp.0 Request processed in 218us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938447.243226:0:25729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 912 00000100:00100000:3.0:1784938447.246388:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.246496:0:25725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337538304 00000100:00100000:2.0:1784938447.246509:0:25725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337538304 00000100:00100000:2.0:1784938447.246571:0:25725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 913 00000100:00100000:2.0:1784938447.246580:0:25725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7ea6e988-18ba-4c98-b179-17995571b98b+71:17112:x1871643337538304:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938447.246601:0:25725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938447.246622:0:25725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000895de66e/0x7b044d4128f9e369 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x59:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476649a3 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.246656:0:25725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006b04cfea/0x7b044d4128f9e362 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766499c expref: 72 pid: 25729 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.246665:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x59:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.246670:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x59:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.246675:0:25725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000895de66e/0x7b044d4128f9e369 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x59:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476649a3 expref: 72 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.246714:0:25725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006b04cfea/0x7b044d4128f9e362 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e94766499c expref: 72 pid: 25729 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.246729:0:25725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006b04cfea/0x7b044d4128f9e362 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766499c expref: 72 pid: 25729 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938447.246744:0:25725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2489ae5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:25725:1871643350900096:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938447.246835:0:25725:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34540 going to sleep for 11 seconds 00000100:00100000:2.0:1784938447.250579:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.250699:0:25725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2489ae5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:25725:1871643350900096:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938447.250742:0:25725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000895de66e/0x7b044d4128f9e369 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x59:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476649a3 expref: 72 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.250766:0:25725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d01200, rc 0) 00000100:00100000:3.0:1784938447.250827:0:25725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7ea6e988-18ba-4c98-b179-17995571b98b+72:17112:x1871643337538304:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4247us (4448us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938447.250837:0:25725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 913 00000100:00100000:0.0:1784938447.251170:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337538432 00000100:00100000:0.0:1784938447.251180:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337538432 00010000:00010000:0.0:1784938447.251219:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006b04cfea/0x7b044d4128f9e362 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766499c expref: 72 pid: 25729 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938447.251258:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 455 00000100:00100000:0.0:1784938447.251266:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b35f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+72:10960:x1871643337538432:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938447.251279:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938447.251313:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006b04cfea/0x7b044d4128f9e362 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x59:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766499c expref: 72 pid: 25729 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.251332:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006b04cfea/0x7b044d4128f9e362 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x59:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766499c expref: 72 pid: 25729 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.251355:0:22955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b04cfea/0x7b044d4128f9e362 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x59:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e94766499c expref: 72 pid: 25729 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.251370:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x59:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938447.251374:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x59:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938447.251382:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000895de66e/0x7b044d4128f9e369 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476649a3 expref: 71 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.251392:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000895de66e/0x7b044d4128f9e369 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476649a3 expref: 71 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.251427:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000895de66e/0x7b044d4128f9e369 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476649a3 expref: 71 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938447.251442:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd55fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350900224:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938447.251509:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2389fdb300 going to sleep for 11 seconds 00000100:00100000:0.0:1784938447.254884:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd55fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350900224:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938447.254913:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938447.254972:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b35f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+71:10960:x1871643337538432:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3704us (4404us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938447.254992:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 455 00000100:00100000:2.0:1784938447.257684:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.257764:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337538688 00000100:00100000:3.0:1784938447.257775:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337538688 00000100:00100000:3.0:1784938447.257837:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 149 00000100:00100000:3.0:1784938447.257848:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b35f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+201:17112:x1871643337538688:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938447.258207:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b35f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+202:17112:x1871643337538688:12345-192.168.202.54@tcp:35:cp.0 Request processed in 359us (531us total) trans 8589934783 rc 0/0 00000100:00100000:3.0:1784938447.258214:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 149 00000100:00100000:1.0:1784938447.262111:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.262346:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337538816 00000100:00100000:3.0:1784938447.262356:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337538816 00000100:00100000:3.0:1784938447.262452:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 643 00000100:00100000:3.0:1784938447.262462:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+202:17112:x1871643337538816:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938447.262492:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938447.262514:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ac00/0x7b044d4128f9e370 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476649aa expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.262583:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e377 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.262598:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e377 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.262608:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e377 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.262623:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61aa00/0x7b044d4128f9e37e lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x239dea14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.262630:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61aa00/0x7b044d4128f9e37e lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.262635:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61aa00/0x7b044d4128f9e37e lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.262675:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e377 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.262682:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e377 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.262692:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e377 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.262698:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61a200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938447.262702:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e377 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.262710:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e377 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.262721:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938447.262725:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.262729:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e377 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.262734:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e377 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.262748:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61aa00/0x7b044d4128f9e37e lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.262753:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61aa00/0x7b044d4128f9e37e lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.262759:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61aa00/0x7b044d4128f9e37e lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.262763:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61aa00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938447.262765:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61aa00/0x7b044d4128f9e37e lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.262774:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61aa00/0x7b044d4128f9e37e lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.262781:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x239dea14 (ffff9f249863be00) 00010000:00010000:3.0:1784938447.262783:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.262786:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61aa00/0x7b044d4128f9e37e lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.262791:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61aa00/0x7b044d4128f9e37e lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.262820:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ac00/0x7b044d4128f9e370 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476649aa expref: 203 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.262830:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938447.262832:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.262836:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ac00/0x7b044d4128f9e370 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476649aa expref: 203 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.262845:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61ac00, rc 0) 00000100:00100000:3.0:1784938447.263035:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+202:17112:x1871643337538816:12345-192.168.202.54@tcp:101:cp.0 Request processed in 573us (933us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938447.263042:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 643 00000100:00100000:2.0:1784938447.270209:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.270323:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337538944 00000100:00100000:0.0:1784938447.270332:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337538944 00000100:00100000:0.0:1784938447.270401:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 644 00000100:00100000:0.0:1784938447.270412:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+202:17112:x1871643337538944:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938447.270435:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938447.270458:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e385 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476649b1 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.270533:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e38c lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.270550:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e38c lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.270560:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e38c lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.270576:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395800/0x7b044d4128f9e393 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x239dea14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.270582:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395800/0x7b044d4128f9e393 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.270588:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395800/0x7b044d4128f9e393 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.270639:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e38c lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.270647:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e38c lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.270658:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e38c lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.270665:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.270669:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e38c lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.270677:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e38c lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.270688:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938447.270691:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.270695:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e38c lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.270700:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e38c lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.270714:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395800/0x7b044d4128f9e393 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.270719:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395800/0x7b044d4128f9e393 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.270724:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395800/0x7b044d4128f9e393 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.270728:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382395800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.270731:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395800/0x7b044d4128f9e393 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.270741:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395800/0x7b044d4128f9e393 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.270748:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x239dea14 (ffff9f238727c500) 00010000:00010000:0.0:1784938447.270750:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.270753:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395800/0x7b044d4128f9e393 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.270758:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395800/0x7b044d4128f9e393 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.270791:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e385 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476649b1 expref: 203 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.270801:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938447.270803:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.270806:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e385 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476649b1 expref: 203 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.270814:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382395200, rc 0) 00000100:00100000:0.0:1784938447.271032:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+202:17112:x1871643337538944:12345-192.168.202.54@tcp:101:cp.0 Request processed in 620us (834us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938447.271039:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 644 00000100:00100000:2.0:1784938447.274717:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.274821:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337539200 00000100:00100000:0.0:1784938447.274835:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337539200 00000100:00100000:0.0:1784938447.274915:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 645 00000100:00100000:0.0:1784938447.274927:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+202:17112:x1871643337539200:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938447.274951:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938447.274972:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395a00/0x7b044d4128f9e39a lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476649b8 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.275094:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395400/0x7b044d4128f9e3a1 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.275111:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395400/0x7b044d4128f9e3a1 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.275123:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395400/0x7b044d4128f9e3a1 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.275142:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394c00/0x7b044d4128f9e3a8 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x239dea14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.275180:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394c00/0x7b044d4128f9e3a8 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.275187:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394c00/0x7b044d4128f9e3a8 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938447.275684:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x5a:0x0], index 1: 0 00010000:00010000:0.0:1784938447.275865:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9e3af lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.275875:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9e3af lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.275883:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9e3af lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.275922:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395400/0x7b044d4128f9e3a1 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.275928:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395400/0x7b044d4128f9e3a1 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.275935:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395400/0x7b044d4128f9e3a1 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.275941:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395400/0x7b044d4128f9e3a1 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.275947:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382395400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.275951:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395400/0x7b044d4128f9e3a1 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.275959:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395400/0x7b044d4128f9e3a1 lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.275972:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938447.275974:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.275979:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395400/0x7b044d4128f9e3a1 lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.275987:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395400/0x7b044d4128f9e3a1 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938447.276004:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007d9bb84f reply state 000000006e52b241 transno 8589934784 ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394c00/0x7b044d4128f9e3a8 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.276016:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394c00/0x7b044d4128f9e3a8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.276023:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x239dea14 (ffff9f24898dc300) 00010000:00010000:0.0:1784938447.276025:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938447.276029:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938447.276058:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395a00/0x7b044d4128f9e39a lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476649b8 expref: 205 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.276072:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9e3af lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476649b8 expref: 204 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.276079:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x32:0x0].0x0 (ffff9f24898dc800) 00010000:00010000:0.0:1784938447.276081:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938447.276084:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217c800, rc 0) 00000100:00100000:0.0:1784938447.276212:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+205:17112:x1871643337539200:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1286us (1515us total) trans 8589934784 rc 0/0 00000100:00100000:0.0:1784938447.276221:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 645 00000100:00100000:1.0:1784938447.280411:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.280582:0:25718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337539328 00000100:00100000:3.0:1784938447.280594:0:25718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337539328 00000100:00100000:3.0:1784938447.280665:0:25718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 914 00000100:00100000:3.0:1784938447.280676:0:25718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ea6e988-18ba-4c98-b179-17995571b98b+73:10957:x1871643337539328:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938447.280701:0:25718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938447.280726:0:25718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e45c1791/0x7b044d4128f9e3bd lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476649bf expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938447.280751:0:25718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938447.280772:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5a:0x0].0x0 since=713s v=(0 0) 00010000:00010000:3.0:1784938447.280777:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938447.280787:0:25718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e45c1791/0x7b044d4128f9e3bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476649bf expref: 74 pid: 25718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.280804:0:25718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e45c1791/0x7b044d4128f9e3bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476649bf expref: 74 pid: 25718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.280816:0:25718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61ac00, rc 0) 00000100:00100000:3.0:1784938447.280884:0:25718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ea6e988-18ba-4c98-b179-17995571b98b+74:10957:x1871643337539328:12345-192.168.202.54@tcp:101:cp.0 Request processed in 210us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938447.280891:0:25718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 914 00000100:00100000:2.0:1784938447.284570:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.284654:0:25723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337539456 00000100:00100000:3.0:1784938447.284664:0:25723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337539456 00000100:00100000:3.0:1784938447.284731:0:25723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 915 00000100:00100000:3.0:1784938447.284742:0:25723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7ea6e988-18ba-4c98-b179-17995571b98b+74:17112:x1871643337539456:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938447.284764:0:25723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938447.284786:0:25723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc245ddc/0x7b044d4128f9e3c4 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x5a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476649c6 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.284821:0:25723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e45c1791/0x7b044d4128f9e3bd lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476649bf expref: 75 pid: 25718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.284832:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938447.284837:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938447.284842:0:25723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc245ddc/0x7b044d4128f9e3c4 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x5a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476649c6 expref: 75 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.284896:0:25723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e45c1791/0x7b044d4128f9e3bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e9476649bf expref: 75 pid: 25718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.284912:0:25723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e45c1791/0x7b044d4128f9e3bd lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476649bf expref: 75 pid: 25718 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938447.284927:0:25723:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:25723:1871643350900352:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938447.285038:0:25723:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485cc9900 going to sleep for 11 seconds 00000100:00100000:2.0:1784938447.289209:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.289525:0:25723:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:25723:1871643350900352:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938447.289567:0:25723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fc245ddc/0x7b044d4128f9e3c4 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x5a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476649c6 expref: 75 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.289590:0:25723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61aa00, rc 0) 00000100:00100000:3.0:1784938447.289654:0:25723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7ea6e988-18ba-4c98-b179-17995571b98b+75:17112:x1871643337539456:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4913us (5094us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938447.289664:0:25723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 915 00000100:00100000:1.0:1784938447.291429:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337539584 00000100:00100000:1.0:1784938447.291444:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337539584 00010000:00010000:1.0:1784938447.291500:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e45c1791/0x7b044d4128f9e3bd lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476649bf expref: 75 pid: 25718 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938447.291586:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 456 00000100:00100000:1.0:1784938447.291596:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+75:10958:x1871643337539584:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938447.291614:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938447.291641:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e45c1791/0x7b044d4128f9e3bd lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476649bf expref: 75 pid: 25718 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.291657:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e45c1791/0x7b044d4128f9e3bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476649bf expref: 75 pid: 25718 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.291685:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e45c1791/0x7b044d4128f9e3bd lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476649bf expref: 75 pid: 25718 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.291710:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938447.291714:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938447.291724:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc245ddc/0x7b044d4128f9e3c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476649c6 expref: 74 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.291737:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc245ddc/0x7b044d4128f9e3c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476649c6 expref: 74 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.291784:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fc245ddc/0x7b044d4128f9e3c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476649c6 expref: 74 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938447.291801:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:19219:1871643350900480:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938447.291968:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbea80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938447.296266:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938447.296513:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:19219:1871643350900480:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938447.296537:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938447.296593:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+74:10958:x1871643337539584:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 4998us (7397us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938447.296604:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 456 00000100:00100000:3.0:1784938447.296897:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337539840 00000100:00100000:3.0:1784938447.296905:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337539840 00000100:00100000:3.0:1784938447.296957:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 150 00000100:00100000:3.0:1784938447.296966:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+205:17112:x1871643337539840:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938447.297415:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+206:17112:x1871643337539840:12345-192.168.202.54@tcp:35:cp.0 Request processed in 450us (1165us total) trans 8589934785 rc 0/0 00000100:00100000:3.0:1784938447.297421:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 150 00000100:00100000:0.0:1784938447.301316:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938447.301399:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337539968 00000100:00100000:1.0:1784938447.301410:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337539968 00000100:00100000:1.0:1784938447.301473:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 646 00000100:00100000:1.0:1784938447.301483:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd55fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+206:17112:x1871643337539968:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938447.301507:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938447.301529:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9e3cb lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476649cd expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.301607:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9e3d2 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.301622:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9e3d2 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.301635:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9e3d2 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.301656:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9e3d9 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x130f79e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.301663:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9e3d9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.301669:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9e3d9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.301723:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9e3d2 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.301732:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9e3d2 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.301738:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9e3d2 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.301745:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9e3d2 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.301751:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938447.301755:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9e3d2 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.301762:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9e3d2 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.301774:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938447.301777:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938447.301781:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9e3d2 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.301788:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9e3d2 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.301803:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9e3d9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.301810:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9e3d9 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.301815:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9e3d9 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.301819:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938447.301822:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9e3d9 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.301827:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9e3d9 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.301834:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x130f79e0 (ffff9f24b67c7f00) 00010000:00010000:1.0:1784938447.301836:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938447.301839:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9e3d9 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.301843:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9e3d9 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.301889:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9e3cb lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476649cd expref: 207 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.301904:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938447.301906:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938447.301910:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9e3cb lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476649cd expref: 207 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.301918:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238db39e00, rc 0) 00000100:00100000:1.0:1784938447.301983:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd55fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+206:17112:x1871643337539968:12345-192.168.202.54@tcp:101:cp.0 Request processed in 501us (678us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938447.301992:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 646 00000100:00100000:3.0:1784938447.305790:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.305894:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337540096 00000100:00100000:0.0:1784938447.305906:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337540096 00000100:00100000:0.0:1784938447.305970:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 647 00000100:00100000:0.0:1784938447.305979:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+206:17112:x1871643337540096:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938447.306001:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938447.306022:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e3e0 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476649d4 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.306090:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e3e7 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.306110:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e3e7 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.306122:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e3e7 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.306186:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e3ee lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x130f79e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.306195:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e3ee lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.306202:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e3ee lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.306246:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e3e7 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.306253:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e3e7 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.306260:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e3e7 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.306267:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e3e7 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.306273:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217d000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.306277:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e3e7 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.306285:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e3e7 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.306305:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938447.306308:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.306314:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e3e7 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.306320:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e3e7 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.306335:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e3ee lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.306342:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e3ee lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.306347:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e3ee lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.306352:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217d800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.306354:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e3ee lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.306360:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e3ee lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.306367:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x130f79e0 (ffff9f24898dcc00) 00010000:00010000:0.0:1784938447.306369:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.306372:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e3ee lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.306378:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e3ee lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.306417:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e3e0 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476649d4 expref: 207 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.306428:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938447.306430:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.306433:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c400/0x7b044d4128f9e3e0 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476649d4 expref: 207 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.306444:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217c400, rc 0) 00000100:00100000:0.0:1784938447.306513:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+206:17112:x1871643337540096:12345-192.168.202.54@tcp:101:cp.0 Request processed in 534us (736us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938447.306520:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 647 00000100:00100000:2.0:1784938447.310402:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938447.310484:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337540352 00000100:00100000:1.0:1784938447.310495:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337540352 00000100:00100000:1.0:1784938447.310569:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 648 00000100:00100000:1.0:1784938447.310580:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+206:17112:x1871643337540352:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938447.310603:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938447.310626:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9e3f5 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476649db expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.310746:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9e3fc lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.310761:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9e3fc lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.310773:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9e3fc lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.310790:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e403 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x130f79e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.310799:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e403 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.310806:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e403 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938447.311136:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x5a:0x0], index 0: 0 00010000:00010000:1.0:1784938447.311335:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc400/0x7b044d4128f9e40a lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.311345:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc400/0x7b044d4128f9e40a lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.311353:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc400/0x7b044d4128f9e40a lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.311387:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9e3fc lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.311395:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9e3fc lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.311400:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9e3fc lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.311407:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9e3fc lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.311413:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f7600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938447.311418:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9e3fc lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.311430:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9e3fc lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.311444:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938447.311447:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938447.311451:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9e3fc lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.311458:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9e3fc lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938447.311472:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d0c62b8b reply state 000000003b085a6d transno 8589934786 ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e403 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.311485:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e403 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.311491:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x130f79e0 (ffff9f24b67c7c00) 00010000:00010000:1.0:1784938447.311494:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938447.311498:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938447.311532:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9e3f5 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476649db expref: 209 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.311547:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc400/0x7b044d4128f9e40a lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476649db expref: 208 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.311555:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x33:0x0].0x0 (ffff9f24b67c7f00) 00010000:00010000:1.0:1784938447.311557:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938447.311559:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fc400, rc 0) 00000100:00100000:1.0:1784938447.311632:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+209:17112:x1871643337540352:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1054us (1240us total) trans 8589934786 rc 0/0 00000100:00100000:1.0:1784938447.311640:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 648 00000100:00100000:2.0:1784938447.315628:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.315711:0:25724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337540480 00000100:00100000:0.0:1784938447.315721:0:25724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337540480 00000100:00100000:0.0:1784938447.315779:0:25724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 916 00000100:00100000:0.0:1784938447.315788:0:25724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238125d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7ea6e988-18ba-4c98-b179-17995571b98b+71:10959:x1871643337540480:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938447.315809:0:25724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938447.315831:0:25724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080def834/0x7b044d4128f9e418 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476649e2 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938447.315857:0:25724:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938447.315891:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5a:0x0].0x0 since=713s v=(0 0) 00010000:00010000:0.0:1784938447.315896:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938447.315907:0:25724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080def834/0x7b044d4128f9e418 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476649e2 expref: 72 pid: 25724 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.315931:0:25724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000080def834/0x7b044d4128f9e418 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476649e2 expref: 72 pid: 25724 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.315944:0:25724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217c200, rc 0) 00000100:00100000:0.0:1784938447.316013:0:25724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238125d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7ea6e988-18ba-4c98-b179-17995571b98b+72:10959:x1871643337540480:12345-192.168.202.54@tcp:101:cp.0 Request processed in 225us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938447.316021:0:25724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 916 00000100:00100000:3.0:1784938447.320192:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.320458:0:25726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337540608 00000100:00100000:0.0:1784938447.320469:0:25726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337540608 00000100:00100000:0.0:1784938447.320549:0:25726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 917 00000100:00100000:0.0:1784938447.320559:0:25726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7ea6e988-18ba-4c98-b179-17995571b98b+72:17112:x1871643337540608:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938447.320579:0:25726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938447.320600:0:25726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0f0b59d/0x7b044d4128f9e41f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476649e9 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.320633:0:25726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000080def834/0x7b044d4128f9e418 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476649e2 expref: 73 pid: 25724 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.320644:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938447.320648:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938447.320654:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0f0b59d/0x7b044d4128f9e41f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476649e9 expref: 73 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.320695:0:25726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000080def834/0x7b044d4128f9e418 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e9476649e2 expref: 73 pid: 25724 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.320710:0:25726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000080def834/0x7b044d4128f9e418 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476649e2 expref: 73 pid: 25724 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938447.320726:0:25726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d4e1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:25726:1871643350900608:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938447.320815:0:25726:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2389fdb600 going to sleep for 11 seconds 00000100:00100000:0.0:1784938447.323332:0:25726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d4e1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:25726:1871643350900608:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938447.323367:0:25726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0f0b59d/0x7b044d4128f9e41f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476649e9 expref: 73 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.323388:0:25726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217c400, rc 0) 00000100:00100000:0.0:1784938447.323556:0:25726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7ea6e988-18ba-4c98-b179-17995571b98b+73:17112:x1871643337540608:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2996us (3434us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938447.323566:0:25726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 917 00000100:00100000:2.0:1784938447.326232:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938447.326934:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337540736 00000100:00100000:1.0:1784938447.326946:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337540736 00010000:00010000:1.0:1784938447.327050:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000080def834/0x7b044d4128f9e418 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476649e2 expref: 73 pid: 25724 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938447.327142:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 457 00000100:00100000:1.0:1784938447.327190:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+73:10960:x1871643337540736:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938447.327206:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938447.327230:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000080def834/0x7b044d4128f9e418 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476649e2 expref: 73 pid: 25724 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.327245:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000080def834/0x7b044d4128f9e418 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476649e2 expref: 73 pid: 25724 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.327273:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080def834/0x7b044d4128f9e418 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e9476649e2 expref: 73 pid: 25724 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.327299:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938447.327304:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938447.327312:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0f0b59d/0x7b044d4128f9e41f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476649e9 expref: 72 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.327323:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0f0b59d/0x7b044d4128f9e41f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476649e9 expref: 72 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.327362:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f0f0b59d/0x7b044d4128f9e41f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476649e9 expref: 72 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938447.327380:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:19221:1871643350900736:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938447.327471:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24906db900 going to sleep for 11 seconds 00000100:00100000:2.0:1784938447.332039:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.332141:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337540992 00000100:00100000:0.0:1784938447.332187:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337540992 00000100:00100000:0.0:1784938447.332252:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 151 00000100:00100000:0.0:1784938447.332262:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+209:17112:x1871643337540992:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:0.0:1784938447.332566:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+210:17112:x1871643337540992:12345-192.168.202.54@tcp:35:cp.0 Request processed in 305us (538us total) trans 8589934787 rc 0/0 00000100:00100000:0.0:1784938447.332574:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 151 00000100:00100000:1.0:1784938447.334943:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:19221:1871643350900736:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938447.334968:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938447.335040:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+72:10960:x1871643337540736:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 7853us (8821us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938447.335051:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 457 00000100:00100000:2.0:1784938447.337620:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.337715:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337541120 00000100:00100000:0.0:1784938447.337725:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337541120 00000100:00100000:0.0:1784938447.337784:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 649 00000100:00100000:0.0:1784938447.337794:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+210:17112:x1871643337541120:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938447.337819:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938447.337839:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e426 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476649f0 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.337918:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e42d lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.337934:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e42d lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.337944:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e42d lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.337960:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e434 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xc735cef4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.337967:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e434 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.337974:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e434 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.338024:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e42d lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.338032:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e42d lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.338039:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e42d lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.338050:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e42d lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.338055:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217d000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.338060:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e42d lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.338067:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e42d lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.338079:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938447.338082:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.338087:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e42d lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.338094:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d000/0x7b044d4128f9e42d lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.338108:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e434 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.338114:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e434 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.338120:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e434 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.338303:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217c200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.338306:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e434 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.338316:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e434 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.338325:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xc735cef4 (ffff9f24898dcc00) 00010000:00010000:0.0:1784938447.338327:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.338330:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e434 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.338335:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c200/0x7b044d4128f9e434 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.338377:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e426 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476649f0 expref: 211 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.338388:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938447.338391:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.338395:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217d800/0x7b044d4128f9e426 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476649f0 expref: 211 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.338404:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217d800, rc 0) 00000100:00100000:0.0:1784938447.338490:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+210:17112:x1871643337541120:12345-192.168.202.54@tcp:101:cp.0 Request processed in 696us (878us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938447.338497:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 649 00000100:00100000:3.0:1784938447.341268:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938447.341392:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337541248 00000100:00100000:1.0:1784938447.341403:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337541248 00000100:00100000:1.0:1784938447.341466:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 650 00000100:00100000:1.0:1784938447.341482:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+210:17112:x1871643337541248:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938447.341504:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938447.341529:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd200/0x7b044d4128f9e43b lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476649f7 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.341595:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc200/0x7b044d4128f9e442 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.341610:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc200/0x7b044d4128f9e442 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.341622:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc200/0x7b044d4128f9e442 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.341641:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e449 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xc735cef4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.341649:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e449 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.341655:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e449 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.341699:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc200/0x7b044d4128f9e442 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.341707:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc200/0x7b044d4128f9e442 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.341713:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc200/0x7b044d4128f9e442 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.341719:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc200/0x7b044d4128f9e442 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.341725:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fc200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938447.341729:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc200/0x7b044d4128f9e442 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.341737:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc200/0x7b044d4128f9e442 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.341747:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938447.341750:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938447.341755:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc200/0x7b044d4128f9e442 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.341762:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc200/0x7b044d4128f9e442 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.341779:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e449 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.341786:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e449 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.341791:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e449 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.341796:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fca00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938447.341799:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e449 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.341805:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e449 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.341812:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xc735cef4 (ffff9f24b67c7600) 00010000:00010000:1.0:1784938447.341815:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938447.341818:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e449 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.341824:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e449 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.341872:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd200/0x7b044d4128f9e43b lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476649f7 expref: 211 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.341887:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938447.341890:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938447.341894:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd200/0x7b044d4128f9e43b lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476649f7 expref: 211 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.341905:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fd200, rc 0) 00000100:00100000:1.0:1784938447.341968:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+210:17112:x1871643337541248:12345-192.168.202.54@tcp:101:cp.0 Request processed in 492us (715us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938447.341976:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 650 00000100:00100000:3.0:1784938447.345402:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.346210:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337541504 00000100:00100000:0.0:1784938447.346227:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337541504 00000100:00100000:0.0:1784938447.346316:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 651 00000100:00100000:0.0:1784938447.346330:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+210:17112:x1871643337541504:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938447.346354:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938447.346377:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395a00/0x7b044d4128f9e450 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e9476649fe expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.346488:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395400/0x7b044d4128f9e457 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.346504:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395400/0x7b044d4128f9e457 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.346515:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395400/0x7b044d4128f9e457 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.346530:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e45e lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0xc735cef4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.346536:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e45e lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.346543:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e45e lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938447.346863:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x5b:0x0], index 1: 0 00010000:00010000:0.0:1784938447.347493:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395800/0x7b044d4128f9e465 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.347512:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395800/0x7b044d4128f9e465 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.347522:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395800/0x7b044d4128f9e465 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.347565:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395400/0x7b044d4128f9e457 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.347572:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395400/0x7b044d4128f9e457 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.347579:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395400/0x7b044d4128f9e457 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.347585:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382395400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.347590:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395400/0x7b044d4128f9e457 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.347597:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395400/0x7b044d4128f9e457 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.347611:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938447.347614:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.347618:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395400/0x7b044d4128f9e457 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.347623:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395400/0x7b044d4128f9e457 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938447.347639:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b48ecfb7 reply state 000000001deb902f transno 8589934788 ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e45e lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.347650:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e45e lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.347656:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xc735cef4 (ffff9f24898dc100) 00010000:00010000:0.0:1784938447.347659:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938447.347663:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938447.347700:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395a00/0x7b044d4128f9e450 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476649fe expref: 213 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.347715:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395800/0x7b044d4128f9e465 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476649fe expref: 212 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.347722:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x34:0x0].0x0 (ffff9f238727c500) 00010000:00010000:0.0:1784938447.347724:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938447.347726:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382395800, rc 0) 00000100:00100000:0.0:1784938447.347811:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+213:17112:x1871643337541504:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1483us (2421us total) trans 8589934788 rc 0/0 00000100:00100000:0.0:1784938447.347819:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 651 00000100:00100000:3.0:1784938447.353451:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.353753:0:25728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337541632 00000100:00100000:0.0:1784938447.353766:0:25728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337541632 00000100:00100000:0.0:1784938447.353838:0:25728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 918 00000100:00100000:0.0:1784938447.353849:0:25728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:7ea6e988-18ba-4c98-b179-17995571b98b+74:10957:x1871643337541632:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938447.353945:0:25728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938447.353973:0:25728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e473 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664a05 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938447.354065:0:25728:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938447.354093:0:25728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5b:0x0].0x0 since=713s v=(0 0) 00010000:00010000:0.0:1784938447.354097:0:25728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938447.354109:0:25728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e473 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a05 expref: 75 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.354135:0:25728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e473 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a05 expref: 75 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.354224:0:25728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382394200, rc 0) 00000100:00100000:0.0:1784938447.354365:0:25728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:7ea6e988-18ba-4c98-b179-17995571b98b+75:10957:x1871643337541632:12345-192.168.202.54@tcp:101:cp.0 Request processed in 517us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938447.354373:0:25728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 918 00000100:00100000:3.0:1784938447.357773:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.357830:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337541760 00000100:00100000:2.0:1784938447.357841:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337541760 00000100:00100000:2.0:1784938447.357907:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 919 00000100:00100000:2.0:1784938447.357918:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+75:17112:x1871643337541760:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938447.357936:0:25722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938447.357955:0:25722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029fd9487/0x7b044d4128f9e47a lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x5b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664a0c expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.358003:0:25722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e473 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a05 expref: 76 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.358013:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.358017:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.358023:0:25722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029fd9487/0x7b044d4128f9e47a lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x5b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a0c expref: 76 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.358067:0:25722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e473 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664a05 expref: 76 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.358083:0:25722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e473 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664a05 expref: 76 pid: 25728 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938447.358100:0:25722:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25722:1871643350900864:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938447.358219:0:25722:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34540 going to sleep for 11 seconds 00000100:00100000:0.0:1784938447.362140:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.362333:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337541888 00000100:00100000:3.0:1784938447.362345:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337541888 00010000:00010000:3.0:1784938447.362393:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e473 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664a05 expref: 77 pid: 25728 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938447.362443:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 458 00000100:00100000:3.0:1784938447.362453:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24a6e62050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+77:10957:x1871643337541888:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938447.362473:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938447.362501:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e473 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x5b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664a05 expref: 77 pid: 25728 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.362516:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e473 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x5b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664a05 expref: 77 pid: 25728 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.362545:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938447.362549:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938447.362559:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000029fd9487/0x7b044d4128f9e47a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a0c expref: 77 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.362570:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029fd9487/0x7b044d4128f9e47a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x5b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a0c expref: 77 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.362617:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000029fd9487/0x7b044d4128f9e47a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x5b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a0c expref: 77 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938447.362631:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68a8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22955:1871643350900992:192.168.202.54@tcp:105: 00000100:00100000:3.0:1784938447.362738:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485cc9900 going to sleep for 11 seconds 00010000:00010000:2.0:1784938447.363606:0:25722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e473 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x5b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664a05 expref: 77 pid: 25728 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938447.363626:0:25722:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25722:1871643350900864:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938447.363658:0:25722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000029fd9487/0x7b044d4128f9e47a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664a0c expref: 76 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.363675:0:25722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d00200, rc 0) 00000100:00100000:2.0:1784938447.363726:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+76:17112:x1871643337541760:12345-192.168.202.54@tcp:101:cp.0 Request processed in 5810us (5968us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938447.363736:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 919 00000100:00100000:3.0:1784938447.367786:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68a8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22955:1871643350900992:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938447.367819:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938447.367892:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24a6e62050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+75:10957:x1871643337541888:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 5440us (5770us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938447.367903:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 458 00000100:00100000:3.0:1784938447.369810:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938447.369967:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337542144 00000100:00100000:1.0:1784938447.369978:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337542144 00000100:00100000:1.0:1784938447.370054:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 152 00000100:00100000:1.0:1784938447.370064:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+213:17112:x1871643337542144:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:1.0:1784938447.370409:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+214:17112:x1871643337542144:12345-192.168.202.54@tcp:35:cp.0 Request processed in 345us (608us total) trans 8589934789 rc 0/0 00000100:00100000:1.0:1784938447.370417:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 152 00000100:00100000:0.0:1784938447.374597:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.374735:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337542272 00000100:00100000:2.0:1784938447.374748:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337542272 00000100:00100000:2.0:1784938447.374833:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 652 00000100:00100000:2.0:1784938447.374844:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+214:17112:x1871643337542272:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938447.374889:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938447.374916:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01400/0x7b044d4128f9e481 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664a13 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.374983:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01000/0x7b044d4128f9e488 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.374997:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01000/0x7b044d4128f9e488 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.375009:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01000/0x7b044d4128f9e488 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.375025:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e48f lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x21aa2247 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.375032:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e48f lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.375039:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e48f lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.375083:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01000/0x7b044d4128f9e488 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.375090:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01000/0x7b044d4128f9e488 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.375096:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01000/0x7b044d4128f9e488 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.375102:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d01000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938447.375107:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01000/0x7b044d4128f9e488 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.375115:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01000/0x7b044d4128f9e488 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.375139:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938447.375184:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.375190:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01000/0x7b044d4128f9e488 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.375195:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01000/0x7b044d4128f9e488 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.375209:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e48f lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.375216:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e48f lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.375222:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e48f lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.375228:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d00600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938447.375231:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e48f lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.375237:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e48f lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.375245:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x21aa2247 (ffff9f23823dc100) 00010000:00010000:2.0:1784938447.375247:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.375250:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e48f lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.375256:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e48f lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.375306:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01400/0x7b044d4128f9e481 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a13 expref: 215 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.375319:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938447.375321:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.375324:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01400/0x7b044d4128f9e481 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a13 expref: 215 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.375333:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d01400, rc 0) 00000100:00100000:2.0:1784938447.375403:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+214:17112:x1871643337542272:12345-192.168.202.54@tcp:101:cp.0 Request processed in 558us (820us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938447.375410:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 652 00000100:00100000:2.0:1784938447.378469:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.379389:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337542400 00000100:00100000:3.0:1784938447.379402:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337542400 00000100:00100000:3.0:1784938447.379477:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 653 00000100:00100000:3.0:1784938447.379489:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+214:17112:x1871643337542400:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938447.379512:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938447.379532:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e496 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664a1a expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.379594:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a000/0x7b044d4128f9e49d lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.379609:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a000/0x7b044d4128f9e49d lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.379619:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a000/0x7b044d4128f9e49d lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.379634:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ac00/0x7b044d4128f9e4a4 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x21aa2247 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.379640:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ac00/0x7b044d4128f9e4a4 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.379646:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ac00/0x7b044d4128f9e4a4 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.379685:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a000/0x7b044d4128f9e49d lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.379693:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a000/0x7b044d4128f9e49d lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.379699:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a000/0x7b044d4128f9e49d lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.379706:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61a000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938447.379709:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a000/0x7b044d4128f9e49d lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.379716:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a000/0x7b044d4128f9e49d lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.379729:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938447.379732:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.379736:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a000/0x7b044d4128f9e49d lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.379741:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a000/0x7b044d4128f9e49d lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.379753:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ac00/0x7b044d4128f9e4a4 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.379758:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ac00/0x7b044d4128f9e4a4 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.379763:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ac00/0x7b044d4128f9e4a4 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.379768:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61ac00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938447.379770:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ac00/0x7b044d4128f9e4a4 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.379777:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ac00/0x7b044d4128f9e4a4 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.379784:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x21aa2247 (ffff9f249863b800) 00010000:00010000:3.0:1784938447.379786:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.379789:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ac00/0x7b044d4128f9e4a4 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.379795:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ac00/0x7b044d4128f9e4a4 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.379826:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e496 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a1a expref: 215 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.379836:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938447.379838:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.379840:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e496 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a1a expref: 215 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.379848:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61a200, rc 0) 00000100:00100000:3.0:1784938447.379911:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+214:17112:x1871643337542400:12345-192.168.202.54@tcp:101:cp.0 Request processed in 425us (1454us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938447.379918:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 653 00000100:00100000:3.0:1784938447.383813:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938447.383951:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337542656 00000100:00100000:1.0:1784938447.383964:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337542656 00000100:00100000:1.0:1784938447.384055:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 654 00000100:00100000:1.0:1784938447.384067:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+214:17112:x1871643337542656:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938447.384096:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938447.384119:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e4ab lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664a21 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.384252:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc200/0x7b044d4128f9e4b2 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.384268:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc200/0x7b044d4128f9e4b2 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.384280:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc200/0x7b044d4128f9e4b2 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.384304:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc600/0x7b044d4128f9e4b9 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x21aa2247 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.384311:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc600/0x7b044d4128f9e4b9 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.384318:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc600/0x7b044d4128f9e4b9 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938447.384656:0:24203:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x5b:0x0], index 0: 0 00010000:00010000:1.0:1784938447.384798:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd000/0x7b044d4128f9e4c0 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.384808:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd000/0x7b044d4128f9e4c0 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.384815:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd000/0x7b044d4128f9e4c0 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.384874:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc200/0x7b044d4128f9e4b2 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.384882:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc200/0x7b044d4128f9e4b2 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.384889:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc200/0x7b044d4128f9e4b2 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.384896:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fc200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938447.384901:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc200/0x7b044d4128f9e4b2 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.384910:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc200/0x7b044d4128f9e4b2 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.384924:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938447.384927:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938447.384932:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc200/0x7b044d4128f9e4b2 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.384938:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc200/0x7b044d4128f9e4b2 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938447.384951:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c13df235 reply state 00000000ccc1f7cf transno 8589934790 ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc600/0x7b044d4128f9e4b9 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.384962:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc600/0x7b044d4128f9e4b9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.384968:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x21aa2247 (ffff9f24b67c7600) 00010000:00010000:1.0:1784938447.384970:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938447.384973:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938447.385003:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e4ab lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a21 expref: 217 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.385018:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd000/0x7b044d4128f9e4c0 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a21 expref: 216 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.385031:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x35:0x0].0x0 (ffff9f24b67c7000) 00010000:00010000:1.0:1784938447.385033:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938447.385036:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fd000, rc 0) 00000100:00100000:1.0:1784938447.385120:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+217:17112:x1871643337542656:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1054us (1315us total) trans 8589934790 rc 0/0 00000100:00100000:1.0:1784938447.385128:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 654 00000100:00100000:1.0:1784938447.389671:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.389749:0:25730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337542784 00000100:00100000:3.0:1784938447.389761:0:25730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337542784 00000100:00100000:3.0:1784938447.389828:0:25730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 920 00000100:00100000:3.0:1784938447.389838:0:25730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:7ea6e988-18ba-4c98-b179-17995571b98b+72:10959:x1871643337542784:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938447.389872:0:25730:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938447.389899:0:25730:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b04cfea/0x7b044d4128f9e4ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664a28 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938447.389927:0:25730:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938447.389948:0:25730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5b:0x0].0x0 since=713s v=(0 0) 00010000:00010000:3.0:1784938447.389952:0:25730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938447.389963:0:25730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b04cfea/0x7b044d4128f9e4ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a28 expref: 73 pid: 25730 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.389981:0:25730:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006b04cfea/0x7b044d4128f9e4ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a28 expref: 73 pid: 25730 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.390007:0:25730:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61b200, rc 0) 00000100:00100000:3.0:1784938447.390078:0:25730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:7ea6e988-18ba-4c98-b179-17995571b98b+73:10959:x1871643337542784:12345-192.168.202.54@tcp:101:cp.0 Request processed in 241us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938447.390085:0:25730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 920 00000100:00100000:3.0:1784938447.393172:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.397723:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337542912 00000100:00100000:0.0:1784938447.397740:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337542912 00000100:00100000:0.0:1784938447.397800:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 921 00000100:00100000:0.0:1784938447.397810:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+73:17112:x1871643337542912:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938447.397828:0:21149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938447.397850:0:21149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c72994c/0x7b044d4128f9e4d5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664a2f expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.397895:0:21149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006b04cfea/0x7b044d4128f9e4ce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a28 expref: 74 pid: 25730 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.397905:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938447.397909:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938447.397915:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c72994c/0x7b044d4128f9e4d5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a2f expref: 74 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.397956:0:21149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006b04cfea/0x7b044d4128f9e4ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664a28 expref: 74 pid: 25730 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.397970:0:21149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006b04cfea/0x7b044d4128f9e4ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664a28 expref: 74 pid: 25730 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938447.397996:0:21149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d4e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:21149:1871643350901120:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938447.398083:0:21149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbee40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938447.404207:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938447.405845:0:19219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337543040 00000100:00100000:0.0:1784938447.406111:0:21149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d4e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:21149:1871643350901120:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938447.406178:0:21149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007c72994c/0x7b044d4128f9e4d5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664a2f expref: 74 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.406200:0:21149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382395400, rc 0) 00000100:00100000:0.0:1784938447.406275:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+74:17112:x1871643337542912:12345-192.168.202.54@tcp:101:cp.0 Request processed in 8466us (13151us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938447.406284:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 921 00000100:00100000:1.0:1784938447.407764:0:19219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337543040 00010000:00010000:1.0:1784938447.407814:0:19219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006b04cfea/0x7b044d4128f9e4ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664a28 expref: 74 pid: 25730 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938447.407876:0:19219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 459 00000100:00100000:1.0:1784938447.407885:0:19219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+74:10960:x1871643337543040:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938447.407901:0:19219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938447.407924:0:19219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006b04cfea/0x7b044d4128f9e4ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664a28 expref: 74 pid: 25730 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.407937:0:19219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006b04cfea/0x7b044d4128f9e4ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664a28 expref: 74 pid: 25730 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.407960:0:19219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b04cfea/0x7b044d4128f9e4ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664a28 expref: 74 pid: 25730 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.407981:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938447.408740:0:19219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938447.408756:0:19219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007c72994c/0x7b044d4128f9e4d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664a2f expref: 73 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.408767:0:19219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c72994c/0x7b044d4128f9e4d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664a2f expref: 73 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.408810:0:19219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007c72994c/0x7b044d4128f9e4d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664a2f expref: 73 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938447.408827:0:19219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350901248:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938447.410427:0:19219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24870c36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938447.417677:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.417709:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337543296 00000100:00100000:3.0:1784938447.417720:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337543296 00000100:00100000:3.0:1784938447.417777:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 153 00000100:00100000:3.0:1784938447.417788:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24857fd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+217:17112:x1871643337543296:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938447.418237:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24857fd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+218:17112:x1871643337543296:12345-192.168.202.54@tcp:35:cp.0 Request processed in 449us (571us total) trans 8589934791 rc 0/0 00000100:00100000:3.0:1784938447.418246:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 153 00000100:00100000:0.0:1784938447.422343:0:19219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:19219:1871643350901248:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938447.422373:0:19219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938447.422456:0:19219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ea6e988-18ba-4c98-b179-17995571b98b+73:10960:x1871643337543040:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 14557us (18243us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938447.422468:0:19219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 459 00000001:00080000:3.0:1784938447.434254:0:24936:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934791 is committed 00000020:00080000:3.0:1784938447.434448:0:24936:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9f2482d95540 refcount 2 committed 0 result 0 batchid 4294967465 00000020:00080000:3.0:1784938447.434454:0:24936:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9f24b8ea5a00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9f2482d95000 00000020:00080000:3.0:1784938447.434458:0:24936:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000bd1:0x1:0x0].2 00000020:00080000:3.0:1784938447.434461:0:24936:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9f24b8ea5300 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f238c518c00 00000020:00080000:3.0:1784938447.434463:0:24936:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000bd0:0x1:0x0].2 00000020:00080000:3.0:1784938447.434477:0:24936:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 4294967464 batchid updated 00000004:00080000:3.0:1784938447.434483:0:24936:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 4 committed 00010000:00010000:0.0:1784938447.434828:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27da00/0x7b044d4128f9d20c lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.434846:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27da00/0x7b044d4128f9d20c lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.434863:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27da00/0x7b044d4128f9d20c lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.434870:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27da00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.434875:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27da00/0x7b044d4128f9d20c lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.434882:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27da00/0x7b044d4128f9d20c lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.434900:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938447.434903:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.434909:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27da00/0x7b044d4128f9d20c lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.434915:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27da00/0x7b044d4128f9d20c lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.434936:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f9d26e lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.434942:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f9d26e lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.434948:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f9d26e lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.434953:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c559200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.434956:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f9d26e lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.434962:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f9d26e lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.434969:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x45c0cf9c (ffff9f24898dd300) 00010000:00010000:0.0:1784938447.434972:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.434975:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f9d26e lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.434981:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f9d26e lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435074:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9d2f3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435081:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9d2f3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435087:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9d2f3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435091:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a6a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.435094:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9d2f3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435100:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9d2f3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435108:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x56569231 (ffff9f2382049400) 00010000:00010000:0.0:1784938447.435110:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.435114:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9d2f3 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435120:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9d2f3 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435136:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d200/0x7b044d4128f9d34e lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435142:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d200/0x7b044d4128f9d34e lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435173:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d200/0x7b044d4128f9d34e lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435178:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27d200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.435181:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d200/0x7b044d4128f9d34e lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435187:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d200/0x7b044d4128f9d34e lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435194:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xa6e7eec (ffff9f248fb8ff00) 00010000:00010000:0.0:1784938447.435196:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.435199:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d200/0x7b044d4128f9d34e lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435206:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d200/0x7b044d4128f9d34e lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435221:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b800/0x7b044d4128f9d3a9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435232:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b800/0x7b044d4128f9d3a9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435237:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b800/0x7b044d4128f9d3a9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435242:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17b800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.435245:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b800/0x7b044d4128f9d3a9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435251:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b800/0x7b044d4128f9d3a9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435258:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xe6b34bd0 (ffff9f2382049000) 00010000:00010000:0.0:1784938447.435261:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.435263:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b800/0x7b044d4128f9d3a9 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435268:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b800/0x7b044d4128f9d3a9 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435282:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35a00/0x7b044d4128f9d404 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435288:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35a00/0x7b044d4128f9d404 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435303:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35a00/0x7b044d4128f9d404 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435309:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.435312:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35a00/0x7b044d4128f9d404 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435318:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35a00/0x7b044d4128f9d404 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435324:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x9ca112ae (ffff9f24898e0900) 00010000:00010000:0.0:1784938447.435326:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.435329:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35a00/0x7b044d4128f9d404 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435334:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35a00/0x7b044d4128f9d404 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435350:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d45f lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435357:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d45f lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435363:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d45f lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435369:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b34a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.435372:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d45f lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435378:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d45f lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435385:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x9fe9a331 (ffff9f248fb6f400) 00010000:00010000:0.0:1784938447.435388:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.435391:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d45f lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435396:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34a00/0x7b044d4128f9d45f lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435412:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9d4ba lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435419:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9d4ba lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435424:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9d4ba lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435429:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c558800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.435432:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9d4ba lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435438:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9d4ba lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435447:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x151c8ac3 (ffff9f24898ddf00) 00010000:00010000:0.0:1784938447.435449:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.435451:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9d4ba lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435458:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9d4ba lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435472:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27c000/0x7b044d4128f9d515 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435484:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27c000/0x7b044d4128f9d515 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435490:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27c000/0x7b044d4128f9d515 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435496:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27c000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.435498:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27c000/0x7b044d4128f9d515 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435504:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27c000/0x7b044d4128f9d515 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435511:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x15c8a56e (ffff9f248fb8fd00) 00010000:00010000:0.0:1784938447.435513:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.435515:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27c000/0x7b044d4128f9d515 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435520:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27c000/0x7b044d4128f9d515 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435534:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf0600/0x7b044d4128f9d570 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435540:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf0600/0x7b044d4128f9d570 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435546:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf0600/0x7b044d4128f9d570 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435551:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf0600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.435554:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf0600/0x7b044d4128f9d570 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435560:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf0600/0x7b044d4128f9d570 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435567:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xe7eb4718 (ffff9f248fb8f700) 00010000:00010000:0.0:1784938447.435570:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.435573:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf0600/0x7b044d4128f9d570 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435578:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf0600/0x7b044d4128f9d570 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435593:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9d5cb lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435599:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9d5cb lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435605:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9d5cb lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435610:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c559400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.435613:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9d5cb lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435619:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9d5cb lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435626:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x48840fb6 (ffff9f24898ddb00) 00010000:00010000:0.0:1784938447.435628:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.435631:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9d5cb lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435636:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9d5cb lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435649:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245c00/0x7b044d4128f9d626 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435655:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245c00/0x7b044d4128f9d626 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435660:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245c00/0x7b044d4128f9d626 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435665:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.435667:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245c00/0x7b044d4128f9d626 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435673:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245c00/0x7b044d4128f9d626 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435679:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x48e4a31f (ffff9f238dcb3a00) 00010000:00010000:0.0:1784938447.435682:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.435684:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245c00/0x7b044d4128f9d626 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435689:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245c00/0x7b044d4128f9d626 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435700:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9d681 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435710:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9d681 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435716:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9d681 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435721:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17b600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.435723:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9d681 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435729:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9d681 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435736:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xbf79d746 (ffff9f2382049c00) 00010000:00010000:0.0:1784938447.435738:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.435741:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9d681 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435748:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9d681 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435763:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f9d6dc lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435768:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f9d6dc lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435774:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f9d6dc lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435779:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3f600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.435782:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f9d6dc lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435789:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f9d6dc lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435796:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xb34b709f (ffff9f2382049100) 00010000:00010000:0.0:1784938447.435799:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.435801:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f9d6dc lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435807:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f9d6dc lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435821:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d737 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435828:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d737 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435834:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d737 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435840:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d27dc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.435842:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d737 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435849:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d737 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435857:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x9b815f19 (ffff9f238dcb3300) 00010000:00010000:0.0:1784938447.435859:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.435862:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d737 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435867:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27dc00/0x7b044d4128f9d737 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435880:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9d792 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435886:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9d792 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435892:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9d792 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435896:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3ea00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.435899:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9d792 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435905:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9d792 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435912:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xe9fa0db8 (ffff9f2382048400) 00010000:00010000:0.0:1784938447.435914:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.435917:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9d792 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435922:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9d792 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435935:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d7ed lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435945:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d7ed lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435949:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d7ed lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435954:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.435957:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d7ed lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435963:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d7ed lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435971:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xc025ca7 (ffff9f238dcb3700) 00010000:00010000:0.0:1784938447.435973:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.435976:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d7ed lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.435982:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9d7ed lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.436917:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9d848 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.436925:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9d848 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.436931:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9d848 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.436937:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3f200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.436942:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9d848 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.436948:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9d848 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.436957:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xecc4f14 (ffff9f2382048600) 00010000:00010000:0.0:1784938447.436960:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.436962:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9d848 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.436967:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9d848 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.436981:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39000/0x7b044d4128f9d8a3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437062:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39000/0x7b044d4128f9d8a3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437067:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39000/0x7b044d4128f9d8a3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437072:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.437075:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39000/0x7b044d4128f9d8a3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437082:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39000/0x7b044d4128f9d8a3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437091:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x712be7d1 (ffff9f24898dda00) 00010000:00010000:0.0:1784938447.437094:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.437097:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39000/0x7b044d4128f9d8a3 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437103:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39000/0x7b044d4128f9d8a3 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437123:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d8fe lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437140:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d8fe lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437161:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d8fe lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437167:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3e800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.437170:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d8fe lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437176:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d8fe lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437185:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x4ee593e6 (ffff9f2382048c00) 00010000:00010000:0.0:1784938447.437188:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.437192:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d8fe lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437198:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9d8fe lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437217:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9d959 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437227:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9d959 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437233:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9d959 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437238:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3c600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.437240:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9d959 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437245:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9d959 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437252:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xf0a46efb (ffff9f248fb6f700) 00010000:00010000:0.0:1784938447.437255:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.437257:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9d959 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437263:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9d959 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437279:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9d9b4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437285:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9d9b4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437299:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9d9b4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437305:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c7600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.437309:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9d9b4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437315:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9d9b4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437322:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x267dbf88 (ffff9f238dcb3200) 00010000:00010000:0.0:1784938447.437324:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.437327:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9d9b4 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437332:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9d9b4 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437348:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9da0f lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437355:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9da0f lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437360:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9da0f lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437365:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3cc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.437368:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9da0f lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437373:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9da0f lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437380:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xd946e4d2 (ffff9f248fb6fe00) 00010000:00010000:0.0:1784938447.437383:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.437386:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9da0f lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437391:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9da0f lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437404:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9da6a lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437410:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9da6a lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437416:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9da6a lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437422:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.437425:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9da6a lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437431:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9da6a lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437437:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x7584afcd (ffff9f248fb6f500) 00010000:00010000:0.0:1784938447.437440:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.437442:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9da6a lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437448:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9da6a lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437462:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f9dac5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437472:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f9dac5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437477:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f9dac5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437482:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db38000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.437485:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f9dac5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437491:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f9dac5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437498:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xf4c8ca43 (ffff9f24898ddc00) 00010000:00010000:0.0:1784938447.437500:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.437503:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f9dac5 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437508:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f9dac5 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437524:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9db20 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437530:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9db20 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437536:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9db20 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437541:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24d000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.437545:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9db20 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437551:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9db20 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437558:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x130bf32a (ffff9f248fb6e500) 00010000:00010000:0.0:1784938447.437560:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.437563:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9db20 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437569:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9db20 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437582:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9db7b lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437588:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9db7b lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437593:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9db7b lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437598:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3ec00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.437601:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9db7b lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437606:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9db7b lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437612:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xe00215d9 (ffff9f23823dda00) 00010000:00010000:0.0:1784938447.437614:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.437617:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9db7b lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437623:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9db7b lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437637:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9dbd6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437644:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9dbd6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437650:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9dbd6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437655:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c7e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.437658:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9dbd6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437664:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9dbd6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437671:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x868dff87 (ffff9f2484afd200) 00010000:00010000:0.0:1784938447.437674:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.437676:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9dbd6 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437682:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9dbd6 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437695:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9dc31 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437706:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9dc31 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437711:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9dc31 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437716:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c6400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.437719:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9dc31 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437725:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9dc31 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437732:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x39c3d8fe (ffff9f2484afd700) 00010000:00010000:0.0:1784938447.437734:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.437736:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9dc31 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437741:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9dc31 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437754:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fe600/0x7b044d4128f9dc8c lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437760:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fe600/0x7b044d4128f9dc8c lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437766:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fe600/0x7b044d4128f9dc8c lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437770:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fe600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.437774:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fe600/0x7b044d4128f9dc8c lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437780:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fe600/0x7b044d4128f9dc8c lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437787:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x5b30f298 (ffff9f23823ddc00) 00010000:00010000:0.0:1784938447.437790:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.437792:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fe600/0x7b044d4128f9dc8c lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437798:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fe600/0x7b044d4128f9dc8c lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437812:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9dce7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437818:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9dce7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437824:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9dce7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437829:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5da000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.437831:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9dce7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437838:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9dce7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437846:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x2893e4db (ffff9f2484afdc00) 00010000:00010000:0.0:1784938447.437848:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.437851:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9dce7 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437857:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9dce7 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437870:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dd42 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437876:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dd42 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437882:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dd42 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437886:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fec00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.437889:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dd42 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437895:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dd42 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437902:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x49aa722d (ffff9f23823ddf00) 00010000:00010000:0.0:1784938447.437904:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.437907:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dd42 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437913:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9dd42 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437927:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9dd9d lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437937:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9dd9d lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437943:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9dd9d lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437948:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5da400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.437951:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9dd9d lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437956:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9dd9d lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437964:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x4c7a76ee (ffff9f23861f8000) 00010000:00010000:0.0:1784938447.437966:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.437969:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9dd9d lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.437975:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9dd9d lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1784938447.438141:0:24957:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4294967465 committed batchid 4294967464 00000004:00080000:2.0:1784938447.438308:0:24957:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9f238eb34540 with version 9 00000020:00080000:2.0:1784938447.438320:0:24957:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4294967464 cancel update log [0x200000bd1:0x1:0x0].1: rc = 0 00000020:00080000:2.0:1784938447.438363:0:24957:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4294967464 cancel update log [0x240000bd0:0x1:0x0].1: rc = 0 00000020:00080000:2.0:1784938447.438370:0:24957:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294967464 00000004:00080000:2.0:1784938447.438382:0:24942:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9f238ec48000 version 9 rpc_version 9 00000020:00100000:2.0:1784938447.438414:0:24942:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1784938447.438425:0:24942:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9f238f22ea00 x1871643350901504/t0(0) o1000->lustre-MDT0000-osp-MDT0001@192.168.202.154@tcp:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784938447.438447:0:24942:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22ea00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:24942:1871643350901504:192.168.202.154@tcp:1000:osp_up0-1.0 00000100:00100000:2.0:1784938447.438529:0:24942:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24917e7780 going to sleep for 11 seconds 00000100:00100000:2.0:1784938447.438697:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938447.439324:0:21161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350901504 00000100:00100000:1.0:1784938447.439333:0:21161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350901504 00000100:00100000:1.0:1784938447.439396:0:21161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 79 00000100:00100000:1.0:1784938447.439406:0:21161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:24942:x1871643350901504:12345-192.168.202.154@tcp:1000:osp_up0-1.0 00000100:00100000:1.0:1784938447.439559:0:21161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:24942:x1871643350901504:12345-192.168.202.154@tcp:1000:osp_up0-1.0 Request processed in 153us (862us total) trans 8589934864 rc 0/0 00000100:00100000:1.0:1784938447.439567:0:21161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 79 00010000:00010000:0.0:1784938447.441110:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9ddf8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441138:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9ddf8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441158:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9ddf8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441166:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382038c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.441171:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9ddf8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441180:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9ddf8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441196:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x610aa076 (ffff9f248fb6ad00) 00010000:00010000:0.0:1784938447.441199:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.441205:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9ddf8 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441211:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9ddf8 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441232:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da800/0x7b044d4128f9de53 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441239:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da800/0x7b044d4128f9de53 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441245:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da800/0x7b044d4128f9de53 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441251:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5da800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.441253:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da800/0x7b044d4128f9de53 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441259:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da800/0x7b044d4128f9de53 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441267:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x72a71b3d (ffff9f23861f8800) 00010000:00010000:0.0:1784938447.441270:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.441273:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da800/0x7b044d4128f9de53 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441279:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da800/0x7b044d4128f9de53 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441304:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f9deae lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441312:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f9deae lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441317:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f9deae lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441322:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b29800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.441324:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f9deae lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441330:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f9deae lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441338:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xa9dd9870 (ffff9f2496483c00) 00010000:00010000:0.0:1784938447.441340:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.441344:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f9deae lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441350:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f9deae lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441368:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9df09 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441378:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9df09 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441384:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9df09 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441389:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24cc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.441392:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9df09 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441397:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9df09 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441405:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x839e9634 (ffff9f23823e0200) 00010000:00010000:0.0:1784938447.441407:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.441409:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9df09 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441414:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9df09 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441430:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9df64 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441436:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9df64 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441441:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9df64 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441446:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b29a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.441450:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9df64 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441457:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9df64 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441464:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x9e90f16b (ffff9f23823e0000) 00010000:00010000:0.0:1784938447.441466:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.441469:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9df64 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441475:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9df64 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441489:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217de00/0x7b044d4128f9dfbf lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441495:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217de00/0x7b044d4128f9dfbf lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441501:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217de00/0x7b044d4128f9dfbf lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441506:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217de00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.441509:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217de00/0x7b044d4128f9dfbf lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441514:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217de00/0x7b044d4128f9dfbf lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441521:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x10fe8da8 (ffff9f23823e0400) 00010000:00010000:0.0:1784938447.441525:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.441528:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217de00/0x7b044d4128f9dfbf lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441534:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217de00/0x7b044d4128f9dfbf lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441548:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65400/0x7b044d4128f9e01a lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441555:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65400/0x7b044d4128f9e01a lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441561:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65400/0x7b044d4128f9e01a lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441566:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dc65400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.441568:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65400/0x7b044d4128f9e01a lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441574:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65400/0x7b044d4128f9e01a lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441583:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x6b7bd7c (ffff9f23861f8c00) 00010000:00010000:0.0:1784938447.441585:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.441587:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65400/0x7b044d4128f9e01a lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441593:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dc65400/0x7b044d4128f9e01a lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441607:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9e075 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441616:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9e075 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441622:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9e075 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441627:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5da600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.441630:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9e075 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441636:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9e075 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441642:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x37dcc2d3 (ffff9f23861f8500) 00010000:00010000:0.0:1784938447.441645:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.441647:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9e075 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441653:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9e075 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441668:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e0d0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441674:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e0d0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441679:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e0d0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441684:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61a400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.441688:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e0d0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441694:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e0d0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441701:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xa4bfea24 (ffff9f249863b100) 00010000:00010000:0.0:1784938447.441703:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.441706:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e0d0 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441711:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e0d0 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441726:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e12b lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441732:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e12b lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441738:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e12b lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441743:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61b600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.441746:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e12b lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441751:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e12b lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441759:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xc2bba7e5 (ffff9f249863b000) 00010000:00010000:0.0:1784938447.441761:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.441764:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e12b lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441769:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e12b lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441784:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01e00/0x7b044d4128f9e186 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441790:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01e00/0x7b044d4128f9e186 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441796:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01e00/0x7b044d4128f9e186 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441801:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d01e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.441804:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01e00/0x7b044d4128f9e186 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441810:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01e00/0x7b044d4128f9e186 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441817:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x2fbacb41 (ffff9f248fb6a700) 00010000:00010000:0.0:1784938447.441820:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.441823:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01e00/0x7b044d4128f9e186 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441828:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01e00/0x7b044d4128f9e186 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441846:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e1e1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441855:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e1e1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441861:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e1e1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441866:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217ce00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.441868:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e1e1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441874:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e1e1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441882:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xff118af2 (ffff9f238d49e500) 00010000:00010000:0.0:1784938447.441884:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.441886:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e1e1 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441891:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217ce00/0x7b044d4128f9e1e1 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441905:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9e23c lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441911:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9e23c lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441916:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9e23c lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441920:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b29c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.441923:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9e23c lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441929:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9e23c lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441935:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xb2d5a33e (ffff9f238727c300) 00010000:00010000:0.0:1784938447.441938:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.441940:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9e23c lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441945:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9e23c lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441959:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394a00/0x7b044d4128f9e297 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441966:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394a00/0x7b044d4128f9e297 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441971:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394a00/0x7b044d4128f9e297 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.441976:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.441978:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394a00/0x7b044d4128f9e297 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938447.442410:0:24942:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22ea00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:24942:1871643350901504:192.168.202.154@tcp:1000:osp_up0-1.0 00000100:00100000:2.0:1784938447.443518:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350901632:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:2.0:1784938447.443619:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d3ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350902144:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:2.0:1784938447.443656:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784938447.443664:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350901760:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:2.0:1784938447.443684:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d3ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350902272:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:2.0:1784938447.443727:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350901888:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:2.0:1784938447.443754:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784938447.443759:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d3ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350902016:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:2.0:1784938447.443971:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938447.444135:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938447.444228:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938447.444249:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938447.444271:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938447.444303:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938447.444329:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350902272 00000100:00100000:2.0:1784938447.444336:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350902272 00000100:00100000:2.0:1784938447.444386:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350901632 00000100:00100000:2.0:1784938447.444390:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350901632 00000100:00100000:2.0:1784938447.444408:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350902016 00000100:00100000:2.0:1784938447.444411:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350902016 00000100:00100000:2.0:1784938447.444428:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350902144 00000100:00100000:2.0:1784938447.444431:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350902144 00000100:00100000:2.0:1784938447.444448:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350901760 00000100:00100000:2.0:1784938447.444451:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350901760 00000100:00100000:2.0:1784938447.444467:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350901888 00000100:00100000:2.0:1784938447.444470:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350901888 00000100:00100000:2.0:1784938447.444495:0:25720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 922 00000100:00100000:2.0:1784938447.444505:0:25720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d3af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+14:16391:x1871643350902272:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00002000:00080000:2.0:1784938447.444546:0:25720:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:32 count 1 00010000:00010000:2.0:1784938447.444578:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000146b94b7/0x7b044d4128f9e4dc lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.444601:0:25720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000331fa39b/0x7b044d4128f98f3f lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663257 expref: 74 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.444611:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=10s v=(0 0) 00010000:00010000:2.0:1784938447.444615:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.444620:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000146b94b7/0x7b044d4128f9e4dc lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.444650:0:25720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000331fa39b/0x7b044d4128f98f3f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663257 expref: 74 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.444664:0:25720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000331fa39b/0x7b044d4128f98f3f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663257 expref: 74 pid: 21151 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938447.444676:0:25720:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:25720:1871643350902400:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938447.444720:0:25720:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24917e7780 going to sleep for 11 seconds 00000100:00100000:2.0:1784938447.444737:0:25723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 923 00000100:00100000:2.0:1784938447.444744:0:25723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d3ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+14:16391:x1871643350901632:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00002000:00080000:2.0:1784938447.444755:0:25723:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:35 count 1 00010000:00010000:2.0:1784938447.444765:0:25723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ee67308/0x7b044d4128f9e4e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.444776:0:25723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003b1e04e7/0x7b044d4128f99494 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663306 expref: 74 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.444782:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x23:0x0].0x0 since=9s v=(0 0) 00010000:00010000:2.0:1784938447.444786:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.444789:0:25723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ee67308/0x7b044d4128f9e4e3 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.444804:0:25723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003b1e04e7/0x7b044d4128f99494 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663306 expref: 74 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.444819:0:25723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003b1e04e7/0x7b044d4128f99494 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663306 expref: 74 pid: 21151 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938447.444828:0:25723:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:25723:1871643350902528:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938447.444846:0:25723:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24917e7480 going to sleep for 11 seconds 00000100:00100000:2.0:1784938447.444861:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 924 00000100:00100000:2.0:1784938447.444867:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d3aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+14:16389:x1871643350902016:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00002000:00080000:2.0:1784938447.444877:0:25715:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:20 count 1 00010000:00010000:2.0:1784938447.444886:0:25715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b91bb11/0x7b044d4128f9e4ea lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.444897:0:25715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb88e185/0x7b044d4128f99590 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476633a0 expref: 74 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.444904:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x14:0x0].0x0 since=9s v=(0 0) 00010000:00010000:2.0:1784938447.444907:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.444910:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b91bb11/0x7b044d4128f9e4ea lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.444927:0:25715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb88e185/0x7b044d4128f99590 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633a0 expref: 74 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.444936:0:25715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb88e185/0x7b044d4128f99590 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633a0 expref: 74 pid: 21149 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938447.444952:0:25715:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25715:1871643350902656:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938447.444970:0:25715:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2483773cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1784938447.446481:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394a00/0x7b044d4128f9e297 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.446517:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x4958ff4 (ffff9f23872e6300) 00010000:00010000:0.0:1784938447.446520:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.446530:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394a00/0x7b044d4128f9e297 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.446538:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394a00/0x7b044d4128f9e297 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.446587:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394400/0x7b044d4128f9e2f2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.446594:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394400/0x7b044d4128f9e2f2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.446601:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394400/0x7b044d4128f9e2f2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.446607:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.446612:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394400/0x7b044d4128f9e2f2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.446622:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394400/0x7b044d4128f9e2f2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.446631:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x57ba1cca (ffff9f23872e6800) 00010000:00010000:0.0:1784938447.446634:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.446637:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394400/0x7b044d4128f9e2f2 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.446642:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394400/0x7b044d4128f9e2f2 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.446655:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e34d lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.446665:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e34d lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.446671:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e34d lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.446676:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.446678:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e34d lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.446684:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e34d lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.446691:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x407c6222 (ffff9f23872e6600) 00010000:00010000:0.0:1784938447.446694:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.446696:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e34d lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.446702:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e34d lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.446720:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394c00/0x7b044d4128f9e3a8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.446726:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394c00/0x7b044d4128f9e3a8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.446731:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394c00/0x7b044d4128f9e3a8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.446736:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.446739:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394c00/0x7b044d4128f9e3a8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.446744:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394c00/0x7b044d4128f9e3a8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.446751:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x239dea14 (ffff9f24898dc300) 00010000:00010000:0.0:1784938447.446754:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.446757:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394c00/0x7b044d4128f9e3a8 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.446762:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394c00/0x7b044d4128f9e3a8 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.446776:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e403 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.446782:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e403 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.446788:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e403 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.446793:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fd400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.446796:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e403 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.446802:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e403 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.446810:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x130f79e0 (ffff9f24b67c7c00) 00010000:00010000:0.0:1784938447.446813:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.446816:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e403 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.446822:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e403 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.446841:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e45e lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.446847:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e45e lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938447.446979:0:25719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 925 00000100:00100000:2.0:1784938447.447120:0:25719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d3adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+14:16391:x1871643350902144:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00002000:00080000:2.0:1784938447.447175:0:25719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:15 count 1 00010000:00010000:2.0:1784938447.447203:0:25719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d240bc4f/0x7b044d4128f9e4f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.447222:0:25719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f40e0824/0x7b044d4128f99582 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476633a7 expref: 74 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.447232:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xf:0x0].0x0 since=9s v=(0 0) 00010000:00010000:2.0:1784938447.447235:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.447240:0:25719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d240bc4f/0x7b044d4128f9e4f1 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.447275:0:25719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f40e0824/0x7b044d4128f99582 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633a7 expref: 74 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.447301:0:25719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f40e0824/0x7b044d4128f99582 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633a7 expref: 74 pid: 21151 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938447.447315:0:25719:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:25719:1871643350902784:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938447.447403:0:25719:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b672a180 going to sleep for 11 seconds 00010000:00010000:0.0:1784938447.450762:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e45e lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.450774:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382395200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.450779:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e45e lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.450789:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e45e lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.450810:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xc735cef4 (ffff9f24898dc100) 00010000:00010000:0.0:1784938447.450813:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.450817:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e45e lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.450824:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e45e lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.450869:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc600/0x7b044d4128f9e4b9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.450881:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc600/0x7b044d4128f9e4b9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.450887:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc600/0x7b044d4128f9e4b9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.450892:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fc600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.450895:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc600/0x7b044d4128f9e4b9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.450901:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc600/0x7b044d4128f9e4b9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.450909:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x21aa2247 (ffff9f24b67c7600) 00010000:00010000:0.0:1784938447.450911:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.450914:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc600/0x7b044d4128f9e4b9 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.450920:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc600/0x7b044d4128f9e4b9 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938447.451787:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 926 00000100:00100000:1.0:1784938447.451807:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+14:16391:x1871643350901760:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00002000:00080000:1.0:1784938447.451842:0:21151:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:5 count 1 00010000:00010000:1.0:1784938447.451876:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4b45686/0x7b044d4128f9e4f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.451894:0:21151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001ddc35db/0x7b044d4128f9957b lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766338b expref: 74 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.451902:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=9s v=(0 0) 00010000:00010000:1.0:1784938447.451906:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938447.451910:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4b45686/0x7b044d4128f9e4f8 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.451949:0:21151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001ddc35db/0x7b044d4128f9957b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e94766338b expref: 74 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.451962:0:21151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ddc35db/0x7b044d4128f9957b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766338b expref: 74 pid: 21149 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938447.451976:0:21151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:21151:1871643350902912:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938447.452062:0:21151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2483885480 going to sleep for 11 seconds 00000100:00100000:0.0:1784938447.455963:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 927 00000100:00100000:0.0:1784938447.455987:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+14:16389:x1871643350901888:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 00002000:00080000:0.0:1784938447.456025:0:21629:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:10 count 1 00010000:00010000:0.0:1784938447.456053:0:21629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e4ff lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.456076:0:21629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000420af1ca/0x7b044d4128f99574 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663392 expref: 74 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.456091:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa:0x0].0x0 since=9s v=(0 0) 00010000:00010000:0.0:1784938447.456096:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938447.456100:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e4ff lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.456138:0:21629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000420af1ca/0x7b044d4128f99574 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.54@tcp remote: 0x571025e947663392 expref: 74 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.456175:0:21629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000420af1ca/0x7b044d4128f99574 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663392 expref: 74 pid: 21149 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938447.456191:0:21629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d4e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:21629:1871643350903040:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938447.456274:0:21629:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbee40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938447.463963:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.464067:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.464086:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.464104:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.464173:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.464214:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.464316:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.464342:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337543808 00000100:00100000:2.0:1784938447.464349:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337543808 00010000:00010000:2.0:1784938447.464389:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb88e185/0x7b044d4128f99590 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633a0 expref: 75 pid: 21149 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938447.464416:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337543552 00000100:00100000:2.0:1784938447.464419:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337543552 00010000:00010000:2.0:1784938447.464432:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000331fa39b/0x7b044d4128f98f3f lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663257 expref: 76 pid: 21151 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938447.464443:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337543680 00000100:00100000:2.0:1784938447.464445:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337543680 00010000:00010000:2.0:1784938447.464455:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003b1e04e7/0x7b044d4128f99494 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663306 expref: 77 pid: 21151 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938447.464468:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 460 00000100:00100000:2.0:1784938447.464476:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23880a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+77:10959:x1871643337543808:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938447.464491:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938447.464496:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb88e185/0x7b044d4128f99590 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633a0 expref: 77 pid: 21149 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.464510:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb88e185/0x7b044d4128f99590 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633a0 expref: 77 pid: 21149 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.464537:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.464542:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.464549:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008b91bb11/0x7b044d4128f9e4ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.464559:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b91bb11/0x7b044d4128f9e4ea lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.464579:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938447.464632:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23880a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+77:10959:x1871643337543808:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 156us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938447.464640:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 460 00000100:00100000:2.0:1784938447.464656:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337543936 00000100:00100000:2.0:1784938447.464660:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337543936 00010000:00010000:2.0:1784938447.464672:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f40e0824/0x7b044d4128f99582 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633a7 expref: 77 pid: 21151 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938447.464684:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337544064 00000100:00100000:2.0:1784938447.464687:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337544064 00010000:00010000:2.0:1784938447.464697:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001ddc35db/0x7b044d4128f9957b lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766338b expref: 78 pid: 21149 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938447.464707:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337544192 00000100:00100000:2.0:1784938447.464709:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337544192 00010000:00010000:2.0:1784938447.464720:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000420af1ca/0x7b044d4128f99574 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663392 expref: 79 pid: 21149 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938447.464733:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 461 00000100:00100000:2.0:1784938447.464738:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23880a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+79:10957:x1871643337543552:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938447.464746:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938447.464750:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000331fa39b/0x7b044d4128f98f3f lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663257 expref: 79 pid: 21151 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.464761:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000331fa39b/0x7b044d4128f98f3f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663257 expref: 79 pid: 21151 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.464774:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.464777:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.464781:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000146b94b7/0x7b044d4128f9e4dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.464789:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000146b94b7/0x7b044d4128f9e4dc lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.464801:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938447.464823:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23880a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+79:10957:x1871643337543552:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 84us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938447.464829:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 461 00000100:00100000:2.0:1784938447.464843:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 462 00000100:00100000:2.0:1784938447.464849:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f182300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+78:10957:x1871643337543680:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938447.464857:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938447.464861:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003b1e04e7/0x7b044d4128f99494 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663306 expref: 78 pid: 21151 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.464871:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003b1e04e7/0x7b044d4128f99494 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663306 expref: 78 pid: 21151 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.464883:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.464886:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.464892:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002ee67308/0x7b044d4128f9e4e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.464898:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ee67308/0x7b044d4128f9e4e3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.464911:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938447.464928:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f182300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+78:10957:x1871643337543680:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 79us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938447.464935:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 462 00000100:00100000:2.0:1784938447.464948:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 463 00000100:00100000:2.0:1784938447.464954:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f182680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+77:10959:x1871643337543936:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938447.464962:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938447.464966:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f40e0824/0x7b044d4128f99582 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633a7 expref: 77 pid: 21151 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.464980:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f40e0824/0x7b044d4128f99582 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633a7 expref: 77 pid: 21151 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.464991:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.464994:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.464997:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d240bc4f/0x7b044d4128f9e4f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.465004:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d240bc4f/0x7b044d4128f9e4f1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.465014:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938447.465030:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f182680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+77:10959:x1871643337543936:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 76us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938447.465036:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 463 00000100:00100000:2.0:1784938447.465046:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 464 00000100:00100000:2.0:1784938447.465052:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f182a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+76:10957:x1871643337544064:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938447.465059:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938447.465064:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001ddc35db/0x7b044d4128f9957b lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766338b expref: 76 pid: 21149 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.465073:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001ddc35db/0x7b044d4128f9957b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766338b expref: 76 pid: 21149 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.465089:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.465092:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.465097:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4b45686/0x7b044d4128f9e4f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.465105:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4b45686/0x7b044d4128f9e4f8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.465116:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938447.465133:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f182a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+76:10957:x1871643337544064:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 81us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938447.465139:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 464 00000100:00100000:2.0:1784938447.465179:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 465 00000100:00100000:2.0:1784938447.465187:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24a6e63050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+75:10957:x1871643337544192:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938447.465194:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938447.465198:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000420af1ca/0x7b044d4128f99574 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663392 expref: 75 pid: 21149 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.465209:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000420af1ca/0x7b044d4128f99574 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663392 expref: 75 pid: 21149 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.465221:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.465224:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.465228:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e4ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.465236:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e4ff lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.465248:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938447.465266:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24a6e63050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+75:10957:x1871643337544192:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 81us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938447.465272:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 465 00010000:00010000:2.0:1784938447.465366:0:25715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb88e185/0x7b044d4128f99590 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633a0 expref: 74 pid: 21149 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938447.465383:0:25715:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25715:1871643350902656:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938447.465403:0:25715:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008b91bb11/0x7b044d4128f9e4ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.465414:0:25715:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008b91bb11/0x7b044d4128f9e4ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.465421:0:25715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b91bb11/0x7b044d4128f9e4ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.465432:0:25715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b91bb11/0x7b044d4128f9e4ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.465441:0:25715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b91bb11/0x7b044d4128f9e4ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.465461:0:25715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784938447.465625:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d3aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+15:16389:x1871643350902016:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 20756us (21396us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1784938447.465633:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 924 00010000:00010000:2.0:1784938447.465655:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938447.465661:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b91bb11/0x7b044d4128f9e4ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.465669:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d01400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938447.465674:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b91bb11/0x7b044d4128f9e4ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.465685:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b91bb11/0x7b044d4128f9e4ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.465697:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b91bb11/0x7b044d4128f9e4ea lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.465705:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b91bb11/0x7b044d4128f9e4ea lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.465725:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938447.465728:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938447.465729:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938447.465752:0:25723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b1e04e7/0x7b044d4128f99494 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663306 expref: 73 pid: 21151 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938447.465763:0:25723:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:25723:1871643350902528:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938447.465775:0:25723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002ee67308/0x7b044d4128f9e4e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.465783:0:25723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002ee67308/0x7b044d4128f9e4e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.465789:0:25723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ee67308/0x7b044d4128f9e4e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.465797:0:25723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ee67308/0x7b044d4128f9e4e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.465803:0:25723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ee67308/0x7b044d4128f9e4e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.465818:0:25723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784938447.465893:0:25723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d3ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+15:16391:x1871643350901632:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 21149us (21769us total) trans 4294967488 rc 0/0 00000100:00100000:2.0:1784938447.465899:0:25723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 923 00010000:00010000:2.0:1784938447.465917:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938447.465921:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ee67308/0x7b044d4128f9e4e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.465934:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d01000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938447.465938:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ee67308/0x7b044d4128f9e4e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.465945:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ee67308/0x7b044d4128f9e4e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.465955:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ee67308/0x7b044d4128f9e4e3 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.465962:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ee67308/0x7b044d4128f9e4e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.465978:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938447.465980:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938447.465981:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784938447.466318:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238d3ac700/2, rc 0, transno 4294967487 00000100:00100000:2.0:1784938447.466326:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d3ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350902016:192.168.202.154@tcp:6:osp-syn-1-1.0 00000004:00080000:2.0:1784938447.466353:0:16391:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f22df80/2, rc 0, transno 4294967488 00000100:00100000:2.0:1784938447.466357:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350901632:192.168.202.154@tcp:6:osp-syn-1-1.0 00010000:00010000:2.0:1784938447.466384:0:25719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f40e0824/0x7b044d4128f99582 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e9476633a7 expref: 72 pid: 21151 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938447.466394:0:25719:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:25719:1871643350902784:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938447.466406:0:25719:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d240bc4f/0x7b044d4128f9e4f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.466415:0:25719:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d240bc4f/0x7b044d4128f9e4f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.466421:0:25719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d240bc4f/0x7b044d4128f9e4f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.466429:0:25719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d240bc4f/0x7b044d4128f9e4f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.466436:0:25719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d240bc4f/0x7b044d4128f9e4f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.466453:0:25719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784938447.466532:0:25719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d3adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+15:16391:x1871643350902144:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 19425us (22282us total) trans 4294967489 rc 0/0 00000100:00100000:2.0:1784938447.466539:0:25719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 925 00010000:00010000:2.0:1784938447.466574:0:25720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000331fa39b/0x7b044d4128f98f3f lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663257 expref: 71 pid: 21151 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938447.466584:0:25720:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:25720:1871643350902400:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938447.466596:0:25720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000146b94b7/0x7b044d4128f9e4dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.466611:0:25720:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000146b94b7/0x7b044d4128f9e4dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.466617:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000146b94b7/0x7b044d4128f9e4dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.466625:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000146b94b7/0x7b044d4128f9e4dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.466633:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000146b94b7/0x7b044d4128f9e4dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.466648:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1784938447.466710:0:25720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d3af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+15:16391:x1871643350902272:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 22206us (22740us total) trans 4294967490 rc 0/0 00000100:00100000:2.0:1784938447.466717:0:25720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 922 00000004:00080000:2.0:1784938447.466822:0:16391:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238d3ad880/2, rc 0, transno 4294967490 00000100:00100000:2.0:1784938447.466828:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d3ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350902272:192.168.202.154@tcp:6:osp-syn-1-1.0 00000004:00080000:2.0:1784938447.466836:0:16391:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238d3ad500/2, rc 0, transno 4294967489 00000100:00100000:2.0:1784938447.466840:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d3ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350902144:192.168.202.154@tcp:6:osp-syn-1-1.0 00010000:00010000:0.0:1784938447.467688:0:21629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000420af1ca/0x7b044d4128f99574 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e947663392 expref: 70 pid: 21149 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938447.467703:0:21629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d4e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:21629:1871643350903040:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938447.467722:0:21629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e4ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.467731:0:21629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e4ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.467737:0:21629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e4ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.467746:0:21629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e4ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.467752:0:21629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e4ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.467773:0:21629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1784938447.467886:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+15:16389:x1871643350901888:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 11909us (23581us total) trans 4294967491 rc 0/0 00000100:00100000:0.0:1784938447.467893:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 927 00010000:00010000:0.0:1784938447.467941:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784938447.467947:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d240bc4f/0x7b044d4128f9e4f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.467956:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d00e00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938447.467960:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d240bc4f/0x7b044d4128f9e4f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.467969:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d240bc4f/0x7b044d4128f9e4f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.467994:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d240bc4f/0x7b044d4128f9e4f1 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.468002:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d240bc4f/0x7b044d4128f9e4f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.468022:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938447.468026:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000146b94b7/0x7b044d4128f9e4dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.468032:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d00600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938447.468035:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000146b94b7/0x7b044d4128f9e4dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.468044:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000146b94b7/0x7b044d4128f9e4dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.468054:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000146b94b7/0x7b044d4128f9e4dc lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.468061:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000146b94b7/0x7b044d4128f9e4dc lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.468073:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938447.468076:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e4ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.468081:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938447.468084:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e4ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.468096:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e4ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.468104:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e4ff lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.468111:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e4ff lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.468339:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938447.468342:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938447.468344:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938447.468441:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337543424 00000100:00100000:1.0:1784938447.468451:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337543424 00000100:00100000:1.0:1784938447.468505:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 655 00000100:00100000:1.0:1784938447.468516:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+58:17112:x1871643337543424:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938447.468540:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938447.468560:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc200/0x7b044d4128f9e506 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664a36 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.468627:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fcc00/0x7b044d4128f9e50d lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.468640:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fcc00/0x7b044d4128f9e50d lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.468649:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fcc00/0x7b044d4128f9e50d lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.468662:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc800/0x7b044d4128f9e514 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xbf580d0c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.468669:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc800/0x7b044d4128f9e514 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.468675:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc800/0x7b044d4128f9e514 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.468711:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fcc00/0x7b044d4128f9e50d lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.468717:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fcc00/0x7b044d4128f9e50d lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.468722:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fcc00/0x7b044d4128f9e50d lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.468727:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fcc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938447.468730:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fcc00/0x7b044d4128f9e50d lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.468739:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fcc00/0x7b044d4128f9e50d lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.468747:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938447.468750:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938447.468753:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fcc00/0x7b044d4128f9e50d lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.468759:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fcc00/0x7b044d4128f9e50d lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.468768:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc800/0x7b044d4128f9e514 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.468773:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc800/0x7b044d4128f9e514 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.468778:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc800/0x7b044d4128f9e514 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.468783:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fc800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938447.468785:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc800/0x7b044d4128f9e514 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.468791:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc800/0x7b044d4128f9e514 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.468797:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xbf580d0c (ffff9f24b67c7200) 00010000:00010000:1.0:1784938447.468799:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938447.468802:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc800/0x7b044d4128f9e514 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.468811:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc800/0x7b044d4128f9e514 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.468841:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc200/0x7b044d4128f9e506 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a36 expref: 59 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.468850:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938447.468866:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938447.468870:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc200/0x7b044d4128f9e506 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a36 expref: 59 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.468880:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fc200, rc 0) 00000100:00100000:1.0:1784938447.468921:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+58:17112:x1871643337543424:12345-192.168.202.54@tcp:101:cp.0 Request processed in 408us (4969us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938447.468927:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 655 00010000:00010000:1.0:1784938447.468971:0:21151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ddc35db/0x7b044d4128f9957b lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.54@tcp remote: 0x571025e94766338b expref: 69 pid: 21149 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938447.468995:0:21151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:21151:1871643350902912:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938447.469016:0:21151:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c4b45686/0x7b044d4128f9e4f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.469025:0:21151:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c4b45686/0x7b044d4128f9e4f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.469033:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4b45686/0x7b044d4128f9e4f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.469042:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4b45686/0x7b044d4128f9e4f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.469049:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4b45686/0x7b044d4128f9e4f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.469065:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938447.469182:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+15:16391:x1871643350901760:12345-192.168.202.154@tcp:6:osp-syn-1-1.0 Request processed in 17383us (24909us total) trans 4294967492 rc 0/0 00000100:00100000:1.0:1784938447.469190:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 926 00010000:00010000:1.0:1784938447.469209:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938447.469214:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4b45686/0x7b044d4128f9e4f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.469221:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fca00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938447.469224:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4b45686/0x7b044d4128f9e4f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.469231:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4b45686/0x7b044d4128f9e4f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.469243:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4b45686/0x7b044d4128f9e4f8 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.469250:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4b45686/0x7b044d4128f9e4f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.469264:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938447.469265:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938447.469267:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938447.472847:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938447.472864:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784938447.476491:0:16389:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f22fb80/2, rc 0, transno 4294967491 00000100:00100000:2.0:1784938447.476508:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350901888:192.168.202.154@tcp:6:osp-syn-1-1.0 00000004:00080000:2.0:1784938447.476544:0:16391:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f238f22c000/2, rc 0, transno 4294967492 00000100:00100000:2.0:1784938447.476549:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350901760:192.168.202.154@tcp:6:osp-syn-1-1.0 00000100:00100000:0.0:1784938447.479920:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.480008:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337544320 00000100:00100000:3.0:1784938447.480018:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337544320 00000100:00100000:3.0:1784938447.480081:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 656 00000100:00100000:3.0:1784938447.480092:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+58:17112:x1871643337544320:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938447.480113:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938447.480134:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e51b lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664a3d expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.480250:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ac00/0x7b044d4128f9e522 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.480264:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ac00/0x7b044d4128f9e522 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.480274:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ac00/0x7b044d4128f9e522 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.480287:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a000/0x7b044d4128f9e529 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xbf580d0c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.480303:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a000/0x7b044d4128f9e529 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.480309:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a000/0x7b044d4128f9e529 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.480353:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ac00/0x7b044d4128f9e522 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.480360:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ac00/0x7b044d4128f9e522 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.480371:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ac00/0x7b044d4128f9e522 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.480376:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61ac00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938447.480380:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ac00/0x7b044d4128f9e522 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.480388:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ac00/0x7b044d4128f9e522 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.480400:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938447.480403:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.480408:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ac00/0x7b044d4128f9e522 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.480414:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ac00/0x7b044d4128f9e522 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.480426:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a000/0x7b044d4128f9e529 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.480433:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a000/0x7b044d4128f9e529 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.480438:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a000/0x7b044d4128f9e529 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.480443:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61a000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938447.480446:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a000/0x7b044d4128f9e529 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.480457:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a000/0x7b044d4128f9e529 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.480465:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xbf580d0c (ffff9f24975b2700) 00010000:00010000:3.0:1784938447.480467:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.480470:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a000/0x7b044d4128f9e529 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.480475:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a000/0x7b044d4128f9e529 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.480507:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e51b lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a3d expref: 59 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.480516:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938447.480518:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.480522:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e51b lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a3d expref: 59 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.480530:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61a200, rc 0) 00000100:00100000:3.0:1784938447.480596:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+58:17112:x1871643337544320:12345-192.168.202.54@tcp:101:cp.0 Request processed in 506us (685us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938447.480604:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 656 00000100:00100000:1.0:1784938447.491050:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.491370:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337544576 00000100:00100000:3.0:1784938447.491380:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337544576 00000100:00100000:3.0:1784938447.491441:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 657 00000100:00100000:3.0:1784938447.491452:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+58:17112:x1871643337544576:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938447.491476:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938447.491499:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e530 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664a44 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.491603:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9e537 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.491618:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9e537 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.491629:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9e537 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.491646:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e53e lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0xbf580d0c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.491653:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e53e lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.491660:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e53e lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938447.492141:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x5c:0x0], index 1: 0 00010000:00010000:2.0:1784938447.493081:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01600/0x7b044d4128f9e545 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.493095:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01600/0x7b044d4128f9e545 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.493104:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01600/0x7b044d4128f9e545 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.493139:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9e537 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.493176:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9e537 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.493183:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9e537 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.493189:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61ba00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938447.493192:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9e537 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.493200:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9e537 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.493212:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938447.493215:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.493220:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9e537 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.493226:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9e537 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938447.493240:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e21c8a17 reply state 0000000038ecb0b2 transno 8589934792 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e53e lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.493251:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e53e lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.493258:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xbf580d0c (ffff9f24975b2c00) 00010000:00010000:2.0:1784938447.493260:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938447.493263:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938447.493308:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e530 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a44 expref: 61 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.493324:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01600/0x7b044d4128f9e545 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a44 expref: 60 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.493331:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x36:0x0].0x0 (ffff9f23823dc100) 00010000:00010000:2.0:1784938447.493334:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938447.493336:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d01600, rc 0) 00000100:00100000:2.0:1784938447.493404:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+61:17112:x1871643337544576:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1952us (2427us total) trans 8589934792 rc 0/0 00000100:00100000:2.0:1784938447.493412:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 657 00000100:00100000:3.0:1784938447.498446:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.498526:0:25728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337544704 00000100:00100000:0.0:1784938447.498536:0:25728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337544704 00000100:00100000:0.0:1784938447.498597:0:25728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 928 00000100:00100000:0.0:1784938447.498607:0:25728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:7ea6e988-18ba-4c98-b179-17995571b98b+69:10959:x1871643337544704:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938447.498626:0:25728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938447.498647:0:25728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e553 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664a4b expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938447.498671:0:25728:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938447.498692:0:25728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5c:0x0].0x0 since=713s v=(0 0) 00010000:00010000:0.0:1784938447.498696:0:25728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938447.498706:0:25728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e553 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a4b expref: 70 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.498724:0:25728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e553 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a4b expref: 70 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.498738:0:25728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382394200, rc 0) 00000100:00100000:0.0:1784938447.498792:0:25728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:7ea6e988-18ba-4c98-b179-17995571b98b+70:10959:x1871643337544704:12345-192.168.202.54@tcp:101:cp.0 Request processed in 186us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938447.498800:0:25728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 928 00000100:00100000:0.0:1784938447.519026:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938447.523130:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337544832 00000100:00100000:1.0:1784938447.523219:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337544832 00000100:00100000:1.0:1784938447.523284:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 929 00000100:00100000:1.0:1784938447.523304:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+70:17112:x1871643337544832:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938447.523324:0:25722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938447.523345:0:25722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a14dc117/0x7b044d4128f9e55a lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x5c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664a52 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.523382:0:25722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e553 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a4b expref: 71 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.523392:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938447.523396:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938447.523402:0:25722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a14dc117/0x7b044d4128f9e55a lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x5c:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a52 expref: 71 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.523439:0:25722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e553 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664a4b expref: 71 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.523454:0:25722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e553 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664a4b expref: 71 pid: 25728 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938447.523475:0:25722:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25722:1871643350903168:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938447.523569:0:25722:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238da84b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938447.531443:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350903296:192.168.202.154@tcp:13:osp-pre-1-1.0 00000100:00100000:2.0:1784938447.531540:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:16389:1871643350903808:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938447.531586:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23880a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350904320:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938447.531610:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:16389:1871643350904832:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938447.531638:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1784938447.531644:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350903424:192.168.202.154@tcp:13:osp-pre-0-1.0 00000100:00100000:2.0:1784938447.531665:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:16389:1871643350903936:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938447.531685:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23880a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350904448:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938447.531720:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e07296-2a01-411c-abf2-6d190cb69ef0:16391:1871643350903552:0@lo:400:kworker.0 00000100:00100000:2.0:1784938447.531768:0:16391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938447.531810:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:16391:1871643350904064:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938447.531834:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:16391:1871643350904576:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938447.532844:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.533142:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938447.533202:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938447.533269:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938447.533325:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938447.533349:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938447.533366:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938447.533389:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938447.533408:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938447.533429:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938447.533447:0:21153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350903296 00000100:00100000:0.0:1784938447.533455:0:21153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350903296 00000100:00100000:0.0:1784938447.533491:0:21153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350903424 00000100:00100000:0.0:1784938447.533494:0:21153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350903424 00000100:00100000:0.0:1784938447.533509:0:21153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 74 00000100:00100000:0.0:1784938447.533517:0:21153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+15:16389:x1871643350903296:12345-192.168.202.154@tcp:13:osp-pre-1-1.0 00002000:00000024:0.0:1784938447.533543:0:21153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4186112 granted 42293696 pending 0 free 318476288 avail 290664448 00000100:00100000:0.0:1784938447.533588:0:21153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+15:16389:x1871643350903296:12345-192.168.202.154@tcp:13:osp-pre-1-1.0 Request processed in 71us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938447.533596:0:21153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 74 00000100:00100000:0.0:1784938447.533613:0:21153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 75 00000100:00100000:0.0:1784938447.533619:0:21153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+9:16389:x1871643350903424:12345-192.168.202.154@tcp:13:osp-pre-0-1.0 00002000:00000024:0.0:1784938447.533628:0:21153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2994176 granted 41978304 pending 65536 free 318586880 avail 290775040 00000100:00100000:0.0:1784938447.533650:0:21153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+9:16389:x1871643350903424:12345-192.168.202.154@tcp:13:osp-pre-0-1.0 Request processed in 31us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938447.533656:0:21153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 75 00000100:00100000:0.0:1784938447.533673:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350904320 00000100:00100000:0.0:1784938447.533676:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350904320 00000100:00100000:0.0:1784938447.533705:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350904448 00000100:00100000:0.0:1784938447.533708:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350904448 00000100:00100000:0.0:1784938447.533726:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 80 00000100:00100000:0.0:1784938447.533732:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:16389:x1871643350904320:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938447.533757:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:16389:x1871643350904320:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 26us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938447.533763:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 80 00000100:00100000:0.0:1784938447.533773:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 81 00000100:00100000:0.0:1784938447.533778:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:16389:x1871643350904448:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938447.533797:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:16389:x1871643350904448:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 19us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938447.533803:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 81 00000100:00100000:0.0:1784938447.533820:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350903808 00000100:00100000:0.0:1784938447.533823:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350903808 00000100:00100000:0.0:1784938447.533841:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350904832 00000100:00100000:0.0:1784938447.533844:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350904832 00000100:00100000:3.0:1784938447.534801:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350903936 00000100:00100000:3.0:1784938447.534808:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350903936 00000100:00100000:3.0:1784938447.534835:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350904064 00000100:00100000:3.0:1784938447.534839:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350904064 00000100:00100000:3.0:1784938447.534923:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350904576 00000100:00100000:3.0:1784938447.534927:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350904576 00000100:00100000:3.0:1784938447.534948:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 39 00000100:00100000:3.0:1784938447.534955:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:16389:x1871643350903808:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938447.535170:0:25722:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25722:1871643350903168:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938447.535205:0:25722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a14dc117/0x7b044d4128f9e55a lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x5c:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664a52 expref: 71 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.535227:0:25722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fc200, rc 0) 00000100:00100000:2.0:1784938447.535311:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784938447.535324:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:16391:1871643350903680:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938447.535404:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:16389:x1871643350903808:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 448us (2200us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938447.535411:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 39 00000100:00100000:3.0:1784938447.535426:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 40 00000100:00100000:3.0:1784938447.535432:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:16389:x1871643350903936:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938447.535509:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 41 00000100:00100000:0.0:1784938447.535516:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:16391:x1871643350904064:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938447.535686:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+71:17112:x1871643337544832:12345-192.168.202.54@tcp:101:cp.0 Request processed in 12393us (16668us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938447.535694:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 929 00000100:00100000:2.0:1784938447.536206:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350904192:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938447.536237:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350904704:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938447.536365:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938447.536395:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938447.536420:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938447.536443:0:24193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350903552 00000100:00100000:2.0:1784938447.536448:0:24193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350903552 00000100:00100000:2.0:1784938447.536482:0:24193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1784938447.536489:0:24193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+24:16391:x1871643350903552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938447.536530:0:24193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+24:16391:x1871643350903552:12345-0@lo:400:kworker.0 Request processed in 42us (4761us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938447.536540:0:24193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1784938447.536572:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337544960 00000100:00100000:2.0:1784938447.536576:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337544960 00010000:00010000:2.0:1784938447.536595:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e553 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664a4b expref: 71 pid: 25728 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938447.536623:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 466 00000100:00100000:2.0:1784938447.536629:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+71:10959:x1871643337544960:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938447.536639:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938447.536659:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e553 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664a4b expref: 71 pid: 25728 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.536672:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e553 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664a4b expref: 71 pid: 25728 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.536695:0:22955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e553 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664a4b expref: 71 pid: 25728 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.536713:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.536717:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.536725:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a14dc117/0x7b044d4128f9e55a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664a52 expref: 70 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.536734:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a14dc117/0x7b044d4128f9e55a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664a52 expref: 70 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.536767:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a14dc117/0x7b044d4128f9e55a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664a52 expref: 70 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938447.536777:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2381d28380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22955:1871643350905088:192.168.202.54@tcp:105: 00000100:00100000:2.0:1784938447.536818:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b2d2c480 going to sleep for 11 seconds 00000100:00100000:2.0:1784938447.536834:0:24202:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1784938447.536840:0:24202:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:2.0:1784938447.536855:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784938447.536860:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784938447.536862:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784938447.536864:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938447.537385:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350904960:192.168.202.154@tcp:41:osp-pre-1-0.0 00000100:00100000:2.0:1784938447.537441:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350903424:192.168.202.154@tcp:13:osp-pre-0-1.0 00000100:00100000:2.0:1784938447.537449:0:16389:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967477 gen 2 00000004:00080000:2.0:1784938447.537461:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f2381d2b100, transno 4294967438 00000004:00080000:2.0:1784938447.537468:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f2381d29500, transno 4294967439 00000004:00080000:2.0:1784938447.537469:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f2386363100, transno 4294967440 00000004:00080000:2.0:1784938447.537471:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f2381d2a680, transno 4294967441 00000004:00080000:2.0:1784938447.537473:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238d3adf80, transno 4294967442 00000004:00080000:2.0:1784938447.537475:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f2381d28a80, transno 4294967443 00000004:00080000:2.0:1784938447.537477:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f19a300, transno 4294967444 00000004:00080000:2.0:1784938447.537478:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238d3afb80, transno 4294967445 00000004:00080000:2.0:1784938447.537480:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f1b5c00, transno 4294967446 00000004:00080000:2.0:1784938447.537482:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f2489ae6680, transno 4294967447 00000004:00080000:2.0:1784938447.537484:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24b3f3e680, transno 4294967448 00000004:00080000:2.0:1784938447.537486:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f2489ae5f80, transno 4294967449 00000004:00080000:2.0:1784938447.537488:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f2489ae7b80, transno 4294967450 00000004:00080000:2.0:1784938447.537489:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24b3f3c380, transno 4294967451 00000004:00080000:2.0:1784938447.537492:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24b35f3480, transno 4294967452 00000004:00080000:2.0:1784938447.537493:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24b3f3d880, transno 4294967453 00000004:00080000:2.0:1784938447.537495:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24bd55d880, transno 4294967454 00000004:00080000:2.0:1784938447.537497:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24bd55ce00, transno 4294967455 00000004:00080000:2.0:1784938447.537498:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f199f80, transno 4294967456 00000004:00080000:2.0:1784938447.537500:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24bd256300, transno 4294967457 00000004:00080000:2.0:1784938447.537501:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24bd257480, transno 4294967458 00000004:00080000:2.0:1784938447.537503:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24bd254700, transno 4294967459 00000004:00080000:2.0:1784938447.537504:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24bd254380, transno 4294967460 00000004:00080000:2.0:1784938447.537506:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f2c9180, transno 4294967461 00000004:00080000:2.0:1784938447.537508:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24b6b8c700, transno 4294967462 00000004:00080000:2.0:1784938447.537510:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24b6b8ed80, transno 4294967463 00000004:00080000:2.0:1784938447.537512:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24b6b8dc00, transno 4294967464 00000004:00080000:2.0:1784938447.537513:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24b6b8f100, transno 4294967465 00000004:00080000:2.0:1784938447.537515:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f23882bdc00, transno 4294967466 00000004:00080000:2.0:1784938447.537516:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238d146a00, transno 4294967467 00000004:00080000:2.0:1784938447.537518:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24b6b8e680, transno 4294967468 00000004:00080000:2.0:1784938447.537519:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24b6b8d500, transno 4294967469 00000004:00080000:2.0:1784938447.537521:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f2388126680, transno 4294967470 00000004:00080000:2.0:1784938447.537522:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f2388124380, transno 4294967471 00000004:00080000:2.0:1784938447.537524:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f24a300, transno 4294967472 00000004:00080000:2.0:1784938447.537525:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f248e00, transno 4294967473 00000004:00080000:2.0:1784938447.537527:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f24b480, transno 4294967474 00000004:00080000:2.0:1784938447.537528:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f248700, transno 4294967475 00000004:00080000:2.0:1784938447.537529:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24b6b8f800, transno 4294967476 00000004:00080000:2.0:1784938447.537531:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24b37cb800, transno 4294967477 00000100:00100000:2.0:1784938447.537534:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23880a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350904448:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938447.537544:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350903296:192.168.202.154@tcp:13:osp-pre-1-1.0 00000100:00100000:2.0:1784938447.537551:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:16389:1871643350903808:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938447.537558:0:16389:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967483 gen 2 00000004:00080000:2.0:1784938447.537562:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f24b800, transno 4294967445 00000004:00080000:2.0:1784938447.537568:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f182d80, transno 4294967446 00000004:00080000:2.0:1784938447.537570:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f180000, transno 4294967447 00000004:00080000:2.0:1784938447.537572:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f181880, transno 4294967448 00000004:00080000:2.0:1784938447.537574:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f181180, transno 4294967449 00000004:00080000:2.0:1784938447.537576:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f249180, transno 4294967450 00000004:00080000:2.0:1784938447.537577:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f181500, transno 4294967451 00000004:00080000:2.0:1784938447.537579:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f180380, transno 4294967452 00000004:00080000:2.0:1784938447.537580:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24b68d8380, transno 4294967453 00000004:00080000:2.0:1784938447.537582:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238d3ad180, transno 4294967454 00000004:00080000:2.0:1784938447.537583:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24b68d8a80, transno 4294967455 00000004:00080000:2.0:1784938447.537584:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f2386360700, transno 4294967456 00000004:00080000:2.0:1784938447.537586:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24b68db480, transno 4294967457 00000004:00080000:2.0:1784938447.537587:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24bd256680, transno 4294967458 00000004:00080000:2.0:1784938447.537589:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f2386360a80, transno 4294967459 00000004:00080000:2.0:1784938447.537590:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24b68da300, transno 4294967460 00000004:00080000:2.0:1784938447.537592:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24b68d9500, transno 4294967461 00000004:00080000:2.0:1784938447.537593:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f2ca300, transno 4294967462 00000004:00080000:2.0:1784938447.537594:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f2c9880, transno 4294967463 00000004:00080000:2.0:1784938447.537596:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238d147800, transno 4294967464 00000004:00080000:2.0:1784938447.537597:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24bd254000, transno 4294967465 00000004:00080000:2.0:1784938447.537599:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24bd255880, transno 4294967466 00000004:00080000:2.0:1784938447.537600:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24bd255500, transno 4294967467 00000004:00080000:2.0:1784938447.537602:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24b6b8ce00, transno 4294967468 00000004:00080000:2.0:1784938447.537604:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24bd254e00, transno 4294967469 00000004:00080000:2.0:1784938447.537606:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f2388245880, transno 4294967470 00000004:00080000:2.0:1784938447.537607:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238d145c00, transno 4294967471 00000004:00080000:2.0:1784938447.537609:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f2388124a80, transno 4294967472 00000004:00080000:2.0:1784938447.537610:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f2388125880, transno 4294967473 00000004:00080000:2.0:1784938447.537612:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f23882be680, transno 4294967474 00000004:00080000:2.0:1784938447.537613:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f2388124e00, transno 4294967475 00000004:00080000:2.0:1784938447.537615:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f2388127480, transno 4294967476 00000004:00080000:2.0:1784938447.537616:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f2388125f80, transno 4294967477 00000004:00080000:2.0:1784938447.537617:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f2388125c00, transno 4294967478 00000004:00080000:2.0:1784938447.537619:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f2388125500, transno 4294967479 00000004:00080000:2.0:1784938447.537620:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238e0ec700, transno 4294967480 00000004:00080000:2.0:1784938447.537622:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f1b6a00, transno 4294967481 00000004:00080000:2.0:1784938447.537623:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f2388125180, transno 4294967482 00000004:00080000:2.0:1784938447.537625:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f23882bce00, transno 4294967483 00000100:00100000:2.0:1784938447.537627:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23880a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350904320:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938447.537723:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000004:00080000:2.0:1784938447.538005:0:24225:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 40 done 00000004:00080000:2.0:1784938447.538195:0:24223:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 39 done 00000100:00100000:2.0:1784938447.538223:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e07296-2a01-411c-abf2-6d190cb69ef0:16391:1871643350903552:0@lo:400:kworker.0 00000100:00100000:3.0:1784938447.540837:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:16389:x1871643350903936:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 5394us (7459us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938447.540853:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 40 00000100:00100000:3.0:1784938447.540890:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350903680 00000100:00100000:3.0:1784938447.540897:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350903680 00000100:00100000:3.0:1784938447.540937:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 42 00000100:00100000:3.0:1784938447.540944:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:16391:x1871643350904576:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938447.541005:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:16391:x1871643350904576:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 61us (7575us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938447.541012:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 42 00000100:00100000:3.0:1784938447.541025:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 43 00000100:00100000:3.0:1784938447.541031:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:16389:x1871643350904832:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938447.541055:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:16389:x1871643350904832:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 25us (7764us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938447.541061:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 43 00000100:00100000:3.0:1784938447.541074:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 44 00000100:00100000:3.0:1784938447.541080:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:16391:x1871643350903680:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938447.541103:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:16391:x1871643350903680:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 24us (4739us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938447.541109:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 44 00000100:00100000:3.0:1784938447.541133:0:25729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350904704 00000100:00100000:3.0:1784938447.541137:0:25729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350904704 00000100:00100000:3.0:1784938447.541181:0:25729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 82 00000100:00100000:3.0:1784938447.541189:0:25729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+9:16391:x1871643350904704:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938447.541213:0:25729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+9:16391:x1871643350904704:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 27us (4793us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938447.541220:0:25729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 82 00000100:00080000:3.0:1784938447.541570:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938447.544589:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:16391:x1871643350904064:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 9056us (11161us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938447.544606:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 41 00000100:00100000:0.0:1784938447.544871:0:21160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350904192 00000100:00100000:0.0:1784938447.544879:0:21160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350904192 00000100:00100000:0.0:1784938447.544924:0:21160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350904960 00000100:00100000:0.0:1784938447.544928:0:21160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350904960 00000100:00100000:0.0:1784938447.544942:0:21160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 80 00000100:00100000:0.0:1784938447.544948:0:21160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:16391:x1871643350904192:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938447.545009:0:21160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:16391:x1871643350904192:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 60us (8613us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938447.545015:0:21160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 80 00000100:00100000:0.0:1784938447.545028:0:21160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 81 00000100:00100000:0.0:1784938447.545034:0:21160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:16390:x1871643350904960:12345-192.168.202.154@tcp:41:osp-pre-1-0.0 00000004:00000024:0.0:1784938447.545060:0:21160:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 218427392 avail 191401984 00000100:00100000:0.0:1784938447.545085:0:21160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:16390:x1871643350904960:12345-192.168.202.154@tcp:41:osp-pre-1-0.0 Request processed in 51us (7361us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938447.545091:0:21160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 81 00000100:00100000:3.0:1784938447.548345:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2381d28380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22955:1871643350905088:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938447.548375:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938447.548423:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+70:10959:x1871643337544960:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 11794us (15583us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938447.548435:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 466 00000100:00100000:2.0:1784938447.549280:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:16389:1871643350903936:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938447.549309:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:16389:1871643350904832:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938447.549350:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:16391:1871643350903680:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938447.549363:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350904192:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938447.549377:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350904704:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938447.549391:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:16391:1871643350904064:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938447.549404:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:16391:1871643350904576:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938447.549448:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350904960:192.168.202.154@tcp:41:osp-pre-1-0.0 00000100:00100000:1.0:1784938447.556183:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.557912:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337545216 00000100:00100000:0.0:1784938447.557925:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337545216 00000100:00100000:0.0:1784938447.557978:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 154 00000100:00100000:0.0:1784938447.558056:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+61:17112:x1871643337545216:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:0.0:1784938447.558384:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+62:17112:x1871643337545216:12345-192.168.202.54@tcp:35:cp.0 Request processed in 396us (2209us total) trans 8589934793 rc 0/0 00000100:00100000:0.0:1784938447.558393:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 154 00000100:00100000:1.0:1784938447.582137:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938447.582192:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337545344 00000100:00100000:1.0:1784938447.582202:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337545344 00000100:00100000:1.0:1784938447.582262:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 658 00000100:00100000:1.0:1784938447.582272:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+62:17112:x1871643337545344:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938447.582306:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938447.582329:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fcc00/0x7b044d4128f9e561 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664a59 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.582395:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9e568 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.582409:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9e568 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.582421:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9e568 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.582435:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc600/0x7b044d4128f9e56f lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe3541c1d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.582442:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc600/0x7b044d4128f9e56f lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.582448:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc600/0x7b044d4128f9e56f lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.582488:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9e568 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.582495:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9e568 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.582500:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9e568 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.582506:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fc000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938447.582510:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9e568 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.582519:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9e568 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.582531:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938447.582534:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938447.582540:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9e568 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.582546:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9e568 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.583259:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc600/0x7b044d4128f9e56f lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.583269:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc600/0x7b044d4128f9e56f lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.583276:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc600/0x7b044d4128f9e56f lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.583281:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fc600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938447.583284:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc600/0x7b044d4128f9e56f lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.583298:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc600/0x7b044d4128f9e56f lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.583308:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xe3541c1d (ffff9f24b67c7200) 00010000:00010000:1.0:1784938447.583311:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938447.583315:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc600/0x7b044d4128f9e56f lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.583321:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc600/0x7b044d4128f9e56f lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.583362:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fcc00/0x7b044d4128f9e561 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a59 expref: 63 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.583377:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938447.583380:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938447.583384:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fcc00/0x7b044d4128f9e561 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a59 expref: 63 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.583393:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fcc00, rc 0) 00000100:00100000:1.0:1784938447.583457:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+62:17112:x1871643337545344:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1187us (1327us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938447.583467:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 658 00000100:00100000:2.0:1784938447.593168:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.593210:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337545472 00000100:00100000:2.0:1784938447.593220:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337545472 00000100:00100000:2.0:1784938447.593273:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 659 00000100:00100000:2.0:1784938447.593282:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+62:17112:x1871643337545472:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938447.593312:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938447.593334:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01400/0x7b044d4128f9e576 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664a60 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.593407:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e57d lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.593424:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e57d lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.593436:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e57d lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.593452:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e584 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe3541c1d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.593459:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e584 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.593466:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e584 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.593510:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e57d lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.593518:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e57d lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.593525:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e57d lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.593531:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d00000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938447.593535:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e57d lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.593543:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e57d lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.593555:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938447.593558:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.593563:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e57d lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.593568:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e57d lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.593581:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e584 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.593587:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e584 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.593593:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e584 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.593599:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d01c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938447.593602:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e584 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.593607:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e584 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.593615:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xe3541c1d (ffff9f23861e4400) 00010000:00010000:2.0:1784938447.593617:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.593620:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e584 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.593626:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e584 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.593660:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01400/0x7b044d4128f9e576 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a60 expref: 63 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.593670:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938447.593673:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.593676:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01400/0x7b044d4128f9e576 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a60 expref: 63 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.593685:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d01400, rc 0) 00000100:00100000:2.0:1784938447.593742:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+62:17112:x1871643337545472:12345-192.168.202.54@tcp:101:cp.0 Request processed in 461us (598us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938447.593749:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 659 00010000:00010000:2.0:1784938447.601082:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938447.608173:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.608387:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337545728 00000100:00100000:2.0:1784938447.608397:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337545728 00000100:00100000:2.0:1784938447.608459:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 660 00000100:00100000:2.0:1784938447.608469:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238c935850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+62:17112:x1871643337545728:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938447.608490:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938447.608511:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00c00/0x7b044d4128f9e58b lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664a67 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.608616:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01e00/0x7b044d4128f9e592 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.608631:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01e00/0x7b044d4128f9e592 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.608643:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01e00/0x7b044d4128f9e592 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.608658:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01800/0x7b044d4128f9e599 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0xe3541c1d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.608665:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01800/0x7b044d4128f9e599 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.608673:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01800/0x7b044d4128f9e599 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938447.609041:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x5c:0x0], index 0: 0 00010000:00010000:2.0:1784938447.609228:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01000/0x7b044d4128f9e5a0 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.609238:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01000/0x7b044d4128f9e5a0 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.609247:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01000/0x7b044d4128f9e5a0 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.609279:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01e00/0x7b044d4128f9e592 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.609287:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01e00/0x7b044d4128f9e592 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.609303:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01e00/0x7b044d4128f9e592 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.609310:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01e00/0x7b044d4128f9e592 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.609317:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d01e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938447.609321:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01e00/0x7b044d4128f9e592 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.609329:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01e00/0x7b044d4128f9e592 lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.609340:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938447.609344:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.609348:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01e00/0x7b044d4128f9e592 lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.609355:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01e00/0x7b044d4128f9e592 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938447.609370:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ab8d0b10 reply state 00000000ce277d3d transno 8589934794 ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01800/0x7b044d4128f9e599 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.609381:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01800/0x7b044d4128f9e599 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.609387:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xe3541c1d (ffff9f23861e4700) 00010000:00010000:2.0:1784938447.609390:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938447.609392:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938447.609422:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00c00/0x7b044d4128f9e58b lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a67 expref: 65 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.609437:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01000/0x7b044d4128f9e5a0 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a67 expref: 64 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.609444:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x37:0x0].0x0 (ffff9f23861e4500) 00010000:00010000:2.0:1784938447.609447:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938447.609449:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d01000, rc 0) 00000100:00100000:2.0:1784938447.609512:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238c935850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+65:17112:x1871643337545728:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1045us (1373us total) trans 8589934794 rc 0/0 00000100:00100000:2.0:1784938447.609520:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 660 00000100:00100000:2.0:1784938447.629656:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.629849:0:25721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337545856 00000100:00100000:3.0:1784938447.629868:0:25721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337545856 00000100:00100000:3.0:1784938447.629934:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 930 00000100:00100000:3.0:1784938447.629944:0:25721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7ea6e988-18ba-4c98-b179-17995571b98b+73:10958:x1871643337545856:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938447.629966:0:25721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938447.630006:0:25721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c010a79b/0x7b044d4128f9e5ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664a6e expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938447.630037:0:25721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938447.630061:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5c:0x0].0x0 since=713s v=(0 0) 00010000:00010000:3.0:1784938447.630066:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938447.630076:0:25721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c010a79b/0x7b044d4128f9e5ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a6e expref: 74 pid: 25721 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.630094:0:25721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c010a79b/0x7b044d4128f9e5ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a6e expref: 74 pid: 25721 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.630108:0:25721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61a000, rc 0) 00000100:00100000:3.0:1784938447.630197:0:25721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7ea6e988-18ba-4c98-b179-17995571b98b+74:10958:x1871643337545856:12345-192.168.202.54@tcp:101:cp.0 Request processed in 254us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938447.630204:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 930 00000100:00100000:2.0:1784938447.634769:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.634845:0:25718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337545984 00000100:00100000:3.0:1784938447.634863:0:25718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337545984 00000100:00100000:3.0:1784938447.634952:0:25718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 931 00000100:00100000:3.0:1784938447.634962:0:25718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ea6e988-18ba-4c98-b179-17995571b98b+74:17112:x1871643337545984:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938447.634980:0:25718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938447.635008:0:25718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e45c1791/0x7b044d4128f9e5b5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664a75 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.635041:0:25718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c010a79b/0x7b044d4128f9e5ae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a6e expref: 75 pid: 25721 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.635051:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938447.635056:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938447.635061:0:25718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e45c1791/0x7b044d4128f9e5b5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a75 expref: 75 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.635102:0:25718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c010a79b/0x7b044d4128f9e5ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664a6e expref: 75 pid: 25721 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.635118:0:25718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c010a79b/0x7b044d4128f9e5ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664a6e expref: 75 pid: 25721 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938447.635133:0:25718:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25718:1871643350905216:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938447.635227:0:25718:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b2d2c480 going to sleep for 11 seconds 00000100:00100000:3.0:1784938447.637927:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.637978:0:25718:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25718:1871643350905216:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938447.638020:0:25718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e45c1791/0x7b044d4128f9e5b5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664a75 expref: 75 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.638043:0:25718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61ac00, rc 0) 00000100:00100000:3.0:1784938447.638091:0:25718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ea6e988-18ba-4c98-b179-17995571b98b+75:17112:x1871643337545984:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3131us (3332us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938447.638100:0:25718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 931 00000100:00100000:1.0:1784938447.638307:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337546112 00000100:00100000:1.0:1784938447.638315:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337546112 00010000:00010000:1.0:1784938447.638344:0:25731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c010a79b/0x7b044d4128f9e5ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664a6e expref: 75 pid: 25721 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938447.638395:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 467 00000100:00100000:1.0:1784938447.638404:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+75:10958:x1871643337546112:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938447.638416:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938447.638438:0:25731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c010a79b/0x7b044d4128f9e5ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664a6e expref: 75 pid: 25721 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.638450:0:25731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c010a79b/0x7b044d4128f9e5ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664a6e expref: 75 pid: 25721 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.638472:0:25731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c010a79b/0x7b044d4128f9e5ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664a6e expref: 75 pid: 25721 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.638488:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938447.638491:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938447.638499:0:25731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e45c1791/0x7b044d4128f9e5b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664a75 expref: 74 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.638509:0:25731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e45c1791/0x7b044d4128f9e5b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664a75 expref: 74 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.638542:0:25731:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e45c1791/0x7b044d4128f9e5b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664a75 expref: 74 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938447.638555:0:25731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:25731:1871643350905344:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938447.638600:0:25731:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238da84600 going to sleep for 11 seconds 00000100:00100000:2.0:1784938447.652199:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.652349:0:25731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:25731:1871643350905344:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938447.652373:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938447.652433:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+74:10958:x1871643337546112:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 14030us (14514us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938447.652445:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 467 00000100:00100000:0.0:1784938447.653074:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337546368 00000100:00100000:0.0:1784938447.653084:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337546368 00000100:00100000:0.0:1784938447.653255:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 155 00000100:00100000:0.0:1784938447.653266:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+65:17112:x1871643337546368:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:0.0:1784938447.653624:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+66:17112:x1871643337546368:12345-192.168.202.54@tcp:35:cp.0 Request processed in 359us (1431us total) trans 8589934795 rc 0/0 00000100:00100000:0.0:1784938447.653631:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 155 00000100:00100000:1.0:1784938447.678881:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.678958:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337546496 00000100:00100000:3.0:1784938447.678968:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337546496 00000100:00100000:3.0:1784938447.679039:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 661 00000100:00100000:3.0:1784938447.679049:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+66:17112:x1871643337546496:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938447.679075:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938447.679096:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e5bc lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664a7c expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.679203:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b200/0x7b044d4128f9e5c3 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.679218:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b200/0x7b044d4128f9e5c3 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.679229:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b200/0x7b044d4128f9e5c3 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.679244:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e5ca lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x89d48c8d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.679250:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e5ca lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.679256:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e5ca lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.679307:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b200/0x7b044d4128f9e5c3 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.679314:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b200/0x7b044d4128f9e5c3 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.679320:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b200/0x7b044d4128f9e5c3 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.679326:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61b200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938447.679331:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b200/0x7b044d4128f9e5c3 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.679339:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b200/0x7b044d4128f9e5c3 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.679350:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938447.679353:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.679359:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b200/0x7b044d4128f9e5c3 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.679364:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b200/0x7b044d4128f9e5c3 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.679378:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e5ca lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.679383:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e5ca lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.679388:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e5ca lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.679393:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61a200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938447.679396:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e5ca lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.679401:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e5ca lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.679411:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x89d48c8d (ffff9f24975b2d00) 00010000:00010000:3.0:1784938447.679413:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.679416:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e5ca lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.679421:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e5ca lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.679457:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e5bc lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a7c expref: 67 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.679467:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938447.679469:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.679473:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e5bc lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a7c expref: 67 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.679482:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61a400, rc 0) 00000100:00100000:3.0:1784938447.679540:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+66:17112:x1871643337546496:12345-192.168.202.54@tcp:101:cp.0 Request processed in 492us (668us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938447.679548:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 661 00000100:00100000:3.0:1784938447.682173:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.682838:0:25738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337546624 00000100:00100000:2.0:1784938447.682848:0:25738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337546624 00000100:00100000:2.0:1784938447.682919:0:25738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 662 00000100:00100000:2.0:1784938447.682929:0:25738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+66:17112:x1871643337546624:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938447.682950:0:25738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938447.682971:0:25738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01400/0x7b044d4128f9e5d1 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664a83 expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.683225:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e5d8 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.683241:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e5d8 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.683253:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e5d8 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.683268:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e5df lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x89d48c8d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.683275:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e5df lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.683282:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e5df lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.683336:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e5d8 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.683344:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e5d8 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.683351:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e5d8 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.683357:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d01c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938447.683362:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e5d8 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.683373:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e5d8 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.683386:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938447.683389:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.683393:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e5d8 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.683399:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e5d8 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.683411:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e5df lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.683417:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e5df lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.683423:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e5df lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.683429:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d00000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938447.683432:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e5df lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.683438:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e5df lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.683445:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x89d48c8d (ffff9f23861e4400) 00010000:00010000:2.0:1784938447.683448:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.683451:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e5df lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.683460:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e5df lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.683491:0:25738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01400/0x7b044d4128f9e5d1 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a83 expref: 67 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.683502:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938447.683504:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.683508:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01400/0x7b044d4128f9e5d1 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a83 expref: 67 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.683517:0:25738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d01400, rc 0) 00000100:00100000:2.0:1784938447.683579:0:25738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+66:17112:x1871643337546624:12345-192.168.202.54@tcp:101:cp.0 Request processed in 651us (1437us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938447.683586:0:25738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 662 00000100:00100000:3.0:1784938447.686191:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938447.686252:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337546880 00000100:00100000:1.0:1784938447.686270:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337546880 00000100:00100000:1.0:1784938447.686340:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 663 00000100:00100000:1.0:1784938447.686349:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+66:17112:x1871643337546880:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938447.686368:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938447.686386:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc600/0x7b044d4128f9e5e6 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664a8a expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.686487:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9e5ed lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.686505:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9e5ed lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.686515:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9e5ed lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.686531:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fda00/0x7b044d4128f9e5f4 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x89d48c8d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.686539:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fda00/0x7b044d4128f9e5f4 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.686545:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fda00/0x7b044d4128f9e5f4 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938447.686828:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x5d:0x0], index 1: 0 00010000:00010000:1.0:1784938447.686961:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd800/0x7b044d4128f9e5fb lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.686970:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd800/0x7b044d4128f9e5fb lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.686977:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd800/0x7b044d4128f9e5fb lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.687021:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9e5ed lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.687028:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9e5ed lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.687034:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9e5ed lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.687041:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9e5ed lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.687047:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fc000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938447.687051:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9e5ed lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.687059:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9e5ed lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.687071:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938447.687074:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938447.687078:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9e5ed lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.687084:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9e5ed lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938447.687095:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004861e582 reply state 000000007b93e4b1 transno 8589934796 ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fda00/0x7b044d4128f9e5f4 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.687105:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fda00/0x7b044d4128f9e5f4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.687111:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x89d48c8d (ffff9f24b67c7200) 00010000:00010000:1.0:1784938447.687114:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938447.687116:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938447.687178:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc600/0x7b044d4128f9e5e6 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a8a expref: 69 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.687194:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd800/0x7b044d4128f9e5fb lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a8a expref: 68 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.687203:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x38:0x0].0x0 (ffff9f24b67c7400) 00010000:00010000:1.0:1784938447.687205:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938447.687207:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fd800, rc 0) 00000100:00100000:1.0:1784938447.687271:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+69:17112:x1871643337546880:12345-192.168.202.54@tcp:101:cp.0 Request processed in 923us (1090us total) trans 8589934796 rc 0/0 00000100:00100000:1.0:1784938447.687279:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 663 00000100:00100000:1.0:1784938447.692762:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.693990:0:25723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337547008 00000100:00100000:3.0:1784938447.694003:0:25723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337547008 00000100:00100000:3.0:1784938447.694072:0:25723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 932 00000100:00100000:3.0:1784938447.694083:0:25723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7ea6e988-18ba-4c98-b179-17995571b98b+70:10959:x1871643337547008:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938447.694105:0:25723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938447.694126:0:25723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088ff705f/0x7b044d4128f9e609 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664a91 expref: -99 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938447.694182:0:25723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938447.694205:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5d:0x0].0x0 since=713s v=(0 0) 00010000:00010000:3.0:1784938447.694209:0:25723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938447.694219:0:25723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088ff705f/0x7b044d4128f9e609 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a91 expref: 71 pid: 25723 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.694236:0:25723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000088ff705f/0x7b044d4128f9e609 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a91 expref: 71 pid: 25723 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.694249:0:25723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61a400, rc 0) 00000100:00100000:3.0:1784938447.694320:0:25723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7ea6e988-18ba-4c98-b179-17995571b98b+71:10959:x1871643337547008:12345-192.168.202.54@tcp:101:cp.0 Request processed in 238us (1566us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938447.694327:0:25723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 932 00000100:00100000:2.0:1784938447.698044:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.698082:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337547136 00000100:00100000:2.0:1784938447.698091:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337547136 00000100:00100000:2.0:1784938447.698140:0:25720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 933 00000100:00100000:2.0:1784938447.698168:0:25720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7ea6e988-18ba-4c98-b179-17995571b98b+71:17112:x1871643337547136:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938447.698187:0:25720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938447.698204:0:25720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b91bb11/0x7b044d4128f9e610 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x5d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664a98 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.698234:0:25720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000088ff705f/0x7b044d4128f9e609 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a91 expref: 72 pid: 25723 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.698249:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.698254:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.698260:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b91bb11/0x7b044d4128f9e610 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x5d:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a98 expref: 72 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.698302:0:25720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000088ff705f/0x7b044d4128f9e609 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664a91 expref: 72 pid: 25723 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.698316:0:25720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000088ff705f/0x7b044d4128f9e609 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664a91 expref: 72 pid: 25723 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938447.698331:0:25720:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:25720:1871643350905472:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938447.698412:0:25720:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238ee37c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938447.704169:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.705452:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337547264 00000100:00100000:0.0:1784938447.705465:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337547264 00010000:00010000:0.0:1784938447.705518:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000088ff705f/0x7b044d4128f9e609 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664a91 expref: 73 pid: 25723 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938447.705565:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 468 00000100:00100000:0.0:1784938447.705576:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+73:10959:x1871643337547264:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938447.705591:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938447.705615:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000088ff705f/0x7b044d4128f9e609 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x5d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664a91 expref: 73 pid: 25723 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.705631:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000088ff705f/0x7b044d4128f9e609 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x5d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664a91 expref: 73 pid: 25723 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.705660:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938447.705666:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938447.705674:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008b91bb11/0x7b044d4128f9e610 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a98 expref: 73 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.705684:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b91bb11/0x7b044d4128f9e610 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x5d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a98 expref: 73 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.705725:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008b91bb11/0x7b044d4128f9e610 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x5d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a98 expref: 73 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938447.705738:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350905600:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938447.705820:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24870c3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938447.708461:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350905600:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938447.708482:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938447.708530:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+73:10959:x1871643337547264:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 2956us (4368us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938447.708540:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 468 00010000:00010000:2.0:1784938447.709693:0:25720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088ff705f/0x7b044d4128f9e609 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664a91 expref: 72 pid: 25723 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938447.709716:0:25720:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:25720:1871643350905472:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938447.709739:0:25720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008b91bb11/0x7b044d4128f9e610 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664a98 expref: 71 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.709754:0:25720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d01400, rc 0) 00000100:00100000:2.0:1784938447.709838:0:25720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7ea6e988-18ba-4c98-b179-17995571b98b+71:17112:x1871643337547136:12345-192.168.202.54@tcp:101:cp.0 Request processed in 11672us (11801us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938447.709850:0:25720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 933 00000100:00100000:0.0:1784938447.713935:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.714080:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337547520 00000100:00100000:3.0:1784938447.714091:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337547520 00000100:00100000:3.0:1784938447.714300:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 156 00000100:00100000:3.0:1784938447.714311:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+69:17112:x1871643337547520:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938447.714659:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+70:17112:x1871643337547520:12345-192.168.202.54@tcp:35:cp.0 Request processed in 347us (732us total) trans 8589934797 rc 0/0 00000100:00100000:3.0:1784938447.714669:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 156 00000100:00100000:2.0:1784938447.722530:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.722615:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337547648 00000100:00100000:3.0:1784938447.722625:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337547648 00000100:00100000:3.0:1784938447.722683:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 664 00000100:00100000:3.0:1784938447.722698:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+70:17112:x1871643337547648:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938447.722727:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938447.722750:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e617 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664a9f expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.722820:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b200/0x7b044d4128f9e61e lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.722835:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b200/0x7b044d4128f9e61e lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.722845:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b200/0x7b044d4128f9e61e lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.722872:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e625 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa38d6329 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.722879:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e625 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.722885:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e625 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.722919:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b200/0x7b044d4128f9e61e lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.722926:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b200/0x7b044d4128f9e61e lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.722931:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b200/0x7b044d4128f9e61e lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.722941:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61b200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938447.722945:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b200/0x7b044d4128f9e61e lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.722952:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b200/0x7b044d4128f9e61e lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.722962:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938447.722965:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.722969:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b200/0x7b044d4128f9e61e lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.722975:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b200/0x7b044d4128f9e61e lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.723579:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e625 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.723588:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e625 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.723594:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e625 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.723600:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61b000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938447.723603:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e625 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.723611:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e625 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.723625:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xa38d6329 (ffff9f24975b2800) 00010000:00010000:3.0:1784938447.723628:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.723636:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e625 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.723642:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e625 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.723681:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e617 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a9f expref: 71 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.723691:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938447.723694:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.723697:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e617 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a9f expref: 71 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.723707:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61a200, rc 0) 00000100:00100000:3.0:1784938447.723769:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+70:17112:x1871643337547648:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1077us (1251us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938447.723969:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 664 00000100:00100000:0.0:1784938447.730749:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.732668:0:25738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337547776 00000100:00100000:2.0:1784938447.732681:0:25738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337547776 00000100:00100000:3.0:1784938447.732830:0:25738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 665 00000100:00100000:3.0:1784938447.732840:0:25738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+70:17112:x1871643337547776:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938447.732957:0:25738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938447.732980:0:25738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9e62c lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664aa6 expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.733108:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e633 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.733123:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e633 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.733483:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e633 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.733500:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a000/0x7b044d4128f9e63a lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa38d6329 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.733507:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a000/0x7b044d4128f9e63a lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.733514:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a000/0x7b044d4128f9e63a lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.733553:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e633 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.733560:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e633 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.733566:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e633 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.733573:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61a400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938447.733577:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e633 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.733585:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e633 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.733598:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938447.733601:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.733606:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e633 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.733612:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e633 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.733625:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a000/0x7b044d4128f9e63a lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.733631:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a000/0x7b044d4128f9e63a lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.733637:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a000/0x7b044d4128f9e63a lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.733642:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61a000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938447.733645:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a000/0x7b044d4128f9e63a lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.733651:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a000/0x7b044d4128f9e63a lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.733658:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xa38d6329 (ffff9f24975b2100) 00010000:00010000:3.0:1784938447.733661:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.733663:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a000/0x7b044d4128f9e63a lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.733669:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a000/0x7b044d4128f9e63a lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.733700:0:25738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9e62c lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664aa6 expref: 71 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.733711:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938447.733713:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.733717:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61ba00/0x7b044d4128f9e62c lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664aa6 expref: 71 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.733727:0:25738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61ba00, rc 0) 00000100:00100000:3.0:1784938447.733842:0:25738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+70:17112:x1871643337547776:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1003us (3101us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938447.733861:0:25738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 665 00000100:00100000:3.0:1784938447.737069:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.737516:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337548032 00000100:00100000:2.0:1784938447.737526:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337548032 00000100:00100000:2.0:1784938447.737584:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 666 00000100:00100000:2.0:1784938447.737594:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+70:17112:x1871643337548032:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938447.737617:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938447.737636:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e641 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664aad expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.737746:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e648 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.737761:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e648 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.737771:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e648 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.737785:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00e00/0x7b044d4128f9e64f lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0xa38d6329 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.737791:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00e00/0x7b044d4128f9e64f lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.737797:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00e00/0x7b044d4128f9e64f lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938447.738277:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x5d:0x0], index 0: 0 00010000:00010000:2.0:1784938447.738428:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01e00/0x7b044d4128f9e656 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.738436:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01e00/0x7b044d4128f9e656 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.738444:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01e00/0x7b044d4128f9e656 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.738477:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e648 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.738483:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e648 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.738489:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e648 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.738495:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e648 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.738500:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d00000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938447.738504:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e648 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.738512:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e648 lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.738523:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938447.738526:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.738531:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e648 lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.738538:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e648 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938447.738549:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000042888e76 reply state 000000003a90eed0 transno 8589934798 ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00e00/0x7b044d4128f9e64f lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.738560:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00e00/0x7b044d4128f9e64f lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.738566:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xa38d6329 (ffff9f23861e4400) 00010000:00010000:2.0:1784938447.738568:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938447.738570:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938447.738599:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e641 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664aad expref: 73 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.738614:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01e00/0x7b044d4128f9e656 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664aad expref: 72 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.738622:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x39:0x0].0x0 (ffff9f23861e4300) 00010000:00010000:2.0:1784938447.738624:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938447.738626:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d01e00, rc 0) 00000100:00100000:2.0:1784938447.738692:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+73:17112:x1871643337548032:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1099us (1632us total) trans 8589934798 rc 0/0 00000100:00100000:2.0:1784938447.738701:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 666 00000100:00100000:3.0:1784938447.741835:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.752620:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337548160 00000100:00100000:2.0:1784938447.752635:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337548160 00000100:00100000:2.0:1784938447.752742:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 934 00000100:00100000:2.0:1784938447.752754:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+74:10957:x1871643337548160:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938447.752774:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938447.752795:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000146b94b7/0x7b044d4128f9e664 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664ab4 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938447.752819:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938447.752840:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5d:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1784938447.752844:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.752865:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000146b94b7/0x7b044d4128f9e664 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664ab4 expref: 75 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.752884:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000146b94b7/0x7b044d4128f9e664 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664ab4 expref: 75 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.752896:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d00600, rc 0) 00000100:00100000:2.0:1784938447.752967:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+75:10957:x1871643337548160:12345-192.168.202.54@tcp:101:cp.0 Request processed in 215us (11138us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938447.752975:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 934 00000100:00100000:3.0:1784938447.763395:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.763434:0:25727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337548288 00000100:00100000:3.0:1784938447.763444:0:25727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337548288 00000100:00100000:3.0:1784938447.763496:0:25727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 935 00000100:00100000:3.0:1784938447.763506:0:25727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7ea6e988-18ba-4c98-b179-17995571b98b+75:17112:x1871643337548288:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938447.763527:0:25727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938447.763547:0:25727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea2da067/0x7b044d4128f9e66b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664abb expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.763581:0:25727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000146b94b7/0x7b044d4128f9e664 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664ab4 expref: 76 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.763591:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938447.763596:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938447.763602:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea2da067/0x7b044d4128f9e66b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 3 type: EXT [0->118783] (req 0->118783) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664abb expref: 76 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.763639:0:25727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000146b94b7/0x7b044d4128f9e664 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664ab4 expref: 76 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.763652:0:25727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000146b94b7/0x7b044d4128f9e664 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664ab4 expref: 76 pid: 21151 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938447.763667:0:25727:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68aad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:25727:1871643350905728:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938447.763749:0:25727:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f23873a9180 going to sleep for 11 seconds 00000100:00100000:1.0:1784938447.777639:0:25727:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68aad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:25727:1871643350905728:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938447.777677:0:25727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ea2da067/0x7b044d4128f9e66b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 3 type: EXT [0->118783] (req 0->118783) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664abb expref: 76 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.777701:0:25727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61ba00, rc 0) 00000100:00100000:1.0:1784938447.777763:0:25727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7ea6e988-18ba-4c98-b179-17995571b98b+76:17112:x1871643337548288:12345-192.168.202.54@tcp:101:cp.0 Request processed in 14258us (14377us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938447.777772:0:25727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 935 00000100:00100000:3.0:1784938447.778102:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.785103:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337548416 00000100:00100000:3.0:1784938447.785118:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337548416 00010000:00010000:3.0:1784938447.785186:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000146b94b7/0x7b044d4128f9e664 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664ab4 expref: 76 pid: 21151 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938447.785230:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 469 00000100:00100000:3.0:1784938447.785238:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+76:10958:x1871643337548416:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938447.785251:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938447.785273:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000146b94b7/0x7b044d4128f9e664 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664ab4 expref: 76 pid: 21151 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.785299:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000146b94b7/0x7b044d4128f9e664 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664ab4 expref: 76 pid: 21151 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.785328:0:22955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000146b94b7/0x7b044d4128f9e664 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664ab4 expref: 76 pid: 21151 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.785340:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938447.785343:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938447.785349:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea2da067/0x7b044d4128f9e66b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664abb expref: 75 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.785357:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea2da067/0x7b044d4128f9e66b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664abb expref: 75 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.785390:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ea2da067/0x7b044d4128f9e66b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664abb expref: 75 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938447.785403:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68a9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350905856:192.168.202.54@tcp:105: 00000100:00100000:3.0:1784938447.785479:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f23873a9180 going to sleep for 11 seconds 00000100:00100000:2.0:1784938447.793425:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.793486:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68a9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350905856:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938447.793509:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938447.793558:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+75:10958:x1871643337548416:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 8320us (15456us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938447.793569:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 469 00000100:00100000:2.0:1784938447.794215:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337548672 00000100:00100000:2.0:1784938447.794222:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337548672 00000100:00100000:2.0:1784938447.794270:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 157 00000100:00100000:2.0:1784938447.794279:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+73:17112:x1871643337548672:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:2.0:1784938447.794563:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+74:17112:x1871643337548672:12345-192.168.202.54@tcp:35:cp.0 Request processed in 284us (1145us total) trans 8589934799 rc 0/0 00000100:00100000:2.0:1784938447.794571:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 157 00000100:00100000:2.0:1784938447.810229:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.810297:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337548800 00000100:00100000:2.0:1784938447.810306:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337548800 00000100:00100000:2.0:1784938447.810362:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 667 00000100:00100000:2.0:1784938447.810372:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+74:17112:x1871643337548800:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938447.810396:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938447.810419:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00c00/0x7b044d4128f9e672 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664ac2 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.810500:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e679 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.810515:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e679 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.810526:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e679 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.810541:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e680 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xbb599949 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.810547:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e680 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.810553:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e680 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.810589:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e679 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.810595:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e679 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.810601:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e679 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.810607:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d01c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938447.810612:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e679 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.810620:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e679 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.810631:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938447.810634:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.810639:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e679 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.810646:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e679 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.810656:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e680 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.810662:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e680 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.810667:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e680 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.810672:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d00000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938447.810675:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e680 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.810681:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e680 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.810687:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xbb599949 (ffff9f23861e4d00) 00010000:00010000:2.0:1784938447.810689:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.810692:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e680 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.810697:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e680 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.810727:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00c00/0x7b044d4128f9e672 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664ac2 expref: 75 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.810737:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938447.810739:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.810743:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00c00/0x7b044d4128f9e672 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664ac2 expref: 75 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.810751:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d00c00, rc 0) 00000100:00100000:2.0:1784938447.810802:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+74:17112:x1871643337548800:12345-192.168.202.54@tcp:101:cp.0 Request processed in 431us (582us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938447.810810:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 667 00000100:00100000:2.0:1784938447.814088:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.814110:0:25738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337548928 00000100:00100000:3.0:1784938447.814120:0:25738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337548928 00000100:00100000:3.0:1784938447.814184:0:25738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 668 00000100:00100000:3.0:1784938447.814195:0:25738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+74:17112:x1871643337548928:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938447.814214:0:25738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938447.814234:0:25738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a000/0x7b044d4128f9e687 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664ac9 expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.814310:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e68e lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.814325:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e68e lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.814340:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e68e lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.814354:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e695 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xbb599949 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.814360:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e695 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.814367:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e695 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.814402:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e68e lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.814409:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e68e lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.814416:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e68e lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.814422:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61a400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938447.814426:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e68e lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.814442:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e68e lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.814453:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938447.814456:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.814460:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e68e lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.814465:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e68e lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.814475:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e695 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.814480:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e695 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.814484:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e695 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.814489:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61a200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938447.814492:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e695 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.814497:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e695 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.814503:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xbb599949 (ffff9f24975b2100) 00010000:00010000:3.0:1784938447.814505:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.814508:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e695 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.814516:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e695 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.814544:0:25738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a000/0x7b044d4128f9e687 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664ac9 expref: 75 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.814553:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938447.814555:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.814559:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a000/0x7b044d4128f9e687 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664ac9 expref: 75 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.814568:0:25738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61a000, rc 0) 00000100:00100000:3.0:1784938447.814634:0:25738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+74:17112:x1871643337548928:12345-192.168.202.54@tcp:101:cp.0 Request processed in 441us (556us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938447.814643:0:25738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 668 00000100:00100000:2.0:1784938447.832594:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938447.832700:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337549184 00000100:00100000:1.0:1784938447.832710:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337549184 00000100:00100000:1.0:1784938447.832807:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 669 00000100:00100000:1.0:1784938447.832816:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+74:17112:x1871643337549184:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938447.832836:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938447.832858:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9e69c lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664ad0 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.832958:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fde00/0x7b044d4128f9e6a3 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.832974:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fde00/0x7b044d4128f9e6a3 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.832995:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fde00/0x7b044d4128f9e6a3 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.833010:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd200/0x7b044d4128f9e6aa lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0xbb599949 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.833018:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd200/0x7b044d4128f9e6aa lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.833025:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd200/0x7b044d4128f9e6aa lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938447.833376:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x5e:0x0], index 1: 0 00010000:00010000:1.0:1784938447.833504:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc600/0x7b044d4128f9e6b1 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.833514:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc600/0x7b044d4128f9e6b1 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.833520:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc600/0x7b044d4128f9e6b1 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.833551:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fde00/0x7b044d4128f9e6a3 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.833558:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fde00/0x7b044d4128f9e6a3 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.833564:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fde00/0x7b044d4128f9e6a3 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.833571:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fde00/0x7b044d4128f9e6a3 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.833577:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fde00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938447.833581:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fde00/0x7b044d4128f9e6a3 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.833588:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fde00/0x7b044d4128f9e6a3 lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.833599:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938447.833602:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938447.833606:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fde00/0x7b044d4128f9e6a3 lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.833613:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fde00/0x7b044d4128f9e6a3 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938447.833623:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c751df73 reply state 0000000091b8134c transno 8589934800 ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd200/0x7b044d4128f9e6aa lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.833634:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd200/0x7b044d4128f9e6aa lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.833640:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xbb599949 (ffff9f24b67c7300) 00010000:00010000:1.0:1784938447.833643:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938447.833645:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938447.833671:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9e69c lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664ad0 expref: 77 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.833685:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc600/0x7b044d4128f9e6b1 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664ad0 expref: 76 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.833693:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x3a:0x0].0x0 (ffff9f24b67c7700) 00010000:00010000:1.0:1784938447.833695:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938447.833697:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fc600, rc 0) 00000100:00100000:1.0:1784938447.833755:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+77:17112:x1871643337549184:12345-192.168.202.54@tcp:101:cp.0 Request processed in 939us (1169us total) trans 8589934800 rc 0/0 00000100:00100000:1.0:1784938447.833762:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 669 00000100:00100000:2.0:1784938447.846469:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.846668:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337549312 00000100:00100000:0.0:1784938447.846681:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337549312 00000100:00100000:0.0:1784938447.846734:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 936 00000100:00100000:0.0:1784938447.846745:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+71:10960:x1871643337549312:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938447.846765:0:25716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938447.846783:0:25716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4b367e8/0x7b044d4128f9e6bf lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664ad7 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938447.846809:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938447.846825:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5e:0x0].0x0 since=714s v=(0 0) 00010000:00010000:0.0:1784938447.846829:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938447.846836:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4b367e8/0x7b044d4128f9e6bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664ad7 expref: 72 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.846850:0:25716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c4b367e8/0x7b044d4128f9e6bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664ad7 expref: 72 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.846869:0:25716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382394a00, rc 0) 00000100:00100000:0.0:1784938447.846914:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+72:10960:x1871643337549312:12345-192.168.202.54@tcp:101:cp.0 Request processed in 172us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938447.846921:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 936 00000100:00100000:1.0:1784938447.854474:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.854571:0:25729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337549440 00000100:00100000:3.0:1784938447.854581:0:25729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337549440 00000100:00100000:3.0:1784938447.854681:0:25729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 937 00000100:00100000:3.0:1784938447.854692:0:25729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7ea6e988-18ba-4c98-b179-17995571b98b+72:17112:x1871643337549440:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938447.854711:0:25729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938447.854728:0:25729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c010a79b/0x7b044d4128f9e6c6 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664ade expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.854761:0:25729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4b367e8/0x7b044d4128f9e6bf lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664ad7 expref: 73 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.854774:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938447.854778:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938447.854782:0:25729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c010a79b/0x7b044d4128f9e6c6 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->147455] (req 0->147455) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664ade expref: 73 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.854814:0:25729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c4b367e8/0x7b044d4128f9e6bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664ad7 expref: 73 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.854827:0:25729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c4b367e8/0x7b044d4128f9e6bf lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664ad7 expref: 73 pid: 25716 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938447.854840:0:25729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:25729:1871643350905984:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938447.855007:0:25729:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f23873a9180 going to sleep for 11 seconds 00000100:00100000:2.0:1784938447.858501:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938447.858579:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337549568 00000100:00100000:1.0:1784938447.858589:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337549568 00010000:00010000:1.0:1784938447.858627:0:25731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c4b367e8/0x7b044d4128f9e6bf lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664ad7 expref: 74 pid: 25716 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938447.858715:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 470 00000100:00100000:1.0:1784938447.858726:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+74:10959:x1871643337549568:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938447.858741:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938447.858764:0:25731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c4b367e8/0x7b044d4128f9e6bf lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664ad7 expref: 74 pid: 25716 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.858778:0:25731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c4b367e8/0x7b044d4128f9e6bf lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664ad7 expref: 74 pid: 25716 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.858807:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938447.858812:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938447.858822:0:25731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c010a79b/0x7b044d4128f9e6c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664ade expref: 74 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.858833:0:25731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c010a79b/0x7b044d4128f9e6c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664ade expref: 74 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.858881:0:25731:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c010a79b/0x7b044d4128f9e6c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664ade expref: 74 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938447.858895:0:25731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:25731:1871643350906112:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938447.858975:0:25731:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238da84c00 going to sleep for 11 seconds 00010000:00010000:3.0:1784938447.859197:0:25729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4b367e8/0x7b044d4128f9e6bf lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664ad7 expref: 74 pid: 25716 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938447.859215:0:25729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:25729:1871643350905984:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938447.859238:0:25729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c010a79b/0x7b044d4128f9e6c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664ade expref: 73 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.859248:0:25729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61a000, rc 0) 00000100:00100000:3.0:1784938447.859277:0:25729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7ea6e988-18ba-4c98-b179-17995571b98b+73:17112:x1871643337549440:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4587us (4816us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938447.859299:0:25729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 937 00000100:00100000:1.0:1784938447.861790:0:25731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:25731:1871643350906112:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938447.861813:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938447.861894:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+72:10959:x1871643337549568:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3168us (3401us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938447.861908:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 470 00000100:00100000:0.0:1784938447.867189:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938447.867246:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337549824 00000100:00100000:1.0:1784938447.867256:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337549824 00000100:00100000:1.0:1784938447.867323:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 158 00000100:00100000:1.0:1784938447.867333:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+77:17112:x1871643337549824:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:1.0:1784938447.867660:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+78:17112:x1871643337549824:12345-192.168.202.54@tcp:35:cp.0 Request processed in 328us (512us total) trans 8589934801 rc 0/0 00000100:00100000:1.0:1784938447.867668:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 158 00000100:00100000:2.0:1784938447.871308:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.871546:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337549952 00000100:00100000:0.0:1784938447.871557:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337549952 00000100:00100000:0.0:1784938447.871617:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 670 00000100:00100000:0.0:1784938447.871626:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+78:17112:x1871643337549952:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938447.871653:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938447.871675:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394c00/0x7b044d4128f9e6cd lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664ae5 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.871739:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e6d4 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.871759:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e6d4 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.871774:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e6d4 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.871789:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e6db lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x1a616f3f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.871796:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e6db lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.871802:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e6db lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.871845:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e6d4 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.871967:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e6d4 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.871975:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e6d4 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.872080:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.872085:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e6d4 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.872094:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e6d4 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.872107:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938447.872111:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.872116:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e6d4 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.872123:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394200/0x7b044d4128f9e6d4 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.872254:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e6db lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.872261:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e6db lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.872268:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e6db lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.872273:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382395200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.872276:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e6db lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.872283:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e6db lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.872304:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x1a616f3f (ffff9f248fb6cd00) 00010000:00010000:0.0:1784938447.872306:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.872310:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e6db lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.872316:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e6db lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.872354:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394c00/0x7b044d4128f9e6cd lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664ae5 expref: 79 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.872365:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938447.872367:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.872371:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394c00/0x7b044d4128f9e6cd lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664ae5 expref: 79 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.872379:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382394c00, rc 0) 00000100:00100000:0.0:1784938447.872488:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+78:17112:x1871643337549952:12345-192.168.202.54@tcp:101:cp.0 Request processed in 862us (1200us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938447.872495:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 670 00000100:00100000:0.0:1784938447.875575:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.875667:0:25738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337550080 00000100:00100000:3.0:1784938447.875676:0:25738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337550080 00000100:00100000:3.0:1784938447.875786:0:25738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 671 00000100:00100000:3.0:1784938447.875797:0:25738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+78:17112:x1871643337550080:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938447.875819:0:25738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938447.875840:0:25738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e6e2 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664aec expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.875921:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e6e9 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.875935:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e6e9 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.875946:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e6e9 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.875962:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e6f0 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x1a616f3f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.875969:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e6f0 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.875975:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e6f0 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.876025:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e6e9 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.876036:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e6e9 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.876041:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e6e9 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.876046:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61a400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938447.876051:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e6e9 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.876058:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e6e9 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.876069:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938447.876072:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.876076:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e6e9 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.876082:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e6e9 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.876097:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e6f0 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.876103:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e6f0 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.876109:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e6f0 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.876114:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61b000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938447.876118:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e6f0 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.876124:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e6f0 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.876142:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x1a616f3f (ffff9f24975b2100) 00010000:00010000:3.0:1784938447.876189:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.876193:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e6f0 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.876199:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e6f0 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.876232:0:25738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e6e2 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664aec expref: 79 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.876243:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938447.876245:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.876249:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e6e2 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664aec expref: 79 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.876259:0:25738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61a200, rc 0) 00000100:00100000:3.0:1784938447.876330:0:25738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+78:17112:x1871643337550080:12345-192.168.202.54@tcp:101:cp.0 Request processed in 534us (763us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938447.876338:0:25738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 671 00000100:00100000:1.0:1784938447.879612:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.879696:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337550336 00000100:00100000:0.0:1784938447.879705:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337550336 00000100:00100000:0.0:1784938447.879768:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 672 00000100:00100000:0.0:1784938447.879779:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+78:17112:x1871643337550336:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938447.879800:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938447.879825:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394a00/0x7b044d4128f9e6f7 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664af3 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.879940:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e6fe lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.879954:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e6fe lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.879964:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e6fe lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.879983:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394400/0x7b044d4128f9e705 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x1a616f3f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.879990:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394400/0x7b044d4128f9e705 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.879996:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394400/0x7b044d4128f9e705 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938447.880370:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x5e:0x0], index 0: 0 00010000:00010000:0.0:1784938447.880518:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395a00/0x7b044d4128f9e70c lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.880526:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395a00/0x7b044d4128f9e70c lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.880534:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395a00/0x7b044d4128f9e70c lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.880566:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e6fe lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.880574:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e6fe lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.880580:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e6fe lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.880586:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e6fe lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.880591:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.880595:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e6fe lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.880602:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e6fe lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.880612:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938447.880615:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.880619:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e6fe lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.880626:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e6fe lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938447.880640:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006b8cb530 reply state 0000000092697e5d transno 8589934802 ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394400/0x7b044d4128f9e705 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.880650:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394400/0x7b044d4128f9e705 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.880655:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x1a616f3f (ffff9f248fb6cc00) 00010000:00010000:0.0:1784938447.880657:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938447.880660:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938447.880687:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394a00/0x7b044d4128f9e6f7 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664af3 expref: 81 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.880701:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395a00/0x7b044d4128f9e70c lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664af3 expref: 80 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.880707:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x3b:0x0].0x0 (ffff9f248fb6c500) 00010000:00010000:0.0:1784938447.880709:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938447.880712:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382395a00, rc 0) 00000100:00100000:0.0:1784938447.880769:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+81:17112:x1871643337550336:12345-192.168.202.54@tcp:101:cp.0 Request processed in 992us (1170us total) trans 8589934802 rc 0/0 00000100:00100000:0.0:1784938447.880777:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 672 00000100:00100000:1.0:1784938447.884639:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.884741:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337550464 00000100:00100000:0.0:1784938447.884752:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337550464 00000100:00100000:0.0:1784938447.884814:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 938 00000100:00100000:0.0:1784938447.884824:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+75:10957:x1871643337550464:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938447.884843:0:21149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938447.884873:0:21149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7d699b7/0x7b044d4128f9e71a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664afa expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938447.884898:0:21149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938447.884919:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5e:0x0].0x0 since=714s v=(0 0) 00010000:00010000:0.0:1784938447.884925:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938447.884935:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d699b7/0x7b044d4128f9e71a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664afa expref: 76 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.884955:0:21149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d7d699b7/0x7b044d4128f9e71a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664afa expref: 76 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.884969:0:21149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382394c00, rc 0) 00000100:00100000:0.0:1784938447.885030:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+76:10957:x1871643337550464:12345-192.168.202.54@tcp:101:cp.0 Request processed in 208us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938447.885037:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 938 00000100:00100000:1.0:1784938447.888571:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.888641:0:25724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337550592 00000100:00100000:0.0:1784938447.888653:0:25724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337550592 00000100:00100000:0.0:1784938447.888716:0:25724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 939 00000100:00100000:0.0:1784938447.888727:0:25724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7ea6e988-18ba-4c98-b179-17995571b98b+76:17112:x1871643337550592:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938447.888754:0:25724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938447.888778:0:25724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4b367e8/0x7b044d4128f9e721 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664b01 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.888812:0:25724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7d699b7/0x7b044d4128f9e71a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664afa expref: 77 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.888822:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938447.888826:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938447.888831:0:25724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4b367e8/0x7b044d4128f9e721 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->172031] (req 0->172031) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b01 expref: 77 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.888884:0:25724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d7d699b7/0x7b044d4128f9e71a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664afa expref: 77 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.888900:0:25724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d7d699b7/0x7b044d4128f9e71a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664afa expref: 77 pid: 21149 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938447.888914:0:25724:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:25724:1871643350906240:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938447.889010:0:25724:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2484c739c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938447.891900:0:25724:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:25724:1871643350906240:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938447.891939:0:25724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c4b367e8/0x7b044d4128f9e721 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->172031] (req 0->172031) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664b01 expref: 77 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.891964:0:25724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382394a00, rc 0) 00000100:00100000:0.0:1784938447.892034:0:25724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7ea6e988-18ba-4c98-b179-17995571b98b+77:17112:x1871643337550592:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3307us (3475us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938447.892042:0:25724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 939 00000100:00100000:1.0:1784938447.893298:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.893390:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337550720 00000100:00100000:0.0:1784938447.893397:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337550720 00010000:00010000:0.0:1784938447.893430:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d699b7/0x7b044d4128f9e71a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664afa expref: 77 pid: 21149 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938447.893473:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 471 00000100:00100000:0.0:1784938447.893481:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+77:10957:x1871643337550720:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938447.893495:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938447.893517:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d7d699b7/0x7b044d4128f9e71a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664afa expref: 77 pid: 21149 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.893530:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d7d699b7/0x7b044d4128f9e71a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664afa expref: 77 pid: 21149 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.893554:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7d699b7/0x7b044d4128f9e71a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664afa expref: 77 pid: 21149 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.893571:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938447.893576:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938447.893584:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4b367e8/0x7b044d4128f9e721 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664b01 expref: 76 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.893596:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4b367e8/0x7b044d4128f9e721 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664b01 expref: 76 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.893629:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c4b367e8/0x7b044d4128f9e721 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664b01 expref: 76 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938447.893642:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:19221:1871643350906368:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938447.893720:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2484c739c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938447.896456:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:19221:1871643350906368:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938447.896484:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938447.896544:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+76:10957:x1871643337550720:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3062us (3257us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938447.896555:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 471 00000100:00100000:2.0:1784938447.902212:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.902356:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337550976 00000100:00100000:0.0:1784938447.902366:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337550976 00000100:00100000:0.0:1784938447.902427:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 159 00000100:00100000:0.0:1784938447.902437:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24857fe050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+81:17112:x1871643337550976:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:0.0:1784938447.902759:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24857fe050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+82:17112:x1871643337550976:12345-192.168.202.54@tcp:35:cp.0 Request processed in 322us (556us total) trans 8589934803 rc 0/0 00000100:00100000:0.0:1784938447.902766:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 159 00000100:00100000:1.0:1784938447.906257:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938447.906358:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337551104 00000100:00100000:0.0:1784938447.906367:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337551104 00000100:00100000:0.0:1784938447.906431:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 673 00000100:00100000:0.0:1784938447.906442:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+82:17112:x1871643337551104:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938447.906466:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938447.906487:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394c00/0x7b044d4128f9e728 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664b08 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.906550:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e72f lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.906565:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e72f lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.906577:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e72f lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.906591:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e736 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x6d38f012 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.906599:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e736 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.906605:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e736 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.906643:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e72f lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.906650:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e72f lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.906656:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e72f lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.906662:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.906666:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e72f lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.906673:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e72f lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.906684:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938447.906688:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.906692:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e72f lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.906699:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e72f lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.906712:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e736 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.906718:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e736 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.906723:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e736 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.906728:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382395200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938447.906731:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e736 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.906737:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e736 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.906744:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x6d38f012 (ffff9f248fb6cb00) 00010000:00010000:0.0:1784938447.906746:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.906750:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e736 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.906756:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e736 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.906788:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394c00/0x7b044d4128f9e728 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b08 expref: 83 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.906798:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938447.906800:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938447.906803:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394c00/0x7b044d4128f9e728 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b08 expref: 83 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.906811:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382394c00, rc 0) 00000100:00100000:0.0:1784938447.906881:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+82:17112:x1871643337551104:12345-192.168.202.54@tcp:101:cp.0 Request processed in 441us (633us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938447.906888:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 673 00000100:00100000:2.0:1784938447.910081:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.910219:0:25738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337551232 00000100:00100000:3.0:1784938447.910229:0:25738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337551232 00000100:00100000:3.0:1784938447.910323:0:25738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 674 00000100:00100000:3.0:1784938447.910334:0:25738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+82:17112:x1871643337551232:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938447.910354:0:25738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938447.910375:0:25738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e73d lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664b0f expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.910436:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e744 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.910450:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e744 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.910461:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e744 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.910474:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e74b lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x6d38f012 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.910480:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e74b lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.910486:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e74b lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.910524:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e744 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.910531:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e744 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.910537:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e744 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.910542:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61b000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938447.910547:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e744 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.910554:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e744 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.910565:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938447.910568:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.910572:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e744 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.910579:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e744 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.910594:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e74b lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.910600:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e74b lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.910605:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e74b lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.910610:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61a400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938447.910613:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e74b lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.910618:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e74b lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.910625:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x6d38f012 (ffff9f24975b2100) 00010000:00010000:3.0:1784938447.910627:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.910630:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e74b lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.910635:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e74b lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.910666:0:25738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e73d lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b0f expref: 83 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.910676:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938447.910678:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.910682:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e73d lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b0f expref: 83 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.910691:0:25738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61a200, rc 0) 00000100:00100000:3.0:1784938447.910815:0:25738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+82:17112:x1871643337551232:12345-192.168.202.54@tcp:101:cp.0 Request processed in 482us (743us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938447.910823:0:25738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 674 00000100:00100000:1.0:1784938447.916526:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.916668:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337551488 00000100:00100000:2.0:1784938447.916681:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337551488 00000100:00100000:2.0:1784938447.916757:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 675 00000100:00100000:2.0:1784938447.916766:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+82:17112:x1871643337551488:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938447.916789:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938447.916813:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9e752 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664b16 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.917059:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e759 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.917074:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e759 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.917084:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e759 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.917098:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e760 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x6d38f012 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.917106:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e760 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.917111:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e760 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938447.917475:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x5f:0x0], index 1: 0 00010000:00010000:2.0:1784938447.917617:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9e767 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.917626:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9e767 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.917633:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9e767 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.917668:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e759 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.917675:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e759 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.917680:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e759 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.917686:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e759 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.917692:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382038200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938447.917696:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e759 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.917703:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e759 lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.917715:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938447.917718:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.917722:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e759 lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.917728:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e759 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938447.917741:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e21c8a17 reply state 000000001ad35fd5 transno 8589934804 ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e760 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.917750:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e760 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.917757:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x6d38f012 (ffff9f23861e4d00) 00010000:00010000:2.0:1784938447.917759:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938447.917762:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938447.917790:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9e752 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b16 expref: 85 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.917803:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9e767 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b16 expref: 84 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.917809:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x3c:0x0].0x0 (ffff9f248fb6a600) 00010000:00010000:2.0:1784938447.917812:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938447.917814:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fec00, rc 0) 00000100:00100000:2.0:1784938447.918367:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+85:17112:x1871643337551488:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1599us (1849us total) trans 8589934804 rc 0/0 00000100:00100000:2.0:1784938447.918377:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 675 00000100:00100000:1.0:1784938447.922085:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.922336:0:25725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337551616 00000100:00100000:3.0:1784938447.922348:0:25725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337551616 00000100:00100000:1.0:1784938447.922531:0:25725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 940 00000100:00100000:1.0:1784938447.922542:0:25725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7ea6e988-18ba-4c98-b179-17995571b98b+72:10959:x1871643337551616:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938447.922565:0:25725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938447.922589:0:25725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000208322d9/0x7b044d4128f9e775 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664b1d expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938447.922616:0:25725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938447.922637:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5f:0x0].0x0 since=714s v=(0 0) 00010000:00010000:1.0:1784938447.922642:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938447.922653:0:25725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000208322d9/0x7b044d4128f9e775 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b1d expref: 73 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.922670:0:25725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000208322d9/0x7b044d4128f9e775 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b1d expref: 73 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.922684:0:25725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fde00, rc 0) 00000100:00100000:1.0:1784938447.922760:0:25725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7ea6e988-18ba-4c98-b179-17995571b98b+73:10959:x1871643337551616:12345-192.168.202.54@tcp:101:cp.0 Request processed in 219us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938447.922767:0:25725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 940 00000100:00100000:1.0:1784938447.925910:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.925993:0:25718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337551744 00000100:00100000:3.0:1784938447.926002:0:25718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337551744 00000100:00100000:3.0:1784938447.926063:0:25718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 941 00000100:00100000:3.0:1784938447.926073:0:25718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ea6e988-18ba-4c98-b179-17995571b98b+73:17112:x1871643337551744:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938447.926090:0:25718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938447.926108:0:25718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b04cfea/0x7b044d4128f9e77c lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664b24 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.926180:0:25718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000208322d9/0x7b044d4128f9e775 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b1d expref: 74 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.926189:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938447.926193:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938447.926197:0:25718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b04cfea/0x7b044d4128f9e77c lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b24 expref: 74 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.926230:0:25718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000208322d9/0x7b044d4128f9e775 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664b1d expref: 74 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.926244:0:25718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000208322d9/0x7b044d4128f9e775 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664b1d expref: 74 pid: 25725 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938447.926257:0:25718:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25718:1871643350906496:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938447.926336:0:25718:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f23873a9180 going to sleep for 11 seconds 00000100:00100000:0.0:1784938447.929605:0:25718:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25718:1871643350906496:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938447.929643:0:25718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006b04cfea/0x7b044d4128f9e77c lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664b24 expref: 74 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938447.929668:0:25718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61b200, rc 0) 00000100:00100000:0.0:1784938447.929733:0:25718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ea6e988-18ba-4c98-b179-17995571b98b+74:17112:x1871643337551744:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3661us (3833us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938447.929742:0:25718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 941 00000100:00100000:1.0:1784938447.930893:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.930968:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337551872 00000100:00100000:2.0:1784938447.930976:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337551872 00010000:00010000:2.0:1784938447.931018:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000208322d9/0x7b044d4128f9e775 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664b1d expref: 74 pid: 25725 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938447.931065:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 472 00000100:00100000:2.0:1784938447.931074:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248301b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+74:10960:x1871643337551872:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938447.931090:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938447.931112:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000208322d9/0x7b044d4128f9e775 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664b1d expref: 74 pid: 25725 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.931123:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000208322d9/0x7b044d4128f9e775 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664b1d expref: 74 pid: 25725 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.931186:0:22955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000208322d9/0x7b044d4128f9e775 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664b1d expref: 74 pid: 25725 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.931202:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.931206:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.931215:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006b04cfea/0x7b044d4128f9e77c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664b24 expref: 73 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.931225:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b04cfea/0x7b044d4128f9e77c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664b24 expref: 73 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.931264:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006b04cfea/0x7b044d4128f9e77c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664b24 expref: 73 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938447.931278:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22955:1871643350906624:192.168.202.54@tcp:105: 00000100:00100000:2.0:1784938447.931352:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238ee376c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938447.936538:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.936650:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22955:1871643350906624:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938447.936673:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938447.936734:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248301b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+73:10960:x1871643337551872:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 5660us (5844us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938447.936746:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 472 00000100:00100000:0.0:1784938447.937841:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337552128 00000100:00100000:0.0:1784938447.937861:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337552128 00000100:00100000:0.0:1784938447.938111:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 160 00000100:00100000:0.0:1784938447.938120:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+85:17112:x1871643337552128:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:0.0:1784938447.938451:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+86:17112:x1871643337552128:12345-192.168.202.54@tcp:35:cp.0 Request processed in 331us (1922us total) trans 8589934805 rc 0/0 00000100:00100000:0.0:1784938447.938458:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 160 00000100:00100000:1.0:1784938447.941366:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.941454:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337552256 00000100:00100000:3.0:1784938447.941462:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337552256 00000100:00100000:3.0:1784938447.941529:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 676 00000100:00100000:3.0:1784938447.941539:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+86:17112:x1871643337552256:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938447.941565:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938447.941586:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e783 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664b2b expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.941654:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e78a lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.941669:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e78a lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.941680:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e78a lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.941694:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e791 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x52815b39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.941701:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e791 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.941707:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e791 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.941748:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e78a lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.941755:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e78a lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.941760:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e78a lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.941767:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61a400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938447.941770:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e78a lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.941777:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e78a lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.941789:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938447.941792:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.941797:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e78a lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.941803:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e78a lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.941818:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e791 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.941824:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e791 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.941829:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e791 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.941835:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61b000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938447.941838:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e791 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.941843:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e791 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.941861:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x52815b39 (ffff9f24975b2100) 00010000:00010000:3.0:1784938447.941864:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.941867:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e791 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.941873:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e791 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.941907:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e783 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b2b expref: 87 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.941921:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938447.941923:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.941927:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e783 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b2b expref: 87 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.941937:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61a200, rc 0) 00000100:00100000:3.0:1784938447.941992:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+86:17112:x1871643337552256:12345-192.168.202.54@tcp:101:cp.0 Request processed in 454us (635us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938447.942000:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 676 00000100:00100000:1.0:1784938447.945084:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.945198:0:25738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337552384 00000100:00100000:3.0:1784938447.945209:0:25738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337552384 00000100:00100000:3.0:1784938447.945265:0:25738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 677 00000100:00100000:3.0:1784938447.945276:0:25738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+86:17112:x1871643337552384:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938447.945304:0:25738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938447.945327:0:25738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00c00/0x7b044d4128f9e798 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664b32 expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.945395:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e79f lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.945410:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e79f lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.945422:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e79f lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.945437:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e7a6 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x52815b39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.945445:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e7a6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.945452:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e7a6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.945490:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e79f lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.945497:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e79f lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.945504:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e79f lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.945510:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d00000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938447.945514:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e79f lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.945522:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e79f lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.945534:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938447.945537:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.945542:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e79f lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.945548:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e79f lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.945562:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e7a6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.945569:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e7a6 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.945574:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e7a6 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.945579:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d01c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938447.945582:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e7a6 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.945588:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e7a6 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.945595:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x52815b39 (ffff9f24975b2800) 00010000:00010000:3.0:1784938447.945598:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.945601:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e7a6 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.945606:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e7a6 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.945641:0:25738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00c00/0x7b044d4128f9e798 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b32 expref: 87 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.945651:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938447.945654:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.945658:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00c00/0x7b044d4128f9e798 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b32 expref: 87 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.945672:0:25738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d00c00, rc 0) 00000100:00100000:3.0:1784938447.945911:0:25738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+86:17112:x1871643337552384:12345-192.168.202.54@tcp:101:cp.0 Request processed in 634us (837us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938447.945919:0:25738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 677 00000100:00100000:1.0:1784938447.949580:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.949684:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337552640 00000100:00100000:2.0:1784938447.949695:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337552640 00000100:00100000:2.0:1784938447.949784:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 678 00000100:00100000:2.0:1784938447.949795:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+86:17112:x1871643337552640:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938447.949818:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938447.949839:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9e7ad lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664b39 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.949962:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fe600/0x7b044d4128f9e7b4 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.949976:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fe600/0x7b044d4128f9e7b4 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.949999:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fe600/0x7b044d4128f9e7b4 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.950017:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9e7bb lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x52815b39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.950024:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9e7bb lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.950030:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9e7bb lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938447.950426:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x5f:0x0], index 0: 0 00010000:00010000:2.0:1784938447.950566:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e7c2 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.950576:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e7c2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.950583:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e7c2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.950615:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fe600/0x7b044d4128f9e7b4 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.950623:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fe600/0x7b044d4128f9e7b4 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.950629:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fe600/0x7b044d4128f9e7b4 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.950636:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fe600/0x7b044d4128f9e7b4 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.950641:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fe600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938447.950645:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fe600/0x7b044d4128f9e7b4 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.950653:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fe600/0x7b044d4128f9e7b4 lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.950664:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938447.950667:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.950671:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fe600/0x7b044d4128f9e7b4 lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.950677:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fe600/0x7b044d4128f9e7b4 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938447.950690:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000820c5868 reply state 000000002ab467c5 transno 8589934806 ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9e7bb lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.950701:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9e7bb lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.950706:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x52815b39 (ffff9f248fb6ad00) 00010000:00010000:2.0:1784938447.950708:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938447.950711:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938447.950741:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff000/0x7b044d4128f9e7ad lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b39 expref: 89 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.950755:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e7c2 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b39 expref: 88 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.950762:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x3d:0x0].0x0 (ffff9f248fb6a700) 00010000:00010000:2.0:1784938447.950764:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938447.950766:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382038200, rc 0) 00000100:00100000:2.0:1784938447.950898:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+89:17112:x1871643337552640:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1103us (1326us total) trans 8589934806 rc 0/0 00000100:00100000:2.0:1784938447.950905:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 678 00000100:00100000:0.0:1784938447.954422:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.954491:0:25719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337552768 00000100:00100000:3.0:1784938447.954501:0:25719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337552768 00000100:00100000:3.0:1784938447.954553:0:25719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 942 00000100:00100000:3.0:1784938447.954562:0:25719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7ea6e988-18ba-4c98-b179-17995571b98b+76:10958:x1871643337552768:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938447.954579:0:25719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938447.954598:0:25719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000146b94b7/0x7b044d4128f9e7d0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664b40 expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938447.954623:0:25719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938447.954644:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5f:0x0].0x0 since=714s v=(0 0) 00010000:00010000:3.0:1784938447.954648:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938447.954656:0:25719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000146b94b7/0x7b044d4128f9e7d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b40 expref: 77 pid: 25719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.954674:0:25719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000146b94b7/0x7b044d4128f9e7d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b40 expref: 77 pid: 25719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.954687:0:25719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d00600, rc 0) 00000100:00100000:3.0:1784938447.954747:0:25719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7ea6e988-18ba-4c98-b179-17995571b98b+77:10958:x1871643337552768:12345-192.168.202.54@tcp:101:cp.0 Request processed in 186us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938447.954758:0:25719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 942 00000100:00100000:1.0:1784938447.957595:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.957847:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337552896 00000100:00100000:2.0:1784938447.957866:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337552896 00000100:00100000:2.0:1784938447.957959:0:25720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 943 00000100:00100000:2.0:1784938447.957969:0:25720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7ea6e988-18ba-4c98-b179-17995571b98b+77:17112:x1871643337552896:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938447.957998:0:25720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938447.958021:0:25720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ff6aa56/0x7b044d4128f9e7d7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664b47 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.958052:0:25720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000146b94b7/0x7b044d4128f9e7d0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b40 expref: 78 pid: 25719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.958060:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.958064:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938447.958068:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ff6aa56/0x7b044d4128f9e7d7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->217087] (req 0->217087) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b47 expref: 78 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.958102:0:25720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000146b94b7/0x7b044d4128f9e7d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664b40 expref: 78 pid: 25719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.958116:0:25720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000146b94b7/0x7b044d4128f9e7d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664b40 expref: 78 pid: 25719 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938447.958130:0:25720:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:25720:1871643350906752:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938447.958235:0:25720:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238ee373c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938447.961306:0:25720:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:25720:1871643350906752:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938447.961341:0:25720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002ff6aa56/0x7b044d4128f9e7d7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->217087] (req 0->217087) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664b47 expref: 78 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.961366:0:25720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e00200, rc 0) 00000100:00100000:2.0:1784938447.961421:0:25720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7ea6e988-18ba-4c98-b179-17995571b98b+78:17112:x1871643337552896:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3452us (3835us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938447.961430:0:25720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 943 00000100:00100000:3.0:1784938447.968028:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938447.968135:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337553024 00000100:00100000:1.0:1784938447.968181:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337553024 00010000:00010000:1.0:1784938447.968224:0:25731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000146b94b7/0x7b044d4128f9e7d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664b40 expref: 78 pid: 25719 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938447.968271:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 473 00000100:00100000:1.0:1784938447.968281:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+78:10958:x1871643337553024:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938447.968307:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938447.968332:0:25731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000146b94b7/0x7b044d4128f9e7d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664b40 expref: 78 pid: 25719 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.968348:0:25731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000146b94b7/0x7b044d4128f9e7d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664b40 expref: 78 pid: 25719 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.968374:0:25731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000146b94b7/0x7b044d4128f9e7d0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664b40 expref: 78 pid: 25719 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.968391:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938447.968396:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938447.968403:0:25731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002ff6aa56/0x7b044d4128f9e7d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664b47 expref: 77 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.968413:0:25731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ff6aa56/0x7b044d4128f9e7d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664b47 expref: 77 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.968456:0:25731:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002ff6aa56/0x7b044d4128f9e7d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664b47 expref: 77 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938447.968470:0:25731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd255c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:25731:1871643350906880:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938447.968542:0:25731:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238da84840 going to sleep for 11 seconds 00000100:00100000:3.0:1784938447.974000:0:25731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd255c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:25731:1871643350906880:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938447.974029:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938447.974090:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+77:10958:x1871643337553024:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 5809us (6071us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938447.974100:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 473 00000100:00100000:0.0:1784938447.977433:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938447.977551:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337553280 00000100:00100000:1.0:1784938447.977561:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337553280 00000100:00100000:1.0:1784938447.977633:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 161 00000100:00100000:1.0:1784938447.977645:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+89:17112:x1871643337553280:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:1.0:1784938447.978011:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+90:17112:x1871643337553280:12345-192.168.202.54@tcp:35:cp.0 Request processed in 367us (590us total) trans 8589934807 rc 0/0 00000100:00100000:1.0:1784938447.978020:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 161 00000100:00100000:0.0:1784938447.985745:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938447.985979:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337553408 00000100:00100000:1.0:1784938447.986049:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337553408 00000100:00100000:1.0:1784938447.986113:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 679 00000100:00100000:1.0:1784938447.986122:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+90:17112:x1871643337553408:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938447.986343:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938447.986367:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e7de lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664b4e expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.986433:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e7e5 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.986447:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e7e5 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.986463:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e7e5 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.986477:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fcc00/0x7b044d4128f9e7ec lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9cfce7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.986484:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fcc00/0x7b044d4128f9e7ec lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.986491:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fcc00/0x7b044d4128f9e7ec lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.986534:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e7e5 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.986541:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e7e5 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.986546:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e7e5 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.986551:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e7e5 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.986556:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fd400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938447.986561:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e7e5 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.986568:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e7e5 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.986580:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938447.986584:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938447.986588:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e7e5 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.986593:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e7e5 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.986608:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fcc00/0x7b044d4128f9e7ec lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.986614:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fcc00/0x7b044d4128f9e7ec lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.986620:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fcc00/0x7b044d4128f9e7ec lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.986625:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fcc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938447.986628:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fcc00/0x7b044d4128f9e7ec lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.986633:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fcc00/0x7b044d4128f9e7ec lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.986640:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x9cfce7b5 (ffff9f24b67c7a00) 00010000:00010000:1.0:1784938447.986642:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938447.986645:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fcc00/0x7b044d4128f9e7ec lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.986651:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fcc00/0x7b044d4128f9e7ec lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.986683:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e7de lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b4e expref: 91 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.986695:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938447.986698:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938447.986702:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e7de lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b4e expref: 91 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938447.986711:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fca00, rc 0) 00000100:00100000:1.0:1784938447.986820:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+90:17112:x1871643337553408:12345-192.168.202.54@tcp:101:cp.0 Request processed in 698us (1085us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938447.986828:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 679 00000100:00100000:1.0:1784938447.990534:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938447.990625:0:25738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337553536 00000100:00100000:3.0:1784938447.990636:0:25738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337553536 00000100:00100000:3.0:1784938447.990742:0:25738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 680 00000100:00100000:3.0:1784938447.990754:0:25738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+90:17112:x1871643337553536:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938447.990777:0:25738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938447.990799:0:25738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00c00/0x7b044d4128f9e7f3 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664b55 expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.990940:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e7fa lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.990954:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e7fa lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.990965:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e7fa lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.991040:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e801 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9cfce7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.991050:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e801 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.991058:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e801 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.991101:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e7fa lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.991108:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e7fa lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.991114:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e7fa lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.991120:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d01c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938447.991337:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e7fa lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.991348:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e7fa lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.991361:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938447.991364:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.991369:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e7fa lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.991376:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e7fa lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.991391:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e801 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.991397:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e801 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.991403:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e801 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.991409:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d00000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938447.991412:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e801 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.991418:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e801 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.991426:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x9cfce7b5 (ffff9f24975b2800) 00010000:00010000:3.0:1784938447.991428:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.991431:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e801 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.991437:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e801 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.991472:0:25738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00c00/0x7b044d4128f9e7f3 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b55 expref: 91 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.991481:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938447.991484:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938447.991487:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00c00/0x7b044d4128f9e7f3 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b55 expref: 91 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938447.991496:0:25738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d00c00, rc 0) 00000100:00100000:3.0:1784938447.991717:0:25738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+90:17112:x1871643337553536:12345-192.168.202.54@tcp:101:cp.0 Request processed in 963us (1191us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938447.991728:0:25738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 680 00000100:00100000:0.0:1784938447.994605:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938447.994661:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337553792 00000100:00100000:2.0:1784938447.994672:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337553792 00000100:00100000:2.0:1784938447.994732:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 681 00000100:00100000:2.0:1784938447.994742:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+90:17112:x1871643337553792:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938447.994761:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938447.994780:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00000/0x7b044d4128f9e808 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664b5c expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.994888:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01200/0x7b044d4128f9e80f lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.994902:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01200/0x7b044d4128f9e80f lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.994913:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01200/0x7b044d4128f9e80f lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.994929:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00a00/0x7b044d4128f9e816 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x9cfce7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.994936:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00a00/0x7b044d4128f9e816 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.994942:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00a00/0x7b044d4128f9e816 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938447.995295:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x60:0x0], index 1: 0 00010000:00010000:2.0:1784938447.995448:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01800/0x7b044d4128f9e81d lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.995457:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01800/0x7b044d4128f9e81d lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.995464:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01800/0x7b044d4128f9e81d lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.995501:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01200/0x7b044d4128f9e80f lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.995508:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01200/0x7b044d4128f9e80f lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.995515:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01200/0x7b044d4128f9e80f lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.995522:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01200/0x7b044d4128f9e80f lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.995529:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e01200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938447.995533:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01200/0x7b044d4128f9e80f lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.995540:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01200/0x7b044d4128f9e80f lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.995553:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938447.995555:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938447.995560:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01200/0x7b044d4128f9e80f lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.995567:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01200/0x7b044d4128f9e80f lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938447.995580:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000622cbe11 reply state 000000008dfe88d1 transno 8589934808 ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00a00/0x7b044d4128f9e816 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.995590:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00a00/0x7b044d4128f9e816 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.995596:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x9cfce7b5 (ffff9f2497006e00) 00010000:00010000:2.0:1784938447.995598:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938447.995600:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938447.995631:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00000/0x7b044d4128f9e808 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b5c expref: 93 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.995644:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01800/0x7b044d4128f9e81d lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b5c expref: 92 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938447.995651:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x3e:0x0].0x0 (ffff9f2497006c00) 00010000:00010000:2.0:1784938447.995653:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938447.995655:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e01800, rc 0) 00000100:00100000:2.0:1784938447.996423:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+93:17112:x1871643337553792:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1679us (1824us total) trans 8589934808 rc 0/0 00000100:00100000:2.0:1784938447.996433:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 681 00000100:00100000:0.0:1784938447.999920:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938448.000096:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337553920 00000100:00100000:2.0:1784938448.000108:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337553920 00000100:00100000:2.0:1784938448.000429:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 944 00000100:00100000:2.0:1784938448.000443:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+73:10960:x1871643337553920:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938448.000469:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938448.000493:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000507b298e/0x7b044d4128f9e82b lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664b63 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938448.000523:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x60:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938448.000545:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x60:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1784938448.000550:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x60:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938448.000559:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000507b298e/0x7b044d4128f9e82b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b63 expref: 74 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.000576:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000507b298e/0x7b044d4128f9e82b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b63 expref: 74 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.000589:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e00c00, rc 0) 00000100:00100000:2.0:1784938448.000659:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+74:10960:x1871643337553920:12345-192.168.202.54@tcp:101:cp.0 Request processed in 219us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938448.000667:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 944 00000100:00100000:1.0:1784938448.003467:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938448.003559:0:25727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337554048 00000100:00100000:3.0:1784938448.003569:0:25727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337554048 00000100:00100000:3.0:1784938448.003625:0:25727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 945 00000100:00100000:3.0:1784938448.003635:0:25727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7ea6e988-18ba-4c98-b179-17995571b98b+74:17112:x1871643337554048:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938448.003653:0:25727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938448.003672:0:25727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea7f802e/0x7b044d4128f9e832 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664b6a expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.003702:0:25727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000507b298e/0x7b044d4128f9e82b lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b63 expref: 75 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.003711:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x60:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938448.003715:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x60:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938448.003720:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea7f802e/0x7b044d4128f9e832 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->200703] (req 0->200703) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b6a expref: 75 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.003754:0:25727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000507b298e/0x7b044d4128f9e82b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664b63 expref: 75 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.003768:0:25727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000507b298e/0x7b044d4128f9e82b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664b63 expref: 75 pid: 21151 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938448.003783:0:25727:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:25727:1871643350907008:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938448.003873:0:25727:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f23873a9180 going to sleep for 11 seconds 00000100:00100000:1.0:1784938448.006544:0:25727:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:25727:1871643350907008:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938448.006578:0:25727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ea7f802e/0x7b044d4128f9e832 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->200703] (req 0->200703) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664b6a expref: 75 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.006599:0:25727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d00c00, rc 0) 00000100:00100000:1.0:1784938448.006659:0:25727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7ea6e988-18ba-4c98-b179-17995571b98b+75:17112:x1871643337554048:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3025us (3202us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938448.006667:0:25727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 945 00000100:00100000:0.0:1784938448.008789:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938448.009107:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337554176 00000100:00100000:2.0:1784938448.009117:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337554176 00010000:00010000:2.0:1784938448.009283:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000507b298e/0x7b044d4128f9e82b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664b63 expref: 75 pid: 21151 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938448.009373:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 474 00000100:00100000:2.0:1784938448.009383:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+75:10959:x1871643337554176:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938448.009401:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938448.009425:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000507b298e/0x7b044d4128f9e82b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664b63 expref: 75 pid: 21151 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.009443:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000507b298e/0x7b044d4128f9e82b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664b63 expref: 75 pid: 21151 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.009465:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000507b298e/0x7b044d4128f9e82b lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664b63 expref: 75 pid: 21151 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.009480:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x60:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938448.009485:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x60:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938448.009493:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea7f802e/0x7b044d4128f9e832 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664b6a expref: 74 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.009502:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea7f802e/0x7b044d4128f9e832 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664b6a expref: 74 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.009541:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ea7f802e/0x7b044d4128f9e832 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664b6a expref: 74 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938448.009555:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350907136:192.168.202.54@tcp:105: 00000100:00100000:2.0:1784938448.009634:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238ee37600 going to sleep for 11 seconds 00000100:00100000:2.0:1784938448.012085:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350907136:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938448.012114:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938448.012188:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+74:10959:x1871643337554176:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 2806us (3407us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938448.012199:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 474 00000100:00100000:1.0:1784938448.018233:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.018333:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337554432 00000100:00100000:0.0:1784938448.018347:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337554432 00000100:00100000:0.0:1784938448.018444:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 162 00000100:00100000:0.0:1784938448.018455:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+93:17112:x1871643337554432:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:0.0:1784938448.018791:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+94:17112:x1871643337554432:12345-192.168.202.54@tcp:35:cp.0 Request processed in 338us (567us total) trans 8589934809 rc 0/0 00000100:00100000:0.0:1784938448.018799:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 162 00000100:00080000:3.0:1784938448.019507:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784938448.022258:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938448.022357:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337554560 00000100:00100000:1.0:1784938448.022367:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337554560 00000100:00100000:1.0:1784938448.022434:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 682 00000100:00100000:1.0:1784938448.022445:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+94:17112:x1871643337554560:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938448.022472:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938448.022496:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fcc00/0x7b044d4128f9e839 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664b71 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.022568:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e840 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.022582:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e840 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.022593:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e840 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.022609:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e847 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe708c894 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.022616:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e847 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.022622:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e847 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.022667:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e840 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.022674:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e840 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.022679:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e840 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.022686:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e840 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.022692:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fd400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938448.022696:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e840 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.022703:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e840 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.022714:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938448.022717:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938448.022721:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e840 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.022727:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e840 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.022742:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e847 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.022747:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e847 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.022752:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e847 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.022757:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fca00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938448.022760:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e847 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.022765:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e847 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.022776:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xe708c894 (ffff9f24b67c7a00) 00010000:00010000:1.0:1784938448.022778:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938448.022781:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e847 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.022787:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e847 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.022819:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fcc00/0x7b044d4128f9e839 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b71 expref: 95 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.022829:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938448.022832:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938448.022836:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fcc00/0x7b044d4128f9e839 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b71 expref: 95 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.022844:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fcc00, rc 0) 00000100:00100000:1.0:1784938448.023028:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+94:17112:x1871643337554560:12345-192.168.202.54@tcp:101:cp.0 Request processed in 585us (779us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938448.023036:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 682 00000100:00100000:3.0:1784938448.025748:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.025829:0:25738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337554688 00000100:00100000:0.0:1784938448.025838:0:25738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337554688 00000100:00100000:0.0:1784938448.025908:0:25738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 683 00000100:00100000:0.0:1784938448.025919:0:25738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+94:17112:x1871643337554688:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938448.025941:0:25738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938448.025965:0:25738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394c00/0x7b044d4128f9e84e lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664b78 expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.026043:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e855 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.026058:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e855 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.026068:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e855 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.026082:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e85c lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe708c894 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.026090:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e85c lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.026097:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e85c lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.026171:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e855 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.026179:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e855 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.026185:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e855 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.026191:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382395200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938448.026195:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e855 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.026207:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e855 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.026219:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938448.026223:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.026227:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e855 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.026233:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e855 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.026248:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e85c lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.026255:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e85c lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.026261:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e85c lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.026267:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938448.026270:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e85c lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.026276:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e85c lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.026283:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xe708c894 (ffff9f248fb6cb00) 00010000:00010000:0.0:1784938448.026293:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.026297:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e85c lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.026307:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e85c lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.026342:0:25738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394c00/0x7b044d4128f9e84e lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b78 expref: 95 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.026352:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938448.026354:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.026358:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394c00/0x7b044d4128f9e84e lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b78 expref: 95 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.026367:0:25738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382394c00, rc 0) 00000100:00100000:0.0:1784938448.026961:0:25738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+94:17112:x1871643337554688:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1041us (1218us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938448.026970:0:25738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 683 00000100:00100000:1.0:1784938448.029907:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938448.030092:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337554944 00000100:00100000:3.0:1784938448.030102:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337554944 00000100:00100000:3.0:1784938448.030193:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 684 00000100:00100000:3.0:1784938448.030202:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+94:17112:x1871643337554944:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938448.030223:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938448.030245:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e863 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664b7f expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.030359:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e86a lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.030374:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e86a lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.030386:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e86a lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.030400:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e871 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0xe708c894 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.030406:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e871 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.030411:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e871 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938448.030742:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x60:0x0], index 0: 0 00010000:00010000:3.0:1784938448.030903:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e878 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.030917:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e878 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.030924:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e878 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.030956:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e86a lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.030963:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e86a lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.030968:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e86a lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.030974:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e86a lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.031484:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d01c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938448.031490:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e86a lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.031497:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e86a lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.031510:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938448.031513:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938448.031517:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e86a lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.031523:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e86a lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938448.031538:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b6b1290f reply state 000000003e1d557e transno 8589934810 ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e871 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.031549:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e871 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.031555:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xe708c894 (ffff9f24975b2800) 00010000:00010000:3.0:1784938448.031557:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938448.031559:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938448.031589:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e863 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b7f expref: 97 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.031604:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e878 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b7f expref: 96 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.031612:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x3f:0x0].0x0 (ffff9f24975b2400) 00010000:00010000:3.0:1784938448.031614:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938448.031616:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61a200, rc 0) 00000100:00100000:3.0:1784938448.031724:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+97:17112:x1871643337554944:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1522us (1828us total) trans 8589934810 rc 0/0 00000100:00100000:3.0:1784938448.031732:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 684 00000100:00100000:1.0:1784938448.034549:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938448.034708:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337555072 00000100:00100000:2.0:1784938448.034718:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337555072 00000100:00100000:2.0:1784938448.034778:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 946 00000100:00100000:2.0:1784938448.034790:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+77:10957:x1871643337555072:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938448.034809:0:25716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938448.034831:0:25716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015193dfb/0x7b044d4128f9e886 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664b86 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938448.034865:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x60:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938448.034885:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x60:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1784938448.034890:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x60:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938448.034899:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015193dfb/0x7b044d4128f9e886 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b86 expref: 78 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.034916:0:25716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000015193dfb/0x7b044d4128f9e886 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b86 expref: 78 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.034927:0:25716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e01400, rc 0) 00000100:00100000:2.0:1784938448.035022:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7ea6e988-18ba-4c98-b179-17995571b98b+78:10957:x1871643337555072:12345-192.168.202.54@tcp:101:cp.0 Request processed in 234us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938448.035029:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 946 00000100:00100000:3.0:1784938448.038089:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.038193:0:25729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337555200 00000100:00100000:0.0:1784938448.038203:0:25729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337555200 00000100:00100000:0.0:1784938448.038255:0:25729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 947 00000100:00100000:0.0:1784938448.038265:0:25729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7ea6e988-18ba-4c98-b179-17995571b98b+78:17112:x1871643337555200:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938448.038282:0:25729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938448.038311:0:25729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e88d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664b8d expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.038341:0:25729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000015193dfb/0x7b044d4128f9e886 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b86 expref: 79 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.038355:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x60:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938448.038359:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x60:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938448.038364:0:25729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e88d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b8d expref: 79 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.038399:0:25729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000015193dfb/0x7b044d4128f9e886 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664b86 expref: 79 pid: 25716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.038412:0:25729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000015193dfb/0x7b044d4128f9e886 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664b86 expref: 79 pid: 25716 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938448.038428:0:25729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:25729:1871643350907264:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938448.038506:0:25729:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b2d2c480 going to sleep for 11 seconds 00000100:00100000:3.0:1784938448.040936:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.041038:0:25729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:25729:1871643350907264:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938448.041067:0:25729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e88d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664b8d expref: 79 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.041089:0:25729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382394200, rc 0) 00000100:00100000:0.0:1784938448.041166:0:25729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7ea6e988-18ba-4c98-b179-17995571b98b+79:17112:x1871643337555200:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2882us (3065us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938448.041175:0:25729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 947 00000100:00100000:2.0:1784938448.041264:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337555328 00000100:00100000:2.0:1784938448.041271:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337555328 00010000:00010000:2.0:1784938448.041311:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000015193dfb/0x7b044d4128f9e886 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664b86 expref: 79 pid: 25716 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938448.041354:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 475 00000100:00100000:2.0:1784938448.041364:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+79:10958:x1871643337555328:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938448.041379:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938448.041402:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000015193dfb/0x7b044d4128f9e886 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664b86 expref: 79 pid: 25716 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.041414:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000015193dfb/0x7b044d4128f9e886 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664b86 expref: 79 pid: 25716 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.041438:0:22955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015193dfb/0x7b044d4128f9e886 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664b86 expref: 79 pid: 25716 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.041453:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x60:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938448.041457:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x60:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938448.041465:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e88d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664b8d expref: 78 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.041476:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e88d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664b8d expref: 78 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.041512:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e88d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664b8d expref: 78 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938448.041527:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350907392:192.168.202.54@tcp:105: 00000100:00100000:2.0:1784938448.041579:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238ee37600 going to sleep for 11 seconds 00000100:00100000:2.0:1784938448.042687:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350907648:192.168.202.154@tcp:41:osp-pre-0-1.0 00000100:00100000:2.0:1784938448.042748:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784938448.042755:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350907520:192.168.202.154@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938448.043113:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938448.043235:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938448.043320:0:21153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350907520 00000100:00100000:0.0:1784938448.043327:0:21153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350907520 00000100:00100000:0.0:1784938448.043362:0:21153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 76 00000100:00100000:0.0:1784938448.043370:0:21153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:16392:x1871643350907520:12345-192.168.202.154@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1784938448.043397:0:21153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4186112 granted 42293696 pending 0 free 318967808 avail 291155968 00000100:00100000:0.0:1784938448.043434:0:21153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:16392:x1871643350907520:12345-192.168.202.154@tcp:13:osp-pre-1-0.0 Request processed in 64us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938448.043440:0:21153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 76 00000100:00100000:1.0:1784938448.044002:0:16390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784938448.044019:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350907776:192.168.202.154@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938448.044884:0:21160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350907648 00000100:00100000:2.0:1784938448.044892:0:21160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350907648 00000100:00100000:2.0:1784938448.044939:0:21160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 82 00000100:00100000:2.0:1784938448.044948:0:21160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:16392:x1871643350907648:12345-192.168.202.154@tcp:41:osp-pre-0-1.0 00000004:00000024:2.0:1784938448.044988:0:21160:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 218308608 avail 191283200 00000100:00100000:2.0:1784938448.045026:0:21160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:16392:x1871643350907648:12345-192.168.202.154@tcp:41:osp-pre-0-1.0 Request processed in 79us (1913us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938448.045033:0:21160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 82 00000100:00100000:2.0:1784938448.045082:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350907520:192.168.202.154@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938448.045389:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938448.045463:0:21153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350907776 00000100:00100000:0.0:1784938448.045468:0:21153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350907776 00000100:00100000:0.0:1784938448.045506:0:21153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 77 00000100:00100000:0.0:1784938448.045514:0:21153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:16390:x1871643350907776:12345-192.168.202.154@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1784938448.045532:0:21153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2994176 granted 41978304 pending 65536 free 318586880 avail 290775040 00000100:00100000:0.0:1784938448.045564:0:21153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:16390:x1871643350907776:12345-192.168.202.154@tcp:13:osp-pre-0-0.0 Request processed in 51us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938448.045570:0:21153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 77 00000100:00100000:2.0:1784938448.045870:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350907648:192.168.202.154@tcp:41:osp-pre-0-1.0 00000100:00100000:1.0:1784938448.046118:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350907776:192.168.202.154@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938448.048845:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350907392:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938448.048872:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938448.048931:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+78:10958:x1871643337555328:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 7567us (8003us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938448.048941:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 475 00000100:00100000:1.0:1784938448.050234:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938448.050321:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337555584 00000100:00100000:2.0:1784938448.050329:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337555584 00000100:00100000:2.0:1784938448.050373:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 163 00000100:00100000:2.0:1784938448.050381:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+97:17112:x1871643337555584:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:2.0:1784938448.050662:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+98:17112:x1871643337555584:12345-192.168.202.54@tcp:35:cp.0 Request processed in 281us (431us total) trans 8589934811 rc 0/0 00000100:00100000:2.0:1784938448.050672:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 163 00000100:00100000:0.0:1784938448.053572:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938448.053745:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337555712 00000100:00100000:2.0:1784938448.053754:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337555712 00000100:00100000:2.0:1784938448.053809:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 685 00000100:00100000:2.0:1784938448.053819:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+98:17112:x1871643337555712:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938448.053841:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938448.053873:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01e00/0x7b044d4128f9e894 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664b94 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.053938:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00800/0x7b044d4128f9e89b lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.053952:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00800/0x7b044d4128f9e89b lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.053963:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00800/0x7b044d4128f9e89b lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.053978:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9e8a2 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xd13f1037 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.053996:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9e8a2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.054003:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9e8a2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.054044:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00800/0x7b044d4128f9e89b lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.054055:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00800/0x7b044d4128f9e89b lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.054062:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00800/0x7b044d4128f9e89b lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.054068:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938448.054074:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00800/0x7b044d4128f9e89b lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.054082:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00800/0x7b044d4128f9e89b lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.054094:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938448.054097:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938448.054102:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00800/0x7b044d4128f9e89b lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.054108:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00800/0x7b044d4128f9e89b lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.054120:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9e8a2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.054330:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9e8a2 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.054336:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9e8a2 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.054341:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e01a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938448.054345:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9e8a2 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.054351:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9e8a2 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.054360:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xd13f1037 (ffff9f2496483200) 00010000:00010000:2.0:1784938448.054362:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938448.054365:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9e8a2 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.054371:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9e8a2 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.054405:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01e00/0x7b044d4128f9e894 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b94 expref: 99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.054416:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938448.054418:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938448.054421:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01e00/0x7b044d4128f9e894 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b94 expref: 99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.054430:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e01e00, rc 0) 00000100:00100000:2.0:1784938448.054496:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+98:17112:x1871643337555712:12345-192.168.202.54@tcp:101:cp.0 Request processed in 678us (932us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938448.054502:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 685 00000100:00100000:3.0:1784938448.057590:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.057718:0:25738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337555840 00000100:00100000:0.0:1784938448.057730:0:25738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337555840 00000100:00100000:0.0:1784938448.057808:0:25738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 686 00000100:00100000:0.0:1784938448.057818:0:25738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+98:17112:x1871643337555840:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938448.057858:0:25738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938448.057884:0:25738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f9e8a9 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664b9b expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.057966:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9e8b0 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.057982:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9e8b0 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.058006:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9e8b0 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.058025:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9e8b7 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xd13f1037 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.058032:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9e8b7 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.058039:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9e8b7 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.058086:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9e8b0 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.058093:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9e8b0 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.058100:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9e8b0 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.058106:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b29a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938448.058111:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9e8b0 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.058119:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9e8b0 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.058479:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938448.058483:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.058488:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9e8b0 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.058495:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29a00/0x7b044d4128f9e8b0 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.058512:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9e8b7 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.058518:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9e8b7 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.058524:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9e8b7 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.058529:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b29c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938448.058532:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9e8b7 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.058539:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9e8b7 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.058546:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xd13f1037 (ffff9f248fb6cb00) 00010000:00010000:0.0:1784938448.058548:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.058551:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9e8b7 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.058557:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29c00/0x7b044d4128f9e8b7 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.058596:0:25738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f9e8a9 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b9b expref: 99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.058612:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938448.058615:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.058618:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f9e8a9 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b9b expref: 99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.058627:0:25738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24c5b29800, rc 0) 00000100:00100000:0.0:1784938448.058708:0:25738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+98:17112:x1871643337555840:12345-192.168.202.54@tcp:101:cp.0 Request processed in 890us (1130us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938448.058717:0:25738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 686 00000100:00100000:3.0:1784938448.062056:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.062180:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337556096 00000100:00100000:0.0:1784938448.062192:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337556096 00000100:00100000:0.0:1784938448.062254:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 687 00000100:00100000:0.0:1784938448.062266:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+98:17112:x1871643337556096:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938448.062299:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938448.062326:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394c00/0x7b044d4128f9e8be lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664ba2 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.062442:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e8c5 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.062457:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e8c5 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.062467:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e8c5 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.062480:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e8cc lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0xd13f1037 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.062488:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e8cc lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.062493:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e8cc lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938448.062810:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x61:0x0], index 1: 0 00010000:00010000:0.0:1784938448.062930:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da200/0x7b044d4128f9e8d3 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.062940:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da200/0x7b044d4128f9e8d3 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.062947:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da200/0x7b044d4128f9e8d3 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.062975:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e8c5 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.062982:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e8c5 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.062988:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e8c5 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.062995:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e8c5 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.063002:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938448.063006:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e8c5 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.063019:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e8c5 lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.063033:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938448.063035:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.063040:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e8c5 lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.063047:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394800/0x7b044d4128f9e8c5 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938448.063065:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000621b91c5 reply state 00000000c7dda2d9 transno 8589934812 ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e8cc lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.063077:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e8cc lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.063083:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xd13f1037 (ffff9f248fb6c800) 00010000:00010000:0.0:1784938448.063085:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938448.063088:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938448.063118:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394c00/0x7b044d4128f9e8be lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664ba2 expref: 101 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.063738:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da200/0x7b044d4128f9e8d3 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664ba2 expref: 100 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.063749:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x40:0x0].0x0 (ffff9f248fb6cf00) 00010000:00010000:0.0:1784938448.063751:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938448.063754:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d5da200, rc 0) 00000100:00100000:0.0:1784938448.063832:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+101:17112:x1871643337556096:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1568us (1785us total) trans 8589934812 rc 0/0 00000100:00100000:0.0:1784938448.063841:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 687 00000100:00100000:3.0:1784938448.066658:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.066976:0:21152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337556224 00000100:00100000:0.0:1784938448.066996:0:21152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337556224 00000100:00100000:0.0:1784938448.067050:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 948 00000100:00100000:0.0:1784938448.067060:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+74:10959:x1871643337556224:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938448.067078:0:21152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938448.067100:0:21152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062c58f3a/0x7b044d4128f9e8e1 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664ba9 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938448.067138:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x61:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938448.067175:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x61:0x0].0x0 since=714s v=(0 0) 00010000:00010000:0.0:1784938448.067180:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x61:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938448.067190:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062c58f3a/0x7b044d4128f9e8e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664ba9 expref: 75 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.067207:0:21152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000062c58f3a/0x7b044d4128f9e8e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664ba9 expref: 75 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.067220:0:21152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d5da600, rc 0) 00000100:00100000:0.0:1784938448.067269:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+75:10959:x1871643337556224:12345-192.168.202.54@tcp:101:cp.0 Request processed in 210us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938448.067276:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 948 00000100:00100000:3.0:1784938448.071283:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.071396:0:25724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337556352 00000100:00100000:0.0:1784938448.071406:0:25724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337556352 00000100:00100000:0.0:1784938448.071464:0:25724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 949 00000100:00100000:0.0:1784938448.071474:0:25724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7ea6e988-18ba-4c98-b179-17995571b98b+75:17112:x1871643337556352:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938448.071493:0:25724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938448.071514:0:25724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b7dca5e/0x7b044d4128f9e8e8 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x61:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664bb0 expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.071549:0:25724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000062c58f3a/0x7b044d4128f9e8e1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664ba9 expref: 76 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.071558:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x61:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938448.071563:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x61:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938448.071568:0:25724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b7dca5e/0x7b044d4128f9e8e8 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x61:0x0].0x0 rrc: 3 type: EXT [0->229375] (req 0->229375) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664bb0 expref: 76 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.071602:0:25724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000062c58f3a/0x7b044d4128f9e8e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664ba9 expref: 76 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.071617:0:25724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000062c58f3a/0x7b044d4128f9e8e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664ba9 expref: 76 pid: 21152 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938448.071632:0:25724:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:25724:1871643350907904:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938448.071724:0:25724:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d077a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938448.075023:0:25724:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:25724:1871643350907904:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938448.075067:0:25724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002b7dca5e/0x7b044d4128f9e8e8 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x61:0x0].0x0 rrc: 3 type: EXT [0->229375] (req 0->229375) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664bb0 expref: 76 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.075097:0:25724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d5da800, rc 0) 00000100:00100000:0.0:1784938448.075200:0:25724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7ea6e988-18ba-4c98-b179-17995571b98b+76:17112:x1871643337556352:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3727us (3927us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938448.075209:0:25724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 949 00000100:00100000:1.0:1784938448.076708:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938448.076781:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337556480 00000100:00100000:3.0:1784938448.076790:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337556480 00010000:00010000:3.0:1784938448.076829:0:25731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000062c58f3a/0x7b044d4128f9e8e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664ba9 expref: 76 pid: 21152 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938448.076882:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 476 00000100:00100000:3.0:1784938448.076891:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd256300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+76:10959:x1871643337556480:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938448.076906:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938448.076930:0:25731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000062c58f3a/0x7b044d4128f9e8e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x61:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664ba9 expref: 76 pid: 21152 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.076942:0:25731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000062c58f3a/0x7b044d4128f9e8e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x61:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664ba9 expref: 76 pid: 21152 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.076967:0:25731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062c58f3a/0x7b044d4128f9e8e1 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x61:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664ba9 expref: 76 pid: 21152 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.076993:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x61:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938448.076998:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x61:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938448.077007:0:25731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002b7dca5e/0x7b044d4128f9e8e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664bb0 expref: 75 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.077017:0:25731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b7dca5e/0x7b044d4128f9e8e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664bb0 expref: 75 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.077061:0:25731:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002b7dca5e/0x7b044d4128f9e8e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664bb0 expref: 75 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938448.077076:0:25731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:25731:1871643350908032:192.168.202.54@tcp:105: 00000100:00100000:3.0:1784938448.077495:0:25731:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f23873a9180 going to sleep for 11 seconds 00000100:00100000:1.0:1784938448.081904:0:25731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:25731:1871643350908032:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938448.081932:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938448.082002:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd256300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+75:10959:x1871643337556480:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 5111us (5301us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938448.082013:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 476 00000100:00100000:0.0:1784938448.086950:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938448.087189:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337556736 00000100:00100000:1.0:1784938448.087200:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337556736 00000100:00100000:1.0:1784938448.087261:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 164 00000100:00100000:1.0:1784938448.087271:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+101:17112:x1871643337556736:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:1.0:1784938448.087743:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+102:17112:x1871643337556736:12345-192.168.202.54@tcp:35:cp.0 Request processed in 472us (802us total) trans 8589934813 rc 0/0 00000100:00100000:1.0:1784938448.087752:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 164 00000100:00100000:1.0:1784938448.091397:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938448.091494:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337556864 00000100:00100000:3.0:1784938448.091504:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337556864 00000100:00100000:3.0:1784938448.091600:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 688 00000100:00100000:3.0:1784938448.091610:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+102:17112:x1871643337556864:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938448.091634:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938448.091654:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e8ef lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664bb7 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.091727:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e8f6 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.091744:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e8f6 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.091754:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e8f6 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.091771:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e8fd lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xc701cb36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.091777:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e8fd lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.091788:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e8fd lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.091830:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e8f6 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.091837:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e8f6 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.091844:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e8f6 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.091861:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61a400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938448.091865:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e8f6 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.091873:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e8f6 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.091885:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938448.091889:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938448.091893:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e8f6 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.091899:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e8f6 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.091915:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e8fd lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.091920:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e8fd lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.091926:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e8fd lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.091931:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d00000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938448.091933:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e8fd lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.091938:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e8fd lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.091944:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xc701cb36 (ffff9f24975b2500) 00010000:00010000:3.0:1784938448.091947:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938448.091949:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e8fd lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.091954:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e8fd lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.092053:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e8ef lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664bb7 expref: 103 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.092064:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938448.092067:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938448.092070:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e8ef lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664bb7 expref: 103 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.092079:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61b000, rc 0) 00000100:00100000:3.0:1784938448.092239:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+102:17112:x1871643337556864:12345-192.168.202.54@tcp:101:cp.0 Request processed in 630us (849us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938448.092251:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 688 00000100:00100000:2.0:1784938448.095408:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.095500:0:25738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337556992 00000100:00100000:0.0:1784938448.095509:0:25738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337556992 00000100:00100000:0.0:1784938448.095602:0:25738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 689 00000100:00100000:0.0:1784938448.095613:0:25738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+102:17112:x1871643337556992:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938448.095635:0:25738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938448.095658:0:25738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9e904 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664bbe expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.095734:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9e90b lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.095753:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9e90b lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.095766:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9e90b lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.095783:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9e912 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xc701cb36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.095790:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9e912 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.095800:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9e912 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.095939:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9e90b lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.095947:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9e90b lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.095954:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9e90b lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.095960:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5da600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938448.095964:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9e90b lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.095973:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9e90b lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.096050:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938448.096054:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.096059:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9e90b lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.096064:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9e90b lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.096078:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9e912 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.096084:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9e912 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.096091:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9e912 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.096096:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5da400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938448.096099:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9e912 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.096106:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9e912 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.096114:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xc701cb36 (ffff9f248fb6cb00) 00010000:00010000:0.0:1784938448.096116:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.096119:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9e912 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.096241:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9e912 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.096279:0:25738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9e904 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664bbe expref: 103 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.096301:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938448.096304:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.096308:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9e904 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664bbe expref: 103 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.096318:0:25738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d5da000, rc 0) 00000100:00100000:0.0:1784938448.096444:0:25738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+102:17112:x1871643337556992:12345-192.168.202.54@tcp:101:cp.0 Request processed in 832us (1047us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938448.096456:0:25738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 689 00000100:00100000:0.0:1784938448.099697:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938448.099795:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337557248 00000100:00100000:3.0:1784938448.099807:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337557248 00000100:00100000:3.0:1784938448.099975:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 690 00000100:00100000:3.0:1784938448.099996:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+102:17112:x1871643337557248:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938448.100017:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938448.100040:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e919 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664bc5 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.100339:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e920 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.100353:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e920 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.100364:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e920 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.100381:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e927 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0xc701cb36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.100388:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e927 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.100394:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e927 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938448.100726:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x61:0x0], index 0: 0 00010000:00010000:3.0:1784938448.100882:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e92e lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.100891:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e92e lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.100898:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e92e lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.100931:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e920 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.100939:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e920 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.100945:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e920 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.100950:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e920 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.100955:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d00000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938448.100959:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e920 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.100965:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e920 lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.100975:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938448.101315:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938448.101323:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e920 lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.101330:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e920 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938448.101348:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000032f5b2db reply state 0000000013acf853 transno 8589934814 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e927 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.101361:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e927 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.101367:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xc701cb36 (ffff9f24975b2500) 00010000:00010000:3.0:1784938448.101369:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938448.101372:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938448.101406:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e919 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664bc5 expref: 105 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.101422:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e92e lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664bc5 expref: 104 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.101430:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x41:0x0].0x0 (ffff9f24975b2f00) 00010000:00010000:3.0:1784938448.101432:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938448.101434:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d61a400, rc 0) 00000100:00100000:3.0:1784938448.101497:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+105:17112:x1871643337557248:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1504us (1812us total) trans 8589934814 rc 0/0 00000100:00100000:3.0:1784938448.101505:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 690 00000100:00100000:1.0:1784938448.105502:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.105630:0:25725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337557376 00000100:00100000:0.0:1784938448.105642:0:25725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337557376 00000100:00100000:0.0:1784938448.105741:0:25725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 950 00000100:00100000:0.0:1784938448.105752:0:25725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7ea6e988-18ba-4c98-b179-17995571b98b+78:10957:x1871643337557376:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938448.105773:0:25725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938448.105801:0:25725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7d699b7/0x7b044d4128f9e93c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664bcc expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938448.105832:0:25725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x61:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938448.105867:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x61:0x0].0x0 since=714s v=(0 0) 00010000:00010000:0.0:1784938448.105872:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x61:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938448.105882:0:25725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d699b7/0x7b044d4128f9e93c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664bcc expref: 79 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.105902:0:25725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d7d699b7/0x7b044d4128f9e93c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664bcc expref: 79 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.105916:0:25725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382394c00, rc 0) 00000100:00100000:0.0:1784938448.105980:0:25725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7ea6e988-18ba-4c98-b179-17995571b98b+79:10957:x1871643337557376:12345-192.168.202.54@tcp:101:cp.0 Request processed in 229us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938448.106351:0:25725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 950 00000100:00100000:2.0:1784938448.109916:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.109998:0:25718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337557504 00000100:00100000:0.0:1784938448.110008:0:25718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337557504 00000100:00100000:0.0:1784938448.110068:0:25718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 951 00000100:00100000:0.0:1784938448.110077:0:25718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ea6e988-18ba-4c98-b179-17995571b98b+79:17112:x1871643337557504:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938448.110095:0:25718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938448.110113:0:25718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c8cb00d/0x7b044d4128f9e943 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x61:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664bd3 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.110186:0:25718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7d699b7/0x7b044d4128f9e93c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664bcc expref: 80 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.110194:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x61:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938448.110198:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x61:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938448.110202:0:25718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c8cb00d/0x7b044d4128f9e943 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x61:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664bd3 expref: 80 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.110236:0:25718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d7d699b7/0x7b044d4128f9e93c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664bcc expref: 80 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.110249:0:25718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d7d699b7/0x7b044d4128f9e93c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664bcc expref: 80 pid: 25725 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938448.110263:0:25718:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25718:1871643350908160:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938448.110347:0:25718:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d077a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938448.113176:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938448.113327:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337557632 00000100:00100000:2.0:1784938448.113336:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337557632 00010000:00010000:2.0:1784938448.113375:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d699b7/0x7b044d4128f9e93c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664bcc expref: 81 pid: 25725 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938448.113423:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 477 00000100:00100000:2.0:1784938448.113432:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd254380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+81:10958:x1871643337557632:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938448.113448:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938448.113472:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d7d699b7/0x7b044d4128f9e93c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x61:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664bcc expref: 81 pid: 25725 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.113485:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d7d699b7/0x7b044d4128f9e93c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x61:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664bcc expref: 81 pid: 25725 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.113509:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x61:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938448.113513:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x61:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938448.113522:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c8cb00d/0x7b044d4128f9e943 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x61:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664bd3 expref: 81 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.113533:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c8cb00d/0x7b044d4128f9e943 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x61:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664bd3 expref: 81 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.113571:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009c8cb00d/0x7b044d4128f9e943 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x61:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664bd3 expref: 81 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938448.113584:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:19221:1871643350908288:192.168.202.54@tcp:105: 00000100:00100000:2.0:1784938448.113656:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238ee37d80 going to sleep for 11 seconds 00010000:00010000:0.0:1784938448.113840:0:25718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7d699b7/0x7b044d4128f9e93c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x61:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664bcc expref: 81 pid: 25725 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938448.113856:0:25718:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25718:1871643350908160:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938448.113880:0:25718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009c8cb00d/0x7b044d4128f9e943 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664bd3 expref: 80 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.113891:0:25718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382394800, rc 0) 00000100:00100000:0.0:1784938448.113937:0:25718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ea6e988-18ba-4c98-b179-17995571b98b+80:17112:x1871643337557504:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3860us (4032us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938448.113944:0:25718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 951 00000100:00100000:2.0:1784938448.117568:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:19221:1871643350908288:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938448.117598:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938448.117664:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd254380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+79:10958:x1871643337557632:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 4231us (4534us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938448.117676:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 477 00000100:00100000:2.0:1784938448.122747:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.122833:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337557888 00000100:00100000:0.0:1784938448.122842:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337557888 00000100:00100000:0.0:1784938448.122901:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 165 00000100:00100000:0.0:1784938448.122909:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24857fdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+105:17112:x1871643337557888:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:0.0:1784938448.123221:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24857fdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+106:17112:x1871643337557888:12345-192.168.202.54@tcp:35:cp.0 Request processed in 311us (480us total) trans 8589934815 rc 0/0 00000100:00100000:0.0:1784938448.123229:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 165 00000100:00100000:0.0:1784938448.126245:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938448.126457:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337558016 00000100:00100000:3.0:1784938448.126467:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337558016 00000100:00100000:3.0:1784938448.126578:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 691 00000100:00100000:3.0:1784938448.126590:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+106:17112:x1871643337558016:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938448.126616:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938448.126640:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e94a lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664bda expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.126704:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e951 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.126718:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e951 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.126728:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e951 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.126742:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9e958 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x322afea2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.126749:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9e958 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.126756:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9e958 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.126795:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e951 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.126803:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e951 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.126810:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e951 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.126816:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d00000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938448.126820:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e951 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.126831:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e951 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.126843:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938448.126846:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938448.126866:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e951 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.126873:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9e951 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.126887:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9e958 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.126893:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9e958 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.126899:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9e958 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.126904:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24cc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938448.126907:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9e958 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.126914:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9e958 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.126921:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x322afea2 (ffff9f24975b2a00) 00010000:00010000:3.0:1784938448.126923:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938448.126926:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9e958 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.126935:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24cc00/0x7b044d4128f9e958 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.126966:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e94a lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664bda expref: 107 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.126975:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938448.127043:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938448.127050:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e94a lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664bda expref: 107 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.127063:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d01c00, rc 0) 00000100:00100000:3.0:1784938448.127235:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+106:17112:x1871643337558016:12345-192.168.202.54@tcp:101:cp.0 Request processed in 647us (999us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938448.127244:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 691 00000100:00100000:1.0:1784938448.132948:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.133096:0:25738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337558144 00000100:00100000:0.0:1784938448.133107:0:25738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337558144 00000100:00100000:0.0:1784938448.133486:0:25738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 692 00000100:00100000:0.0:1784938448.133497:0:25738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+106:17112:x1871643337558144:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938448.133519:0:25738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938448.133541:0:25738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9e95f lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664be1 expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.133608:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9e966 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.133624:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9e966 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.133635:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9e966 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.133650:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9e96d lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x322afea2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.133657:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9e96d lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.133663:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9e96d lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.133704:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9e966 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.133710:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9e966 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.133716:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9e966 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.133721:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5da600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938448.133725:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9e966 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.133732:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9e966 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.133744:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938448.133747:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.133751:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9e966 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.133758:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9e966 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.133771:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9e96d lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.133777:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9e96d lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.133783:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9e96d lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.133787:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5da000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938448.133790:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9e96d lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.133795:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9e96d lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.133802:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x322afea2 (ffff9f248fb6cb00) 00010000:00010000:0.0:1784938448.133804:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.133807:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9e96d lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.133812:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9e96d lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.133845:0:25738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9e95f lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664be1 expref: 107 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.133873:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938448.133875:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.133879:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9e95f lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664be1 expref: 107 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.133888:0:25738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d5da400, rc 0) 00000100:00100000:0.0:1784938448.133951:0:25738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+106:17112:x1871643337558144:12345-192.168.202.54@tcp:101:cp.0 Request processed in 456us (1013us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938448.133958:0:25738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 692 00000100:00100000:3.0:1784938448.136894:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938448.137510:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337558400 00000100:00100000:1.0:1784938448.137520:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337558400 00000100:00100000:1.0:1784938448.137584:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 693 00000100:00100000:1.0:1784938448.137595:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+106:17112:x1871643337558400:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938448.137616:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938448.137639:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9e974 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664be8 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.137761:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e97b lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.137776:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e97b lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.137787:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e97b lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.137803:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e982 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x322afea2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.137811:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e982 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.137818:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e982 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938448.138336:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x62:0x0], index 1: 0 00010000:00010000:1.0:1784938448.138491:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fcc00/0x7b044d4128f9e989 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.138501:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fcc00/0x7b044d4128f9e989 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.138508:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fcc00/0x7b044d4128f9e989 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.138540:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e97b lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.138551:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e97b lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.138556:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e97b lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.138562:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e97b lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.138567:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fca00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938448.138571:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e97b lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.138578:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e97b lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.138589:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938448.138592:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938448.138597:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e97b lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.138602:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fca00/0x7b044d4128f9e97b lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938448.138615:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003d1de8f8 reply state 000000008323d684 transno 8589934816 ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e982 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.138624:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e982 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.138631:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x322afea2 (ffff9f24b67c7a00) 00010000:00010000:1.0:1784938448.138634:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938448.138636:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938448.138667:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9e974 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664be8 expref: 109 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.138681:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fcc00/0x7b044d4128f9e989 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664be8 expref: 108 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.138688:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x42:0x0].0x0 (ffff9f24b67c7b00) 00010000:00010000:1.0:1784938448.138690:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938448.138692:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fcc00, rc 0) 00000100:00100000:1.0:1784938448.138763:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+109:17112:x1871643337558400:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1170us (1880us total) trans 8589934816 rc 0/0 00000100:00100000:1.0:1784938448.138771:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 693 00000100:00100000:3.0:1784938448.142249:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938448.142353:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337558528 00000100:00100000:1.0:1784938448.142365:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337558528 00000100:00100000:1.0:1784938448.142414:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 952 00000100:00100000:1.0:1784938448.142425:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+75:10960:x1871643337558528:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938448.142444:0:21629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938448.142465:0:21629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c692a8e/0x7b044d4128f9e997 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664bef expref: -99 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938448.142493:0:21629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x62:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938448.142513:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x62:0x0].0x0 since=714s v=(0 0) 00010000:00010000:1.0:1784938448.142517:0:21629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938448.142527:0:21629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c692a8e/0x7b044d4128f9e997 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664bef expref: 76 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.142548:0:21629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c692a8e/0x7b044d4128f9e997 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664bef expref: 76 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.142560:0:21629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fc800, rc 0) 00000100:00100000:1.0:1784938448.142609:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ea6e988-18ba-4c98-b179-17995571b98b+76:10960:x1871643337558528:12345-192.168.202.54@tcp:101:cp.0 Request processed in 186us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938448.142616:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 952 00000100:00100000:1.0:1784938448.145549:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938448.145632:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337558656 00000100:00100000:3.0:1784938448.145642:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337558656 00000100:00100000:3.0:1784938448.145697:0:25720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 953 00000100:00100000:3.0:1784938448.145708:0:25720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7ea6e988-18ba-4c98-b179-17995571b98b+76:17112:x1871643337558656:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938448.145727:0:25720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938448.145745:0:25720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051f4609e/0x7b044d4128f9e99e lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664bf6 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.145776:0:25720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c692a8e/0x7b044d4128f9e997 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664bef expref: 77 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.145786:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938448.145791:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938448.145796:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051f4609e/0x7b044d4128f9e99e lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->90111] (req 0->90111) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664bf6 expref: 77 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.145830:0:25720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c692a8e/0x7b044d4128f9e997 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664bef expref: 77 pid: 21629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.145855:0:25720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c692a8e/0x7b044d4128f9e997 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664bef expref: 77 pid: 21629 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938448.145872:0:25720:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:25720:1871643350908416:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938448.145964:0:25720:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24867ea300 going to sleep for 11 seconds 00000100:00100000:3.0:1784938448.148948:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.149075:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337558784 00000100:00100000:0.0:1784938448.149085:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337558784 00010000:00010000:0.0:1784938448.149121:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c692a8e/0x7b044d4128f9e997 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664bef expref: 78 pid: 21629 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938448.149215:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 478 00000100:00100000:0.0:1784938448.149225:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+78:10960:x1871643337558784:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938448.149239:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938448.149263:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c692a8e/0x7b044d4128f9e997 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664bef expref: 78 pid: 21629 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.149276:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c692a8e/0x7b044d4128f9e997 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664bef expref: 78 pid: 21629 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.149311:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938448.149317:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938448.149326:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000051f4609e/0x7b044d4128f9e99e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664bf6 expref: 78 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.149336:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051f4609e/0x7b044d4128f9e99e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664bf6 expref: 78 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.149375:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000051f4609e/0x7b044d4128f9e99e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664bf6 expref: 78 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938448.149391:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22955:1871643350908544:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938448.149471:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238ec48780 going to sleep for 11 seconds 00010000:00010000:2.0:1784938448.149795:0:25720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c692a8e/0x7b044d4128f9e997 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664bef expref: 78 pid: 21629 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938448.149812:0:25720:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:25720:1871643350908416:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938448.149837:0:25720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000051f4609e/0x7b044d4128f9e99e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664bf6 expref: 77 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.149847:0:25720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24cc00, rc 0) 00000100:00100000:2.0:1784938448.149891:0:25720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7ea6e988-18ba-4c98-b179-17995571b98b+77:17112:x1871643337558656:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4185us (4351us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938448.149899:0:25720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 953 00000100:00100000:0.0:1784938448.153091:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22955:1871643350908544:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938448.153119:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938448.153237:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+76:10960:x1871643337558784:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 4012us (4297us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938448.153248:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 478 00000100:00100000:0.0:1784938448.156784:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938448.156925:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337559040 00000100:00100000:1.0:1784938448.156936:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337559040 00000100:00100000:1.0:1784938448.157003:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 166 00000100:00100000:1.0:1784938448.157014:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+109:17112:x1871643337559040:12345-192.168.202.54@tcp:35:cp.0 00000001:00080000:1.0:1784938448.157275:0:24204:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934817 00000100:00100000:1.0:1784938448.157403:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+111:17112:x1871643337559040:12345-192.168.202.54@tcp:35:cp.0 Request processed in 390us (629us total) trans 8589934818 rc 0/0 00000100:00100000:1.0:1784938448.157411:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 166 00000020:00080000:1.0:1784938448.157415:0:24204:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784938448.164405:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938448.164502:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337559168 00000100:00100000:3.0:1784938448.164512:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337559168 00000100:00100000:3.0:1784938448.164574:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 694 00000100:00100000:3.0:1784938448.164584:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+111:17112:x1871643337559168:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938448.164612:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938448.164633:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9e9a5 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664bfd expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.164703:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9e9ac lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.164721:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9e9ac lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.164731:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9e9ac lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.164748:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e9b3 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xaa0c2c16 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.164755:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e9b3 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.164761:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e9b3 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.164803:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9e9ac lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.164810:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9e9ac lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.164816:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9e9ac lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.164822:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24d400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938448.164826:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9e9ac lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.164833:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9e9ac lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.164844:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938448.164858:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938448.164863:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9e9ac lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.164868:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9e9ac lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.164881:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e9b3 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.164887:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e9b3 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.164892:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e9b3 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.164896:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d01c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938448.164899:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e9b3 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.164904:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e9b3 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.164911:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xaa0c2c16 (ffff9f24975b2a00) 00010000:00010000:3.0:1784938448.164913:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938448.164915:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e9b3 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.164920:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9e9b3 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.164953:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9e9a5 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664bfd expref: 112 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.164962:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938448.164964:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938448.164967:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9e9a5 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664bfd expref: 112 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.164976:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24d000, rc 0) 00000100:00100000:3.0:1784938448.165230:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+111:17112:x1871643337559168:12345-192.168.202.54@tcp:101:cp.0 Request processed in 647us (834us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938448.165237:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 694 00000100:00100000:3.0:1784938448.167990:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938448.168137:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337559296 00000100:00100000:2.0:1784938448.168184:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337559296 00000100:00100000:2.0:1784938448.168237:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 695 00000100:00100000:2.0:1784938448.168247:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+111:17112:x1871643337559296:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938448.168267:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938448.168299:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00800/0x7b044d4128f9e9ba lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664c04 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.168366:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9e9c1 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.168380:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9e9c1 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.168391:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9e9c1 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.168406:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01e00/0x7b044d4128f9e9c8 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xaa0c2c16 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.168413:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01e00/0x7b044d4128f9e9c8 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.168419:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01e00/0x7b044d4128f9e9c8 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.168466:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9e9c1 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.168472:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9e9c1 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.168478:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9e9c1 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.168483:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e01a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938448.168487:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9e9c1 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.168494:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9e9c1 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.168505:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938448.168509:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938448.168513:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9e9c1 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.168518:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9e9c1 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.168530:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01e00/0x7b044d4128f9e9c8 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.168535:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01e00/0x7b044d4128f9e9c8 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.168541:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01e00/0x7b044d4128f9e9c8 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.168545:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e01e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938448.168547:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01e00/0x7b044d4128f9e9c8 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.168553:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01e00/0x7b044d4128f9e9c8 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.168559:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xaa0c2c16 (ffff9f2496483200) 00010000:00010000:2.0:1784938448.168562:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938448.168565:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01e00/0x7b044d4128f9e9c8 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.168570:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01e00/0x7b044d4128f9e9c8 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.168602:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00800/0x7b044d4128f9e9ba lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c04 expref: 112 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.168613:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938448.168615:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938448.168618:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00800/0x7b044d4128f9e9ba lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c04 expref: 112 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.168627:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e00800, rc 0) 00000100:00100000:2.0:1784938448.168694:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+111:17112:x1871643337559296:12345-192.168.202.54@tcp:101:cp.0 Request processed in 448us (723us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938448.168701:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 695 00000100:00100000:0.0:1784938448.172235:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938448.172332:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337559552 00000100:00100000:2.0:1784938448.172344:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337559552 00000100:00100000:2.0:1784938448.172409:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 696 00000100:00100000:2.0:1784938448.172419:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+111:17112:x1871643337559552:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938448.172441:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938448.172464:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01200/0x7b044d4128f9e9cf lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664c0b expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.172571:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00000/0x7b044d4128f9e9d6 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.172585:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00000/0x7b044d4128f9e9d6 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.172597:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00000/0x7b044d4128f9e9d6 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.172612:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00c00/0x7b044d4128f9e9dd lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0xaa0c2c16 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.172620:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00c00/0x7b044d4128f9e9dd lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.172626:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00c00/0x7b044d4128f9e9dd lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938448.172941:0:24945:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x62:0x0], index 0: 0 00010000:00010000:2.0:1784938448.173078:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01400/0x7b044d4128f9e9e4 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.173088:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01400/0x7b044d4128f9e9e4 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.173096:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01400/0x7b044d4128f9e9e4 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.173129:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00000/0x7b044d4128f9e9d6 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.173136:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00000/0x7b044d4128f9e9d6 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.173174:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00000/0x7b044d4128f9e9d6 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.173183:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00000/0x7b044d4128f9e9d6 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.173189:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938448.173193:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00000/0x7b044d4128f9e9d6 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.173205:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00000/0x7b044d4128f9e9d6 lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.173218:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938448.173221:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938448.173225:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00000/0x7b044d4128f9e9d6 lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.173231:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00000/0x7b044d4128f9e9d6 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938448.173244:0:24945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e55d2144 reply state 00000000ba964f84 transno 8589934819 ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00c00/0x7b044d4128f9e9dd lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.173254:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00c00/0x7b044d4128f9e9dd lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.173260:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xaa0c2c16 (ffff9f23823dc500) 00010000:00010000:2.0:1784938448.173262:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938448.173265:0:24945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938448.173306:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01200/0x7b044d4128f9e9cf lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c0b expref: 114 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.173321:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01400/0x7b044d4128f9e9e4 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c0b expref: 113 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.173329:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x43:0x0].0x0 (ffff9f23823dce00) 00010000:00010000:2.0:1784938448.173331:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938448.173334:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e01400, rc 0) 00000100:00100000:2.0:1784938448.173397:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+114:17112:x1871643337559552:12345-192.168.202.54@tcp:101:cp.0 Request processed in 980us (1172us total) trans 8589934819 rc 0/0 00000100:00100000:2.0:1784938448.173405:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 696 00000100:00100000:1.0:1784938448.179101:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938448.179236:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337559680 00000100:00100000:2.0:1784938448.179246:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337559680 00000100:00100000:2.0:1784938448.179317:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 954 00000100:00100000:2.0:1784938448.179327:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+79:10957:x1871643337559680:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938448.179348:0:25722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938448.179369:0:25722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e4a76a9/0x7b044d4128f9e9f2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664c12 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938448.179396:0:25722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x62:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938448.179418:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x62:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1784938448.179423:0:25722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938448.179433:0:25722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e4a76a9/0x7b044d4128f9e9f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c12 expref: 80 pid: 25722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.179450:0:25722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003e4a76a9/0x7b044d4128f9e9f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c12 expref: 80 pid: 25722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.179462:0:25722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e01200, rc 0) 00000100:00100000:2.0:1784938448.179511:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+80:10957:x1871643337559680:12345-192.168.202.54@tcp:101:cp.0 Request processed in 185us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938448.179518:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 954 00000100:00100000:0.0:1784938448.182685:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938448.182759:0:25727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337559808 00000100:00100000:1.0:1784938448.182768:0:25727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337559808 00000100:00100000:1.0:1784938448.182826:0:25727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 955 00000100:00100000:1.0:1784938448.182836:0:25727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7ea6e988-18ba-4c98-b179-17995571b98b+80:17112:x1871643337559808:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938448.182866:0:25727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938448.182887:0:25727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4b45686/0x7b044d4128f9e9f9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664c19 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.182919:0:25727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003e4a76a9/0x7b044d4128f9e9f2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c12 expref: 81 pid: 25722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.182927:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938448.182931:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938448.182935:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4b45686/0x7b044d4128f9e9f9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->258047] (req 0->258047) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c19 expref: 81 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.182971:0:25727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003e4a76a9/0x7b044d4128f9e9f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664c12 expref: 81 pid: 25722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.182993:0:25727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003e4a76a9/0x7b044d4128f9e9f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664c12 expref: 81 pid: 25722 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938448.183008:0:25727:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd257800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:25727:1871643350908672:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938448.183098:0:25727:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238da84540 going to sleep for 11 seconds 00000100:00100000:1.0:1784938448.186053:0:25727:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd257800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:25727:1871643350908672:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938448.186092:0:25727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c4b45686/0x7b044d4128f9e9f9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->258047] (req 0->258047) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664c19 expref: 81 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.186115:0:25727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fca00, rc 0) 00000100:00100000:1.0:1784938448.186221:0:25727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7ea6e988-18ba-4c98-b179-17995571b98b+81:17112:x1871643337559808:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3384us (3543us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938448.186235:0:25727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 955 00000100:00100000:3.0:1784938448.187778:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938448.187873:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337559936 00000100:00100000:1.0:1784938448.187882:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337559936 00010000:00010000:1.0:1784938448.187921:0:25731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003e4a76a9/0x7b044d4128f9e9f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664c12 expref: 81 pid: 25722 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938448.188009:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 479 00000100:00100000:1.0:1784938448.188019:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483019850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+81:10958:x1871643337559936:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938448.188035:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938448.188058:0:25731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003e4a76a9/0x7b044d4128f9e9f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664c12 expref: 81 pid: 25722 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.188072:0:25731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003e4a76a9/0x7b044d4128f9e9f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664c12 expref: 81 pid: 25722 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.188096:0:25731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e4a76a9/0x7b044d4128f9e9f2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664c12 expref: 81 pid: 25722 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.188112:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938448.188117:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938448.188138:0:25731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4b45686/0x7b044d4128f9e9f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664c19 expref: 80 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.188201:0:25731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4b45686/0x7b044d4128f9e9f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664c19 expref: 80 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.188244:0:25731:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c4b45686/0x7b044d4128f9e9f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664c19 expref: 80 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938448.188259:0:25731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd257800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:25731:1871643350908800:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938448.188335:0:25731:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238da84540 going to sleep for 11 seconds 00000100:00100000:0.0:1784938448.195630:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938448.195711:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337560192 00000100:00100000:2.0:1784938448.195720:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337560192 00000100:00100000:2.0:1784938448.195783:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 167 00000100:00100000:2.0:1784938448.195792:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+114:17112:x1871643337560192:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:2.0:1784938448.196114:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+115:17112:x1871643337560192:12345-192.168.202.54@tcp:35:cp.0 Request processed in 322us (492us total) trans 8589934820 rc 0/0 00000100:00100000:2.0:1784938448.196122:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 167 00000100:00100000:1.0:1784938448.198476:0:25731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd257800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:25731:1871643350908800:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938448.198506:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938448.199036:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938448.199169:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337560320 00000100:00100000:1.0:1784938448.199177:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337560320 00000100:00100000:1.0:1784938448.199235:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 697 00000100:00100000:1.0:1784938448.199245:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+115:17112:x1871643337560320:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938448.199267:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938448.199299:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc800/0x7b044d4128f9ea00 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664c20 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.199361:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9ea07 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.199375:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9ea07 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.199387:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9ea07 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.199403:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fde00/0x7b044d4128f9ea0e lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xd47b514a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.199415:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fde00/0x7b044d4128f9ea0e lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.199421:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fde00/0x7b044d4128f9ea0e lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.199459:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9ea07 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.199465:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9ea07 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.199471:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9ea07 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.199478:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9ea07 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.199483:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fc000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938448.199487:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9ea07 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.199494:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9ea07 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.199506:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938448.199508:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938448.199512:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9ea07 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.199519:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9ea07 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.199534:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fde00/0x7b044d4128f9ea0e lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.199540:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fde00/0x7b044d4128f9ea0e lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.199545:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fde00/0x7b044d4128f9ea0e lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.199549:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fde00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938448.199552:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fde00/0x7b044d4128f9ea0e lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.199558:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fde00/0x7b044d4128f9ea0e lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.199565:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xd47b514a (ffff9f24b67c7800) 00010000:00010000:1.0:1784938448.199568:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938448.199571:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fde00/0x7b044d4128f9ea0e lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.199576:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fde00/0x7b044d4128f9ea0e lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.199609:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc800/0x7b044d4128f9ea00 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c20 expref: 116 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.199619:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938448.199622:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938448.199626:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc800/0x7b044d4128f9ea00 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c20 expref: 116 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.199635:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f23823fc800, rc 0) 00000100:00100000:1.0:1784938448.199692:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+115:17112:x1871643337560320:12345-192.168.202.54@tcp:101:cp.0 Request processed in 449us (658us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938448.199699:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 697 00000100:00100000:3.0:1784938448.202348:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938448.202493:0:25738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337560448 00000100:00100000:1.0:1784938448.202502:0:25738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337560448 00000100:00100000:1.0:1784938448.202548:0:25738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 698 00000100:00100000:1.0:1784938448.202558:0:25738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+115:17112:x1871643337560448:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938448.202580:0:25738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938448.202602:0:25738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9ea15 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664c27 expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.202663:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9ea1c lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.202675:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9ea1c lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.202686:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9ea1c lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.202700:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f9ea23 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xd47b514a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.202707:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f9ea23 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.202714:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f9ea23 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.202751:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9ea1c lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.202759:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9ea1c lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.202765:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9ea1c lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.202771:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c558800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938448.202774:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9ea1c lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.202781:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9ea1c lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.202792:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938448.202795:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938448.202799:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9ea1c lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.202805:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9ea1c lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.202817:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f9ea23 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.202823:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f9ea23 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.202828:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f9ea23 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.202833:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c559200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938448.202836:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f9ea23 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.202841:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f9ea23 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.202847:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xd47b514a (ffff9f24b67c7d00) 00010000:00010000:1.0:1784938448.202850:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938448.202852:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f9ea23 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.202857:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f9ea23 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.202889:0:25738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9ea15 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c27 expref: 116 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.202898:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938448.202900:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938448.202903:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9ea15 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c27 expref: 116 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.202911:0:25738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c559400, rc 0) 00000100:00100000:1.0:1784938448.202966:0:25738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+115:17112:x1871643337560448:12345-192.168.202.54@tcp:101:cp.0 Request processed in 409us (627us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938448.202973:0:25738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 698 00000100:00100000:3.0:1784938448.205639:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.205861:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483019850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+80:10958:x1871643337559936:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 17841us (18088us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938448.205874:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 479 00000100:00100000:1.0:1784938448.206113:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337560704 00000100:00100000:1.0:1784938448.206123:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337560704 00000100:00100000:1.0:1784938448.206316:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 699 00000100:00100000:1.0:1784938448.206325:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+115:17112:x1871643337560704:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938448.206344:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938448.206363:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9ea2a lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664c2e expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.206458:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9ea31 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.206471:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9ea31 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.206481:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9ea31 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.206495:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38800/0x7b044d4128f9ea38 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0xd47b514a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.206502:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38800/0x7b044d4128f9ea38 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.206508:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38800/0x7b044d4128f9ea38 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938448.206782:0:24203:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x63:0x0], index 1: 0 00010000:00010000:1.0:1784938448.207074:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38200/0x7b044d4128f9ea3f lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.207084:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38200/0x7b044d4128f9ea3f lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.207095:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38200/0x7b044d4128f9ea3f lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.207371:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9ea31 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.207380:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9ea31 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.207387:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9ea31 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.207393:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c9f7600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938448.207398:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9ea31 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.207406:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9ea31 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.207418:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938448.207421:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938448.207425:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9ea31 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.207431:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9ea31 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938448.207444:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bdbaf8e9 reply state 00000000920bad7e transno 8589934821 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38800/0x7b044d4128f9ea38 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.207454:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38800/0x7b044d4128f9ea38 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.207461:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xd47b514a (ffff9f24b67c7600) 00010000:00010000:1.0:1784938448.207463:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938448.207465:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938448.207492:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9ea2a lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c2e expref: 118 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.207505:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38200/0x7b044d4128f9ea3f lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c2e expref: 117 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.207513:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x44:0x0].0x0 (ffff9f24b67c7c00) 00010000:00010000:1.0:1784938448.207515:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938448.207517:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238db38200, rc 0) 00000100:00100000:1.0:1784938448.207559:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+118:17112:x1871643337560704:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1235us (1929us total) trans 8589934821 rc 0/0 00000100:00100000:1.0:1784938448.207566:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 699 00000100:00100000:0.0:1784938448.211494:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938448.211566:0:25726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337560832 00000100:00100000:3.0:1784938448.211575:0:25726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337560832 00000100:00100000:3.0:1784938448.211670:0:25726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 956 00000100:00100000:3.0:1784938448.211681:0:25726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7ea6e988-18ba-4c98-b179-17995571b98b+76:10959:x1871643337560832:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938448.211699:0:25726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938448.211722:0:25726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d41c9e94/0x7b044d4128f9ea4d lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664c35 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938448.211749:0:25726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x63:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938448.211768:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x63:0x0].0x0 since=714s v=(0 0) 00010000:00010000:3.0:1784938448.211773:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938448.211783:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d41c9e94/0x7b044d4128f9ea4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c35 expref: 77 pid: 25726 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.211799:0:25726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d41c9e94/0x7b044d4128f9ea4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c35 expref: 77 pid: 25726 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.211812:0:25726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d01c00, rc 0) 00000100:00100000:3.0:1784938448.211883:0:25726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7ea6e988-18ba-4c98-b179-17995571b98b+77:10959:x1871643337560832:12345-192.168.202.54@tcp:101:cp.0 Request processed in 204us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938448.211891:0:25726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 956 00000100:00100000:2.0:1784938448.214780:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.214949:0:25729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337560960 00000100:00100000:0.0:1784938448.214960:0:25729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337560960 00000100:00100000:0.0:1784938448.215117:0:25729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 957 00000100:00100000:0.0:1784938448.215137:0:25729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238125f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7ea6e988-18ba-4c98-b179-17995571b98b+77:17112:x1871643337560960:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938448.215182:0:25729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938448.215202:0:25729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7d699b7/0x7b044d4128f9ea54 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664c3c expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.215235:0:25729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d41c9e94/0x7b044d4128f9ea4d lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c35 expref: 78 pid: 25726 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.215245:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938448.215248:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938448.215253:0:25729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7d699b7/0x7b044d4128f9ea54 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c3c expref: 78 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.215297:0:25729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d41c9e94/0x7b044d4128f9ea4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664c35 expref: 78 pid: 25726 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.215311:0:25729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d41c9e94/0x7b044d4128f9ea4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664c35 expref: 78 pid: 25726 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938448.215325:0:25729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:25729:1871643350908928:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938448.215409:0:25729:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238ec48d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938448.217781:0:25729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:25729:1871643350908928:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938448.217816:0:25729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d7d699b7/0x7b044d4128f9ea54 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664c3c expref: 78 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.217837:0:25729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2382394c00, rc 0) 00000100:00100000:3.0:1784938448.217910:0:25729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238125f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7ea6e988-18ba-4c98-b179-17995571b98b+78:17112:x1871643337560960:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2784us (3138us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938448.217920:0:25729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 957 00000100:00100000:3.0:1784938448.223994:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938448.224133:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337561088 00000100:00100000:2.0:1784938448.224172:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337561088 00010000:00010000:2.0:1784938448.224215:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d41c9e94/0x7b044d4128f9ea4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664c35 expref: 78 pid: 25726 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938448.224255:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 480 00000100:00100000:2.0:1784938448.224265:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+78:10959:x1871643337561088:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938448.224279:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938448.224314:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d41c9e94/0x7b044d4128f9ea4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664c35 expref: 78 pid: 25726 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.224328:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d41c9e94/0x7b044d4128f9ea4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664c35 expref: 78 pid: 25726 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.224351:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d41c9e94/0x7b044d4128f9ea4d lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664c35 expref: 78 pid: 25726 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.224368:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938448.224372:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938448.224380:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7d699b7/0x7b044d4128f9ea54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664c3c expref: 77 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.224391:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7d699b7/0x7b044d4128f9ea54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664c3c expref: 77 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.224432:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d7d699b7/0x7b044d4128f9ea54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664c3c expref: 77 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938448.224447:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350909056:192.168.202.54@tcp:105: 00000100:00100000:2.0:1784938448.224521:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238ee37a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938448.228387:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350909056:192.168.202.54@tcp:105: 00010000:00010000:2.0:1784938448.228414:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938448.228475:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+77:10959:x1871643337561088:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 4210us (4501us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938448.228486:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 480 00000100:00100000:0.0:1784938448.230031:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938448.230272:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337561344 00000100:00100000:2.0:1784938448.230282:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337561344 00000100:00100000:2.0:1784938448.230339:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 168 00000100:00100000:2.0:1784938448.230349:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+118:17112:x1871643337561344:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:2.0:1784938448.230693:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+119:17112:x1871643337561344:12345-192.168.202.54@tcp:35:cp.0 Request processed in 342us (666us total) trans 8589934822 rc 0/0 00000100:00100000:2.0:1784938448.230701:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 168 00000100:00100000:0.0:1784938448.234407:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938448.234522:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337561472 00000100:00100000:2.0:1784938448.234533:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337561472 00000100:00100000:2.0:1784938448.234629:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 700 00000100:00100000:2.0:1784938448.234640:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+119:17112:x1871643337561472:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938448.234665:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938448.234685:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00800/0x7b044d4128f9ea5b lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664c43 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.234748:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01e00/0x7b044d4128f9ea62 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.234761:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01e00/0x7b044d4128f9ea62 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.234772:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01e00/0x7b044d4128f9ea62 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.234786:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9ea69 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x7772308b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.234791:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9ea69 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.234796:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9ea69 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.234835:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01e00/0x7b044d4128f9ea62 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.234842:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01e00/0x7b044d4128f9ea62 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.234860:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01e00/0x7b044d4128f9ea62 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.234870:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e01e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938448.234874:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01e00/0x7b044d4128f9ea62 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.234881:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01e00/0x7b044d4128f9ea62 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.234893:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938448.234896:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938448.234900:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01e00/0x7b044d4128f9ea62 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.234905:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01e00/0x7b044d4128f9ea62 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.234917:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9ea69 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.234922:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9ea69 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.234927:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9ea69 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.234931:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e01a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938448.234934:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9ea69 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.234939:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9ea69 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.234948:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x7772308b (ffff9f23823dc300) 00010000:00010000:2.0:1784938448.234951:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938448.234954:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9ea69 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.234960:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9ea69 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.235005:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00800/0x7b044d4128f9ea5b lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c43 expref: 120 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.235014:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938448.235017:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938448.235020:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00800/0x7b044d4128f9ea5b lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c43 expref: 120 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.235030:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e00800, rc 0) 00000100:00100000:2.0:1784938448.235141:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+119:17112:x1871643337561472:12345-192.168.202.54@tcp:101:cp.0 Request processed in 487us (727us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938448.235187:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 700 00000100:00100000:1.0:1784938448.238305:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.238395:0:25738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337561600 00000100:00100000:0.0:1784938448.238406:0:25738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337561600 00000100:00100000:0.0:1784938448.238500:0:25738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 701 00000100:00100000:0.0:1784938448.238510:0:25738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+119:17112:x1871643337561600:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938448.238530:0:25738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938448.238550:0:25738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9ea70 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664c4a expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.238612:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9ea77 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.238625:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9ea77 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.238636:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9ea77 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.238650:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9ea7e lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x7772308b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.238657:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9ea7e lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.238664:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9ea7e lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.238702:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9ea77 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.238709:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9ea77 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.238715:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9ea77 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.238722:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5da000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938448.238727:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9ea77 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.238733:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9ea77 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.238745:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938448.238748:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.238752:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9ea77 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.238757:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9ea77 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.238770:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9ea7e lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.238775:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9ea7e lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.238780:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9ea7e lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.238784:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5da400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938448.238786:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9ea7e lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.238792:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9ea7e lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.238802:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x7772308b (ffff9f248fb6cb00) 00010000:00010000:0.0:1784938448.238804:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.238806:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9ea7e lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.238812:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9ea7e lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.238842:0:25738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9ea70 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c4a expref: 120 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.238927:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938448.238930:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.238934:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9ea70 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c4a expref: 120 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.238943:0:25738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d5da600, rc 0) 00000100:00100000:0.0:1784938448.239007:0:25738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+119:17112:x1871643337561600:12345-192.168.202.54@tcp:101:cp.0 Request processed in 499us (731us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938448.239014:0:25738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 701 00000100:00100000:3.0:1784938448.241948:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938448.242120:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337561856 00000100:00100000:1.0:1784938448.242140:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337561856 00000100:00100000:1.0:1784938448.242218:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 702 00000100:00100000:1.0:1784938448.242228:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+119:17112:x1871643337561856:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938448.242247:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938448.242266:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39000/0x7b044d4128f9ea85 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664c51 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.242373:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9ea8c lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.242390:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9ea8c lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.242400:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9ea8c lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.242414:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9ea93 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x7772308b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.242420:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9ea93 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.242426:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9ea93 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938448.242727:0:24203:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x63:0x0], index 0: 0 00010000:00010000:1.0:1784938448.242879:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9ea9a lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.242887:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9ea9a lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.242894:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9ea9a lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.242926:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9ea8c lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.242933:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9ea8c lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.242939:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9ea8c lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.242946:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938448.242950:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9ea8c lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.242956:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9ea8c lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.242969:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938448.242972:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938448.242976:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9ea8c lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.242993:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9ea8c lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938448.243005:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dee85eb4 reply state 00000000e45006b4 transno 8589934823 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9ea93 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.243015:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9ea93 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.243021:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x7772308b (ffff9f24b67c7d00) 00010000:00010000:1.0:1784938448.243024:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938448.243027:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938448.243054:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39000/0x7b044d4128f9ea85 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c51 expref: 122 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.243068:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9ea9a lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c51 expref: 121 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.243080:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x45:0x0].0x0 (ffff9f24b67c7800) 00010000:00010000:1.0:1784938448.243083:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938448.243085:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238db39200, rc 0) 00000100:00100000:1.0:1784938448.243176:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+122:17112:x1871643337561856:12345-192.168.202.54@tcp:101:cp.0 Request processed in 949us (1236us total) trans 8589934823 rc 0/0 00000100:00100000:1.0:1784938448.243183:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 702 00000100:00100000:3.0:1784938448.246914:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.247085:0:25721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337561984 00000100:00100000:0.0:1784938448.247097:0:25721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337561984 00000100:00100000:0.0:1784938448.247199:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 958 00000100:00100000:0.0:1784938448.247209:0:25721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7ea6e988-18ba-4c98-b179-17995571b98b+80:10958:x1871643337561984:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938448.247227:0:25721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938448.247251:0:25721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ac23323/0x7b044d4128f9eaa8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664c58 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938448.247280:0:25721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x63:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938448.247308:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x63:0x0].0x0 since=714s v=(0 0) 00010000:00010000:0.0:1784938448.247313:0:25721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938448.247322:0:25721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ac23323/0x7b044d4128f9eaa8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c58 expref: 81 pid: 25721 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.247338:0:25721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008ac23323/0x7b044d4128f9eaa8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c58 expref: 81 pid: 25721 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.247350:0:25721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24c5b29800, rc 0) 00000100:00100000:0.0:1784938448.247403:0:25721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7ea6e988-18ba-4c98-b179-17995571b98b+81:10958:x1871643337561984:12345-192.168.202.54@tcp:101:cp.0 Request processed in 196us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938448.247409:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 958 00000100:00100000:3.0:1784938448.250843:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.250992:0:25724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337562112 00000100:00100000:0.0:1784938448.251003:0:25724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337562112 00000100:00100000:0.0:1784938448.251067:0:25724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 959 00000100:00100000:0.0:1784938448.251078:0:25724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7ea6e988-18ba-4c98-b179-17995571b98b+81:17112:x1871643337562112:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938448.251097:0:25724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938448.251118:0:25724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c9e6d5b/0x7b044d4128f9eaaf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664c5f expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.251184:0:25724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008ac23323/0x7b044d4128f9eaa8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c58 expref: 82 pid: 25721 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.251199:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938448.251203:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938448.251208:0:25724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c9e6d5b/0x7b044d4128f9eaaf lrc: 4/0,0 mode: --/PW res: [0x280000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->430079] (req 0->430079) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c5f expref: 82 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.251243:0:25724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008ac23323/0x7b044d4128f9eaa8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664c58 expref: 82 pid: 25721 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.251256:0:25724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008ac23323/0x7b044d4128f9eaa8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664c58 expref: 82 pid: 25721 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938448.251271:0:25724:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:25724:1871643350909184:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938448.251369:0:25724:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238ec48c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938448.253337:0:25724:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:25724:1871643350909184:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938448.253371:0:25724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008c9e6d5b/0x7b044d4128f9eaaf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->430079] (req 0->430079) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664c5f expref: 82 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.253390:0:25724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24c5b29c00, rc 0) 00000100:00100000:0.0:1784938448.253439:0:25724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7ea6e988-18ba-4c98-b179-17995571b98b+82:17112:x1871643337562112:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2364us (2606us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938448.253449:0:25724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 959 00000100:00100000:1.0:1784938448.255940:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.256081:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337562240 00000100:00100000:0.0:1784938448.256092:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337562240 00010000:00010000:0.0:1784938448.256386:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008ac23323/0x7b044d4128f9eaa8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664c58 expref: 82 pid: 25721 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938448.256513:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 481 00000100:00100000:1.0:1784938448.256525:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd254e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+82:10957:x1871643337562240:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938448.256541:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938448.256566:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008ac23323/0x7b044d4128f9eaa8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664c58 expref: 82 pid: 25721 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.256579:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008ac23323/0x7b044d4128f9eaa8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664c58 expref: 82 pid: 25721 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.256602:0:22955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ac23323/0x7b044d4128f9eaa8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664c58 expref: 82 pid: 25721 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.256617:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938448.256620:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938448.256629:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008c9e6d5b/0x7b044d4128f9eaaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664c5f expref: 81 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.256644:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c9e6d5b/0x7b044d4128f9eaaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664c5f expref: 81 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.256682:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008c9e6d5b/0x7b044d4128f9eaaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664c5f expref: 81 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938448.256698:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd255c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350909312:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938448.256783:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238da84240 going to sleep for 11 seconds 00000100:00100000:3.0:1784938448.263886:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd255c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350909312:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938448.263918:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938448.263990:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd254e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+81:10957:x1871643337562240:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 7466us (8057us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938448.264006:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 481 00000100:00100000:0.0:1784938448.269884:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938448.269968:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337562496 00000100:00100000:3.0:1784938448.269988:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337562496 00000100:00100000:3.0:1784938448.270087:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 169 00000100:00100000:3.0:1784938448.270097:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+122:17112:x1871643337562496:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938448.270467:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+123:17112:x1871643337562496:12345-192.168.202.54@tcp:35:cp.0 Request processed in 371us (591us total) trans 8589934824 rc 0/0 00000100:00100000:3.0:1784938448.270474:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 169 00000100:00100000:2.0:1784938448.277404:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938448.277503:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337562624 00000100:00100000:3.0:1784938448.277513:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337562624 00000100:00100000:3.0:1784938448.277610:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 703 00000100:00100000:3.0:1784938448.277620:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+123:17112:x1871643337562624:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938448.277647:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938448.277669:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9eab6 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664c66 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.277737:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9eabd lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.277752:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9eabd lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.277765:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9eabd lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.277783:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9eac4 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe087ee79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.277795:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9eac4 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.277802:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9eac4 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.277844:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9eabd lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.277864:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9eabd lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.277870:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9eabd lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.277877:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d01c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938448.277881:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9eabd lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.277889:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9eabd lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.277901:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938448.277904:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938448.277909:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9eabd lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.277914:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9eabd lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.277928:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9eac4 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.277934:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9eac4 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.277940:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9eac4 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.277945:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24d000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938448.277948:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9eac4 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.277953:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9eac4 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.277960:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xe087ee79 (ffff9f249863b100) 00010000:00010000:3.0:1784938448.277962:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938448.277965:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9eac4 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.277970:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9eac4 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.278011:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9eab6 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c66 expref: 124 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.278023:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938448.278025:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938448.278029:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9eab6 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c66 expref: 124 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.278043:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d00000, rc 0) 00000100:00100000:3.0:1784938448.278167:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+123:17112:x1871643337562624:12345-192.168.202.54@tcp:101:cp.0 Request processed in 527us (750us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938448.278175:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 703 00000100:00100000:1.0:1784938448.281335:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938448.281398:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337562752 00000100:00100000:3.0:1784938448.281407:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337562752 00000100:00100000:3.0:1784938448.281454:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 704 00000100:00100000:3.0:1784938448.281464:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+123:17112:x1871643337562752:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938448.281484:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938448.281504:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9eacb lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664c6d expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.281565:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9ead2 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.281579:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9ead2 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.281590:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9ead2 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.281605:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9ead9 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe087ee79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.281612:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9ead9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.281617:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9ead9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.281655:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9ead2 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.281663:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9ead2 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.281669:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9ead2 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.281676:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c6400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938448.281680:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9ead2 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.281687:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9ead2 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.281699:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938448.281702:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938448.281707:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9ead2 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.281713:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9ead2 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.281727:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9ead9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.281732:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9ead9 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.281739:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9ead9 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.281745:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c7e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938448.281748:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9ead9 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.281754:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9ead9 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.281760:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xe087ee79 (ffff9f249863b800) 00010000:00010000:3.0:1784938448.281762:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938448.281765:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9ead9 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.281770:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9ead9 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.281802:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9eacb lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c6d expref: 124 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.281813:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938448.281815:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938448.281819:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9eacb lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c6d expref: 124 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.281828:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24d400, rc 0) 00000100:00100000:3.0:1784938448.281899:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+123:17112:x1871643337562752:12345-192.168.202.54@tcp:101:cp.0 Request processed in 436us (572us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938448.281907:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 704 00000100:00100000:0.0:1784938448.285060:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938448.285185:0:25738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337563008 00000100:00100000:1.0:1784938448.285198:0:25738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337563008 00000100:00100000:1.0:1784938448.285250:0:25738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 705 00000100:00100000:1.0:1784938448.285258:0:25738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+123:17112:x1871643337563008:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938448.285281:0:25738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938448.285310:0:25738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9eae0 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664c74 expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.285414:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39000/0x7b044d4128f9eae7 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.285427:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39000/0x7b044d4128f9eae7 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.285438:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39000/0x7b044d4128f9eae7 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.285458:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f9eaee lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0xe087ee79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.285464:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f9eaee lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.285470:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f9eaee lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938448.285791:0:25738:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x64:0x0], index 1: 0 00010000:00010000:1.0:1784938448.285953:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9eaf5 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x46:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.285963:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9eaf5 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.285971:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9eaf5 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.286003:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39000/0x7b044d4128f9eae7 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.286011:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39000/0x7b044d4128f9eae7 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.286018:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39000/0x7b044d4128f9eae7 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.286024:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938448.286028:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39000/0x7b044d4128f9eae7 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.286039:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39000/0x7b044d4128f9eae7 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.286052:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938448.286055:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938448.286060:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39000/0x7b044d4128f9eae7 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.286066:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39000/0x7b044d4128f9eae7 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938448.286079:0:25738:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000167a0dcb reply state 00000000a9697ae3 transno 8589934825 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f9eaee lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.286090:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f9eaee lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.286096:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xe087ee79 (ffff9f24898ddc00) 00010000:00010000:1.0:1784938448.286098:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938448.286101:0:25738:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938448.286130:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9eae0 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c74 expref: 126 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.286191:0:25738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9eaf5 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c74 expref: 125 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.286199:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x46:0x0].0x0 (ffff9f24898dda00) 00010000:00010000:1.0:1784938448.286201:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938448.286203:0:25738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c9f7600, rc 0) 00000100:00100000:1.0:1784938448.286265:0:25738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+126:17112:x1871643337563008:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1007us (1215us total) trans 8589934825 rc 0/0 00000100:00100000:1.0:1784938448.286273:0:25738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 705 00000100:00100000:1.0:1784938448.290114:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.290499:0:25725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337563136 00000100:00100000:0.0:1784938448.290509:0:25725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337563136 00000100:00100000:0.0:1784938448.290569:0:25725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 960 00000100:00100000:0.0:1784938448.290578:0:25725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7ea6e988-18ba-4c98-b179-17995571b98b+77:10959:x1871643337563136:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938448.290596:0:25725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938448.290618:0:25725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ac23323/0x7b044d4128f9eb03 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664c7b expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938448.290647:0:25725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x64:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938448.290669:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x64:0x0].0x0 since=714s v=(0 0) 00010000:00010000:0.0:1784938448.290674:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x64:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938448.290685:0:25725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ac23323/0x7b044d4128f9eb03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c7b expref: 78 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.290703:0:25725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ac23323/0x7b044d4128f9eb03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c7b expref: 78 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.290718:0:25725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24c5b29800, rc 0) 00000100:00100000:0.0:1784938448.290785:0:25725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7ea6e988-18ba-4c98-b179-17995571b98b+78:10959:x1871643337563136:12345-192.168.202.54@tcp:101:cp.0 Request processed in 208us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938448.290793:0:25725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 960 00000100:00100000:3.0:1784938448.293180:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.293336:0:25718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337563264 00000100:00100000:0.0:1784938448.293346:0:25718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337563264 00000100:00100000:0.0:1784938448.293399:0:25718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 961 00000100:00100000:0.0:1784938448.293409:0:25718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ea6e988-18ba-4c98-b179-17995571b98b+78:17112:x1871643337563264:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938448.293427:0:25718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938448.293444:0:25718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000208c6716/0x7b044d4128f9eb0a lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664c82 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.293474:0:25718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ac23323/0x7b044d4128f9eb03 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c7b expref: 79 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.293483:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x64:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938448.293487:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x64:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938448.293492:0:25718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000208c6716/0x7b044d4128f9eb0a lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c82 expref: 79 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.293523:0:25718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ac23323/0x7b044d4128f9eb03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664c7b expref: 79 pid: 25725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.293536:0:25718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ac23323/0x7b044d4128f9eb03 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664c7b expref: 79 pid: 25725 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938448.293549:0:25718:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25718:1871643350909440:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938448.293625:0:25718:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238ec48c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784938448.295911:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938448.295969:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337563392 00000100:00100000:3.0:1784938448.295983:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337563392 00010000:00010000:3.0:1784938448.296023:0:25731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ac23323/0x7b044d4128f9eb03 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664c7b expref: 80 pid: 25725 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938448.296064:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 482 00000100:00100000:3.0:1784938448.296072:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd254000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+80:10960:x1871643337563392:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938448.296087:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938448.296107:0:25731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ac23323/0x7b044d4128f9eb03 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664c7b expref: 80 pid: 25725 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.296121:0:25731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ac23323/0x7b044d4128f9eb03 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664c7b expref: 80 pid: 25725 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.296176:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x64:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938448.296181:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x64:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938448.296191:0:25731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000208c6716/0x7b044d4128f9eb0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c82 expref: 80 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.296201:0:25731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000208c6716/0x7b044d4128f9eb0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c82 expref: 80 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.296239:0:25731:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000208c6716/0x7b044d4128f9eb0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c82 expref: 80 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938448.296252:0:25731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:25731:1871643350909568:192.168.202.54@tcp:105: 00000100:00100000:3.0:1784938448.296344:0:25731:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248529f840 going to sleep for 11 seconds 00010000:00010000:0.0:1784938448.297018:0:25718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ac23323/0x7b044d4128f9eb03 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664c7b expref: 80 pid: 25725 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938448.297043:0:25718:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25718:1871643350909440:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938448.297068:0:25718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000208c6716/0x7b044d4128f9eb0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664c82 expref: 79 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.297080:0:25718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24c5b29a00, rc 0) 00000100:00100000:0.0:1784938448.297139:0:25718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ea6e988-18ba-4c98-b179-17995571b98b+79:17112:x1871643337563264:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3731us (3999us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938448.297185:0:25718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 961 00000100:00100000:1.0:1784938448.300795:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938448.300890:0:25731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:25731:1871643350909568:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938448.300913:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938448.300969:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd254000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+78:10960:x1871643337563392:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 4897us (5065us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938448.300980:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 482 00000100:00100000:0.0:1784938448.301740:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337563648 00000100:00100000:0.0:1784938448.301752:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337563648 00000100:00100000:0.0:1784938448.301806:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 170 00000100:00100000:0.0:1784938448.301816:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+126:17112:x1871643337563648:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:0.0:1784938448.302121:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+127:17112:x1871643337563648:12345-192.168.202.54@tcp:35:cp.0 Request processed in 305us (1333us total) trans 8589934826 rc 0/0 00000100:00100000:0.0:1784938448.302139:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 170 00000100:00100000:1.0:1784938448.306243:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938448.306392:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337563776 00000100:00100000:3.0:1784938448.306404:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337563776 00000100:00100000:3.0:1784938448.306471:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 706 00000100:00100000:3.0:1784938448.306481:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+127:17112:x1871643337563776:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938448.306507:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938448.306530:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9eb11 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664c89 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.306598:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9eb18 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.306612:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9eb18 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.306623:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9eb18 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.306637:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9eb1f lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x4d2290fc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.306645:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9eb1f lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.306656:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9eb1f lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.306695:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9eb18 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.306701:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9eb18 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.306707:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9eb18 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.306712:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c6400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938448.306716:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9eb18 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.306723:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9eb18 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.306735:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938448.306737:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938448.306742:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9eb18 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.306748:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9eb18 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.306761:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9eb1f lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.306767:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9eb1f lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.306772:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9eb1f lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.306776:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c7600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938448.306779:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9eb1f lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.306784:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9eb1f lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.306790:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x4d2290fc (ffff9f249863b800) 00010000:00010000:3.0:1784938448.306792:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938448.306794:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9eb1f lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.306799:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9eb1f lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.306832:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9eb11 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c89 expref: 128 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.306842:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938448.306844:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938448.306861:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7e00/0x7b044d4128f9eb11 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c89 expref: 128 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.306871:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c7e00, rc 0) 00000100:00100000:3.0:1784938448.307047:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+127:17112:x1871643337563776:12345-192.168.202.54@tcp:101:cp.0 Request processed in 566us (812us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938448.307058:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 706 00000100:00100000:1.0:1784938448.310508:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.310644:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337563904 00000100:00100000:0.0:1784938448.310654:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337563904 00000100:00100000:0.0:1784938448.310721:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 707 00000100:00100000:0.0:1784938448.310731:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+127:17112:x1871643337563904:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938448.310758:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938448.310782:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f9eb26 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664c90 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.310867:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9eb2d lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.310882:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9eb2d lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.310893:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9eb2d lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.310908:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9eb34 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x4d2290fc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.310914:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9eb34 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.310920:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9eb34 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.310961:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9eb2d lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.310968:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9eb2d lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.310974:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9eb2d lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.310992:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9eb2d lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.310998:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5da600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938448.311002:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9eb2d lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.311010:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9eb2d lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.311022:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938448.311025:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.311030:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9eb2d lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.311035:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9eb2d lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.311050:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9eb34 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.311056:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9eb34 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.311061:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9eb34 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.311065:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5da400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938448.311068:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9eb34 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.311074:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9eb34 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.311081:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x4d2290fc (ffff9f23872e6800) 00010000:00010000:0.0:1784938448.311083:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.311085:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9eb34 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.311090:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9eb34 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.311349:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f9eb26 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c90 expref: 128 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.311363:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938448.311366:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.311370:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f9eb26 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c90 expref: 128 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.311382:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24c5b29800, rc 0) 00000100:00100000:0.0:1784938448.311453:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+127:17112:x1871643337563904:12345-192.168.202.54@tcp:101:cp.0 Request processed in 723us (954us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938448.311460:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 707 00000100:00100000:2.0:1784938448.314629:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.314710:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337564160 00000100:00100000:0.0:1784938448.314720:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337564160 00000100:00100000:0.0:1784938448.314782:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 708 00000100:00100000:0.0:1784938448.314792:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+127:17112:x1871643337564160:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938448.314814:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938448.314835:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9eb3b lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664c97 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.314960:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9eb42 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.314975:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9eb42 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.314997:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9eb42 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.315013:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9eb49 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x4d2290fc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.315020:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9eb49 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.315026:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9eb49 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938448.315383:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x64:0x0], index 0: 0 00010000:00010000:0.0:1784938448.315529:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9eb50 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.315539:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9eb50 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.315546:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9eb50 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.315578:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9eb42 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.315585:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9eb42 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.315591:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9eb42 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.315597:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9eb42 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.315603:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3cc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938448.315608:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9eb42 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.315615:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9eb42 lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.315626:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938448.315629:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.315634:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9eb42 lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.315641:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9eb42 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938448.315655:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000032119ec7 reply state 000000005af946fb transno 8589934827 ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9eb49 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.315666:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9eb49 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.315671:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x4d2290fc (ffff9f23872e6300) 00010000:00010000:0.0:1784938448.315674:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938448.315676:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938448.315703:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9eb3b lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c97 expref: 130 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.315717:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9eb50 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c97 expref: 129 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.315724:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x47:0x0].0x0 (ffff9f238727c300) 00010000:00010000:0.0:1784938448.315726:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938448.315730:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3ec00, rc 0) 00000100:00100000:0.0:1784938448.315786:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+130:17112:x1871643337564160:12345-192.168.202.54@tcp:101:cp.0 Request processed in 995us (1166us total) trans 8589934827 rc 0/0 00000100:00100000:0.0:1784938448.315793:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 708 00000100:00100000:2.0:1784938448.319836:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.319925:0:25728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337564288 00000100:00100000:0.0:1784938448.319935:0:25728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337564288 00000100:00100000:0.0:1784938448.320005:0:25728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 962 00000100:00100000:0.0:1784938448.320015:0:25728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:7ea6e988-18ba-4c98-b179-17995571b98b+81:10957:x1871643337564288:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938448.320038:0:25728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938448.320071:0:25728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6aa69be/0x7b044d4128f9eb5e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664c9e expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938448.320098:0:25728:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x64:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938448.320119:0:25728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x64:0x0].0x0 since=714s v=(0 0) 00010000:00010000:0.0:1784938448.320136:0:25728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x64:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938448.320193:0:25728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6aa69be/0x7b044d4128f9eb5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c9e expref: 82 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.320211:0:25728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e6aa69be/0x7b044d4128f9eb5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c9e expref: 82 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.320225:0:25728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3e800, rc 0) 00000100:00100000:0.0:1784938448.320275:0:25728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:7ea6e988-18ba-4c98-b179-17995571b98b+82:10957:x1871643337564288:12345-192.168.202.54@tcp:101:cp.0 Request processed in 261us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938448.320291:0:25728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 962 00000100:00100000:2.0:1784938448.327456:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938448.327585:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337564416 00000100:00100000:3.0:1784938448.327595:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337564416 00000100:00100000:3.0:1784938448.327656:0:25720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 963 00000100:00100000:3.0:1784938448.327666:0:25720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7ea6e988-18ba-4c98-b179-17995571b98b+82:17112:x1871643337564416:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938448.327685:0:25720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938448.327704:0:25720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a97217e/0x7b044d4128f9eb65 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664ca5 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.327736:0:25720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e6aa69be/0x7b044d4128f9eb5e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c9e expref: 83 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.327745:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x64:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938448.327749:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x64:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938448.327754:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a97217e/0x7b044d4128f9eb65 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->1179647] (req 0->1179647) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664ca5 expref: 83 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.327791:0:25720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e6aa69be/0x7b044d4128f9eb5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664c9e expref: 83 pid: 25728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.327805:0:25720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e6aa69be/0x7b044d4128f9eb5e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664c9e expref: 83 pid: 25728 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938448.327822:0:25720:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:25720:1871643350909696:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938448.328077:0:25720:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248529f840 going to sleep for 11 seconds 00000100:00100000:2.0:1784938448.331600:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938448.332276:0:25720:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:25720:1871643350909696:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938448.332316:0:25720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a97217e/0x7b044d4128f9eb65 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->1179647] (req 0->1179647) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664ca5 expref: 83 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.332337:0:25720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c7e00, rc 0) 00000100:00100000:3.0:1784938448.332446:0:25720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7ea6e988-18ba-4c98-b179-17995571b98b+83:17112:x1871643337564416:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4781us (5000us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938448.332456:0:25720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 963 00000100:00100000:0.0:1784938448.332548:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337564544 00000100:00100000:0.0:1784938448.332557:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337564544 00010000:00010000:0.0:1784938448.332591:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e6aa69be/0x7b044d4128f9eb5e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664c9e expref: 83 pid: 25728 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938448.332629:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 483 00000100:00100000:0.0:1784938448.332639:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+83:10958:x1871643337564544:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938448.332653:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938448.332676:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e6aa69be/0x7b044d4128f9eb5e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664c9e expref: 83 pid: 25728 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.332690:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e6aa69be/0x7b044d4128f9eb5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664c9e expref: 83 pid: 25728 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.332713:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6aa69be/0x7b044d4128f9eb5e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664c9e expref: 83 pid: 25728 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.332728:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x64:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938448.332732:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x64:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938448.332740:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003a97217e/0x7b044d4128f9eb65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1179647) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664ca5 expref: 82 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.332751:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a97217e/0x7b044d4128f9eb65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1179647) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664ca5 expref: 82 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.332786:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003a97217e/0x7b044d4128f9eb65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1179647) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664ca5 expref: 82 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938448.332806:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:19221:1871643350909824:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938448.332871:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2483773cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938448.338674:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:19221:1871643350909824:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938448.338702:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938448.338767:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+82:10958:x1871643337564544:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 6129us (7176us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938448.338779:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 483 00000100:00100000:2.0:1784938448.361768:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938448.362125:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337564800 00000100:00100000:3.0:1784938448.362135:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337564800 00000100:00100000:2.0:1784938448.362420:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 171 00000100:00100000:2.0:1784938448.362432:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24857fe850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+130:17112:x1871643337564800:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:2.0:1784938448.362736:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24857fe850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+131:17112:x1871643337564800:12345-192.168.202.54@tcp:35:cp.0 Request processed in 306us (977us total) trans 8589934828 rc 0/0 00000100:00100000:2.0:1784938448.362744:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 171 00000100:00100000:1.0:1784938448.366036:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938448.366123:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337564928 00000100:00100000:3.0:1784938448.366171:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337564928 00000100:00100000:3.0:1784938448.366220:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 709 00000100:00100000:3.0:1784938448.366229:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+131:17112:x1871643337564928:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938448.366253:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938448.366276:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9eb6c lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664cac expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.366352:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9eb73 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.366366:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9eb73 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.366377:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9eb73 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.366391:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9eb7a lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x489b8eb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.366402:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9eb7a lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.366408:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9eb7a lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.366448:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9eb73 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.366455:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9eb73 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.366461:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9eb73 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.366467:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c6400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938448.366471:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9eb73 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.366478:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9eb73 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.366489:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938448.366492:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938448.366496:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9eb73 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.366501:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9eb73 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.366514:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9eb7a lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.366522:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9eb7a lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.366527:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9eb7a lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.366532:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c7400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938448.366535:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9eb7a lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.366540:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9eb7a lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.366547:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x489b8eb2 (ffff9f249863b800) 00010000:00010000:3.0:1784938448.366550:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938448.366552:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9eb7a lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.366559:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7400/0x7b044d4128f9eb7a lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.366593:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9eb6c lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664cac expref: 132 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.366603:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938448.366606:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938448.366609:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9eb6c lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664cac expref: 132 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.366624:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c7600, rc 0) 00000100:00100000:3.0:1784938448.366688:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+131:17112:x1871643337564928:12345-192.168.202.54@tcp:101:cp.0 Request processed in 460us (660us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938448.366695:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 709 00000100:00100000:1.0:1784938448.373325:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.373412:0:25738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337565056 00000100:00100000:0.0:1784938448.373423:0:25738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337565056 00000100:00100000:0.0:1784938448.373493:0:25738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 710 00000100:00100000:0.0:1784938448.373503:0:25738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+131:17112:x1871643337565056:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938448.373527:0:25738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938448.373548:0:25738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9eb81 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664cb3 expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.373621:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9eb88 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.373636:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9eb88 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.373648:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9eb88 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.373665:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9eb8f lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x489b8eb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.373677:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9eb8f lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.373683:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9eb8f lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.373726:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9eb88 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.373734:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9eb88 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.373741:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9eb88 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.373746:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3f200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938448.373750:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9eb88 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.373758:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9eb88 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.373771:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938448.373775:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.373780:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9eb88 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.373786:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9eb88 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.373800:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9eb8f lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.373806:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9eb8f lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.373813:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9eb8f lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.373818:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3ea00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938448.373821:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9eb8f lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.373826:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9eb8f lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.373833:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x489b8eb2 (ffff9f23823e0000) 00010000:00010000:0.0:1784938448.373835:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.373837:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9eb8f lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.373843:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9eb8f lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.374063:0:25738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9eb81 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664cb3 expref: 132 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.374073:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938448.374075:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.374078:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9eb81 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664cb3 expref: 132 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.374093:0:25738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3e800, rc 0) 00000100:00100000:0.0:1784938448.374241:0:25738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+131:17112:x1871643337565056:12345-192.168.202.54@tcp:101:cp.0 Request processed in 738us (926us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938448.374249:0:25738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 710 00000100:00100000:2.0:1784938448.377655:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938448.377756:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337565312 00000100:00100000:1.0:1784938448.377766:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337565312 00000100:00100000:1.0:1784938448.377872:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 711 00000100:00100000:1.0:1784938448.377883:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+131:17112:x1871643337565312:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938448.377903:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938448.377924:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9eb96 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664cba expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.378035:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9eb9d lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.378050:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9eb9d lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.378060:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9eb9d lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.378073:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f9eba4 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x489b8eb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.378083:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f9eba4 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.378089:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f9eba4 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938448.378446:0:24203:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x65:0x0], index 1: 0 00010000:00010000:1.0:1784938448.378589:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9ebab lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.378598:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9ebab lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.378605:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9ebab lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.378636:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9eb9d lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.378643:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9eb9d lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.378648:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9eb9d lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.378654:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c559400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938448.378658:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9eb9d lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.378665:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9eb9d lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.378683:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938448.378686:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938448.378691:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9eb9d lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.378696:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9eb9d lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938448.378709:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000003f58a8a reply state 000000003dc96e4e transno 8589934829 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f9eba4 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.378721:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f9eba4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.378727:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x489b8eb2 (ffff9f24898ddb00) 00010000:00010000:1.0:1784938448.378729:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938448.378731:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938448.378757:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9eb96 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664cba expref: 134 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.378771:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9ebab lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664cba expref: 133 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.378778:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x48:0x0].0x0 (ffff9f24898ddf00) 00010000:00010000:1.0:1784938448.378781:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938448.378783:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c558800, rc 0) 00000100:00100000:1.0:1784938448.378982:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+134:17112:x1871643337565312:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1100us (1335us total) trans 8589934829 rc 0/0 00000100:00100000:1.0:1784938448.378991:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 711 00000100:00100000:1.0:1784938448.382527:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938448.382618:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337565440 00000100:00100000:2.0:1784938448.382628:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337565440 00000100:00100000:2.0:1784938448.382715:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 964 00000100:00100000:2.0:1784938448.382726:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+78:10960:x1871643337565440:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938448.382745:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938448.382766:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000308168bd/0x7b044d4128f9ebb9 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664cc1 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938448.382794:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x65:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938448.382815:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x65:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1784938448.382820:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x65:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938448.382829:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000308168bd/0x7b044d4128f9ebb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664cc1 expref: 79 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.382911:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000308168bd/0x7b044d4128f9ebb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664cc1 expref: 79 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.382927:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e00000, rc 0) 00000100:00100000:2.0:1784938448.383070:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+79:10960:x1871643337565440:12345-192.168.202.54@tcp:101:cp.0 Request processed in 345us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938448.383079:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 964 00000100:00100000:3.0:1784938448.385541:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938448.385722:0:25727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337565568 00000100:00100000:1.0:1784938448.385731:0:25727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337565568 00000100:00100000:1.0:1784938448.385780:0:25727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 965 00000100:00100000:1.0:1784938448.385791:0:25727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7ea6e988-18ba-4c98-b179-17995571b98b+79:17112:x1871643337565568:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938448.385808:0:25727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938448.385826:0:25727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097541b4a/0x7b044d4128f9ebc0 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664cc8 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.385864:0:25727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000308168bd/0x7b044d4128f9ebb9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664cc1 expref: 80 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.385873:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x65:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938448.385877:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x65:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938448.385881:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097541b4a/0x7b044d4128f9ebc0 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664cc8 expref: 80 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.385913:0:25727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000308168bd/0x7b044d4128f9ebb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664cc1 expref: 80 pid: 21151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.385925:0:25727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000308168bd/0x7b044d4128f9ebb9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664cc1 expref: 80 pid: 21151 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938448.385939:0:25727:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:25727:1871643350909952:192.168.202.54@tcp:104: 00000100:00100000:1.0:1784938448.386023:0:25727:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238da84600 going to sleep for 11 seconds 00000100:00100000:3.0:1784938448.388315:0:25727:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:25727:1871643350909952:192.168.202.54@tcp:104: 00010000:00010000:3.0:1784938448.388353:0:25727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000097541b4a/0x7b044d4128f9ebc0 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664cc8 expref: 80 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.388375:0:25727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238db39000, rc 0) 00000100:00100000:3.0:1784938448.388434:0:25727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7ea6e988-18ba-4c98-b179-17995571b98b+80:17112:x1871643337565568:12345-192.168.202.54@tcp:101:cp.0 Request processed in 2645us (2903us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938448.388443:0:25727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 965 00000100:00100000:1.0:1784938448.389659:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938448.389725:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337565696 00000100:00100000:3.0:1784938448.389733:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337565696 00010000:00010000:3.0:1784938448.389767:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000308168bd/0x7b044d4128f9ebb9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664cc1 expref: 80 pid: 21151 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938448.389811:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 484 00000100:00100000:3.0:1784938448.389821:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+80:10960:x1871643337565696:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938448.389835:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938448.389869:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000308168bd/0x7b044d4128f9ebb9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664cc1 expref: 80 pid: 21151 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.389887:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000308168bd/0x7b044d4128f9ebb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664cc1 expref: 80 pid: 21151 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.389910:0:22955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000308168bd/0x7b044d4128f9ebb9 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664cc1 expref: 80 pid: 21151 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.389927:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x65:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938448.389931:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x65:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938448.389939:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000097541b4a/0x7b044d4128f9ebc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664cc8 expref: 79 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.389949:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097541b4a/0x7b044d4128f9ebc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664cc8 expref: 79 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.389996:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000097541b4a/0x7b044d4128f9ebc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664cc8 expref: 79 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938448.390010:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22955:1871643350910080:192.168.202.54@tcp:105: 00000100:00100000:3.0:1784938448.390078:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248529f840 going to sleep for 11 seconds 00000100:00100000:3.0:1784938448.393496:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22955:1871643350910080:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938448.393523:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938448.393578:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+79:10960:x1871643337565696:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3757us (3922us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938448.393590:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 484 00000100:00100000:1.0:1784938448.396630:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938448.396700:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337565952 00000100:00100000:2.0:1784938448.396711:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337565952 00000100:00100000:2.0:1784938448.396772:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 172 00000100:00100000:2.0:1784938448.396782:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+134:17112:x1871643337565952:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:2.0:1784938448.397063:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+135:17112:x1871643337565952:12345-192.168.202.54@tcp:35:cp.0 Request processed in 282us (446us total) trans 8589934830 rc 0/0 00000100:00100000:2.0:1784938448.397071:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 172 00000100:00100000:1.0:1784938448.399928:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.400105:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337566080 00000100:00100000:0.0:1784938448.400115:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337566080 00000100:00100000:0.0:1784938448.400211:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 712 00000100:00100000:0.0:1784938448.400221:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+135:17112:x1871643337566080:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938448.400247:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938448.400270:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9ebc7 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664ccf expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.400344:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9ebce lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.400360:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9ebce lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.400373:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9ebce lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.400387:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9ebd5 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xf2ca543e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.400393:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9ebd5 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.400398:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9ebd5 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.400442:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9ebce lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.400449:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9ebce lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.400455:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9ebce lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.400461:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9ebce lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.400467:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3ea00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938448.400472:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9ebce lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.400480:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9ebce lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.400494:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938448.400497:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.400502:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9ebce lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.400509:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9ebce lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.400524:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9ebd5 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.400531:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9ebd5 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.400537:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9ebd5 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.400542:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3f200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938448.400545:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9ebd5 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.400551:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9ebd5 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.400558:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xf2ca543e (ffff9f23823e0000) 00010000:00010000:0.0:1784938448.400561:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.400563:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9ebd5 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.400570:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9ebd5 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.400604:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9ebc7 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664ccf expref: 136 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.400614:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938448.400616:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.400620:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9ebc7 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664ccf expref: 136 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.400629:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3e800, rc 0) 00000100:00100000:0.0:1784938448.400697:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+135:17112:x1871643337566080:12345-192.168.202.54@tcp:101:cp.0 Request processed in 478us (776us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938448.400706:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 712 00000100:00100000:1.0:1784938448.403515:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.403598:0:25738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337566208 00000100:00100000:0.0:1784938448.403609:0:25738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337566208 00000100:00100000:0.0:1784938448.403670:0:25738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 713 00000100:00100000:0.0:1784938448.403679:0:25738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+135:17112:x1871643337566208:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938448.403699:0:25738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938448.403721:0:25738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f9ebdc lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664cd6 expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.403789:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9ebe3 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.403802:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9ebe3 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.403812:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9ebe3 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.403828:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f9ebea lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xf2ca543e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.403834:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f9ebea lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.403839:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f9ebea lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.403889:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9ebe3 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.403900:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9ebe3 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.403907:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9ebe3 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.403913:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3cc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938448.403918:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9ebe3 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.403925:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9ebe3 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.403938:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938448.403941:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.403945:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9ebe3 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.403950:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3cc00/0x7b044d4128f9ebe3 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.403963:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f9ebea lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.403969:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f9ebea lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.403974:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f9ebea lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.403989:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b29800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938448.403993:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f9ebea lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.403999:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f9ebea lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.404006:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xf2ca543e (ffff9f23823e0200) 00010000:00010000:0.0:1784938448.404008:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.404010:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f9ebea lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.404015:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29800/0x7b044d4128f9ebea lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.404049:0:25738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f9ebdc lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664cd6 expref: 136 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.404058:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938448.404060:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.404063:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f9ebdc lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664cd6 expref: 136 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.404073:0:25738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3f600, rc 0) 00000100:00100000:0.0:1784938448.404132:0:25738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+135:17112:x1871643337566208:12345-192.168.202.54@tcp:101:cp.0 Request processed in 453us (627us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938448.404140:0:25738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 713 00000100:00100000:2.0:1784938448.407472:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938448.407576:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337566464 00000100:00100000:1.0:1784938448.407586:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337566464 00000100:00100000:1.0:1784938448.407646:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 714 00000100:00100000:1.0:1784938448.407657:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+135:17112:x1871643337566464:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938448.407678:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938448.407702:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fde00/0x7b044d4128f9ebf1 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664cdd expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.407808:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc800/0x7b044d4128f9ebf8 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.407822:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc800/0x7b044d4128f9ebf8 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.407834:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc800/0x7b044d4128f9ebf8 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.407862:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9ebff lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0xf2ca543e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.407870:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9ebff lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.407877:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9ebff lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938448.408529:0:24203:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x65:0x0], index 0: 0 00010000:00010000:1.0:1784938448.408675:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9ec06 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.408686:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9ec06 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.408693:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9ec06 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.408749:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc800/0x7b044d4128f9ebf8 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.408756:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc800/0x7b044d4128f9ebf8 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.408762:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc800/0x7b044d4128f9ebf8 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.408769:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fc800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938448.408772:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc800/0x7b044d4128f9ebf8 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.408780:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc800/0x7b044d4128f9ebf8 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.408791:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938448.408794:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938448.408797:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc800/0x7b044d4128f9ebf8 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.408803:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc800/0x7b044d4128f9ebf8 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938448.408815:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ac019b12 reply state 00000000c8a5b8ab transno 8589934831 ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9ebff lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.408825:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9ebff lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.408830:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xf2ca543e (ffff9f24898dd300) 00010000:00010000:1.0:1784938448.408832:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938448.408835:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938448.408931:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fde00/0x7b044d4128f9ebf1 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664cdd expref: 138 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.408945:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9ec06 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664cdd expref: 137 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.408952:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x49:0x0].0x0 (ffff9f24898ddd00) 00010000:00010000:1.0:1784938448.408954:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938448.408956:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c559000, rc 0) 00000100:00100000:1.0:1784938448.409091:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+138:17112:x1871643337566464:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1435us (1627us total) trans 8589934831 rc 0/0 00000100:00100000:1.0:1784938448.409099:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 714 00000100:00100000:1.0:1784938448.412790:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938448.412927:0:25726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337566592 00000100:00100000:3.0:1784938448.412937:0:25726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337566592 00000100:00100000:3.0:1784938448.413003:0:25726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 966 00000100:00100000:3.0:1784938448.413013:0:25726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7ea6e988-18ba-4c98-b179-17995571b98b+82:10957:x1871643337566592:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938448.413033:0:25726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938448.413054:0:25726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076ff25e4/0x7b044d4128f9ec14 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664ce4 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938448.413078:0:25726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x65:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938448.413097:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x65:0x0].0x0 since=714s v=(0 0) 00010000:00010000:3.0:1784938448.413103:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x65:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938448.413112:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076ff25e4/0x7b044d4128f9ec14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664ce4 expref: 83 pid: 25726 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.413130:0:25726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000076ff25e4/0x7b044d4128f9ec14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664ce4 expref: 83 pid: 25726 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.413180:0:25726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c7600, rc 0) 00000100:00100000:3.0:1784938448.413240:0:25726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7ea6e988-18ba-4c98-b179-17995571b98b+83:10957:x1871643337566592:12345-192.168.202.54@tcp:101:cp.0 Request processed in 228us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938448.413247:0:25726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 966 00000100:00100000:3.0:1784938448.418056:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.418176:0:25729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337566720 00000100:00100000:0.0:1784938448.418187:0:25729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337566720 00000100:00100000:0.0:1784938448.418246:0:25729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 967 00000100:00100000:0.0:1784938448.418256:0:25729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7ea6e988-18ba-4c98-b179-17995571b98b+83:17112:x1871643337566720:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938448.418275:0:25729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938448.418306:0:25729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ac23323/0x7b044d4128f9ec1b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664ceb expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.418336:0:25729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000076ff25e4/0x7b044d4128f9ec14 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664ce4 expref: 84 pid: 25726 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.418344:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x65:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938448.418348:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x65:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938448.418353:0:25729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ac23323/0x7b044d4128f9ec1b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664ceb expref: 84 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.418392:0:25729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000076ff25e4/0x7b044d4128f9ec14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664ce4 expref: 84 pid: 25726 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.418406:0:25729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000076ff25e4/0x7b044d4128f9ec14 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664ce4 expref: 84 pid: 25726 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938448.418420:0:25729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:25729:1871643350910208:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938448.418509:0:25729:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2483773cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938448.421402:0:25729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:25729:1871643350910208:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938448.421439:0:25729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008ac23323/0x7b044d4128f9ec1b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664ceb expref: 84 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.421462:0:25729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24c5b29800, rc 0) 00000100:00100000:0.0:1784938448.421521:0:25729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7ea6e988-18ba-4c98-b179-17995571b98b+84:17112:x1871643337566720:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3266us (3474us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938448.421530:0:25729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 967 00000100:00100000:3.0:1784938448.421915:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.422037:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337566848 00000100:00100000:0.0:1784938448.422043:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337566848 00010000:00010000:0.0:1784938448.422072:0:25731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000076ff25e4/0x7b044d4128f9ec14 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664ce4 expref: 84 pid: 25726 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938448.422106:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 485 00000100:00100000:0.0:1784938448.422115:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+84:10957:x1871643337566848:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938448.422127:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938448.422183:0:25731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000076ff25e4/0x7b044d4128f9ec14 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664ce4 expref: 84 pid: 25726 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.422195:0:25731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000076ff25e4/0x7b044d4128f9ec14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664ce4 expref: 84 pid: 25726 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.422218:0:25731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076ff25e4/0x7b044d4128f9ec14 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664ce4 expref: 84 pid: 25726 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.422233:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x65:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938448.422237:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x65:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938448.422244:0:25731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008ac23323/0x7b044d4128f9ec1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664ceb expref: 83 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.422254:0:25731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ac23323/0x7b044d4128f9ec1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664ceb expref: 83 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.422298:0:25731:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008ac23323/0x7b044d4128f9ec1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664ceb expref: 83 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938448.422311:0:25731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:25731:1871643350910336:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938448.422366:0:25731:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2483773cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938448.425658:0:25731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:25731:1871643350910336:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938448.425685:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938448.425745:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+83:10957:x1871643337566848:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3629us (3830us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938448.425758:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 485 00000100:00100000:1.0:1784938448.429567:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938448.429661:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337567104 00000100:00100000:2.0:1784938448.429671:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337567104 00000100:00100000:2.0:1784938448.429734:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 173 00000100:00100000:2.0:1784938448.429743:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+138:17112:x1871643337567104:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:2.0:1784938448.430068:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+139:17112:x1871643337567104:12345-192.168.202.54@tcp:35:cp.0 Request processed in 324us (508us total) trans 8589934832 rc 0/0 00000100:00100000:2.0:1784938448.430075:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 173 00000100:00100000:2.0:1784938448.433922:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938448.434030:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337567232 00000100:00100000:1.0:1784938448.434041:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337567232 00000100:00100000:1.0:1784938448.434106:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 715 00000100:00100000:1.0:1784938448.434116:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+139:17112:x1871643337567232:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938448.434183:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938448.434207:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9ec22 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664cf2 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.434290:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fde00/0x7b044d4128f9ec29 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.434305:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fde00/0x7b044d4128f9ec29 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.434317:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fde00/0x7b044d4128f9ec29 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.434333:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc800/0x7b044d4128f9ec30 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xd06bcd9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.434341:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc800/0x7b044d4128f9ec30 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.434347:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc800/0x7b044d4128f9ec30 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.434394:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fde00/0x7b044d4128f9ec29 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.434403:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fde00/0x7b044d4128f9ec29 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.434409:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fde00/0x7b044d4128f9ec29 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.434416:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fde00/0x7b044d4128f9ec29 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.434421:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fde00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938448.434426:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fde00/0x7b044d4128f9ec29 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.434433:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fde00/0x7b044d4128f9ec29 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.434445:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938448.434448:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938448.434454:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fde00/0x7b044d4128f9ec29 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.434459:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fde00/0x7b044d4128f9ec29 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.434472:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc800/0x7b044d4128f9ec30 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.434477:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc800/0x7b044d4128f9ec30 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.434482:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc800/0x7b044d4128f9ec30 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.434487:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fc800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938448.434490:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc800/0x7b044d4128f9ec30 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.434495:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc800/0x7b044d4128f9ec30 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.434502:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xd06bcd9f (ffff9f23823e1100) 00010000:00010000:1.0:1784938448.434504:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938448.434507:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc800/0x7b044d4128f9ec30 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.434513:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc800/0x7b044d4128f9ec30 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.434546:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9ec22 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664cf2 expref: 140 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.434556:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938448.434558:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938448.434561:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559400/0x7b044d4128f9ec22 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664cf2 expref: 140 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.434570:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c559400, rc 0) 00000100:00100000:1.0:1784938448.434627:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+139:17112:x1871643337567232:12345-192.168.202.54@tcp:101:cp.0 Request processed in 511us (715us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938448.434635:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 715 00000100:00100000:3.0:1784938448.437447:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938448.437549:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337567360 00000100:00100000:2.0:1784938448.437557:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337567360 00000100:00100000:2.0:1784938448.437611:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 716 00000100:00100000:2.0:1784938448.437619:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+139:17112:x1871643337567360:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938448.437638:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938448.437656:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01200/0x7b044d4128f9ec37 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664cf9 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.437711:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01e00/0x7b044d4128f9ec3e lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.437727:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01e00/0x7b044d4128f9ec3e lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.437737:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01e00/0x7b044d4128f9ec3e lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.437750:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9ec45 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xd06bcd9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.437757:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9ec45 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.437763:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9ec45 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.437798:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01e00/0x7b044d4128f9ec3e lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.437804:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01e00/0x7b044d4128f9ec3e lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.437810:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01e00/0x7b044d4128f9ec3e lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.437816:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e01e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938448.437820:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01e00/0x7b044d4128f9ec3e lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.437828:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01e00/0x7b044d4128f9ec3e lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.437838:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938448.437841:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938448.437857:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01e00/0x7b044d4128f9ec3e lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.437864:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01e00/0x7b044d4128f9ec3e lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.437876:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9ec45 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.437882:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9ec45 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.437888:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9ec45 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.437893:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e01a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938448.437896:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9ec45 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.437901:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9ec45 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.437907:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xd06bcd9f (ffff9f2496483200) 00010000:00010000:2.0:1784938448.437909:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938448.437912:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9ec45 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.437917:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01a00/0x7b044d4128f9ec45 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.437942:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01200/0x7b044d4128f9ec37 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664cf9 expref: 140 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.437952:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938448.437954:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938448.437957:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01200/0x7b044d4128f9ec37 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664cf9 expref: 140 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.437966:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e01200, rc 0) 00000100:00100000:2.0:1784938448.438027:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+139:17112:x1871643337567360:12345-192.168.202.54@tcp:101:cp.0 Request processed in 408us (587us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938448.438034:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 716 00000100:00100000:2.0:1784938448.441428:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938448.441527:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337567616 00000100:00100000:1.0:1784938448.441537:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337567616 00000100:00100000:1.0:1784938448.441590:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 717 00000100:00100000:1.0:1784938448.441600:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+139:17112:x1871643337567616:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938448.441622:0:24203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938448.441645:0:24203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42c200/0x7b044d4128f9ec4c lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664d00 expref: -99 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.441751:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d000/0x7b044d4128f9ec53 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.441771:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d000/0x7b044d4128f9ec53 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.441782:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d000/0x7b044d4128f9ec53 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.441796:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42dc00/0x7b044d4128f9ec5a lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0xd06bcd9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.441803:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42dc00/0x7b044d4128f9ec5a lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.441809:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42dc00/0x7b044d4128f9ec5a lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938448.442179:0:24203:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x66:0x0], index 1: 0 00010000:00010000:1.0:1784938448.442323:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42c600/0x7b044d4128f9ec61 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.442332:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42c600/0x7b044d4128f9ec61 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.442340:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42c600/0x7b044d4128f9ec61 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.442371:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d000/0x7b044d4128f9ec53 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.442379:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d000/0x7b044d4128f9ec53 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.442386:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d000/0x7b044d4128f9ec53 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.442392:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42d000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938448.442396:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d000/0x7b044d4128f9ec53 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.442405:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d000/0x7b044d4128f9ec53 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.442417:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938448.442419:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938448.442423:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d000/0x7b044d4128f9ec53 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.442429:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d000/0x7b044d4128f9ec53 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938448.442453:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006ba0332d reply state 000000003896427d transno 8589934833 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42dc00/0x7b044d4128f9ec5a lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.442464:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42dc00/0x7b044d4128f9ec5a lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.442471:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xd06bcd9f (ffff9f23823e1100) 00010000:00010000:1.0:1784938448.442474:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938448.442477:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938448.442506:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42c200/0x7b044d4128f9ec4c lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d00 expref: 142 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.442520:0:24203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42c600/0x7b044d4128f9ec61 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d00 expref: 141 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.442532:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x4a:0x0].0x0 (ffff9f23823e1300) 00010000:00010000:1.0:1784938448.442534:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938448.442536:0:24203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d42c600, rc 0) 00000100:00100000:1.0:1784938448.442596:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+142:17112:x1871643337567616:12345-192.168.202.54@tcp:101:cp.0 Request processed in 997us (1177us total) trans 8589934833 rc 0/0 00000100:00100000:1.0:1784938448.442604:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 717 00000100:00100000:1.0:1784938448.447359:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938448.447573:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337567744 00000100:00100000:2.0:1784938448.447584:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337567744 00000100:00100000:2.0:1784938448.447691:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 968 00000100:00100000:2.0:1784938448.447702:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+79:10959:x1871643337567744:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938448.447722:0:25715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938448.447749:0:25715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9ec6f lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664d07 expref: -99 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938448.447776:0:25715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x66:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938448.447800:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x66:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1784938448.447805:0:25715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x66:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938448.447814:0:25715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9ec6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d07 expref: 80 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.447832:0:25715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9ec6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d07 expref: 80 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.447860:0:25715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e01200, rc 0) 00000100:00100000:2.0:1784938448.447924:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+80:10959:x1871643337567744:12345-192.168.202.54@tcp:101:cp.0 Request processed in 224us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938448.447931:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 968 00000100:00100000:1.0:1784938448.450730:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.450830:0:25724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337567872 00000100:00100000:0.0:1784938448.450841:0:25724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337567872 00000100:00100000:0.0:1784938448.450993:0:25724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 969 00000100:00100000:0.0:1784938448.451003:0:25724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7ea6e988-18ba-4c98-b179-17995571b98b+80:17112:x1871643337567872:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938448.451022:0:25724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938448.451042:0:25724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066613dfd/0x7b044d4128f9ec76 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664d0e expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.451076:0:25724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9ec6f lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d07 expref: 81 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.451086:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x66:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938448.451090:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x66:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938448.451095:0:25724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066613dfd/0x7b044d4128f9ec76 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d0e expref: 81 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.451130:0:25724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9ec6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664d07 expref: 81 pid: 25715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.451173:0:25724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9ec6f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664d07 expref: 81 pid: 25715 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938448.451187:0:25724:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:25724:1871643350910464:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938448.451263:0:25724:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2483773cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938448.454258:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.454461:0:25724:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:25724:1871643350910464:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938448.454495:0:25724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000066613dfd/0x7b044d4128f9ec76 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664d0e expref: 81 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.454519:0:25724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d3cc00, rc 0) 00000100:00100000:0.0:1784938448.454590:0:25724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7ea6e988-18ba-4c98-b179-17995571b98b+81:17112:x1871643337567872:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3587us (3867us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938448.454598:0:25724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 969 00000100:00100000:2.0:1784938448.454681:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337568000 00000100:00100000:2.0:1784938448.454689:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337568000 00010000:00010000:2.0:1784938448.454721:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9ec6f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664d07 expref: 81 pid: 25715 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938448.454751:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 486 00000100:00100000:2.0:1784938448.454759:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24c5a49850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+81:10960:x1871643337568000:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938448.454771:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938448.454793:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9ec6f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664d07 expref: 81 pid: 25715 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.454804:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9ec6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664d07 expref: 81 pid: 25715 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.454827:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9ec6f lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664d07 expref: 81 pid: 25715 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.454839:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x66:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938448.454843:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x66:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938448.454851:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000066613dfd/0x7b044d4128f9ec76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664d0e expref: 80 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.454861:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066613dfd/0x7b044d4128f9ec76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664d0e expref: 80 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.454892:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000066613dfd/0x7b044d4128f9ec76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664d0e expref: 80 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938448.454905:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350910592:192.168.202.54@tcp:105: 00000100:00100000:2.0:1784938448.454953:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238ee37540 going to sleep for 11 seconds 00000100:00100000:3.0:1784938448.457796:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:19221:1871643350910592:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938448.457827:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938448.457894:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24c5a49850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+80:10960:x1871643337568000:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3134us (3645us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938448.457906:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 486 00000100:00100000:2.0:1784938448.460923:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938448.461087:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337568256 00000100:00100000:3.0:1784938448.461096:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337568256 00000100:00100000:3.0:1784938448.461183:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 174 00000100:00100000:3.0:1784938448.461193:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+142:17112:x1871643337568256:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:3.0:1784938448.461512:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+143:17112:x1871643337568256:12345-192.168.202.54@tcp:35:cp.0 Request processed in 319us (597us total) trans 8589934834 rc 0/0 00000100:00100000:3.0:1784938448.461519:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 174 00000100:00100000:2.0:1784938448.465065:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.465191:0:25738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337568384 00000100:00100000:0.0:1784938448.465201:0:25738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337568384 00000100:00100000:0.0:1784938448.465257:0:25738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 718 00000100:00100000:0.0:1784938448.465268:0:25738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+143:17112:x1871643337568384:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938448.465304:0:25738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938448.465327:0:25738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f9ec7d lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664d15 expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.465400:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9ec84 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.465415:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9ec84 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.465428:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9ec84 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.465445:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9ec8b lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x22eacdcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.465452:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9ec8b lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.465459:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9ec8b lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.465499:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9ec84 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.465505:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9ec84 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.465510:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9ec84 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.465516:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3e800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938448.465520:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9ec84 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.465532:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9ec84 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.465544:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938448.465547:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.465551:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9ec84 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.465557:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9ec84 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.465570:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9ec8b lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.465577:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9ec8b lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.465584:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9ec8b lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.465589:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3f200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938448.465592:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9ec8b lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.465598:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9ec8b lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.465603:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x22eacdcf (ffff9f23823e0200) 00010000:00010000:0.0:1784938448.465607:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.465609:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9ec8b lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.465618:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9ec8b lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.465651:0:25738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f9ec7d lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d15 expref: 144 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.465661:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938448.465663:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.465666:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f9ec7d lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d15 expref: 144 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.465674:0:25738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3f600, rc 0) 00000100:00100000:0.0:1784938448.465740:0:25738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+143:17112:x1871643337568384:12345-192.168.202.54@tcp:101:cp.0 Request processed in 474us (683us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938448.465747:0:25738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 718 00000100:00100000:2.0:1784938448.468686:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.468761:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337568512 00000100:00100000:0.0:1784938448.468771:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337568512 00000100:00100000:0.0:1784938448.468833:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 719 00000100:00100000:0.0:1784938448.468850:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+143:17112:x1871643337568512:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938448.468872:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938448.468894:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9ec92 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664d1c expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.468958:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9ec99 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.468972:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9ec99 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.468995:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9ec99 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.469010:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9eca0 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x22eacdcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.469017:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9eca0 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.469022:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9eca0 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.469062:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9ec99 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.469069:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9ec99 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.469074:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9ec99 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.469080:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9ec99 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.469086:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5da000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938448.469090:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9ec99 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.469097:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9ec99 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.469108:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938448.469111:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.469115:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9ec99 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.469120:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9ec99 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.469134:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9eca0 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.469139:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9eca0 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.469351:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9eca0 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.469357:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5da400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938448.469360:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9eca0 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.469366:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9eca0 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.469375:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x22eacdcf (ffff9f23823e0000) 00010000:00010000:0.0:1784938448.469377:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.469380:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9eca0 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.469386:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da400/0x7b044d4128f9eca0 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.469423:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9ec92 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d1c expref: 144 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.469433:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938448.469436:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.469439:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ea00/0x7b044d4128f9ec92 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d1c expref: 144 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.469449:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3ea00, rc 0) 00000100:00100000:0.0:1784938448.469545:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+143:17112:x1871643337568512:12345-192.168.202.54@tcp:101:cp.0 Request processed in 703us (869us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938448.469553:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 719 00000100:00100000:1.0:1784938448.472995:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.473109:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337568768 00000100:00100000:0.0:1784938448.473119:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337568768 00000100:00100000:0.0:1784938448.473215:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 720 00000100:00100000:0.0:1784938448.473224:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+143:17112:x1871643337568768:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938448.473243:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938448.473262:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9eca7 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664d23 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.473375:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9ecae lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.473389:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9ecae lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.473400:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9ecae lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.473415:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245c00/0x7b044d4128f9ecb5 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x22eacdcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.473423:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245c00/0x7b044d4128f9ecb5 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.473428:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245c00/0x7b044d4128f9ecb5 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938448.473742:0:24201:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x66:0x0], index 0: 0 00010000:00010000:0.0:1784938448.474371:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f9ecbc lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.474384:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f9ecbc lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.474393:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f9ecbc lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.474428:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9ecae lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.474436:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9ecae lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.474442:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9ecae lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.474449:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9ecae lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.474454:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938448.474459:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9ecae lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.474470:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9ecae lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.474482:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938448.474485:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.474490:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9ecae lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.474496:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9ecae lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938448.474509:0:24201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003065d696 reply state 00000000c023d759 transno 8589934835 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245c00/0x7b044d4128f9ecb5 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.474519:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245c00/0x7b044d4128f9ecb5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.474525:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x22eacdcf (ffff9f23872e6800) 00010000:00010000:0.0:1784938448.474527:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938448.474529:0:24201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938448.474560:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9eca7 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d23 expref: 146 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.474575:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f9ecbc lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d23 expref: 145 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.474582:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x4b:0x0].0x0 (ffff9f23823e0200) 00010000:00010000:0.0:1784938448.474584:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938448.474586:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3f600, rc 0) 00000100:00100000:0.0:1784938448.474648:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+146:17112:x1871643337568768:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1425us (1673us total) trans 8589934835 rc 0/0 00000100:00100000:0.0:1784938448.474657:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 720 00000100:00100000:2.0:1784938448.478529:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938448.478608:0:25719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337568896 00000100:00100000:3.0:1784938448.478617:0:25719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337568896 00000100:00100000:3.0:1784938448.478675:0:25719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 970 00000100:00100000:3.0:1784938448.478685:0:25719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387daea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7ea6e988-18ba-4c98-b179-17995571b98b+83:10957:x1871643337568896:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938448.478704:0:25719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938448.478727:0:25719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f9ecca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664d2a expref: -99 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938448.478751:0:25719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x66:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938448.478772:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x66:0x0].0x0 since=714s v=(0 0) 00010000:00010000:3.0:1784938448.478777:0:25719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x66:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938448.478786:0:25719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f9ecca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d2a expref: 84 pid: 25719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.478802:0:25719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f9ecca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d2a expref: 84 pid: 25719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.478815:0:25719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c7400, rc 0) 00000100:00100000:3.0:1784938448.479053:0:25719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387daea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7ea6e988-18ba-4c98-b179-17995571b98b+84:10957:x1871643337568896:12345-192.168.202.54@tcp:101:cp.0 Request processed in 368us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938448.479061:0:25719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 970 00000100:00100000:3.0:1784938448.481778:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.481854:0:25718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337569024 00000100:00100000:0.0:1784938448.481864:0:25718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337569024 00000100:00100000:0.0:1784938448.481916:0:25718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 971 00000100:00100000:0.0:1784938448.481924:0:25718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ea6e988-18ba-4c98-b179-17995571b98b+84:17112:x1871643337569024:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938448.481942:0:25718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938448.481959:0:25718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d7f4af6/0x7b044d4128f9ecd1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664d31 expref: -99 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.481996:0:25718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f9ecca lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d2a expref: 85 pid: 25719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.482005:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x66:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938448.482009:0:25718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x66:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938448.482013:0:25718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d7f4af6/0x7b044d4128f9ecd1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d31 expref: 85 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.482048:0:25718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f9ecca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664d2a expref: 85 pid: 25719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.482062:0:25718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f9ecca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664d2a expref: 85 pid: 25719 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938448.482078:0:25718:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25718:1871643350910720:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938448.482206:0:25718:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238ec68e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784938448.485511:0:25718:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25718:1871643350910720:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938448.485558:0:25718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001d7f4af6/0x7b044d4128f9ecd1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664d31 expref: 85 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.485580:0:25718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3ea00, rc 0) 00000100:00100000:0.0:1784938448.485645:0:25718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ea6e988-18ba-4c98-b179-17995571b98b+85:17112:x1871643337569024:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3720us (3875us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938448.485654:0:25718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 971 00000100:00100000:3.0:1784938448.487094:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938448.488467:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337569152 00000100:00100000:1.0:1784938448.488482:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337569152 00010000:00010000:1.0:1784938448.488528:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f9ecca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664d2a expref: 85 pid: 25719 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938448.488625:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 487 00000100:00100000:1.0:1784938448.488636:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+85:10958:x1871643337569152:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938448.488651:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938448.488674:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f9ecca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664d2a expref: 85 pid: 25719 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.488687:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f9ecca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664d2a expref: 85 pid: 25719 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.488712:0:22955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f9ecca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664d2a expref: 85 pid: 25719 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.488730:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x66:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938448.488734:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x66:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938448.488742:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001d7f4af6/0x7b044d4128f9ecd1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664d31 expref: 84 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.488755:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d7f4af6/0x7b044d4128f9ecd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664d31 expref: 84 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.488799:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001d7f4af6/0x7b044d4128f9ecd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664d31 expref: 84 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938448.488816:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68aa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350910848:192.168.202.54@tcp:105: 00000100:00100000:1.0:1784938448.489085:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238da84c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938448.492614:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938448.492729:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68aa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:22955:1871643350910848:192.168.202.54@tcp:105: 00010000:00010000:1.0:1784938448.492753:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938448.492807:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+84:10958:x1871643337569152:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 4172us (5719us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938448.492818:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 487 00000100:00100000:0.0:1784938448.494094:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337569408 00000100:00100000:0.0:1784938448.494105:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337569408 00000100:00100000:0.0:1784938448.494381:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 175 00000100:00100000:0.0:1784938448.494393:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387daf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+146:17112:x1871643337569408:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:0.0:1784938448.494716:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387daf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+147:17112:x1871643337569408:12345-192.168.202.54@tcp:35:cp.0 Request processed in 324us (2109us total) trans 8589934836 rc 0/0 00000100:00100000:0.0:1784938448.494723:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 175 00000100:00100000:2.0:1784938448.498236:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938448.498376:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337569536 00000100:00100000:3.0:1784938448.498386:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337569536 00000100:00100000:3.0:1784938448.498447:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 721 00000100:00100000:3.0:1784938448.498458:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+147:17112:x1871643337569536:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938448.498484:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938448.498507:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9ecd8 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664d38 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.498571:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9ecdf lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.498585:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9ecdf lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.498596:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9ecdf lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.498610:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9ece6 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9ce4d69c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.498616:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9ece6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.498623:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9ece6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.498658:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9ecdf lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.498666:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9ecdf lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.498671:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9ecdf lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.498677:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c7600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938448.498681:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9ecdf lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.498689:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9ecdf lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.498700:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938448.498703:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938448.498708:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9ecdf lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.498714:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c7600/0x7b044d4128f9ecdf lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.498729:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9ece6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.498735:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9ece6 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.498741:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9ece6 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.498746:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938448.498749:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9ece6 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.498754:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9ece6 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.498761:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x9ce4d69c (ffff9f23861e5500) 00010000:00010000:3.0:1784938448.498764:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938448.498766:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9ece6 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.498771:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39e00/0x7b044d4128f9ece6 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.498803:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9ecd8 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d38 expref: 148 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.498813:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938448.498815:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938448.498818:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6400/0x7b044d4128f9ecd8 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d38 expref: 148 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.498827:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c6400, rc 0) 00000100:00100000:3.0:1784938448.499006:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+147:17112:x1871643337569536:12345-192.168.202.54@tcp:101:cp.0 Request processed in 549us (779us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938448.499017:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 721 00000100:00100000:2.0:1784938448.502100:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.502328:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337569664 00000100:00100000:0.0:1784938448.502339:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337569664 00000100:00100000:0.0:1784938448.502459:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 722 00000100:00100000:0.0:1784938448.502470:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+147:17112:x1871643337569664:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938448.502492:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938448.502513:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9eced lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664d3f expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.502583:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9ecf4 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.502598:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9ecf4 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.502610:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9ecf4 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.502626:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9ecfb lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9ce4d69c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.502633:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9ecfb lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.502639:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9ecfb lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.502676:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9ecf4 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.502683:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9ecf4 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.502690:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9ecf4 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.502697:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9ecf4 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.502703:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3e800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938448.502707:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9ecf4 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.502716:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9ecf4 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.502729:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938448.502732:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.502738:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9ecf4 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.502745:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9ecf4 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.502762:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9ecfb lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.502768:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9ecfb lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.502773:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9ecfb lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.502778:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938448.502781:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9ecfb lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.502787:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9ecfb lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.502794:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x9ce4d69c (ffff9f23823e0000) 00010000:00010000:0.0:1784938448.502796:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.502798:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9ecfb lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.502804:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9ecfb lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.502841:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9eced lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d3f expref: 148 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.502861:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938448.502864:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.502867:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9eced lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d3f expref: 148 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.502876:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b2f3f200, rc 0) 00000100:00100000:0.0:1784938448.506364:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+147:17112:x1871643337569664:12345-192.168.202.54@tcp:101:cp.0 Request processed in 3882us (4261us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938448.506379:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 722 00000100:00100000:2.0:1784938448.509708:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938448.509805:0:25738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337569920 00000100:00100000:1.0:1784938448.509816:0:25738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337569920 00000100:00100000:1.0:1784938448.509945:0:25738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 723 00000100:00100000:1.0:1784938448.509957:0:25738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+147:17112:x1871643337569920:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938448.510069:0:25738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938448.510090:0:25738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42c400/0x7b044d4128f9ed02 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664d46 expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.510423:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d600/0x7b044d4128f9ed09 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.510439:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d600/0x7b044d4128f9ed09 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.510450:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d600/0x7b044d4128f9ed09 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.510464:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d800/0x7b044d4128f9ed10 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x9ce4d69c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.510471:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d800/0x7b044d4128f9ed10 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.510478:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d800/0x7b044d4128f9ed10 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938448.510793:0:25738:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x67:0x0], index 1: 0 00010000:00010000:1.0:1784938448.511102:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42c000/0x7b044d4128f9ed17 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.511112:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42c000/0x7b044d4128f9ed17 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.511120:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42c000/0x7b044d4128f9ed17 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.511318:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d600/0x7b044d4128f9ed09 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.511331:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d600/0x7b044d4128f9ed09 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.511338:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d600/0x7b044d4128f9ed09 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.511344:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42d600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938448.511350:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d600/0x7b044d4128f9ed09 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.511357:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d600/0x7b044d4128f9ed09 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.511372:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938448.511376:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938448.511380:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d600/0x7b044d4128f9ed09 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.511387:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d600/0x7b044d4128f9ed09 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938448.511404:0:25738:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000049b9c960 reply state 00000000dd51822c transno 8589934837 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d800/0x7b044d4128f9ed10 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.511415:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d800/0x7b044d4128f9ed10 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.511422:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x9ce4d69c (ffff9f23823e1f00) 00010000:00010000:1.0:1784938448.511425:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938448.511427:0:25738:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938448.511459:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42c400/0x7b044d4128f9ed02 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d46 expref: 150 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.511477:0:25738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42c000/0x7b044d4128f9ed17 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d46 expref: 149 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.511485:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x4c:0x0].0x0 (ffff9f23823e1000) 00010000:00010000:1.0:1784938448.511487:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938448.511489:0:25738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d42c000, rc 0) 00000100:00100000:1.0:1784938448.511615:0:25738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+150:17112:x1871643337569920:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1660us (1916us total) trans 8589934837 rc 0/0 00000100:00100000:1.0:1784938448.511624:0:25738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 723 00000100:00100000:2.0:1784938448.517049:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938448.517187:0:25730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337570048 00000100:00100000:1.0:1784938448.517199:0:25730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337570048 00000100:00100000:1.0:1784938448.517252:0:25730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 972 00000100:00100000:1.0:1784938448.517262:0:25730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:7ea6e988-18ba-4c98-b179-17995571b98b+80:10959:x1871643337570048:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938448.517289:0:25730:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938448.517311:0:25730:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9cf9a9f/0x7b044d4128f9ed25 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664d4d expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938448.517349:0:25730:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x67:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938448.517367:0:25730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x67:0x0].0x0 since=714s v=(0 0) 00010000:00010000:1.0:1784938448.517373:0:25730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x67:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938448.517387:0:25730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9cf9a9f/0x7b044d4128f9ed25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d4d expref: 81 pid: 25730 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.517406:0:25730:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f9cf9a9f/0x7b044d4128f9ed25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d4d expref: 81 pid: 25730 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.517425:0:25730:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d42d400, rc 0) 00000100:00100000:1.0:1784938448.517496:0:25730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:7ea6e988-18ba-4c98-b179-17995571b98b+81:10959:x1871643337570048:12345-192.168.202.54@tcp:101:cp.0 Request processed in 235us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938448.517502:0:25730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 972 00000100:00100000:2.0:1784938448.523970:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938448.524114:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337570176 00000100:00100000:3.0:1784938448.524124:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337570176 00000100:00100000:3.0:1784938448.524204:0:25720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 973 00000100:00100000:3.0:1784938448.524214:0:25720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7ea6e988-18ba-4c98-b179-17995571b98b+81:17112:x1871643337570176:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938448.524233:0:25720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938448.524252:0:25720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b20eee20/0x7b044d4128f9ed2c lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x67:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664d54 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.524294:0:25720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9cf9a9f/0x7b044d4128f9ed25 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d4d expref: 82 pid: 25730 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.524304:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x67:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938448.524309:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x67:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938448.524314:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b20eee20/0x7b044d4128f9ed2c lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x67:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d54 expref: 82 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.524350:0:25720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f9cf9a9f/0x7b044d4128f9ed25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664d4d expref: 82 pid: 25730 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.524365:0:25720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f9cf9a9f/0x7b044d4128f9ed25 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664d4d expref: 82 pid: 25730 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938448.524379:0:25720:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd254e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:25720:1871643350910976:192.168.202.54@tcp:104: 00000100:00100000:3.0:1784938448.524466:0:25720:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238cd3f600 going to sleep for 11 seconds 00000100:00100000:2.0:1784938448.528538:0:25720:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd254e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:25720:1871643350910976:192.168.202.54@tcp:104: 00010000:00010000:2.0:1784938448.528574:0:25720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b20eee20/0x7b044d4128f9ed2c lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x67:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664d54 expref: 82 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.528595:0:25720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238db39e00, rc 0) 00000100:00100000:2.0:1784938448.528661:0:25720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7ea6e988-18ba-4c98-b179-17995571b98b+82:17112:x1871643337570176:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4447us (4700us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938448.528670:0:25720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 973 00000100:00100000:2.0:1784938448.530427:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.530525:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337570304 00000100:00100000:0.0:1784938448.530534:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337570304 00010000:00010000:0.0:1784938448.530573:0:25731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f9cf9a9f/0x7b044d4128f9ed25 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664d4d expref: 82 pid: 25730 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938448.530621:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 488 00000100:00100000:0.0:1784938448.530631:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387daca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+82:10960:x1871643337570304:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938448.530646:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938448.530671:0:25731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f9cf9a9f/0x7b044d4128f9ed25 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664d4d expref: 82 pid: 25730 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.530685:0:25731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f9cf9a9f/0x7b044d4128f9ed25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664d4d expref: 82 pid: 25730 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.530717:0:25731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9cf9a9f/0x7b044d4128f9ed25 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664d4d expref: 82 pid: 25730 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.530737:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x67:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938448.530742:0:25731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x67:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938448.530752:0:25731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b20eee20/0x7b044d4128f9ed2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664d54 expref: 81 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.530764:0:25731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b20eee20/0x7b044d4128f9ed2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664d54 expref: 81 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.530801:0:25731:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b20eee20/0x7b044d4128f9ed2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664d54 expref: 81 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938448.530816:0:25731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:25731:1871643350911104:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938448.530918:0:25731:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238ec68240 going to sleep for 11 seconds 00000100:00100000:0.0:1784938448.534300:0:25731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:25731:1871643350911104:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938448.534326:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938448.534387:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387daca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ea6e988-18ba-4c98-b179-17995571b98b+81:10960:x1871643337570304:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3756us (3967us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938448.534399:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 488 00000100:00100000:3.0:1784938448.536650:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938448.536740:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337570560 00000100:00100000:2.0:1784938448.536750:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337570560 00000100:00100000:2.0:1784938448.536805:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 176 00000100:00100000:2.0:1784938448.536816:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+150:17112:x1871643337570560:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:2.0:1784938448.537175:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+151:17112:x1871643337570560:12345-192.168.202.54@tcp:35:cp.0 Request processed in 360us (531us total) trans 8589934838 rc 0/0 00000100:00100000:2.0:1784938448.537183:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 176 00000100:00100000:2.0:1784938448.540939:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938448.544696:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337570688 00000100:00100000:3.0:1784938448.544709:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337570688 00000100:00100000:3.0:1784938448.544787:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 724 00000100:00100000:3.0:1784938448.544798:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387daed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+151:17112:x1871643337570688:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938448.544826:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938448.544863:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9ed33 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664d5b expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.544930:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9ed3a lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.544945:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9ed3a lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.544956:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9ed3a lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.544971:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9ed41 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x6caa4986 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.544978:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9ed41 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.544984:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9ed41 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.545027:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9ed3a lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.545034:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9ed3a lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.545041:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9ed3a lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.545046:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f24d000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938448.545050:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9ed3a lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.545059:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9ed3a lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.545070:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938448.545073:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938448.545078:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9ed3a lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.545084:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d000/0x7b044d4128f9ed3a lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.545096:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9ed41 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.545103:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9ed41 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.545108:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9ed41 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.545113:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d00000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938448.545116:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9ed41 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.545124:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9ed41 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.545132:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x6caa4986 (ffff9f23861e5500) 00010000:00010000:3.0:1784938448.545134:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938448.545136:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9ed41 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.545141:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9ed41 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.545202:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9ed33 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d5b expref: 152 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.545212:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938448.545215:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938448.545218:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24d400/0x7b044d4128f9ed33 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d5b expref: 152 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.545227:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238f24d400, rc 0) 00000100:00100000:3.0:1784938448.545330:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387daed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+151:17112:x1871643337570688:12345-192.168.202.54@tcp:101:cp.0 Request processed in 534us (4402us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938448.545337:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 724 00000100:00100000:0.0:1784938448.549292:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938448.549494:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337570816 00000100:00100000:1.0:1784938448.549505:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337570816 00000100:00100000:1.0:1784938448.549571:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 725 00000100:00100000:1.0:1784938448.549581:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+151:17112:x1871643337570816:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938448.549602:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938448.550394:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d600/0x7b044d4128f9ed48 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664d62 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.550480:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42da00/0x7b044d4128f9ed4f lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.550494:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42da00/0x7b044d4128f9ed4f lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.550507:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42da00/0x7b044d4128f9ed4f lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.550523:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42cc00/0x7b044d4128f9ed56 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x6caa4986 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.550531:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42cc00/0x7b044d4128f9ed56 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.550538:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42cc00/0x7b044d4128f9ed56 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.550581:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42da00/0x7b044d4128f9ed4f lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.550589:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42da00/0x7b044d4128f9ed4f lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.550594:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42da00/0x7b044d4128f9ed4f lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.550601:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42da00/0x7b044d4128f9ed4f lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.550606:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42da00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938448.550610:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42da00/0x7b044d4128f9ed4f lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.550618:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42da00/0x7b044d4128f9ed4f lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.550629:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938448.550632:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938448.550636:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42da00/0x7b044d4128f9ed4f lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.550642:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42da00/0x7b044d4128f9ed4f lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.550654:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42cc00/0x7b044d4128f9ed56 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.550660:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42cc00/0x7b044d4128f9ed56 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.550667:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42cc00/0x7b044d4128f9ed56 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.550672:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42cc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938448.550675:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42cc00/0x7b044d4128f9ed56 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.550681:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42cc00/0x7b044d4128f9ed56 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.550688:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x6caa4986 (ffff9f23823e1200) 00010000:00010000:1.0:1784938448.550690:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938448.550694:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42cc00/0x7b044d4128f9ed56 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.550700:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42cc00/0x7b044d4128f9ed56 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.550735:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d600/0x7b044d4128f9ed48 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d62 expref: 152 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.550746:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938448.550749:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938448.550753:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d600/0x7b044d4128f9ed48 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d62 expref: 152 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.550762:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d42d600, rc 0) 00000100:00100000:1.0:1784938448.550834:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+151:17112:x1871643337570816:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1254us (1560us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938448.551504:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 725 00000100:00100000:2.0:1784938448.555946:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938448.556024:0:25738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337571072 00000100:00100000:1.0:1784938448.556036:0:25738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337571072 00000100:00100000:1.0:1784938448.556102:0:25738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 726 00000100:00100000:1.0:1784938448.556112:0:25738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387daf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+151:17112:x1871643337571072:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938448.556135:0:25738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938448.556189:0:25738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42de00/0x7b044d4128f9ed5d lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664d69 expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.556304:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9ed64 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.556319:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9ed64 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.556331:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9ed64 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.556347:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42c400/0x7b044d4128f9ed6b lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x6caa4986 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.556353:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42c400/0x7b044d4128f9ed6b lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.556360:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42c400/0x7b044d4128f9ed6b lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938448.556627:0:25738:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x67:0x0], index 0: 0 00010000:00010000:1.0:1784938448.556730:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d000/0x7b044d4128f9ed72 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.556737:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d000/0x7b044d4128f9ed72 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.556742:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d000/0x7b044d4128f9ed72 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.556767:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9ed64 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.556772:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9ed64 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.556777:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9ed64 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.556780:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42d400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938448.556783:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9ed64 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.556789:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9ed64 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.556797:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938448.556799:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938448.556803:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9ed64 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.556806:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9ed64 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938448.556815:0:25738:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cfaca830 reply state 00000000db1f6a23 transno 8589934839 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42c400/0x7b044d4128f9ed6b lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.556823:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42c400/0x7b044d4128f9ed6b lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.556827:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x6caa4986 (ffff9f238dd4bf00) 00010000:00010000:1.0:1784938448.556829:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938448.556830:0:25738:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938448.556852:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42de00/0x7b044d4128f9ed5d lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d69 expref: 154 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.556865:0:25738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d000/0x7b044d4128f9ed72 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d69 expref: 153 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.556871:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x4d:0x0].0x0 (ffff9f238dd4b900) 00010000:00010000:1.0:1784938448.556874:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938448.556876:0:25738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d42d000, rc 0) 00000100:00100000:1.0:1784938448.556926:0:25738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387daf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+154:17112:x1871643337571072:12345-192.168.202.54@tcp:101:cp.0 Request processed in 816us (986us total) trans 8589934839 rc 0/0 00000100:00100000:1.0:1784938448.556931:0:25738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 726 00000100:00100000:2.0:1784938448.562733:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938448.562816:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337571200 00000100:00100000:3.0:1784938448.562827:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337571200 00000100:00100000:3.0:1784938448.562892:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 974 00000100:00100000:3.0:1784938448.562902:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387daf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+84:10958:x1871643337571200:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:3.0:1784938448.562925:0:21149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938448.562949:0:21149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dda476a/0x7b044d4128f9ed80 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664d70 expref: -99 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938448.562976:0:21149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x67:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938448.563011:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x67:0x0].0x0 since=714s v=(0 0) 00010000:00010000:3.0:1784938448.563016:0:21149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x67:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938448.563025:0:21149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dda476a/0x7b044d4128f9ed80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d70 expref: 85 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.563042:0:21149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000dda476a/0x7b044d4128f9ed80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d70 expref: 85 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.563055:0:21149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2381d00000, rc 0) 00000100:00100000:3.0:1784938448.563112:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387daf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ea6e988-18ba-4c98-b179-17995571b98b+85:10958:x1871643337571200:12345-192.168.202.54@tcp:101:cp.0 Request processed in 211us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938448.563118:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 974 00000100:00100000:0.0:1784938448.570332:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938448.570711:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337571328 00000100:00100000:2.0:1784938448.570723:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337571328 00000100:00100000:2.0:1784938448.570796:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 975 00000100:00100000:2.0:1784938448.570807:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+85:17112:x1871643337571328:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938448.570824:0:21151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938448.570842:0:21151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fcea42e/0x7b044d4128f9ed87 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x67:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664d77 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.570873:0:21151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000dda476a/0x7b044d4128f9ed80 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d70 expref: 86 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.570882:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x67:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938448.570885:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x67:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938448.570891:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fcea42e/0x7b044d4128f9ed87 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x67:0x0].0x0 rrc: 3 type: EXT [0->319487] (req 0->319487) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d77 expref: 86 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.570924:0:21151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000dda476a/0x7b044d4128f9ed80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664d70 expref: 86 pid: 21149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.570937:0:21151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000dda476a/0x7b044d4128f9ed80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664d70 expref: 86 pid: 21149 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938448.570951:0:21151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387dac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:21151:1871643350911232:192.168.202.54@tcp:104: 00000100:00100000:2.0:1784938448.571085:0:21151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238ee37e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938448.574736:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938448.574864:0:21151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387dac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:21151:1871643350911232:192.168.202.54@tcp:104: 00010000:00010000:1.0:1784938448.574902:0:21151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009fcea42e/0x7b044d4128f9ed87 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x67:0x0].0x0 rrc: 3 type: EXT [0->319487] (req 0->319487) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664d77 expref: 86 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.574925:0:21151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e01e00, rc 0) 00000100:00100000:1.0:1784938448.575051:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ea6e988-18ba-4c98-b179-17995571b98b+86:17112:x1871643337571328:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4245us (4726us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938448.575061:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 975 00000100:00100000:3.0:1784938448.575220:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337571456 00000100:00100000:3.0:1784938448.575228:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337571456 00010000:00010000:3.0:1784938448.575274:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000dda476a/0x7b044d4128f9ed80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664d70 expref: 86 pid: 21149 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938448.576718:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 489 00000100:00100000:3.0:1784938448.576736:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+86:10957:x1871643337571456:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938448.576760:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938448.576797:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000dda476a/0x7b044d4128f9ed80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664d70 expref: 86 pid: 21149 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.576814:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000dda476a/0x7b044d4128f9ed80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664d70 expref: 86 pid: 21149 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.576842:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dda476a/0x7b044d4128f9ed80 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664d70 expref: 86 pid: 21149 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.576862:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x67:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938448.576867:0:19221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x67:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938448.576875:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009fcea42e/0x7b044d4128f9ed87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664d77 expref: 85 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.576886:0:19221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fcea42e/0x7b044d4128f9ed87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664d77 expref: 85 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.577785:0:19221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009fcea42e/0x7b044d4128f9ed87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664d77 expref: 85 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938448.577803:0:19221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:19221:1871643350911360:192.168.202.54@tcp:105: 00000100:00100000:0.0:1784938448.577926:0:19221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238ec68240 going to sleep for 11 seconds 00000100:00100000:0.0:1784938448.583339:0:19221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:19221:1871643350911360:192.168.202.54@tcp:105: 00010000:00010000:0.0:1784938448.583366:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938448.583435:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ea6e988-18ba-4c98-b179-17995571b98b+85:10957:x1871643337571456:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 6707us (8710us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938448.583448:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 489 00000100:00100000:2.0:1784938448.588821:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.588971:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337571712 00000100:00100000:0.0:1784938448.588991:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337571712 00000100:00100000:0.0:1784938448.589058:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 177 00000100:00100000:0.0:1784938448.589069:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24857fcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+154:17112:x1871643337571712:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:0.0:1784938448.589482:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24857fcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+155:17112:x1871643337571712:12345-192.168.202.54@tcp:35:cp.0 Request processed in 413us (672us total) trans 8589934840 rc 0/0 00000100:00100000:0.0:1784938448.589490:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 177 00000100:00100000:3.0:1784938448.592514:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938448.592615:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337571840 00000100:00100000:1.0:1784938448.592627:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337571840 00000100:00100000:1.0:1784938448.592699:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 727 00000100:00100000:1.0:1784938448.592710:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+155:17112:x1871643337571840:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938448.592744:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938448.592773:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42de00/0x7b044d4128f9ed8e lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664d7e expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.592858:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9ed95 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.592873:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9ed95 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.592884:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9ed95 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.592898:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d600/0x7b044d4128f9ed9c lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x47a21a83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.592904:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d600/0x7b044d4128f9ed9c lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.592911:0:24201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d600/0x7b044d4128f9ed9c lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.592952:0:24201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9ed95 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.592960:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9ed95 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.592970:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9ed95 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.592987:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9ed95 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.592995:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42d400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938448.592999:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9ed95 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.593006:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9ed95 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.593018:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938448.593021:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938448.593026:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9ed95 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.593033:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9ed95 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.593049:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d600/0x7b044d4128f9ed9c lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.593055:0:24201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d600/0x7b044d4128f9ed9c lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.593061:0:24201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d600/0x7b044d4128f9ed9c lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.593067:0:24201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42d600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938448.593070:0:24201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d600/0x7b044d4128f9ed9c lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.593076:0:24201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d600/0x7b044d4128f9ed9c lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.593082:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x47a21a83 (ffff9f238dd4b200) 00010000:00010000:1.0:1784938448.593085:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938448.593088:0:24201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d600/0x7b044d4128f9ed9c lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.593095:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d600/0x7b044d4128f9ed9c lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.593127:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42de00/0x7b044d4128f9ed8e lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d7e expref: 156 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.593137:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938448.593139:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938448.593142:0:24201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42de00/0x7b044d4128f9ed8e lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d7e expref: 156 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.593203:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d42de00, rc 0) 00000100:00100000:1.0:1784938448.593267:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+155:17112:x1871643337571840:12345-192.168.202.54@tcp:101:cp.0 Request processed in 558us (765us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938448.593274:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 727 00000100:00100000:3.0:1784938448.598860:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938448.599358:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337571968 00000100:00100000:1.0:1784938448.599370:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337571968 00000100:00100000:1.0:1784938448.599435:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 728 00000100:00100000:1.0:1784938448.599445:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+155:17112:x1871643337571968:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:1.0:1784938448.599467:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938448.599495:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d600/0x7b044d4128f9eda3 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664d85 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.599583:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9edaa lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.599598:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9edaa lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.599608:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9edaa lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.599622:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42cc00/0x7b044d4128f9edb1 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x47a21a83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.599629:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42cc00/0x7b044d4128f9edb1 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.599636:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42cc00/0x7b044d4128f9edb1 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.599676:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9edaa lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.599683:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9edaa lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.599689:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9edaa lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.599695:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9edaa lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.599702:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42d400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938448.599707:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9edaa lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.599716:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9edaa lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.599727:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938448.599730:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938448.599736:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9edaa lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.599741:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9edaa lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.599756:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42cc00/0x7b044d4128f9edb1 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.599763:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42cc00/0x7b044d4128f9edb1 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.599769:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42cc00/0x7b044d4128f9edb1 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.599774:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42cc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938448.599777:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42cc00/0x7b044d4128f9edb1 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.599783:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42cc00/0x7b044d4128f9edb1 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.599796:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x47a21a83 (ffff9f238dd4b200) 00010000:00010000:1.0:1784938448.599798:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938448.599801:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42cc00/0x7b044d4128f9edb1 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.599807:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42cc00/0x7b044d4128f9edb1 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.600036:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d600/0x7b044d4128f9eda3 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d85 expref: 156 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.600051:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:1.0:1784938448.600054:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938448.600058:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d600/0x7b044d4128f9eda3 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d85 expref: 156 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.600070:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d42d600, rc 0) 00000100:00100000:1.0:1784938448.600383:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+155:17112:x1871643337571968:12345-192.168.202.54@tcp:101:cp.0 Request processed in 938us (1543us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938448.600392:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 728 00000100:00100000:3.0:1784938448.603445:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.603516:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337572224 00000100:00100000:0.0:1784938448.603526:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337572224 00000100:00100000:0.0:1784938448.603585:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 729 00000100:00100000:0.0:1784938448.603595:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+155:17112:x1871643337572224:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938448.603616:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938448.603637:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9edb8 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664d8c expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.603745:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9edbf lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.603765:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9edbf lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.603775:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9edbf lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.603791:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9edc6 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x47a21a83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.603798:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9edc6 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.603806:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9edc6 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938448.604172:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x68:0x0], index 1: 0 00010000:00010000:0.0:1784938448.604325:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9edcd lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.604334:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9edcd lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.604342:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9edcd lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.604373:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9edbf lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.604381:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9edbf lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.604388:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9edbf lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.604395:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3f200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938448.604399:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9edbf lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.604406:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9edbf lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.604418:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938448.604421:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.604426:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9edbf lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.604431:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9edbf lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938448.604443:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000d82c817 reply state 000000005de63086 transno 8589934841 ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9edc6 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.604454:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9edc6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.604460:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x47a21a83 (ffff9f23823e0000) 00010000:00010000:0.0:1784938448.604462:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938448.604465:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938448.604492:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9edb8 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d8c expref: 158 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.604506:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9edcd lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d8c expref: 157 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.604519:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x4e:0x0].0x0 (ffff9f23861f8500) 00010000:00010000:0.0:1784938448.604521:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938448.604523:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d5da600, rc 0) 00000100:00100000:0.0:1784938448.605115:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+158:17112:x1871643337572224:12345-192.168.202.54@tcp:101:cp.0 Request processed in 1519us (1679us total) trans 8589934841 rc 0/0 00000100:00100000:0.0:1784938448.605123:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 729 00000100:00100000:3.0:1784938448.608725:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938448.608828:0:21152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337572352 00000100:00100000:2.0:1784938448.608838:0:21152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337572352 00000100:00100000:2.0:1784938448.608908:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 976 00000100:00100000:2.0:1784938448.608917:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+81:10959:x1871643337572352:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:2.0:1784938448.608935:0:21152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938448.608956:0:21152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9eddb lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664d93 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938448.609376:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x68:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938448.609404:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x68:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1784938448.609410:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x68:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938448.609421:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9eddb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d93 expref: 82 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.609447:0:21152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9eddb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d93 expref: 82 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938448.609461:0:21152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e01200, rc 0) 00000100:00100000:2.0:1784938448.609582:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ea6e988-18ba-4c98-b179-17995571b98b+82:10959:x1871643337572352:12345-192.168.202.54@tcp:101:cp.0 Request processed in 665us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938448.609590:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 976 00000100:00100000:2.0:1784938448.613265:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.613362:0:25729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337572480 00000100:00100000:0.0:1784938448.613372:0:25729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337572480 00000100:00100000:0.0:1784938448.613478:0:25729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 977 00000100:00100000:0.0:1784938448.613489:0:25729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7ea6e988-18ba-4c98-b179-17995571b98b+82:17112:x1871643337572480:12345-192.168.202.54@tcp:101:cp.0 00010000:00010000:0.0:1784938448.613511:0:25729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938448.613536:0:25729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7577f35/0x7b044d4128f9ede2 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x68:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664d9a expref: -99 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.613574:0:25729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9eddb lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d93 expref: 83 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.613583:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x68:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938448.613588:0:25729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x68:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938448.613593:0:25729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7577f35/0x7b044d4128f9ede2 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x68:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d9a expref: 83 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.613632:0:25729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9eddb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x571025e947664d93 expref: 83 pid: 21152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.613652:0:25729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9eddb lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664d93 expref: 83 pid: 21152 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938448.613667:0:25729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:25729:1871643350911488:192.168.202.54@tcp:104: 00000100:00100000:0.0:1784938448.613799:0:25729:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24831dd6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1784938448.616377:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938448.617270:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.617395:0:25729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:25729:1871643350911488:192.168.202.54@tcp:104: 00010000:00010000:0.0:1784938448.617427:0:25729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c7577f35/0x7b044d4128f9ede2 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x68:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664d9a expref: 83 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.617449:0:25729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d5da400, rc 0) 00000100:00100000:0.0:1784938448.617501:0:25729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7ea6e988-18ba-4c98-b179-17995571b98b+83:17112:x1871643337572480:12345-192.168.202.54@tcp:101:cp.0 Request processed in 4014us (4246us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938448.617510:0:25729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 977 00000100:00100000:3.0:1784938448.618010:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337572608 00000100:00100000:3.0:1784938448.618018:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337572608 00010000:00010000:3.0:1784938448.618052:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9eddb lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664d93 expref: 83 pid: 21152 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938448.618090:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 490 00000100:00100000:3.0:1784938448.618099:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+83:10960:x1871643337572608:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938448.618113:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938448.618174:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9eddb lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664d93 expref: 83 pid: 21152 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.618186:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9eddb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664d93 expref: 83 pid: 21152 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.618210:0:22955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9eddb lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x571025e947664d93 expref: 83 pid: 21152 timeout: 814 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.618224:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x68:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938448.618227:0:22955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x68:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938448.618235:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7577f35/0x7b044d4128f9ede2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664d9a expref: 82 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.618245:0:22955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7577f35/0x7b044d4128f9ede2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664d9a expref: 82 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.618292:0:22955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c7577f35/0x7b044d4128f9ede2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664d9a expref: 82 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938448.618307:0:22955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2489ae4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22955:1871643350911616:192.168.202.54@tcp:105: 00000100:00100000:3.0:1784938448.618370:0:22955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238cd3f600 going to sleep for 11 seconds 00000100:00100000:1.0:1784938448.623599:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.623668:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337572864 00000100:00100000:0.0:1784938448.623678:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337572864 00000100:00100000:0.0:1784938448.623740:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 178 00000100:00100000:0.0:1784938448.623750:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+158:17112:x1871643337572864:12345-192.168.202.54@tcp:35:cp.0 00000100:00100000:0.0:1784938448.624068:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ea6e988-18ba-4c98-b179-17995571b98b+159:17112:x1871643337572864:12345-192.168.202.54@tcp:35:cp.0 Request processed in 319us (479us total) trans 8589934842 rc 0/0 00000100:00100000:0.0:1784938448.624076:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 178 00000100:00100000:3.0:1784938448.624490:0:22955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2489ae4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22955:1871643350911616:192.168.202.54@tcp:105: 00010000:00010000:3.0:1784938448.624513:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938448.624538:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ea6e988-18ba-4c98-b179-17995571b98b+82:10960:x1871643337572608:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 6440us (7276us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938448.624547:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 490 00000100:00100000:1.0:1784938448.637398:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938448.637563:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337573120 00000100:00100000:3.0:1784938448.637573:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337573120 00000100:00100000:3.0:1784938448.637636:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 730 00000100:00100000:3.0:1784938448.637648:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+159:17114:x1871643337573120:12345-192.168.202.54@tcp:36:mkdir.0 00010000:00010000:3.0:1784938448.637784:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9ede9 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.637804:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9ede9 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.637815:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9ede9 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.637829:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9edf0 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x5b337780 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.637836:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9edf0 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x5b337780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938448.637841:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9edf0 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x5b337780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.638780:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9edf7 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.638801:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9edf7 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.638809:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9edf7 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938448.638825:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b48ecfb7 reply state 0000000055d02a0e transno 8589934843 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9edf7 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.638835:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9edf7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.638842:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x4f:0x0].0x0 (ffff9f23861f8c00) 00010000:00010000:0.0:1784938448.638845:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938448.638848:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784938448.638853:0:24203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd1:0x4f:0x0]: returning size 4096 00010000:00010000:0.0:1784938448.638860:0:24203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9ede9 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.638867:0:24203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9ede9 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.638873:0:24203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9ede9 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.638879:0:24203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d00000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938448.638883:0:24203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9ede9 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.638890:0:24203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9ede9 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.638904:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938448.638907:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.638910:0:24203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9ede9 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.638917:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00000/0x7b044d4128f9ede9 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938448.638928:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b48ecfb7 reply state 0000000055d02a0e transno 8589934843 ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9edf0 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x5b337780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.638936:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9edf0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x5b337780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.638941:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x5b337780 (ffff9f23861e5b00) 00010000:00010000:0.0:1784938448.638943:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938448.638945:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1784938448.639066:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+161:17114:x1871643337573120:12345-192.168.202.54@tcp:36:mkdir.0 Request processed in 1418us (1675us total) trans 8589934843 rc 0/0 00000100:00100000:0.0:1784938448.639075:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 730 00000100:00100000:1.0:1784938448.650239:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.650369:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337573248 00000100:00100000:0.0:1784938448.650380:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337573248 00000100:00100000:0.0:1784938448.650439:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 731 00000100:00100000:0.0:1784938448.650449:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+161:17115:x1871643337573248:12345-192.168.202.54@tcp:101:touch.0 00010000:00010000:0.0:1784938448.650479:0:24945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938448.650505:0:24945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9edfe lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664da1 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.650578:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9ee05 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.650594:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9ee05 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.650605:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9ee05 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.650617:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9ee0c lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x5b337780 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.650626:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9ee0c lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x5b337780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.650631:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9ee0c lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x5b337780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.650727:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf0600/0x7b044d4128f9ee13 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.650737:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf0600/0x7b044d4128f9ee13 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.650743:0:24945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf0600/0x7b044d4128f9ee13 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938448.650794:0:24945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd1:0x4f:0x0]: returning size 4096 00000004:00200000:0.0:1784938448.650798:0:24945:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784938448.650859:0:24945:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf0600/0x7b044d4128f9ee13 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.650877:0:24945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9ee05 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.650889:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9ee05 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.650896:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9ee05 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.650903:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9ee05 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.650909:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3f200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938448.650915:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9ee05 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.650924:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9ee05 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.650938:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:0.0:1784938448.650941:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.650946:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9ee05 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.650952:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f200/0x7b044d4128f9ee05 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.650971:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9ee0c lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x5b337780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.650976:0:24945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9ee0c lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x5b337780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.650981:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9ee0c lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x5b337780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.650987:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dbf1e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938448.650991:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9ee0c lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x5b337780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.650996:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9ee0c lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x5b337780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.651003:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x5b337780 (ffff9f23861e5b00) 00010000:00010000:0.0:1784938448.651006:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.651009:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9ee0c lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x5b337780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.651015:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1e00/0x7b044d4128f9ee0c lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x5b337780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.651047:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245600/0x7b044d4128f9edfe lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664da1 expref: 163 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.651061:0:24945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf0600/0x7b044d4128f9ee13 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664da1 expref: 162 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.651069:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x4f:0x0].0x0 (ffff9f23861f8c00) 00010000:00010000:0.0:1784938448.651071:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784938448.651074:0:24945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238dbf0600, rc 0) 00000100:00100000:0.0:1784938448.651199:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+162:17115:x1871643337573248:12345-192.168.202.54@tcp:101:touch.0 Request processed in 750us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938448.651208:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 731 00000100:00100000:1.0:1784938448.654270:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.654378:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337573504 00000100:00100000:0.0:1784938448.654387:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337573504 00000100:00100000:0.0:1784938448.654443:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 732 00000100:00100000:0.0:1784938448.654454:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+162:17115:x1871643337573504:12345-192.168.202.54@tcp:101:touch.0 00010000:00010000:0.0:1784938448.654483:0:24202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938448.654512:0:24202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34a00/0x7b044d4128f9ee1a lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664da8 expref: -99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.654631:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35a00/0x7b044d4128f9ee21 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.654650:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35a00/0x7b044d4128f9ee21 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.654662:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35a00/0x7b044d4128f9ee21 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.654678:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9ee28 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x4f:0x0].0x1cda55a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.654684:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9ee28 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x4f:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.654689:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9ee28 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x4f:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938448.655050:0:24202:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x68:0x0], index 0: 0 00010000:00010000:0.0:1784938448.655220:0:24202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b800/0x7b044d4128f9ee2f lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x50:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.655230:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b800/0x7b044d4128f9ee2f lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.655241:0:24202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b800/0x7b044d4128f9ee2f lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.655272:0:24202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35a00/0x7b044d4128f9ee21 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.655278:0:24202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35a00/0x7b044d4128f9ee21 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.655294:0:24202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35a00/0x7b044d4128f9ee21 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.655300:0:24202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2488b35a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938448.655304:0:24202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35a00/0x7b044d4128f9ee21 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.655311:0:24202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35a00/0x7b044d4128f9ee21 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.655322:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x4f:0x0].0x0 (ffff9f23861f8c00) 00010000:00010000:0.0:1784938448.655324:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938448.655329:0:24202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35a00/0x7b044d4128f9ee21 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.655335:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35a00/0x7b044d4128f9ee21 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938448.655350:0:24202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f44c32a8 reply state 0000000020fd143f transno 8589934844 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9ee28 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x4f:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.655360:0:24202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9ee28 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x4f:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.655367:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x4f:0x0].0x1cda55a (ffff9f23861f8800) 00010000:00010000:0.0:1784938448.655369:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938448.655371:0:24202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938448.655401:0:24202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34a00/0x7b044d4128f9ee1a lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664da8 expref: 165 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.655418:0:24202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b800/0x7b044d4128f9ee2f lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664da8 expref: 164 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.655426:0:24202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x50:0x0].0x0 (ffff9f23861f8000) 00010000:00010000:0.0:1784938448.655428:0:24202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938448.655431:0:24202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17b800, rc 0) 00000100:00100000:0.0:1784938448.655500:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ea6e988-18ba-4c98-b179-17995571b98b+165:17115:x1871643337573504:12345-192.168.202.54@tcp:101:touch.0 Request processed in 1048us (1241us total) trans 8589934844 rc 0/0 00000100:00100000:0.0:1784938448.655508:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 732 00000100:00100000:3.0:1784938448.660255:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.660393:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337573760 00000100:00100000:0.0:1784938448.660405:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337573760 00000100:00100000:0.0:1784938448.660464:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 733 00000100:00100000:0.0:1784938448.660474:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+165:17115:x1871643337573760:12345-192.168.202.54@tcp:36:touch.0 00010000:00010000:0.0:1784938448.660539:0:24203:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938448.660572:0:24203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b800/0x7b044d4128f9ee2f lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664da8 expref: 165 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.660596:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x50:0x0].0x0 (ffff9f23861f8000) 00010000:00010000:0.0:1784938448.660609:0:24203:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784938448.660672:0:24203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9ee3d lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x50:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.660688:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9ee3d lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.660697:0:24203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9ee3d lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938448.660810:0:24203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003cf6bd8e reply state 0000000085994066 transno 8589934845 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9ee3d lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.660822:0:24203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9ee3d lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.660828:0:24203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x50:0x0].0x0 (ffff9f2387231500) 00010000:00010000:0.0:1784938448.660831:0:24203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938448.660833:0:24203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938448.661064:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ea6e988-18ba-4c98-b179-17995571b98b+166:17115:x1871643337573760:12345-192.168.202.54@tcp:36:touch.0 Request processed in 591us (820us total) trans 8589934845 rc 0/0 00000100:00100000:0.0:1784938448.661071:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 733 00000100:00100000:2.0:1784938448.664209:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938448.664393:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337573888 00000100:00100000:1.0:1784938448.664404:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337573888 00000100:00100000:1.0:1784938448.664481:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 734 00000100:00100000:1.0:1784938448.664491:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+166:17115:x1871643337573888:12345-192.168.202.54@tcp:101:touch.0 00010000:00010000:1.0:1784938448.664519:0:24201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938448.664544:0:24201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d200/0x7b044d4128f9ee44 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x50:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664daf expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.664607:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d200/0x7b044d4128f9ee44 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x50:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664daf expref: 167 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.664622:0:24201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d200/0x7b044d4128f9ee44 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x50:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664daf expref: 167 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.664640:0:24201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x50:0x0].0x0 (ffff9f2387231500) 00010000:00010000:1.0:1784938448.664643:0:24201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784938448.664647:0:24201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d42d200, rc 0) 00000100:00100000:1.0:1784938448.664711:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+167:17115:x1871643337573888:12345-192.168.202.54@tcp:101:touch.0 Request processed in 221us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938448.664718:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 734 00000100:00100000:1.0:1784938448.668189:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938448.668331:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337574016 00000100:00100000:2.0:1784938448.668342:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337574016 00000100:00100000:2.0:1784938448.668412:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 978 00000100:00100000:2.0:1784938448.668424:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387daf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+85:10957:x1871643337574016:12345-192.168.202.54@tcp:2:touch.0 00000100:00100000:2.0:1784938448.668677:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387daf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ea6e988-18ba-4c98-b179-17995571b98b+86:10957:x1871643337574016:12345-192.168.202.54@tcp:2:touch.0 Request processed in 253us (534us total) trans 4294967492 rc 0/0 00000100:00100000:2.0:1784938448.668687:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 978 00000100:00100000:3.0:1784938448.671786:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938448.671887:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337574272 00000100:00100000:2.0:1784938448.671897:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337574272 00000100:00100000:2.0:1784938448.671955:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 179 00000100:00100000:2.0:1784938448.671965:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+167:17115:x1871643337574272:12345-192.168.202.54@tcp:35:touch.0 00000100:00100000:2.0:1784938448.672531:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ea6e988-18ba-4c98-b179-17995571b98b+168:17115:x1871643337574272:12345-192.168.202.54@tcp:35:touch.0 Request processed in 566us (754us total) trans 8589934846 rc 0/0 00000100:00100000:2.0:1784938448.672540:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 179 00000100:00100000:3.0:1784938448.681331:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938448.681437:0:25738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337574528 00000100:00100000:1.0:1784938448.681447:0:25738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337574528 00000100:00100000:1.0:1784938448.681511:0:25738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 735 00000100:00100000:1.0:1784938448.681522:0:25738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+168:17116:x1871643337574528:12345-192.168.202.54@tcp:101:dd.0 00010000:00010000:1.0:1784938448.681545:0:25738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938448.681567:0:25738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42ce00/0x7b044d4128f9ee4b lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664db6 expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.681677:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9ee52 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.681692:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9ee52 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.681703:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9ee52 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.681718:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42cc00/0x7b044d4128f9ee59 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x4f:0x0].0x45fac828 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.681726:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42cc00/0x7b044d4128f9ee59 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x4f:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.681733:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42cc00/0x7b044d4128f9ee59 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x4f:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938448.682048:0:25738:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x69:0x0], index 1: 0 00010000:00010000:1.0:1784938448.682250:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d600/0x7b044d4128f9ee60 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x51:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.682260:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d600/0x7b044d4128f9ee60 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.682268:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d600/0x7b044d4128f9ee60 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.682309:0:25738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9ee52 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.682320:0:25738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9ee52 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.682327:0:25738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9ee52 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.682333:0:25738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42d400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:1.0:1784938448.682337:0:25738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9ee52 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.682345:0:25738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9ee52 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.682357:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x4f:0x0].0x0 (ffff9f23861f8c00) 00010000:00010000:1.0:1784938448.682360:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938448.682365:0:25738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9ee52 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.682371:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d400/0x7b044d4128f9ee52 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938448.682386:0:25738:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000025271679 reply state 00000000576bc8cf transno 8589934847 ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42cc00/0x7b044d4128f9ee59 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x4f:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.682397:0:25738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42cc00/0x7b044d4128f9ee59 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x4f:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.682404:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x4f:0x0].0x45fac828 (ffff9f238dd4b200) 00010000:00010000:1.0:1784938448.682406:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938448.682409:0:25738:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938448.682436:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42ce00/0x7b044d4128f9ee4b lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664db6 expref: 171 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.682451:0:25738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d600/0x7b044d4128f9ee60 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664db6 expref: 170 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938448.682457:0:25738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x51:0x0].0x0 (ffff9f238dd4b000) 00010000:00010000:1.0:1784938448.682459:0:25738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938448.682462:0:25738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d42d600, rc 0) 00000100:00100000:1.0:1784938448.682533:0:25738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+171:17116:x1871643337574528:12345-192.168.202.54@tcp:101:dd.0 Request processed in 1012us (1210us total) trans 8589934847 rc 0/0 00000100:00100000:1.0:1784938448.682541:0:25738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 735 00000100:00100000:1.0:1784938448.689370:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938448.689459:0:25724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337574656 00000100:00100000:0.0:1784938448.689469:0:25724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337574656 00000100:00100000:0.0:1784938448.689533:0:25724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 979 00000100:00100000:0.0:1784938448.689543:0:25724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7ea6e988-18ba-4c98-b179-17995571b98b+82:17116:x1871643337574656:12345-192.168.202.54@tcp:101:dd.0 00010000:00010000:0.0:1784938448.689559:0:25724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938448.689580:0:25724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d1223b5/0x7b044d4128f9ee6e lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664dbd expref: -99 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938448.689605:0:25724:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x69:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938448.689626:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x69:0x0].0x0 since=714s v=(0 0) 00010000:00010000:0.0:1784938448.689631:0:25724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x69:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938448.689641:0:25724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d1223b5/0x7b044d4128f9ee6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664dbd expref: 83 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.689656:0:25724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008d1223b5/0x7b044d4128f9ee6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664dbd expref: 83 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938448.689669:0:25724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17b800, rc 0) 00000100:00100000:0.0:1784938448.689727:0:25724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7ea6e988-18ba-4c98-b179-17995571b98b+83:17116:x1871643337574656:12345-192.168.202.54@tcp:101:dd.0 Request processed in 185us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938448.689734:0:25724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 979 00000100:00100000:3.0:1784938448.709553:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938448.709665:0:24205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337574912 00000100:00100000:2.0:1784938448.709675:0:24205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337574912 00000100:00100000:2.0:1784938448.709735:0:24205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 180 00000100:00100000:2.0:1784938448.709745:0:24205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+171:17116:x1871643337574912:12345-192.168.202.54@tcp:35:dd.0 00000100:00100000:2.0:1784938448.710106:0:24205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ea6e988-18ba-4c98-b179-17995571b98b+172:17116:x1871643337574912:12345-192.168.202.54@tcp:35:dd.0 Request processed in 360us (560us total) trans 8589934848 rc 0/0 00000100:00100000:2.0:1784938448.710115:0:24205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 180 00010000:00010000:1.0:1784938449.643028:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938449.726743:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938449.726801:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938449.726959:0:25719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337575424 00000100:00100000:2.0:1784938449.726977:0:25719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337575424 00000100:00100000:2.0:1784938449.727047:0:25719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 83 00000100:00100000:2.0:1784938449.727057:0:25719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7ea6e988-18ba-4c98-b179-17995571b98b+86:10957:x1871643337575424:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1784938449.727128:0:25719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7ea6e988-18ba-4c98-b179-17995571b98b+86:10957:x1871643337575424:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 72us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938449.727135:0:25719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 83 00000100:00080000:3.0:1784938449.727222:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938449.727519:0:24194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337575040 00000100:00100000:0.0:1784938449.727524:0:24194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337575040 00000100:00100000:0.0:1784938449.727566:0:24194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 101 00000100:00100000:0.0:1784938449.727574:0:24194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:357535a6-3234-42c0-bf92-af4663775ca3+10:10957:x1871643337575040:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1784938449.727711:0:24194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:357535a6-3234-42c0-bf92-af4663775ca3+10:10957:x1871643337575040:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 137us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938449.727719:0:24194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 101 00000100:00100000:3.0:1784938449.734309:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938449.734461:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938449.734498:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938449.734605:0:25718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337575552 00000100:00100000:0.0:1784938449.734614:0:25718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337575552 00000100:00100000:0.0:1784938449.734683:0:25718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 84 00000100:00100000:0.0:1784938449.734694:0:25718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ea6e988-18ba-4c98-b179-17995571b98b+83:10957:x1871643337575552:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1784938449.734764:0:25718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ea6e988-18ba-4c98-b179-17995571b98b+83:10957:x1871643337575552:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 71us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938449.734772:0:25718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 84 00000100:00100000:1.0:1784938449.734851:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337575168 00000100:00100000:1.0:1784938449.734856:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337575168 00000100:00100000:1.0:1784938449.734898:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337575296 00000100:00100000:1.0:1784938449.734901:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337575296 00000100:00100000:1.0:1784938449.734925:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 45 00000100:00100000:1.0:1784938449.734932:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+91:10959:x1871643337575168:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1784938449.734964:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+91:10959:x1871643337575168:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 33us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938449.734983:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 45 00000100:00100000:1.0:1784938449.734996:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 46 00000100:00100000:1.0:1784938449.735002:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+172:10959:x1871643337575296:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1784938449.735031:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ea6e988-18ba-4c98-b179-17995571b98b+172:10959:x1871643337575296:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 30us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938449.735041:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 46 00000100:00080000:3.0:1784938449.736173:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784938449.736182:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784938450.240243:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938450.240346:0:23337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337576064 00000100:00100000:1.0:1784938450.240361:0:23337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337576064 00002000:00100000:1.0:1784938450.240434:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x47:0x0] (0->4206) req@ffff9f2489ae6300 x1871643337576064/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 4696/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.240446:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2489ae6300 with x1871643337576064 ext(0->4206) 00002000:00010000:1.0:1784938450.240453:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2489ae6300 00000100:00100000:3.0:1784938450.240537:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938450.240572:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938450.240595:0:21156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337576576 00000100:00100000:3.0:1784938450.240598:0:21156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337576576 00002000:00100000:3.0:1784938450.240621:0:21156:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x49:0x0] (0->4914) req@ffff9f2489ae6680 x1871643337576576/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 5408/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.240630:0:21156:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2489ae6680 with x1871643337576576 ext(0->4914) 00000100:00100000:0.0:1784938450.240633:0:23328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337577088 00002000:00010000:3.0:1784938450.240634:0:21156:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2489ae6680 00000100:00100000:0.0:1784938450.240638:0:23328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337577088 00000100:00100000:3.0:1784938450.240655:0:21156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 166 00002000:00100000:0.0:1784938450.240657:0:23328:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x4b:0x0] (0->2857) req@ffff9f2489ae5f80 x1871643337577088/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 3352/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784938450.240663:0:21156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7ea6e988-18ba-4c98-b179-17995571b98b+85:10958:x1871643337576064:12345-192.168.202.54@tcp:4:cp.0 00002000:00100000:0.0:1784938450.240666:0:23328:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2489ae5f80 with x1871643337577088 ext(0->2857) 00002000:00010000:0.0:1784938450.240669:0:23328:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2489ae5f80 00000100:00100000:0.0:1784938450.240685:0:23328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 167 00000100:00100000:0.0:1784938450.240690:0:23328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7ea6e988-18ba-4c98-b179-17995571b98b+85:10958:x1871643337576576:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.241185:0:21155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 168 00000100:00100000:2.0:1784938450.241196:0:21155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7ea6e988-18ba-4c98-b179-17995571b98b+87:10958:x1871643337577088:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.241322:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.241368:0:21157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337577600 00000100:00100000:0.0:1784938450.241372:0:21157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337577600 00002000:00100000:0.0:1784938450.241391:0:21157:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4d:0x0] (0->2191) req@ffff9f24b6b8ed80 x1871643337577600/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2680/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.241399:0:21157:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b6b8ed80 with x1871643337577600 ext(0->2191) 00002000:00010000:0.0:1784938450.241402:0:21157:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b6b8ed80 00000100:00100000:0.0:1784938450.241420:0:21157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 169 00000100:00100000:0.0:1784938450.241426:0:21157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7ea6e988-18ba-4c98-b179-17995571b98b+90:10958:x1871643337577600:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.243616:0:21155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7ea6e988-18ba-4c98-b179-17995571b98b+90:10958:x1871643337577088:12345-192.168.202.54@tcp:4:cp.0 Request processed in 2413us (3033us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1784938450.243630:0:21155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 168 00002000:00100000:2.0:1784938450.243640:0:21155:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4b:0x0] (0->2857) req@ffff9f2489ae5f80 x1871643337577088/t4294967494(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 3352/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.243649:0:21155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2489ae5f80 with x1871643337577088 ext(0->2857) 00002000:00010000:2.0:1784938450.243655:0:21155:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2489ae5f80 00000100:00100000:3.0:1784938450.244879:0:23328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7ea6e988-18ba-4c98-b179-17995571b98b+89:10958:x1871643337576576:12345-192.168.202.54@tcp:4:cp.0 Request processed in 4182us (4338us total) trans 4294967493 rc 0/0 00000100:00100000:3.0:1784938450.244891:0:23328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 167 00002000:00100000:3.0:1784938450.244901:0:23328:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x49:0x0] (0->4914) req@ffff9f2489ae6680 x1871643337576576/t4294967493(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 5408/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.244911:0:23328:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2489ae6680 with x1871643337576576 ext(0->4914) 00002000:00010000:3.0:1784938450.244916:0:23328:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2489ae6680 00000100:00100000:3.0:1784938450.246878:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938450.246963:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938450.246995:0:23335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337575936 00000100:00100000:3.0:1784938450.247004:0:23335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337575936 00002000:00100000:3.0:1784938450.247043:0:23335:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x47:0x0] (0->2658) req@ffff9f2489ae7b80 x1871643337575936/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 3152/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.247054:0:23335:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2489ae7b80 with x1871643337575936 ext(0->2658) 00002000:00010000:3.0:1784938450.247059:0:23335:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2489ae7b80 00000100:00100000:1.0:1784938450.247425:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938450.247452:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938450.247469:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938450.247564:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938450.247588:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938450.247607:0:23337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337577856 00000100:00100000:1.0:1784938450.247611:0:23337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337577856 00002000:00100000:1.0:1784938450.247632:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x4e:0x0] (0->55539) req@ffff9f2489ae4000 x1871643337577856/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.247640:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2489ae4000 with x1871643337577856 ext(0->55539) 00002000:00010000:1.0:1784938450.247644:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2489ae4000 00000100:00100000:2.0:1784938450.247727:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337576448 00000100:00100000:2.0:1784938450.247732:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337576448 00002000:00100000:2.0:1784938450.247753:0:23334:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x49:0x0] (0->1753) req@ffff9f238f22bb80 x1871643337576448/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2248/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.247761:0:23334:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f22bb80 with x1871643337576448 ext(0->1753) 00002000:00010000:2.0:1784938450.247765:0:23334:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f22bb80 00000100:00100000:3.0:1784938450.247825:0:23335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337576192 00000100:00100000:3.0:1784938450.247829:0:23335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337576192 00002000:00100000:3.0:1784938450.247845:0:23335:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x48:0x0] (0->28244) req@ffff9f238f229180 x1871643337576192/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.247852:0:23335:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f229180 with x1871643337576192 ext(0->28244) 00002000:00010000:3.0:1784938450.247855:0:23335:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f229180 00000100:00100000:0.0:1784938450.247930:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.247951:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.247980:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.248181:0:21156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7ea6e988-18ba-4c98-b179-17995571b98b+91:10958:x1871643337576064:12345-192.168.202.54@tcp:4:cp.0 Request processed in 7516us (7945us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1784938450.251651:0:23337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337576960 00000100:00100000:1.0:1784938450.251664:0:23337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337576960 00002000:00100000:1.0:1784938450.251711:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x4b:0x0] (0->837) req@ffff9f238f22a300 x1871643337576960/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 1328/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.251723:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f22a300 with x1871643337576960 ext(0->837) 00002000:00010000:1.0:1784938450.251728:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f22a300 00000100:00100000:1.0:1784938450.251740:0:23337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337577216 00000100:00100000:1.0:1784938450.251743:0:23337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337577216 00002000:00100000:1.0:1784938450.251757:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x4c:0x0] (0->18268) req@ffff9f238f229f80 x1871643337577216/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.251765:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f229f80 with x1871643337577216 ext(0->18268) 00002000:00010000:1.0:1784938450.251768:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f229f80 00000100:00100000:1.0:1784938450.251775:0:23337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337577472 00000100:00100000:1.0:1784938450.251778:0:23337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337577472 00002000:00100000:1.0:1784938450.251789:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x4d:0x0] (0->3005) req@ffff9f238f228700 x1871643337577472/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 3496/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.251796:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f228700 with x1871643337577472 ext(0->3005) 00002000:00010000:1.0:1784938450.251800:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f228700 00000100:00100000:1.0:1784938450.251806:0:23337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337575808 00000100:00100000:1.0:1784938450.251808:0:23337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337575808 00002000:00100000:1.0:1784938450.251822:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x46:0x0] (0->9197) req@ffff9f24b6b8d500 x1871643337575808/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 9688/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.251841:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b6b8d500 with x1871643337575808 ext(0->9197) 00002000:00010000:1.0:1784938450.251845:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b6b8d500 00000100:00100000:1.0:1784938450.251853:0:23337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337576320 00000100:00100000:1.0:1784938450.251856:0:23337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337576320 00002000:00100000:1.0:1784938450.251869:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x48:0x0] (0->703) req@ffff9f24b6b8e300 x1871643337576320/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 1192/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.251876:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b6b8e300 with x1871643337576320 ext(0->703) 00002000:00010000:1.0:1784938450.251879:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b6b8e300 00000100:00100000:1.0:1784938450.251886:0:23337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337576832 00000100:00100000:1.0:1784938450.251888:0:23337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337576832 00002000:00100000:1.0:1784938450.251900:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x4a:0x0] (0->16000) req@ffff9f24b6b8e680 x1871643337576832/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 16496/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.251913:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b6b8e680 with x1871643337576832 ext(0->16000) 00002000:00010000:1.0:1784938450.251916:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b6b8e680 00000100:00100000:1.0:1784938450.251928:0:23337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 170 00000100:00100000:1.0:1784938450.251937:0:23337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7ea6e988-18ba-4c98-b179-17995571b98b+91:10958:x1871643337575936:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938450.252863:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 171 00000100:00100000:1.0:1784938450.252874:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7ea6e988-18ba-4c98-b179-17995571b98b+94:10960:x1871643337577856:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938450.253053:0:23329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 172 00000100:00100000:1.0:1784938450.253061:0:23329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7ea6e988-18ba-4c98-b179-17995571b98b+93:10958:x1871643337576960:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938450.253235:0:23331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 173 00000100:00100000:1.0:1784938450.253243:0:23331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f229f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7ea6e988-18ba-4c98-b179-17995571b98b+93:10960:x1871643337577216:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.253613:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 174 00000100:00100000:2.0:1784938450.253624:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f228700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7ea6e988-18ba-4c98-b179-17995571b98b+93:10958:x1871643337577472:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.253765:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 175 00000100:00100000:2.0:1784938450.253773:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7ea6e988-18ba-4c98-b179-17995571b98b+95:10960:x1871643337575808:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.254062:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.254119:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.254218:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.254248:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.254283:0:21155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337577344 00000100:00100000:2.0:1784938450.254290:0:21155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337577344 00002000:00100000:2.0:1784938450.254321:0:21155:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4c:0x0] (0->4217) req@ffff9f238f22ce00 x1871643337577344/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 4712/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.254332:0:21155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f22ce00 with x1871643337577344 ext(0->4217) 00002000:00010000:2.0:1784938450.254338:0:21155:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f238f22ce00 00000100:00100000:2.0:1784938450.254351:0:21155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337575680 00000100:00100000:2.0:1784938450.254354:0:21155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337575680 00002000:00100000:2.0:1784938450.254367:0:21155:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x46:0x0] (0->673) req@ffff9f238f22ed80 x1871643337575680/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 1168/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.254376:0:21155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f22ed80 with x1871643337575680 ext(0->673) 00002000:00010000:2.0:1784938450.254379:0:21155:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f22ed80 00000100:00100000:2.0:1784938450.254386:0:21155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337576704 00000100:00100000:2.0:1784938450.254389:0:21155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337576704 00002000:00100000:2.0:1784938450.254400:0:21155:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4a:0x0] (0->1612) req@ffff9f238f22f480 x1871643337576704/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2104/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.254406:0:21155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f22f480 with x1871643337576704 ext(0->1612) 00002000:00010000:2.0:1784938450.254409:0:21155:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f22f480 00000100:00100000:2.0:1784938450.254416:0:21155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337577728 00000100:00100000:2.0:1784938450.254418:0:21155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337577728 00002000:00100000:2.0:1784938450.254427:0:21155:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4e:0x0] (0->937) req@ffff9f238f22c380 x1871643337577728/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 1432/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.254433:0:21155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f22c380 with x1871643337577728 ext(0->937) 00002000:00010000:2.0:1784938450.254436:0:21155:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f22c380 00000100:00100000:2.0:1784938450.254443:0:21155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 176 00000100:00100000:2.0:1784938450.254448:0:21155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7ea6e988-18ba-4c98-b179-17995571b98b+98:10960:x1871643337576320:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.255782:0:21155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7ea6e988-18ba-4c98-b179-17995571b98b+100:10960:x1871643337576320:12345-192.168.202.54@tcp:4:cp.0 Request processed in 1327us (7823us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1784938450.255793:0:21155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 176 00002000:00100000:2.0:1784938450.255801:0:21155:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x48:0x0] (0->703) req@ffff9f24b6b8e300 x1871643337576320/t4294967497(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 1192/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.255808:0:21155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b6b8e300 with x1871643337576320 ext(0->703) 00002000:00010000:2.0:1784938450.255813:0:21155:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b6b8e300 00000100:00100000:2.0:1784938450.255842:0:21155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 177 00000100:00100000:2.0:1784938450.255850:0:21155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7ea6e988-18ba-4c98-b179-17995571b98b+99:10960:x1871643337576832:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938450.255921:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7ea6e988-18ba-4c98-b179-17995571b98b+99:10960:x1871643337575808:12345-192.168.202.54@tcp:4:cp.0 Request processed in 2147us (7990us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1784938450.255928:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 175 00002000:00100000:1.0:1784938450.255934:0:23327:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x46:0x0] (0->9197) req@ffff9f24b6b8d500 x1871643337575808/t4294967496(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 9688/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.255941:0:23327:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b6b8d500 with x1871643337575808 ext(0->9197) 00002000:00010000:1.0:1784938450.255945:0:23327:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b6b8d500 00000100:00100000:1.0:1784938450.255960:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 178 00000100:00100000:1.0:1784938450.256393:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7ea6e988-18ba-4c98-b179-17995571b98b+97:10958:x1871643337576448:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.256638:0:23337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7ea6e988-18ba-4c98-b179-17995571b98b+101:10958:x1871643337575936:12345-192.168.202.54@tcp:4:cp.0 Request processed in 4700us (9769us total) trans 4294967493 rc 0/0 00000100:00100000:2.0:1784938450.256647:0:23337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 170 00002000:00100000:2.0:1784938450.256654:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x47:0x0] (0->2658) req@ffff9f2489ae7b80 x1871643337575936/t4294967493(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 3152/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.256663:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2489ae7b80 with x1871643337575936 ext(0->2658) 00002000:00010000:2.0:1784938450.256666:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2489ae7b80 00000100:00100000:2.0:1784938450.256685:0:23337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 179 00000100:00100000:2.0:1784938450.256692:0:23337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7ea6e988-18ba-4c98-b179-17995571b98b+100:10960:x1871643337577344:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938450.256782:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7ea6e988-18ba-4c98-b179-17995571b98b+102:10958:x1871643337576448:12345-192.168.202.54@tcp:4:cp.0 Request processed in 392us (9357us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1784938450.256792:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 178 00002000:00100000:1.0:1784938450.256798:0:23327:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x49:0x0] (0->1753) req@ffff9f238f22bb80 x1871643337576448/t4294967496(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2248/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.256805:0:23327:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f22bb80 with x1871643337576448 ext(0->1753) 00002000:00010000:1.0:1784938450.256809:0:23327:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f22bb80 00000100:00100000:1.0:1784938450.256824:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 180 00000100:00100000:1.0:1784938450.257254:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7ea6e988-18ba-4c98-b179-17995571b98b+101:10960:x1871643337575680:12345-192.168.202.54@tcp:4:cp.0 00000001:00080000:1.0:1784938450.257541:0:22178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967494 is committed 00000001:00080000:1.0:1784938450.257555:0:22178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967492 is committed 00000100:00100000:2.0:1784938450.257738:0:23329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7ea6e988-18ba-4c98-b179-17995571b98b+103:10958:x1871643337576960:12345-192.168.202.54@tcp:4:cp.0 Request processed in 4676us (10266us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1784938450.257856:0:23329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 172 00002000:00100000:2.0:1784938450.257864:0:23329:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x4b:0x0] (0->837) req@ffff9f238f22a300 x1871643337576960/t4294967494(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 1328/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.257873:0:23329:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f22a300 with x1871643337576960 ext(0->837) 00002000:00010000:2.0:1784938450.257877:0:23329:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f22a300 00000100:00100000:1.0:1784938450.257881:0:21155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7ea6e988-18ba-4c98-b179-17995571b98b+96:10960:x1871643337576832:12345-192.168.202.54@tcp:4:cp.0 Request processed in 2033us (9901us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1784938450.257887:0:21155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 177 00000100:00100000:2.0:1784938450.257893:0:23329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 181 00002000:00100000:1.0:1784938450.257893:0:21155:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4a:0x0] (0->16000) req@ffff9f24b6b8e680 x1871643337576832/t4294967498(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 16496/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784938450.257901:0:23329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7ea6e988-18ba-4c98-b179-17995571b98b+102:10960:x1871643337576704:12345-192.168.202.54@tcp:4:cp.0 00002000:00100000:1.0:1784938450.257901:0:21155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b6b8e680 with x1871643337576832 ext(0->16000) 00002000:00010000:1.0:1784938450.257904:0:21155:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b6b8e680 00000100:00100000:1.0:1784938450.257916:0:21155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 182 00000100:00100000:1.0:1784938450.257922:0:21155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7ea6e988-18ba-4c98-b179-17995571b98b+102:10960:x1871643337577728:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.258394:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f228700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7ea6e988-18ba-4c98-b179-17995571b98b+106:10958:x1871643337577472:12345-192.168.202.54@tcp:4:cp.0 Request processed in 4770us (10802us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1784938450.258402:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 174 00002000:00100000:2.0:1784938450.258408:0:23334:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x4d:0x0] (0->3005) req@ffff9f238f228700 x1871643337577472/t4294967495(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 3496/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.258416:0:23334:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f228700 with x1871643337577472 ext(0->3005) 00002000:00010000:2.0:1784938450.258420:0:23334:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f228700 00000100:00100000:3.0:1784938450.261739:0:23335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 183 00000100:00100000:3.0:1784938450.261762:0:23335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f229180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7ea6e988-18ba-4c98-b179-17995571b98b+105:10960:x1871643337576192:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.262212:0:21156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 166 00002000:00100000:0.0:1784938450.262225:0:21156:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x47:0x0] (0->4206) req@ffff9f2489ae6300 x1871643337576064/t4294967495(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 4696/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.262246:0:21156:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2489ae6300 with x1871643337576064 ext(0->4206) 00002000:00010000:0.0:1784938450.262254:0:21156:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2489ae6300 00000100:00100000:3.0:1784938450.262675:0:23329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7ea6e988-18ba-4c98-b179-17995571b98b+106:10960:x1871643337576704:12345-192.168.202.54@tcp:4:cp.0 Request processed in 4772us (8454us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1784938450.262684:0:23329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 181 00002000:00100000:3.0:1784938450.262691:0:23329:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x4a:0x0] (0->1612) req@ffff9f238f22f480 x1871643337576704/t4294967499(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2104/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.262699:0:23329:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f22f480 with x1871643337576704 ext(0->1612) 00002000:00010000:3.0:1784938450.262704:0:23329:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f22f480 00000100:00100000:1.0:1784938450.264730:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7ea6e988-18ba-4c98-b179-17995571b98b+105:10960:x1871643337575680:12345-192.168.202.54@tcp:4:cp.0 Request processed in 7889us (10600us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1784938450.264744:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 180 00002000:00100000:1.0:1784938450.264754:0:23327:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x46:0x0] (0->673) req@ffff9f238f22ed80 x1871643337575680/t4294967497(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 1168/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.264770:0:23327:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f22ed80 with x1871643337575680 ext(0->673) 00002000:00010000:1.0:1784938450.264775:0:23327:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f22ed80 00000100:00100000:1.0:1784938450.264832:0:21155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7ea6e988-18ba-4c98-b179-17995571b98b+104:10960:x1871643337577728:12345-192.168.202.54@tcp:4:cp.0 Request processed in 6909us (10583us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1784938450.264840:0:21155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 182 00002000:00100000:1.0:1784938450.264846:0:21155:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4e:0x0] (0->937) req@ffff9f238f22c380 x1871643337577728/t4294967498(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 1432/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.264854:0:21155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f22c380 with x1871643337577728 ext(0->937) 00002000:00010000:1.0:1784938450.264857:0:21155:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f22c380 00000100:00100000:3.0:1784938450.267442:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938450.267479:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938450.267644:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938450.267761:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337577984 00000100:00100000:3.0:1784938450.267771:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337577984 00002000:00100000:3.0:1784938450.267820:0:23334:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x55:0x0] (0->111138) req@ffff9f2489ae5180 x1871643337577984/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.267831:0:23334:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2489ae5180 with x1871643337577984 ext(0->111138) 00002000:00010000:3.0:1784938450.267836:0:23334:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2489ae5180 00000100:00100000:3.0:1784938450.267857:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337578112 00000100:00100000:3.0:1784938450.267861:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337578112 00002000:00100000:3.0:1784938450.267876:0:23334:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x5c:0x0] (0->4749) req@ffff9f2489ae5880 x1871643337578112/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 5240/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.267885:0:23334:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2489ae5880 with x1871643337578112 ext(0->4749) 00002000:00010000:3.0:1784938450.267888:0:23334:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2489ae5880 00000100:00100000:3.0:1784938450.267901:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337578240 00000100:00100000:3.0:1784938450.267904:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337578240 00002000:00100000:3.0:1784938450.267917:0:23334:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x52:0x0] (0->7184) req@ffff9f24bd5a5c00 x1871643337578240/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 7680/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.267924:0:23334:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a5c00 with x1871643337578240 ext(0->7184) 00002000:00010000:3.0:1784938450.267928:0:23334:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24bd5a5c00 00000100:00100000:3.0:1784938450.267944:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 184 00000100:00100000:3.0:1784938450.267952:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7ea6e988-18ba-4c98-b179-17995571b98b+97:10957:x1871643337577984:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:3.0:1784938450.268219:0:23329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 185 00000100:00100000:3.0:1784938450.268226:0:23329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7ea6e988-18ba-4c98-b179-17995571b98b+98:10957:x1871643337578112:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938450.268468:0:21155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 186 00000100:00100000:1.0:1784938450.268476:0:21155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7ea6e988-18ba-4c98-b179-17995571b98b+98:10959:x1871643337578240:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.270548:0:21157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7ea6e988-18ba-4c98-b179-17995571b98b+100:10958:x1871643337577600:12345-192.168.202.54@tcp:4:cp.0 Request processed in 29113us (29218us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1784938450.270560:0:21157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 169 00002000:00100000:0.0:1784938450.270571:0:21157:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4d:0x0] (0->2191) req@ffff9f24b6b8ed80 x1871643337577600/t4294967499(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2680/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.270580:0:21157:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b6b8ed80 with x1871643337577600 ext(0->2191) 00002000:00010000:0.0:1784938450.270586:0:21157:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b6b8ed80 00000001:00080000:3.0:1784938450.270638:0:22178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967498 is committed 00000100:00100000:0.0:1784938450.270653:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.270763:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.270781:0:21156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337578624 00000100:00100000:0.0:1784938450.270787:0:21156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337578624 00002000:00100000:0.0:1784938450.270810:0:21156:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x56:0x0] (0->35426) req@ffff9f24b68c1f80 x1871643337578624/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.270818:0:21156:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b68c1f80 with x1871643337578624 ext(0->35426) 00002000:00010000:0.0:1784938450.270822:0:21156:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b68c1f80 00000100:00100000:0.0:1784938450.270842:0:21156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337578496 00000100:00100000:0.0:1784938450.270846:0:21156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337578496 00000100:00100000:3.0:1784938450.270853:0:23328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 187 00002000:00100000:0.0:1784938450.270859:0:21156:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5d:0x0] (0->6820) req@ffff9f2387fd3100 x1871643337578496/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 7312/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784938450.270861:0:23328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7ea6e988-18ba-4c98-b179-17995571b98b+107:10957:x1871643337578624:12345-192.168.202.54@tcp:4:cp.0 00002000:00100000:0.0:1784938450.270867:0:21156:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2387fd3100 with x1871643337578496 ext(0->6820) 00002000:00010000:0.0:1784938450.270870:0:21156:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2387fd3100 00000100:00100000:0.0:1784938450.270884:0:21157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 188 00000100:00100000:0.0:1784938450.270890:0:21157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7ea6e988-18ba-4c98-b179-17995571b98b+107:10957:x1871643337578496:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:3.0:1784938450.275828:0:23335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f229180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7ea6e988-18ba-4c98-b179-17995571b98b+111:10960:x1871643337576192:12345-192.168.202.54@tcp:4:cp.0 Request processed in 14066us (28364us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1784938450.275828:0:21157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7ea6e988-18ba-4c98-b179-17995571b98b+111:10957:x1871643337578496:12345-192.168.202.54@tcp:4:cp.0 Request processed in 4926us (5054us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1784938450.275842:0:21157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 188 00000001:00080000:1.0:1784938450.276028:0:21144:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967493 is committed 00000001:00080000:1.0:1784938450.276042:0:21144:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967491 is committed 00002000:00100000:0.0:1784938450.276574:0:21157:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5d:0x0] (0->6820) req@ffff9f2387fd3100 x1871643337578496/t4294967501(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 7312/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784938450.276576:0:23335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 183 00002000:00100000:3.0:1784938450.276582:0:23335:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x48:0x0] (0->28244) req@ffff9f238f229180 x1871643337576192/t4294967502(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.276586:0:21157:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2387fd3100 with x1871643337578496 ext(0->6820) 00002000:00100000:3.0:1784938450.276590:0:23335:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f229180 with x1871643337576192 ext(0->28244) 00002000:00010000:3.0:1784938450.276595:0:23335:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f229180 00002000:00010000:0.0:1784938450.276595:0:21157:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2387fd3100 00000100:00100000:0.0:1784938450.276666:0:23331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f229f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7ea6e988-18ba-4c98-b179-17995571b98b+103:10960:x1871643337577216:12345-192.168.202.54@tcp:4:cp.0 Request processed in 23422us (29101us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1784938450.276673:0:23331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 173 00002000:00100000:0.0:1784938450.276679:0:23331:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x4c:0x0] (0->18268) req@ffff9f238f229f80 x1871643337577216/t4294967500(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.276687:0:23331:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f229f80 with x1871643337577216 ext(0->18268) 00002000:00010000:0.0:1784938450.276691:0:23331:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f229f80 00000100:00100000:1.0:1784938450.277546:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938450.277601:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938450.277632:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337578368 00000100:00100000:1.0:1784938450.277642:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337578368 00002000:00100000:1.0:1784938450.277689:0:23327:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x52:0x0] (0->4149) req@ffff9f238f228000 x1871643337578368/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 4640/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.277698:0:23327:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f228000 with x1871643337578368 ext(0->4149) 00002000:00010000:1.0:1784938450.277702:0:23327:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f228000 00000100:00100000:1.0:1784938450.277719:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337579264 00000100:00100000:1.0:1784938450.277722:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337579264 00002000:00100000:1.0:1784938450.277737:0:23327:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x56:0x0] (0->13878) req@ffff9f238f228a80 x1871643337579264/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 14368/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.277746:0:23327:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f228a80 with x1871643337579264 ext(0->13878) 00002000:00010000:1.0:1784938450.277749:0:23327:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f238f228a80 00000100:00100000:1.0:1784938450.277763:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 189 00000100:00100000:1.0:1784938450.277771:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f228000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7ea6e988-18ba-4c98-b179-17995571b98b+103:10960:x1871643337578368:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938450.278748:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938450.278774:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.279470:0:21157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337579008 00000100:00100000:0.0:1784938450.279477:0:21157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337579008 00002000:00100000:0.0:1784938450.279507:0:21157:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x57:0x0] (0->2128) req@ffff9f238f22b100 x1871643337579008/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2624/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.279517:0:21157:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f22b100 with x1871643337579008 ext(0->2128) 00002000:00010000:0.0:1784938450.279522:0:21157:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f22b100 00000100:00100000:0.0:1784938450.279534:0:21157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337579520 00000100:00100000:0.0:1784938450.279537:0:21157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337579520 00002000:00100000:0.0:1784938450.279552:0:21157:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4f:0x0] (0->6212) req@ffff9f238f22aa00 x1871643337579520/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 6704/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.279559:0:21157:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f22aa00 with x1871643337579520 ext(0->6212) 00002000:00010000:0.0:1784938450.279563:0:21157:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f238f22aa00 00000100:00100000:0.0:1784938450.279574:0:21157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 190 00000100:00100000:0.0:1784938450.279582:0:21157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7ea6e988-18ba-4c98-b179-17995571b98b+93:10960:x1871643337579264:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.279735:0:23331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 191 00000100:00100000:0.0:1784938450.279741:0:23331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7ea6e988-18ba-4c98-b179-17995571b98b+106:10958:x1871643337579008:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:3.0:1784938450.279792:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938450.279835:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938450.279848:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938450.279876:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.279962:0:21156:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 11 min 3 max 116 00000100:00100000:0.0:1784938450.279971:0:21156:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_011' 00000100:00100000:0.0:1784938450.280879:0:23331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7ea6e988-18ba-4c98-b179-17995571b98b+108:10958:x1871643337579008:12345-192.168.202.54@tcp:4:cp.0 Request processed in 1135us (2132us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1784938450.280887:0:23331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 191 00002000:00100000:0.0:1784938450.280895:0:23331:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x57:0x0] (0->2128) req@ffff9f238f22b100 x1871643337579008/t4294967504(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2624/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.280904:0:23331:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f22b100 with x1871643337579008 ext(0->2128) 00002000:00010000:0.0:1784938450.280908:0:23331:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f22b100 00000100:00100000:0.0:1784938450.280928:0:23331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337578752 00000100:00100000:0.0:1784938450.280933:0:23331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337578752 00002000:00100000:0.0:1784938450.280952:0:23331:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x5e:0x0] (0->143466) req@ffff9f24bd5a5f80 x1871643337578752/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.280960:0:23331:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a5f80 with x1871643337578752 ext(0->143466) 00002000:00010000:0.0:1784938450.280964:0:23331:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24bd5a5f80 00000100:00100000:0.0:1784938450.280973:0:23331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337578880 00000100:00100000:0.0:1784938450.280976:0:23331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337578880 00002000:00100000:0.0:1784938450.281057:0:23331:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x5f:0x0] (0->31710) req@ffff9f24bd5a6d80 x1871643337578880/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.281065:0:23331:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a6d80 with x1871643337578880 ext(0->31710) 00002000:00010000:0.0:1784938450.281068:0:23331:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24bd5a6d80 00000100:00100000:0.0:1784938450.281078:0:23331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337579392 00000100:00100000:0.0:1784938450.281081:0:23331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337579392 00002000:00100000:0.0:1784938450.281094:0:23331:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x5e:0x0] (0->170594) req@ffff9f24bd5a6a00 x1871643337579392/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.281102:0:23331:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a6a00 with x1871643337579392 ext(0->170594) 00002000:00010000:0.0:1784938450.281105:0:23331:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24bd5a6a00 00000100:00100000:0.0:1784938450.281112:0:23331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337579136 00000100:00100000:0.0:1784938450.281115:0:23331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337579136 00002000:00100000:0.0:1784938450.281224:0:23331:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x60:0x0] (0->198049) req@ffff9f24bd5a4e00 x1871643337579136/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.281232:0:23331:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a4e00 with x1871643337579136 ext(0->198049) 00002000:00010000:0.0:1784938450.281235:0:23331:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24bd5a4e00 00000100:00100000:0.0:1784938450.281248:0:23331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 192 00000100:00100000:0.0:1784938450.281256:0:23331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7ea6e988-18ba-4c98-b179-17995571b98b+96:10958:x1871643337579520:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.282771:0:23337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7ea6e988-18ba-4c98-b179-17995571b98b+96:10960:x1871643337577344:12345-192.168.202.54@tcp:4:cp.0 Request processed in 26073us (28704us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1784938450.282781:0:23337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 179 00002000:00100000:2.0:1784938450.282790:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x4c:0x0] (0->4217) req@ffff9f238f22ce00 x1871643337577344/t4294967500(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 4712/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.282797:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f22ce00 with x1871643337577344 ext(0->4217) 00002000:00010000:2.0:1784938450.282802:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f238f22ce00 00000100:00100000:2.0:1784938450.282821:0:23337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 193 00000100:00100000:2.0:1784938450.282828:0:23337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7ea6e988-18ba-4c98-b179-17995571b98b+110:10959:x1871643337578752:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938450.283277:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f228000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7ea6e988-18ba-4c98-b179-17995571b98b+110:10960:x1871643337578368:12345-192.168.202.54@tcp:4:cp.0 Request processed in 5495us (7138us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1784938450.283285:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 189 00002000:00100000:1.0:1784938450.283292:0:23327:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x52:0x0] (0->4149) req@ffff9f238f228000 x1871643337578368/t4294967503(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 4640/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.283301:0:23327:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f228000 with x1871643337578368 ext(0->4149) 00002000:00010000:1.0:1784938450.283305:0:23327:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f228000 00000100:00100000:1.0:1784938450.283325:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 194 00000100:00100000:1.0:1784938450.283333:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7ea6e988-18ba-4c98-b179-17995571b98b+109:10960:x1871643337578880:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938450.289302:0:25745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 195 00000100:00100000:1.0:1784938450.289349:0:25745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7ea6e988-18ba-4c98-b179-17995571b98b+99:10960:x1871643337579392:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.290026:0:21157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7ea6e988-18ba-4c98-b179-17995571b98b+100:10960:x1871643337579264:12345-192.168.202.54@tcp:4:cp.0 Request processed in 10442us (12423us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1784938450.290036:0:21157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 190 00002000:00100000:0.0:1784938450.290046:0:21157:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x56:0x0] (0->13878) req@ffff9f238f228a80 x1871643337579264/t4294967501(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 14368/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.290056:0:21157:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f228a80 with x1871643337579264 ext(0->13878) 00002000:00010000:0.0:1784938450.290063:0:21157:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f238f228a80 00000100:00100000:0.0:1784938450.290088:0:21157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 196 00000100:00100000:0.0:1784938450.290099:0:21157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7ea6e988-18ba-4c98-b179-17995571b98b+111:10958:x1871643337579136:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:3.0:1784938450.291046:0:23331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7ea6e988-18ba-4c98-b179-17995571b98b+99:10958:x1871643337579520:12345-192.168.202.54@tcp:4:cp.0 Request processed in 9787us (12267us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1784938450.291055:0:23331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 192 00002000:00100000:3.0:1784938450.291062:0:23331:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x4f:0x0] (0->6212) req@ffff9f238f22aa00 x1871643337579520/t4294967502(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 6704/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.291071:0:23331:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f22aa00 with x1871643337579520 ext(0->6212) 00002000:00010000:3.0:1784938450.291075:0:23331:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f238f22aa00 00000100:00100000:0.0:1784938450.312778:0:23328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7ea6e988-18ba-4c98-b179-17995571b98b+113:10957:x1871643337578624:12345-192.168.202.54@tcp:4:cp.0 Request processed in 41905us (42112us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1784938450.312794:0:23328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 187 00002000:00100000:0.0:1784938450.312807:0:23328:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x56:0x0] (0->35426) req@ffff9f24b68c1f80 x1871643337578624/t4294967505(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.312818:0:23328:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b68c1f80 with x1871643337578624 ext(0->35426) 00002000:00010000:0.0:1784938450.312824:0:23328:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b68c1f80 00000100:00100000:2.0:1784938450.317903:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.318423:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.318517:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.318536:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.318552:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.318566:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.318754:0:21156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337579648 00000100:00100000:0.0:1784938450.318764:0:21156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337579648 00002000:00100000:0.0:1784938450.318807:0:21156:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x57:0x0] (0->158095) req@ffff9f238f22dc00 x1871643337579648/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.318819:0:21156:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f22dc00 with x1871643337579648 ext(0->158095) 00002000:00010000:0.0:1784938450.318824:0:21156:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f238f22dc00 00000100:00100000:0.0:1784938450.318841:0:21156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337579904 00000100:00100000:0.0:1784938450.318844:0:21156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337579904 00002000:00100000:0.0:1784938450.318860:0:21156:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x62:0x0] (0->88086) req@ffff9f238f22e300 x1871643337579904/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.318867:0:21156:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f22e300 with x1871643337579904 ext(0->88086) 00002000:00010000:0.0:1784938450.318870:0:21156:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f22e300 00000100:00100000:0.0:1784938450.318876:0:21156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337579776 00000100:00100000:0.0:1784938450.318879:0:21156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337579776 00002000:00100000:0.0:1784938450.318891:0:21156:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x61:0x0] (0->227515) req@ffff9f238f22f800 x1871643337579776/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.318899:0:21156:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f22f800 with x1871643337579776 ext(0->227515) 00002000:00010000:0.0:1784938450.318902:0:21156:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f22f800 00000100:00100000:0.0:1784938450.318910:0:21156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337580032 00000100:00100000:0.0:1784938450.318912:0:21156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337580032 00002000:00100000:0.0:1784938450.318925:0:21156:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x63:0x0] (0->42516) req@ffff9f238f22d500 x1871643337580032/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.318931:0:21156:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f22d500 with x1871643337580032 ext(0->42516) 00002000:00010000:0.0:1784938450.318934:0:21156:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f22d500 00000100:00100000:0.0:1784938450.318941:0:21156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337580288 00000100:00100000:0.0:1784938450.318943:0:21156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337580288 00002000:00100000:0.0:1784938450.318954:0:21156:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x64:0x0] (0->26715) req@ffff9f238f22ca80 x1871643337580288/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.318961:0:21156:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f22ca80 with x1871643337580288 ext(0->26715) 00002000:00010000:0.0:1784938450.318965:0:21156:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f22ca80 00000100:00100000:0.0:1784938450.318971:0:21156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337580544 00000100:00100000:0.0:1784938450.318974:0:21156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337580544 00002000:00100000:0.0:1784938450.318988:0:21156:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x58:0x0] (0->422) req@ffff9f238f22f100 x1871643337580544/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 912/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.318995:0:21156:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f22f100 with x1871643337580544 ext(0->422) 00002000:00010000:0.0:1784938450.318998:0:21156:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f238f22f100 00000100:00100000:0.0:1784938450.319008:0:21156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 197 00000100:00100000:0.0:1784938450.319016:0:21156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7ea6e988-18ba-4c98-b179-17995571b98b+100:10958:x1871643337579648:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.319631:0:23328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 198 00000100:00100000:2.0:1784938450.319641:0:23328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7ea6e988-18ba-4c98-b179-17995571b98b+118:10960:x1871643337579904:12345-192.168.202.54@tcp:4:cp.0 00000001:00080000:3.0:1784938450.321466:0:22178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967500 is committed 00000100:00100000:1.0:1784938450.324415:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7ea6e988-18ba-4c98-b179-17995571b98b+120:10960:x1871643337578880:12345-192.168.202.54@tcp:4:cp.0 Request processed in 41072us (44567us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1784938450.324431:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 194 00002000:00100000:1.0:1784938450.324445:0:23327:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x5f:0x0] (0->31710) req@ffff9f24bd5a6d80 x1871643337578880/t4294967507(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.324464:0:23327:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a6d80 with x1871643337578880 ext(0->31710) 00002000:00010000:1.0:1784938450.324471:0:23327:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24bd5a6d80 00000100:00100000:1.0:1784938450.324505:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 199 00000100:00100000:1.0:1784938450.324517:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7ea6e988-18ba-4c98-b179-17995571b98b+119:10960:x1871643337579776:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938450.325181:0:23337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7ea6e988-18ba-4c98-b179-17995571b98b+119:10959:x1871643337578752:12345-192.168.202.54@tcp:4:cp.0 Request processed in 42316us (45353us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1784938450.325190:0:23337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 193 00002000:00100000:1.0:1784938450.325197:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x5e:0x0] (0->143466) req@ffff9f24bd5a5f80 x1871643337578752/t4294967506(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.325205:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a5f80 with x1871643337578752 ext(0->143466) 00002000:00010000:1.0:1784938450.325210:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24bd5a5f80 00000100:00100000:1.0:1784938450.325228:0:23337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 200 00000100:00100000:1.0:1784938450.325235:0:23337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7ea6e988-18ba-4c98-b179-17995571b98b+118:10957:x1871643337580032:12345-192.168.202.54@tcp:4:cp.0 00000001:00080000:0.0:1784938450.337060:0:22178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967502 is committed 00000001:00080000:0.0:1784938450.340009:0:22178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967503 is committed 00000100:00100000:1.0:1784938450.344495:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938450.344537:0:23335:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 12 min 3 max 116 00000100:00100000:1.0:1784938450.344548:0:23335:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_012' 00000100:00100000:1.0:1784938450.344748:0:23335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337580928 00000100:00100000:1.0:1784938450.344758:0:23335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337580928 00002000:00100000:1.0:1784938450.344808:0:23335:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x66:0x0] (0->24287) req@ffff9f238f229c00 x1871643337580928/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.344819:0:23335:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f229c00 with x1871643337580928 ext(0->24287) 00002000:00010000:1.0:1784938450.344824:0:23335:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f229c00 00000100:00100000:1.0:1784938450.348555:0:25746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 201 00000100:00100000:1.0:1784938450.348578:0:25746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7ea6e988-18ba-4c98-b179-17995571b98b+120:10960:x1871643337580288:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.348976:0:21155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7ea6e988-18ba-4c98-b179-17995571b98b+98:10959:x1871643337578240:12345-192.168.202.54@tcp:4:cp.0 Request processed in 80497us (81329us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1784938450.348987:0:21155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 186 00002000:00100000:0.0:1784938450.348997:0:21155:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x52:0x0] (0->7184) req@ffff9f24bd5a5c00 x1871643337578240/t4294967504(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 7680/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.349015:0:21155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a5c00 with x1871643337578240 ext(0->7184) 00002000:00010000:0.0:1784938450.349022:0:21155:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24bd5a5c00 00000100:00100000:0.0:1784938450.349047:0:21155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 202 00000100:00100000:0.0:1784938450.349055:0:21155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7ea6e988-18ba-4c98-b179-17995571b98b+97:10958:x1871643337580544:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.354833:0:21155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7ea6e988-18ba-4c98-b179-17995571b98b+99:10958:x1871643337580544:12345-192.168.202.54@tcp:4:cp.0 Request processed in 5766us (36252us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1784938450.354848:0:21155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 202 00002000:00100000:0.0:1784938450.354862:0:21155:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x58:0x0] (0->422) req@ffff9f238f22f100 x1871643337580544/t4294967507(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 912/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.354872:0:21155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f22f100 with x1871643337580544 ext(0->422) 00002000:00010000:0.0:1784938450.354878:0:21155:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f238f22f100 00000100:00100000:0.0:1784938450.354911:0:21155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 203 00000100:00100000:0.0:1784938450.354922:0:21155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7ea6e988-18ba-4c98-b179-17995571b98b+121:10959:x1871643337580928:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938450.357681:0:23329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7ea6e988-18ba-4c98-b179-17995571b98b+98:10957:x1871643337578112:12345-192.168.202.54@tcp:4:cp.0 Request processed in 89440us (90186us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1784938450.357697:0:23329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 185 00002000:00100000:1.0:1784938450.357712:0:23329:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x5c:0x0] (0->4749) req@ffff9f2489ae5880 x1871643337578112/t4294967506(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 5240/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.357722:0:23329:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2489ae5880 with x1871643337578112 ext(0->4749) 00002000:00010000:1.0:1784938450.357729:0:23329:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2489ae5880 00000100:00100000:1.0:1784938450.357796:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7ea6e988-18ba-4c98-b179-17995571b98b+96:10960:x1871643337577856:12345-192.168.202.54@tcp:4:cp.0 Request processed in 104924us (110832us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1784938450.357802:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 171 00002000:00100000:1.0:1784938450.357809:0:23333:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x4e:0x0] (0->55539) req@ffff9f2489ae4000 x1871643337577856/t4294967505(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.357817:0:23333:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2489ae4000 with x1871643337577856 ext(0->55539) 00002000:00010000:1.0:1784938450.357822:0:23333:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2489ae4000 00000100:00100000:2.0:1784938450.363674:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.363701:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.363905:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.363926:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938450.364715:0:23335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337580160 00000100:00100000:1.0:1784938450.364725:0:23335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337580160 00002000:00100000:1.0:1784938450.364782:0:23335:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x59:0x0] (0->1341) req@ffff9f24b37c8700 x1871643337580160/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 1832/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.364794:0:23335:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37c8700 with x1871643337580160 ext(0->1341) 00002000:00010000:1.0:1784938450.364800:0:23335:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b37c8700 00000100:00100000:1.0:1784938450.364815:0:23335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337580416 00000100:00100000:1.0:1784938450.364819:0:23335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337580416 00002000:00100000:1.0:1784938450.364846:0:23335:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x53:0x0] (0->1789) req@ffff9f24b37c9f80 x1871643337580416/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2280/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.364861:0:23335:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37c9f80 with x1871643337580416 ext(0->1789) 00002000:00010000:1.0:1784938450.364864:0:23335:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b37c9f80 00000100:00100000:1.0:1784938450.364872:0:23335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337580672 00000100:00100000:1.0:1784938450.364876:0:23335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337580672 00002000:00100000:1.0:1784938450.364889:0:23335:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x51:0x0] (0->3078) req@ffff9f24b37c9c00 x1871643337580672/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 3568/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.364897:0:23335:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37c9c00 with x1871643337580672 ext(0->3078) 00002000:00010000:1.0:1784938450.364900:0:23335:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b37c9c00 00000100:00100000:1.0:1784938450.364907:0:23335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337580800 00000100:00100000:1.0:1784938450.364909:0:23335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337580800 00002000:00100000:1.0:1784938450.364923:0:23335:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x65:0x0] (0->5104) req@ffff9f24b37cbb80 x1871643337580800/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 5600/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.364930:0:23335:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37cbb80 with x1871643337580800 ext(0->5104) 00002000:00010000:1.0:1784938450.364934:0:23335:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b37cbb80 00000100:00100000:1.0:1784938450.364946:0:23335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 204 00000100:00100000:1.0:1784938450.364954:0:23335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7ea6e988-18ba-4c98-b179-17995571b98b+124:10957:x1871643337580160:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938450.365419:0:23331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 205 00000100:00100000:1.0:1784938450.365427:0:23331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7ea6e988-18ba-4c98-b179-17995571b98b+97:10960:x1871643337580416:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938450.369728:0:23331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7ea6e988-18ba-4c98-b179-17995571b98b+101:10960:x1871643337580416:12345-192.168.202.54@tcp:4:cp.0 Request processed in 4289us (6014us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1784938450.369743:0:23331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 205 00002000:00100000:1.0:1784938450.369755:0:23331:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x53:0x0] (0->1789) req@ffff9f24b37c9f80 x1871643337580416/t4294967508(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2280/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.369770:0:23331:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37c9f80 with x1871643337580416 ext(0->1789) 00002000:00010000:1.0:1784938450.369777:0:23331:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b37c9f80 00000100:00100000:1.0:1784938450.369809:0:23331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 206 00000100:00100000:1.0:1784938450.369821:0:23331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7ea6e988-18ba-4c98-b179-17995571b98b+100:10957:x1871643337580672:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.370639:0:23335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7ea6e988-18ba-4c98-b179-17995571b98b+128:10957:x1871643337580160:12345-192.168.202.54@tcp:4:cp.0 Request processed in 5683us (6972us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1784938450.370649:0:23335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 204 00002000:00100000:2.0:1784938450.370657:0:23335:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x59:0x0] (0->1341) req@ffff9f24b37c8700 x1871643337580160/t4294967508(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 1832/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.370664:0:23335:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37c8700 with x1871643337580160 ext(0->1341) 00002000:00010000:2.0:1784938450.370668:0:23335:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b37c8700 00000100:00100000:2.0:1784938450.370685:0:23335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 207 00000100:00100000:2.0:1784938450.370693:0:23335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7ea6e988-18ba-4c98-b179-17995571b98b+127:10960:x1871643337580800:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.372078:0:21157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7ea6e988-18ba-4c98-b179-17995571b98b+128:10958:x1871643337579136:12345-192.168.202.54@tcp:4:cp.0 Request processed in 81974us (92193us total) trans 4294967509 rc 0/0 00000100:00100000:0.0:1784938450.372089:0:21157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 196 00002000:00100000:0.0:1784938450.372098:0:21157:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x60:0x0] (0->198049) req@ffff9f24bd5a4e00 x1871643337579136/t4294967509(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.372107:0:21157:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a4e00 with x1871643337579136 ext(0->198049) 00002000:00010000:0.0:1784938450.372112:0:21157:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24bd5a4e00 00000100:00100000:3.0:1784938450.372637:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7ea6e988-18ba-4c98-b179-17995571b98b+100:10957:x1871643337577984:12345-192.168.202.54@tcp:4:cp.0 Request processed in 104683us (105201us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1784938450.372646:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 184 00002000:00100000:3.0:1784938450.372653:0:23334:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x55:0x0] (0->111138) req@ffff9f2489ae5180 x1871643337577984/t4294967503(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.372667:0:23334:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2489ae5180 with x1871643337577984 ext(0->111138) 00002000:00010000:3.0:1784938450.372671:0:23334:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2489ae5180 00000100:00100000:0.0:1784938450.373307:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938450.374878:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337581568 00000100:00100000:1.0:1784938450.374893:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337581568 00002000:00100000:1.0:1784938450.374944:0:23333:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x50:0x0] (0->233) req@ffff9f2387fd3800 x1871643337581568/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 728/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.374954:0:23333:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2387fd3800 with x1871643337581568 ext(0->233) 00002000:00010000:1.0:1784938450.374959:0:23333:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2387fd3800 00000100:00100000:1.0:1784938450.375001:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 208 00000100:00100000:1.0:1784938450.375010:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7ea6e988-18ba-4c98-b179-17995571b98b+102:10957:x1871643337581568:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.381834:0:25745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7ea6e988-18ba-4c98-b179-17995571b98b+105:10960:x1871643337579392:12345-192.168.202.54@tcp:4:cp.0 Request processed in 92476us (101968us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1784938450.381849:0:25745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 195 00002000:00100000:2.0:1784938450.381862:0:25745:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x5e:0x0] (0->170594) req@ffff9f24bd5a6a00 x1871643337579392/t4294967509(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.381872:0:25745:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a6a00 with x1871643337579392 ext(0->170594) 00002000:00010000:2.0:1784938450.381879:0:25745:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24bd5a6a00 00000100:00100000:3.0:1784938450.382556:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938450.382836:0:23335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7ea6e988-18ba-4c98-b179-17995571b98b+129:10960:x1871643337580800:12345-192.168.202.54@tcp:4:cp.0 Request processed in 12141us (18906us total) trans 4294967510 rc 0/0 00000100:00100000:1.0:1784938450.382845:0:23335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 207 00002000:00100000:1.0:1784938450.382853:0:23335:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x65:0x0] (0->5104) req@ffff9f24b37cbb80 x1871643337580800/t4294967510(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 5600/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.382862:0:23335:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37cbb80 with x1871643337580800 ext(0->5104) 00002000:00010000:1.0:1784938450.382866:0:23335:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b37cbb80 00000100:00100000:1.0:1784938450.382885:0:23335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337581824 00000100:00100000:1.0:1784938450.382890:0:23335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337581824 00002000:00100000:1.0:1784938450.382921:0:23335:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x5f:0x0] (0->215292) req@ffff9f24bd5a4700 x1871643337581824/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.382935:0:23335:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a4700 with x1871643337581824 ext(0->215292) 00002000:00010000:1.0:1784938450.382938:0:23335:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24bd5a4700 00000100:00100000:1.0:1784938450.382958:0:23335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 209 00000100:00100000:1.0:1784938450.382967:0:23335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7ea6e988-18ba-4c98-b179-17995571b98b+105:10959:x1871643337581824:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.386760:0:21156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7ea6e988-18ba-4c98-b179-17995571b98b+105:10958:x1871643337579648:12345-192.168.202.54@tcp:4:cp.0 Request processed in 67733us (68856us total) trans 4294967510 rc 0/0 00000100:00100000:2.0:1784938450.386775:0:21156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 197 00002000:00100000:2.0:1784938450.386789:0:21156:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x57:0x0] (0->158095) req@ffff9f238f22dc00 x1871643337579648/t4294967510(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.386799:0:21156:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f22dc00 with x1871643337579648 ext(0->158095) 00002000:00010000:2.0:1784938450.386806:0:21156:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f238f22dc00 00000100:00100000:2.0:1784938450.387461:0:23328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7ea6e988-18ba-4c98-b179-17995571b98b+127:10960:x1871643337579904:12345-192.168.202.54@tcp:4:cp.0 Request processed in 67819us (69035us total) trans 4294967511 rc 0/0 00000100:00100000:2.0:1784938450.387470:0:23328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 198 00002000:00100000:2.0:1784938450.387477:0:23328:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x62:0x0] (0->88086) req@ffff9f238f22e300 x1871643337579904/t4294967511(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.387487:0:23328:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f22e300 with x1871643337579904 ext(0->88086) 00002000:00010000:2.0:1784938450.387491:0:23328:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f22e300 00000100:00100000:3.0:1784938450.388805:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938450.388826:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938450.388881:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.389365:0:25745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337581056 00000100:00100000:2.0:1784938450.389374:0:25745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337581056 00002000:00100000:2.0:1784938450.389410:0:25745:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x67:0x0] (0->1764) req@ffff9f24bd5a4380 x1871643337581056/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2256/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.389420:0:25745:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a4380 with x1871643337581056 ext(0->1764) 00002000:00010000:2.0:1784938450.389425:0:25745:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24bd5a4380 00000100:00100000:2.0:1784938450.389443:0:25745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337581184 00000100:00100000:2.0:1784938450.389445:0:25745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337581184 00002000:00100000:2.0:1784938450.389460:0:25745:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x59:0x0] (0->1658) req@ffff9f24bd5a4000 x1871643337581184/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2152/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.389467:0:25745:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a4000 with x1871643337581184 ext(0->1658) 00002000:00010000:2.0:1784938450.389470:0:25745:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24bd5a4000 00000100:00100000:2.0:1784938450.389482:0:25745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337581312 00000100:00100000:2.0:1784938450.389485:0:25745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337581312 00002000:00100000:2.0:1784938450.389497:0:25745:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x54:0x0] (0->6429) req@ffff9f24bd5a6680 x1871643337581312/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 6920/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.389504:0:25745:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a6680 with x1871643337581312 ext(0->6429) 00002000:00010000:2.0:1784938450.389507:0:25745:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24bd5a6680 00000100:00100000:2.0:1784938450.389521:0:25745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 210 00000100:00100000:2.0:1784938450.389529:0:25745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7ea6e988-18ba-4c98-b179-17995571b98b+129:10957:x1871643337581056:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.389734:0:23328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 211 00000100:00100000:2.0:1784938450.389744:0:23328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7ea6e988-18ba-4c98-b179-17995571b98b+106:10957:x1871643337581184:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.389939:0:21156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 212 00000100:00100000:2.0:1784938450.389947:0:21156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7ea6e988-18ba-4c98-b179-17995571b98b+108:10959:x1871643337581312:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:3.0:1784938450.392850:0:23331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7ea6e988-18ba-4c98-b179-17995571b98b+110:10957:x1871643337580672:12345-192.168.202.54@tcp:4:cp.0 Request processed in 23014us (28924us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1784938450.392863:0:23331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 206 00002000:00100000:3.0:1784938450.392875:0:23331:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x51:0x0] (0->3078) req@ffff9f24b37c9c00 x1871643337580672/t4294967512(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 3568/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.392885:0:23331:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37c9c00 with x1871643337580672 ext(0->3078) 00002000:00010000:3.0:1784938450.392892:0:23331:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b37c9c00 00000100:00100000:0.0:1784938450.393040:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.393459:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.393480:0:21157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337582080 00000100:00100000:0.0:1784938450.393487:0:21157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337582080 00002000:00100000:0.0:1784938450.393521:0:21157:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x69:0x0] (0->1048575) req@ffff9f2387fd1880 x1871643337582080/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.393530:0:21157:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2387fd1880 with x1871643337582080 ext(0->1048575) 00002000:00010000:0.0:1784938450.393534:0:21157:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2387fd1880 00000100:00100000:0.0:1784938450.393554:0:21157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337581440 00000100:00100000:0.0:1784938450.393557:0:21157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337581440 00002000:00100000:0.0:1784938450.393572:0:21157:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5a:0x0] (0->1407) req@ffff9f2387fd1500 x1871643337581440/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 1896/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.393580:0:21157:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2387fd1500 with x1871643337581440 ext(0->1407) 00002000:00010000:0.0:1784938450.393583:0:21157:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2387fd1500 00000100:00100000:0.0:1784938450.393601:0:21157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 213 00000100:00100000:0.0:1784938450.393609:0:21157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7ea6e988-18ba-4c98-b179-17995571b98b+138:10957:x1871643337582080:12345-192.168.202.54@tcp:4:dd.0 00000100:00100000:0.0:1784938450.394728:0:23329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 214 00000100:00100000:0.0:1784938450.394739:0:23329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7ea6e988-18ba-4c98-b179-17995571b98b+110:10960:x1871643337581440:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.395039:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.395064:0:23331:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 13 min 3 max 116 00000100:00100000:0.0:1784938450.395072:0:23331:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_013' 00000100:00100000:0.0:1784938450.395227:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.395723:0:23337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7ea6e988-18ba-4c98-b179-17995571b98b+138:10957:x1871643337580032:12345-192.168.202.54@tcp:4:cp.0 Request processed in 70486us (77183us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1784938450.395732:0:23337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 200 00002000:00100000:2.0:1784938450.395741:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x63:0x0] (0->42516) req@ffff9f238f22d500 x1871643337580032/t4294967512(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.395749:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f22d500 with x1871643337580032 ext(0->42516) 00002000:00010000:2.0:1784938450.395754:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f22d500 00000100:00100000:2.0:1784938450.395775:0:23337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337581696 00000100:00100000:2.0:1784938450.395780:0:23337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337581696 00002000:00100000:2.0:1784938450.395801:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x5b:0x0] (0->1653) req@ffff9f2387fd0000 x1871643337581696/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2144/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.395809:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2387fd0000 with x1871643337581696 ext(0->1653) 00002000:00010000:2.0:1784938450.395812:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2387fd0000 00000100:00100000:2.0:1784938450.395820:0:23337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337581952 00000100:00100000:2.0:1784938450.395822:0:23337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337581952 00002000:00100000:2.0:1784938450.395835:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x68:0x0] (0->4511) req@ffff9f2387fd1180 x1871643337581952/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 5000/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.395841:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2387fd1180 with x1871643337581952 ext(0->4511) 00002000:00010000:2.0:1784938450.395844:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2387fd1180 00000100:00100000:2.0:1784938450.395853:0:23337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 215 00000100:00100000:2.0:1784938450.395859:0:23337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7ea6e988-18ba-4c98-b179-17995571b98b+113:10958:x1871643337581696:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.396119:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7ea6e988-18ba-4c98-b179-17995571b98b+115:10957:x1871643337581568:12345-192.168.202.54@tcp:4:cp.0 Request processed in 21109us (22812us total) trans 4294967511 rc 0/0 00000100:00100000:2.0:1784938450.396140:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 208 00002000:00100000:2.0:1784938450.396170:0:23333:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x50:0x0] (0->233) req@ffff9f2387fd3800 x1871643337581568/t4294967511(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 728/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.396178:0:23333:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2387fd3800 with x1871643337581568 ext(0->233) 00002000:00010000:2.0:1784938450.396182:0:23333:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2387fd3800 00000100:00100000:2.0:1784938450.396200:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 216 00000100:00100000:2.0:1784938450.396208:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7ea6e988-18ba-4c98-b179-17995571b98b+138:10959:x1871643337581952:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.396439:0:25745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7ea6e988-18ba-4c98-b179-17995571b98b+140:10957:x1871643337581056:12345-192.168.202.54@tcp:4:cp.0 Request processed in 6909us (7639us total) trans 4294967513 rc 0/0 00000100:00100000:2.0:1784938450.396447:0:25745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 210 00002000:00100000:2.0:1784938450.396452:0:25745:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x67:0x0] (0->1764) req@ffff9f24bd5a4380 x1871643337581056/t4294967513(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2256/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.396461:0:25745:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a4380 with x1871643337581056 ext(0->1764) 00002000:00010000:2.0:1784938450.396464:0:25745:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24bd5a4380 00000100:00100000:2.0:1784938450.396505:0:21156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7ea6e988-18ba-4c98-b179-17995571b98b+114:10959:x1871643337581312:12345-192.168.202.54@tcp:4:cp.0 Request processed in 6558us (7623us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1784938450.396511:0:21156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 212 00002000:00100000:2.0:1784938450.396517:0:21156:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x54:0x0] (0->6429) req@ffff9f24bd5a6680 x1871643337581312/t4294967514(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 6920/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.396524:0:21156:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a6680 with x1871643337581312 ext(0->6429) 00002000:00010000:2.0:1784938450.396528:0:21156:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24bd5a6680 00000100:00100000:3.0:1784938450.402224:0:25746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7ea6e988-18ba-4c98-b179-17995571b98b+138:10960:x1871643337580288:12345-192.168.202.54@tcp:4:cp.0 Request processed in 53640us (83655us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1784938450.402242:0:25746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 201 00002000:00100000:3.0:1784938450.402260:0:25746:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x64:0x0] (0->26715) req@ffff9f238f22ca80 x1871643337580288/t4294967515(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.402280:0:25746:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f22ca80 with x1871643337580288 ext(0->26715) 00002000:00010000:3.0:1784938450.402286:0:25746:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f22ca80 00000100:00100000:2.0:1784938450.406442:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7ea6e988-18ba-4c98-b179-17995571b98b+136:10960:x1871643337579776:12345-192.168.202.54@tcp:4:cp.0 Request processed in 81916us (87912us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1784938450.406459:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 199 00002000:00100000:2.0:1784938450.406473:0:23327:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x61:0x0] (0->227515) req@ffff9f238f22f800 x1871643337579776/t4294967514(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.406482:0:23327:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f22f800 with x1871643337579776 ext(0->227515) 00002000:00010000:2.0:1784938450.406488:0:23327:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f22f800 00000100:00100000:3.0:1784938450.407262:0:23337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7ea6e988-18ba-4c98-b179-17995571b98b+113:10958:x1871643337581696:12345-192.168.202.54@tcp:4:cp.0 Request processed in 11401us (12221us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1784938450.407282:0:23337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 215 00002000:00100000:3.0:1784938450.407290:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x5b:0x0] (0->1653) req@ffff9f2387fd0000 x1871643337581696/t4294967516(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2144/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.407298:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2387fd0000 with x1871643337581696 ext(0->1653) 00002000:00010000:3.0:1784938450.407302:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2387fd0000 00000100:00100000:1.0:1784938450.408227:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7ea6e988-18ba-4c98-b179-17995571b98b+135:10959:x1871643337581952:12345-192.168.202.54@tcp:4:cp.0 Request processed in 12016us (12996us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1784938450.408237:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 216 00002000:00100000:1.0:1784938450.408245:0:23333:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x68:0x0] (0->4511) req@ffff9f2387fd1180 x1871643337581952/t4294967517(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 5000/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.408254:0:23333:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2387fd1180 with x1871643337581952 ext(0->4511) 00002000:00010000:1.0:1784938450.408258:0:23333:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2387fd1180 00000100:00100000:1.0:1784938450.408512:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938450.408568:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.409390:0:21156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337582464 00000100:00100000:2.0:1784938450.409400:0:21156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337582464 00002000:00100000:2.0:1784938450.409444:0:21156:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x61:0x0] (0->159677) req@ffff9f238f22ad80 x1871643337582464/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.409454:0:21156:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f22ad80 with x1871643337582464 ext(0->159677) 00002000:00010000:2.0:1784938450.409458:0:21156:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f238f22ad80 00000100:00100000:2.0:1784938450.409488:0:21156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337582592 00000100:00100000:2.0:1784938450.409492:0:21156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337582592 00002000:00100000:2.0:1784938450.409507:0:21156:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x63:0x0] (0->429669) req@ffff9f238f22a680 x1871643337582592/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.409515:0:21156:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f22a680 with x1871643337582592 ext(0->429669) 00002000:00010000:2.0:1784938450.409518:0:21156:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f238f22a680 00000100:00100000:2.0:1784938450.409537:0:21156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 217 00000100:00100000:2.0:1784938450.409545:0:21156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7ea6e988-18ba-4c98-b179-17995571b98b+114:10959:x1871643337582464:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938450.410311:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 218 00000100:00100000:1.0:1784938450.410321:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7ea6e988-18ba-4c98-b179-17995571b98b+115:10958:x1871643337582592:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.412313:0:23328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7ea6e988-18ba-4c98-b179-17995571b98b+116:10957:x1871643337581184:12345-192.168.202.54@tcp:4:cp.0 Request processed in 22560us (23475us total) trans 4294967513 rc 0/0 00000100:00100000:0.0:1784938450.412326:0:23328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 211 00002000:00100000:0.0:1784938450.412339:0:23328:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x59:0x0] (0->1658) req@ffff9f24bd5a4000 x1871643337581184/t4294967513(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2152/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.412357:0:23328:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a4000 with x1871643337581184 ext(0->1658) 00002000:00010000:0.0:1784938450.412364:0:23328:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24bd5a4000 00000100:00100000:0.0:1784938450.412529:0:23329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7ea6e988-18ba-4c98-b179-17995571b98b+115:10960:x1871643337581440:12345-192.168.202.54@tcp:4:cp.0 Request processed in 17791us (19069us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1784938450.412537:0:23329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 214 00002000:00100000:0.0:1784938450.412542:0:23329:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x5a:0x0] (0->1407) req@ffff9f2387fd1500 x1871643337581440/t4294967515(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 1896/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.412550:0:23329:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2387fd1500 with x1871643337581440 ext(0->1407) 00002000:00010000:0.0:1784938450.412554:0:23329:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2387fd1500 00000100:00100000:0.0:1784938450.412607:0:21155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7ea6e988-18ba-4c98-b179-17995571b98b+133:10959:x1871643337580928:12345-192.168.202.54@tcp:4:cp.0 Request processed in 57688us (68122us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1784938450.412613:0:21155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 203 00002000:00100000:0.0:1784938450.412619:0:21155:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x66:0x0] (0->24287) req@ffff9f238f229c00 x1871643337580928/t4294967516(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.412627:0:21155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f229c00 with x1871643337580928 ext(0->24287) 00002000:00010000:0.0:1784938450.412630:0:21155:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f229c00 00000100:00100000:0.0:1784938450.416068:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.416163:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938450.417178:0:23337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337582336 00000100:00100000:3.0:1784938450.417188:0:23337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337582336 00002000:00100000:3.0:1784938450.417232:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x53:0x0] (0->8440) req@ffff9f2387fd2a00 x1871643337582336/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 8936/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.417242:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2387fd2a00 with x1871643337582336 ext(0->8440) 00002000:00010000:3.0:1784938450.417247:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2387fd2a00 00000100:00100000:3.0:1784938450.417283:0:23337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337582208 00000100:00100000:3.0:1784938450.417286:0:23337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337582208 00002000:00100000:3.0:1784938450.417302:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x4f:0x0] (0->6812) req@ffff9f2387fd2300 x1871643337582208/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 7304/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.417309:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2387fd2300 with x1871643337582208 ext(0->6812) 00002000:00010000:3.0:1784938450.417313:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2387fd2300 00000100:00100000:3.0:1784938450.417337:0:23337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 219 00000100:00100000:3.0:1784938450.417346:0:23337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7ea6e988-18ba-4c98-b179-17995571b98b+134:10959:x1871643337582336:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:3.0:1784938450.417651:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 220 00000100:00100000:3.0:1784938450.417659:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7ea6e988-18ba-4c98-b179-17995571b98b+136:10958:x1871643337582208:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.419626:0:23335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7ea6e988-18ba-4c98-b179-17995571b98b+115:10959:x1871643337581824:12345-192.168.202.54@tcp:4:cp.0 Request processed in 36652us (37063us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1784938450.419641:0:23335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 209 00002000:00100000:2.0:1784938450.419652:0:23335:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x5f:0x0] (0->215292) req@ffff9f24bd5a4700 x1871643337581824/t4294967517(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.419668:0:23335:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a4700 with x1871643337581824 ext(0->215292) 00002000:00010000:2.0:1784938450.419674:0:23335:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24bd5a4700 00000100:00100000:3.0:1784938450.420219:0:23337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7ea6e988-18ba-4c98-b179-17995571b98b+138:10959:x1871643337582336:12345-192.168.202.54@tcp:4:cp.0 Request processed in 2871us (4158us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1784938450.420230:0:23337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 219 00002000:00100000:3.0:1784938450.420237:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x53:0x0] (0->8440) req@ffff9f2387fd2a00 x1871643337582336/t4294967518(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 8936/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.420245:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2387fd2a00 with x1871643337582336 ext(0->8440) 00002000:00010000:3.0:1784938450.420249:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2387fd2a00 00000100:00100000:2.0:1784938450.421089:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7ea6e988-18ba-4c98-b179-17995571b98b+137:10958:x1871643337582208:12345-192.168.202.54@tcp:4:cp.0 Request processed in 3428us (4944us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1784938450.421098:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 220 00002000:00100000:2.0:1784938450.421105:0:23327:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x4f:0x0] (0->6812) req@ffff9f2387fd2300 x1871643337582208/t4294967519(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 7304/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.421113:0:23327:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2387fd2300 with x1871643337582208 ext(0->6812) 00002000:00010000:2.0:1784938450.421117:0:23327:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2387fd2300 00000100:00100000:3.0:1784938450.439730:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.439965:0:23329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337583872 00000100:00100000:0.0:1784938450.439976:0:23329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337583872 00002000:00100000:0.0:1784938450.440027:0:23329:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x5d:0x0] (0->116977) req@ffff9f24bd5a5880 x1871643337583872/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.440038:0:23329:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a5880 with x1871643337583872 ext(0->116977) 00002000:00010000:0.0:1784938450.440043:0:23329:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24bd5a5880 00000100:00100000:0.0:1784938450.440085:0:23329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 221 00000100:00100000:0.0:1784938450.440095:0:23329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7ea6e988-18ba-4c98-b179-17995571b98b+115:10959:x1871643337583872:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:3.0:1784938450.447964:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.448793:0:23331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337583744 00000100:00100000:0.0:1784938450.448805:0:23331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337583744 00002000:00100000:0.0:1784938450.448869:0:23331:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x67:0x0] (0->316747) req@ffff9f24bd5a7b80 x1871643337583744/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.448881:0:23331:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a7b80 with x1871643337583744 ext(0->316747) 00002000:00010000:0.0:1784938450.448887:0:23331:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24bd5a7b80 00000100:00100000:0.0:1784938450.448923:0:23331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 222 00000100:00100000:0.0:1784938450.448933:0:23331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7ea6e988-18ba-4c98-b179-17995571b98b+117:10958:x1871643337583744:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:3.0:1784938450.450439:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.450723:0:25747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337584000 00000100:00100000:2.0:1784938450.450731:0:25747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337584000 00002000:00100000:2.0:1784938450.450763:0:25747:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x2c0000401:0x62:0x0] (0->254128) req@ffff9f24bd5a7480 x1871643337584000/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.450773:0:25747:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a7480 with x1871643337584000 ext(0->254128) 00002000:00010000:2.0:1784938450.450779:0:25747:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24bd5a7480 00000100:00100000:2.0:1784938450.450813:0:25747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 223 00000100:00100000:2.0:1784938450.450822:0:25747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7ea6e988-18ba-4c98-b179-17995571b98b+119:10960:x1871643337584000:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:3.0:1784938450.461207:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938450.461243:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938450.461316:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938450.461344:0:23337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337584128 00000100:00100000:3.0:1784938450.461356:0:23337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337584128 00002000:00100000:3.0:1784938450.461401:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x64:0x0] (0->1179442) req@ffff9f24bd5a5500 x1871643337584128/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.461412:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a5500 with x1871643337584128 ext(0->1179442) 00002000:00010000:3.0:1784938450.461418:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24bd5a5500 00000100:00100000:3.0:1784938450.461438:0:23337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337584384 00000100:00100000:3.0:1784938450.461441:0:23337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337584384 00002000:00100000:3.0:1784938450.461457:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x58:0x0] (0->37841) req@ffff9f24bd5a4a80 x1871643337584384/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.461464:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a4a80 with x1871643337584384 ext(0->37841) 00002000:00010000:3.0:1784938450.461467:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24bd5a4a80 00000100:00100000:3.0:1784938450.461477:0:23337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337584512 00000100:00100000:3.0:1784938450.461479:0:23337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337584512 00002000:00100000:3.0:1784938450.461490:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x50:0x0] (0->268) req@ffff9f24bd5a7800 x1871643337584512/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 760/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.461497:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a7800 with x1871643337584512 ext(0->268) 00002000:00010000:3.0:1784938450.461501:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24bd5a7800 00000100:00100000:3.0:1784938450.461515:0:23337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 224 00000100:00100000:3.0:1784938450.461524:0:23337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7ea6e988-18ba-4c98-b179-17995571b98b+121:10958:x1871643337584128:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.463344:0:23328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 225 00000100:00100000:0.0:1784938450.463359:0:23328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7ea6e988-18ba-4c98-b179-17995571b98b+138:10959:x1871643337584384:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.463505:0:23335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 226 00000100:00100000:0.0:1784938450.463513:0:23335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7ea6e988-18ba-4c98-b179-17995571b98b+139:10960:x1871643337584512:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.464943:0:23335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7ea6e988-18ba-4c98-b179-17995571b98b+141:10960:x1871643337584512:12345-192.168.202.54@tcp:4:cp.0 Request processed in 1425us (3620us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1784938450.464954:0:23335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 226 00002000:00100000:0.0:1784938450.464965:0:23335:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x50:0x0] (0->268) req@ffff9f24bd5a7800 x1871643337584512/t4294967520(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 760/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.464975:0:23335:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a7800 with x1871643337584512 ext(0->268) 00002000:00010000:0.0:1784938450.464980:0:23335:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24bd5a7800 00000100:00100000:1.0:1784938450.476563:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938450.476601:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.477499:0:25745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337582720 00000100:00100000:0.0:1784938450.477511:0:25745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337582720 00002000:00100000:0.0:1784938450.477563:0:25745:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x51:0x0] (0->4116) req@ffff9f238f228380 x1871643337582720/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 4608/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.477574:0:25745:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f228380 with x1871643337582720 ext(0->4116) 00002000:00010000:0.0:1784938450.477580:0:25745:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f228380 00000100:00100000:0.0:1784938450.477610:0:25745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337582848 00000100:00100000:0.0:1784938450.477614:0:25745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337582848 00002000:00100000:0.0:1784938450.477629:0:25745:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x5a:0x0] (0->1752) req@ffff9f238f229500 x1871643337582848/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2248/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.477637:0:25745:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f229500 with x1871643337582848 ext(0->1752) 00002000:00010000:0.0:1784938450.477641:0:25745:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f229500 00000100:00100000:0.0:1784938450.477668:0:25745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 227 00000100:00100000:0.0:1784938450.477677:0:25745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f228380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7ea6e988-18ba-4c98-b179-17995571b98b+142:10958:x1871643337582720:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.478897:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 228 00000100:00100000:2.0:1784938450.478910:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f229500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7ea6e988-18ba-4c98-b179-17995571b98b+146:10959:x1871643337582848:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.480576:0:25745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f228380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7ea6e988-18ba-4c98-b179-17995571b98b+148:10958:x1871643337582720:12345-192.168.202.54@tcp:4:cp.0 Request processed in 2892us (4016us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1784938450.480590:0:25745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 227 00002000:00100000:0.0:1784938450.480601:0:25745:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x51:0x0] (0->4116) req@ffff9f238f228380 x1871643337582720/t4294967521(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 4608/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.480611:0:25745:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f228380 with x1871643337582720 ext(0->4116) 00002000:00010000:0.0:1784938450.480617:0:25745:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f228380 00000100:00100000:3.0:1784938450.481686:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f229500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7ea6e988-18ba-4c98-b179-17995571b98b+147:10959:x1871643337582848:12345-192.168.202.54@tcp:4:cp.0 Request processed in 2773us (5079us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1784938450.481698:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 228 00002000:00100000:3.0:1784938450.481705:0:23333:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x5a:0x0] (0->1752) req@ffff9f238f229500 x1871643337582848/t4294967523(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2248/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.481715:0:23333:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f229500 with x1871643337582848 ext(0->1752) 00002000:00010000:3.0:1784938450.481720:0:23333:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f238f229500 00000100:00100000:1.0:1784938450.482741:0:21157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7ea6e988-18ba-4c98-b179-17995571b98b+145:10957:x1871643337582080:12345-192.168.202.54@tcp:4:dd.0 Request processed in 89127us (89696us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1784938450.482750:0:21157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 213 00002000:00100000:1.0:1784938450.482757:0:21157:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x69:0x0] (0->1048575) req@ffff9f2387fd1880 x1871643337582080/t4294967522(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.482772:0:21157:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2387fd1880 with x1871643337582080 ext(0->1048575) 00002000:00010000:1.0:1784938450.482781:0:21157:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2387fd1880 00000100:00100000:3.0:1784938450.490826:0:21156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7ea6e988-18ba-4c98-b179-17995571b98b+123:10959:x1871643337582464:12345-192.168.202.54@tcp:4:cp.0 Request processed in 81270us (82302us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1784938450.490840:0:21156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 217 00002000:00100000:3.0:1784938450.490853:0:21156:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x61:0x0] (0->159677) req@ffff9f238f22ad80 x1871643337582464/t4294967518(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.490862:0:21156:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f22ad80 with x1871643337582464 ext(0->159677) 00002000:00010000:3.0:1784938450.490869:0:21156:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f238f22ad80 00000100:00100000:1.0:1784938450.502525:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7ea6e988-18ba-4c98-b179-17995571b98b+123:10958:x1871643337582592:12345-192.168.202.54@tcp:4:cp.0 Request processed in 92193us (93944us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1784938450.502540:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 218 00002000:00100000:1.0:1784938450.502554:0:23334:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x63:0x0] (0->429669) req@ffff9f238f22a680 x1871643337582592/t4294967519(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.502564:0:23334:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f238f22a680 with x1871643337582592 ext(0->429669) 00002000:00010000:1.0:1784938450.502571:0:23334:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f238f22a680 00000100:00100000:0.0:1784938450.502740:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.502825:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.502857:0:23335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337582976 00000100:00100000:0.0:1784938450.502865:0:23335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337582976 00002000:00100000:0.0:1784938450.502904:0:23335:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x5b:0x0] (0->854) req@ffff9f2387fd3b80 x1871643337582976/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 1344/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.502920:0:23335:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2387fd3b80 with x1871643337582976 ext(0->854) 00002000:00010000:0.0:1784938450.502924:0:23335:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2387fd3b80 00000100:00100000:0.0:1784938450.502941:0:23335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337583232 00000100:00100000:0.0:1784938450.502945:0:23335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337583232 00002000:00100000:0.0:1784938450.502959:0:23335:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x5c:0x0] (0->6547) req@ffff9f2388245500 x1871643337583232/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 7040/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.502966:0:23335:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2388245500 with x1871643337583232 ext(0->6547) 00002000:00010000:0.0:1784938450.502970:0:23335:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2388245500 00000100:00100000:0.0:1784938450.502998:0:23335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 229 00000100:00100000:0.0:1784938450.503007:0:23335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7ea6e988-18ba-4c98-b179-17995571b98b+146:10959:x1871643337582976:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.503439:0:25745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 230 00000100:00100000:0.0:1784938450.503447:0:25745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388245500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7ea6e988-18ba-4c98-b179-17995571b98b+148:10958:x1871643337583232:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.503639:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.503664:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.503680:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.503697:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.504057:0:25746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337583104 00000100:00100000:0.0:1784938450.504062:0:25746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337583104 00002000:00100000:0.0:1784938450.504084:0:25746:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x55:0x0] (0->6233) req@ffff9f2388246a00 x1871643337583104/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 6728/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.504093:0:25746:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2388246a00 with x1871643337583104 ext(0->6233) 00002000:00010000:0.0:1784938450.504097:0:25746:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2388246a00 00000100:00100000:0.0:1784938450.504112:0:25746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337583360 00000100:00100000:0.0:1784938450.504116:0:25746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337583360 00002000:00100000:0.0:1784938450.504131:0:25746:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x54:0x0] (0->1693) req@ffff9f2388244380 x1871643337583360/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2184/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.504138:0:25746:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2388244380 with x1871643337583360 ext(0->1693) 00002000:00010000:0.0:1784938450.504142:0:25746:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2388244380 00000100:00100000:0.0:1784938450.504169:0:25746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337583616 00000100:00100000:0.0:1784938450.504172:0:25746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337583616 00002000:00100000:0.0:1784938450.504186:0:25746:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000401:0x66:0x0] (0->1610) req@ffff9f2388244000 x1871643337583616/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2104/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.504193:0:25746:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2388244000 with x1871643337583616 ext(0->1610) 00002000:00010000:0.0:1784938450.504197:0:25746:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2388244000 00000100:00100000:0.0:1784938450.504204:0:25746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337583488 00000100:00100000:0.0:1784938450.504206:0:25746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337583488 00002000:00100000:0.0:1784938450.504219:0:25746:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000401:0x65:0x0] (0->2474) req@ffff9f2388247800 x1871643337583488/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2968/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.504226:0:25746:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2388247800 with x1871643337583488 ext(0->2474) 00002000:00010000:0.0:1784938450.504230:0:25746:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2388247800 00000100:00100000:0.0:1784938450.504239:0:25746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 231 00000100:00100000:0.0:1784938450.504246:0:25746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388246a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7ea6e988-18ba-4c98-b179-17995571b98b+152:10958:x1871643337583104:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938450.505952:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 232 00000100:00100000:1.0:1784938450.505994:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7ea6e988-18ba-4c98-b179-17995571b98b+154:10959:x1871643337583360:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938450.506382:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 233 00000100:00100000:1.0:1784938450.506390:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7ea6e988-18ba-4c98-b179-17995571b98b+126:10957:x1871643337583616:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938450.506621:0:21155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 234 00000100:00100000:1.0:1784938450.506628:0:21155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388247800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7ea6e988-18ba-4c98-b179-17995571b98b+128:10959:x1871643337583488:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938450.509786:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7ea6e988-18ba-4c98-b179-17995571b98b+156:10959:x1871643337583360:12345-192.168.202.54@tcp:4:cp.0 Request processed in 3812us (6109us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1784938450.509801:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 232 00002000:00100000:1.0:1784938450.509814:0:23327:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x54:0x0] (0->1693) req@ffff9f2388244380 x1871643337583360/t4294967527(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2184/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.509825:0:23327:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2388244380 with x1871643337583360 ext(0->1693) 00002000:00010000:1.0:1784938450.509843:0:23327:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2388244380 00000100:00100000:1.0:1784938450.509907:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7ea6e988-18ba-4c98-b179-17995571b98b+130:10957:x1871643337583616:12345-192.168.202.54@tcp:4:cp.0 Request processed in 3518us (6225us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1784938450.509914:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 233 00002000:00100000:1.0:1784938450.509920:0:23334:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x66:0x0] (0->1610) req@ffff9f2388244000 x1871643337583616/t4294967521(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2104/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.509929:0:23334:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2388244000 with x1871643337583616 ext(0->1610) 00002000:00010000:1.0:1784938450.509933:0:23334:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2388244000 00000100:00100000:0.0:1784938450.510940:0:25745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388245500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7ea6e988-18ba-4c98-b179-17995571b98b+155:10958:x1871643337583232:12345-192.168.202.54@tcp:4:cp.0 Request processed in 7489us (8111us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1784938450.510949:0:25745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 230 00002000:00100000:0.0:1784938450.510956:0:25745:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x5c:0x0] (0->6547) req@ffff9f2388245500 x1871643337583232/t4294967525(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 7040/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784938450.511757:0:23335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7ea6e988-18ba-4c98-b179-17995571b98b+155:10959:x1871643337582976:12345-192.168.202.54@tcp:4:cp.0 Request processed in 8746us (9014us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1784938450.511768:0:23335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 229 00002000:00100000:3.0:1784938450.511775:0:23335:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x5b:0x0] (0->854) req@ffff9f2387fd3b80 x1871643337582976/t4294967524(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 1344/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.511784:0:23335:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2387fd3b80 with x1871643337582976 ext(0->854) 00002000:00010000:3.0:1784938450.511789:0:23335:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2387fd3b80 00000100:00100000:3.0:1784938450.511859:0:21155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388247800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7ea6e988-18ba-4c98-b179-17995571b98b+129:10959:x1871643337583488:12345-192.168.202.54@tcp:4:cp.0 Request processed in 5231us (8161us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1784938450.511866:0:21155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 234 00002000:00100000:3.0:1784938450.511872:0:21155:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x65:0x0] (0->2474) req@ffff9f2388247800 x1871643337583488/t4294967522(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2968/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.511879:0:21155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2388247800 with x1871643337583488 ext(0->2474) 00002000:00010000:3.0:1784938450.511883:0:21155:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2388247800 00000100:00100000:3.0:1784938450.511930:0:25746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388246a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7ea6e988-18ba-4c98-b179-17995571b98b+154:10958:x1871643337583104:12345-192.168.202.54@tcp:4:cp.0 Request processed in 7684us (8291us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1784938450.511936:0:25746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 231 00002000:00100000:3.0:1784938450.511943:0:25746:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x55:0x0] (0->6233) req@ffff9f2388246a00 x1871643337583104/t4294967526(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 6728/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.511950:0:25746:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2388246a00 with x1871643337583104 ext(0->6233) 00002000:00010000:3.0:1784938450.511954:0:25746:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2388246a00 00002000:00100000:0.0:1784938450.512093:0:25745:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2388245500 with x1871643337583232 ext(0->6547) 00002000:00010000:0.0:1784938450.512098:0:25745:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2388245500 00000100:00100000:1.0:1784938450.512671:0:23329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7ea6e988-18ba-4c98-b179-17995571b98b+129:10959:x1871643337583872:12345-192.168.202.54@tcp:4:cp.0 Request processed in 72575us (72948us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1784938450.512679:0:23329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 221 00002000:00100000:1.0:1784938450.512686:0:23329:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x5d:0x0] (0->116977) req@ffff9f24bd5a5880 x1871643337583872/t4294967520(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.512695:0:23329:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a5880 with x1871643337583872 ext(0->116977) 00002000:00010000:1.0:1784938450.512698:0:23329:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24bd5a5880 00000100:00100000:1.0:1784938450.526120:0:23331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7ea6e988-18ba-4c98-b179-17995571b98b+127:10958:x1871643337583744:12345-192.168.202.54@tcp:4:cp.0 Request processed in 77176us (78154us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1784938450.526134:0:23331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 222 00002000:00100000:1.0:1784938450.526183:0:23331:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x67:0x0] (0->316747) req@ffff9f24bd5a7b80 x1871643337583744/t4294967523(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.526195:0:23331:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a7b80 with x1871643337583744 ext(0->316747) 00002000:00010000:1.0:1784938450.526201:0:23331:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24bd5a7b80 00000100:00100000:2.0:1784938450.552290:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938450.554636:0:21157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337584256 00000100:00100000:1.0:1784938450.554651:0:21157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337584256 00002000:00100000:1.0:1784938450.554704:0:21157:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x60:0x0] (0->10933) req@ffff9f24b37ca680 x1871643337584256/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 11424/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.554716:0:21157:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37ca680 with x1871643337584256 ext(0->10933) 00002000:00010000:1.0:1784938450.554722:0:21157:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b37ca680 00000100:00100000:1.0:1784938450.554758:0:21157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 235 00000100:00100000:1.0:1784938450.554768:0:21157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7ea6e988-18ba-4c98-b179-17995571b98b+127:10958:x1871643337584256:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938450.557726:0:21157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7ea6e988-18ba-4c98-b179-17995571b98b+131:10958:x1871643337584256:12345-192.168.202.54@tcp:4:cp.0 Request processed in 2949us (5461us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1784938450.557740:0:21157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 235 00002000:00100000:1.0:1784938450.557750:0:21157:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x60:0x0] (0->10933) req@ffff9f24b37ca680 x1871643337584256/t4294967524(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 11424/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.557760:0:21157:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37ca680 with x1871643337584256 ext(0->10933) 00002000:00010000:1.0:1784938450.557765:0:21157:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b37ca680 00000100:00100000:2.0:1784938450.564115:0:25747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7ea6e988-18ba-4c98-b179-17995571b98b+129:10960:x1871643337584000:12345-192.168.202.54@tcp:4:cp.0 Request processed in 113283us (113673us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1784938450.564130:0:25747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 223 00002000:00100000:2.0:1784938450.564184:0:25747:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x2c0000401:0x62:0x0] (0->254128) req@ffff9f24bd5a7480 x1871643337584000/t4294967525(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.564196:0:25747:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a7480 with x1871643337584000 ext(0->254128) 00002000:00010000:2.0:1784938450.564202:0:25747:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24bd5a7480 00000100:00100000:0.0:1784938450.591360:0:23337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7ea6e988-18ba-4c98-b179-17995571b98b+129:10958:x1871643337584128:12345-192.168.202.54@tcp:4:cp.0 Request processed in 129825us (130152us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1784938450.591376:0:23337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 224 00002000:00100000:0.0:1784938450.591394:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x64:0x0] (0->1179442) req@ffff9f24bd5a5500 x1871643337584128/t4294967526(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.591405:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a5500 with x1871643337584128 ext(0->1179442) 00002000:00010000:0.0:1784938450.591411:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24bd5a5500 00000100:00100000:0.0:1784938450.621215:0:23328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7ea6e988-18ba-4c98-b179-17995571b98b+153:10959:x1871643337584384:12345-192.168.202.54@tcp:4:cp.0 Request processed in 157848us (159958us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1784938450.621230:0:23328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 225 00002000:00100000:0.0:1784938450.621246:0:23328:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x58:0x0] (0->37841) req@ffff9f24bd5a4a80 x1871643337584384/t4294967528(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.621256:0:23328:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a4a80 with x1871643337584384 ext(0->37841) 00002000:00010000:0.0:1784938450.621262:0:23328:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24bd5a4a80 00000100:00100000:2.0:1784938450.643711:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.643803:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938450.644058:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337584640 00000100:00100000:3.0:1784938450.644068:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337584640 00002000:00100000:3.0:1784938450.644119:0:23333:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0x42:0x0] (0->902) req@ffff9f24b37c9180 x1871643337584640/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 1392/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.644138:0:23333:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37c9180 with x1871643337584640 ext(0->902) 00002000:00010000:3.0:1784938450.644328:0:23333:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b37c9180 00000100:00100000:3.0:1784938450.644353:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337584768 00000100:00100000:3.0:1784938450.644357:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337584768 00002000:00100000:3.0:1784938450.644377:0:23333:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0x42:0x0] (0->5633) req@ffff9f24b37c8a80 x1871643337584768/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 6128/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.644386:0:23333:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37c8a80 with x1871643337584768 ext(0->5633) 00002000:00010000:3.0:1784938450.644391:0:23333:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b37c8a80 00000100:00100000:3.0:1784938450.644411:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 236 00000100:00100000:3.0:1784938450.644421:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7ea6e988-18ba-4c98-b179-17995571b98b+129:10957:x1871643337584640:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.645898:0:21156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 237 00000100:00100000:2.0:1784938450.645910:0:21156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7ea6e988-18ba-4c98-b179-17995571b98b+153:10958:x1871643337584768:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.646317:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.646352:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.646377:0:21155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337585024 00000100:00100000:2.0:1784938450.646384:0:21155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337585024 00002000:00100000:2.0:1784938450.646412:0:21155:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x43:0x0] (0->1734) req@ffff9f24b37caa00 x1871643337585024/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2224/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.646422:0:21155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37caa00 with x1871643337585024 ext(0->1734) 00002000:00010000:2.0:1784938450.646427:0:21155:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b37caa00 00000100:00100000:2.0:1784938450.646451:0:21155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337585152 00000100:00100000:2.0:1784938450.646455:0:21155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337585152 00002000:00100000:2.0:1784938450.646471:0:21155:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x44:0x0] (0->9973) req@ffff9f24b37cb480 x1871643337585152/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 10464/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.646478:0:21155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37cb480 with x1871643337585152 ext(0->9973) 00002000:00010000:2.0:1784938450.646482:0:21155:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b37cb480 00000100:00100000:2.0:1784938450.646496:0:21155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 238 00000100:00100000:2.0:1784938450.646503:0:21155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7ea6e988-18ba-4c98-b179-17995571b98b+156:10960:x1871643337585024:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.646671:0:25746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 239 00000100:00100000:2.0:1784938450.646679:0:25746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7ea6e988-18ba-4c98-b179-17995571b98b+130:10957:x1871643337585152:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.648285:0:21155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7ea6e988-18ba-4c98-b179-17995571b98b+158:10960:x1871643337585024:12345-192.168.202.54@tcp:4:cp.0 Request processed in 1776us (1962us total) trans 4294967530 rc 0/0 00000100:00100000:2.0:1784938450.648296:0:21155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 238 00002000:00100000:2.0:1784938450.648306:0:21155:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x43:0x0] (0->1734) req@ffff9f24b37caa00 x1871643337585024/t4294967530(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2224/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.648316:0:21155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37caa00 with x1871643337585024 ext(0->1734) 00002000:00010000:2.0:1784938450.648322:0:21155:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b37caa00 00000100:00100000:2.0:1784938450.648400:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7ea6e988-18ba-4c98-b179-17995571b98b+134:10957:x1871643337584640:12345-192.168.202.54@tcp:4:cp.0 Request processed in 3980us (4779us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1784938450.648408:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 236 00002000:00100000:2.0:1784938450.648414:0:23333:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0x42:0x0] (0->902) req@ffff9f24b37c9180 x1871643337584640/t4294967528(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 1392/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.648423:0:23333:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37c9180 with x1871643337584640 ext(0->902) 00002000:00010000:2.0:1784938450.648427:0:23333:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b37c9180 00000100:00100000:2.0:1784938450.648523:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938450.648599:0:21156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7ea6e988-18ba-4c98-b179-17995571b98b+157:10958:x1871643337584768:12345-192.168.202.54@tcp:4:cp.0 Request processed in 2691us (4795us total) trans 4294967529 rc 0/0 00000100:00100000:1.0:1784938450.648607:0:21156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 237 00002000:00100000:1.0:1784938450.648613:0:21156:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x42:0x0] (0->5633) req@ffff9f24b37c8a80 x1871643337584768/t4294967529(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 6128/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.648621:0:21156:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37c8a80 with x1871643337584768 ext(0->5633) 00002000:00010000:1.0:1784938450.648624:0:21156:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b37c8a80 00000100:00100000:1.0:1784938450.648639:0:21156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337585536 00000100:00100000:1.0:1784938450.648644:0:21156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337585536 00002000:00100000:1.0:1784938450.648668:0:21156:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x45:0x0] (0->15475) req@ffff9f2381e3cc50 x1871643337585536/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 15968/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.648681:0:21156:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2381e3cc50 with x1871643337585536 ext(0->15475) 00002000:00010000:1.0:1784938450.648685:0:21156:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2381e3cc50 00000100:00100000:1.0:1784938450.648705:0:21156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 240 00000100:00100000:1.0:1784938450.648713:0:21156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7ea6e988-18ba-4c98-b179-17995571b98b+157:10960:x1871643337585536:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938450.651652:0:21156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7ea6e988-18ba-4c98-b179-17995571b98b+159:10960:x1871643337585536:12345-192.168.202.54@tcp:4:cp.0 Request processed in 2929us (3119us total) trans 4294967531 rc 0/0 00000100:00100000:1.0:1784938450.651667:0:21156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 240 00002000:00100000:1.0:1784938450.651677:0:21156:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x45:0x0] (0->15475) req@ffff9f2381e3cc50 x1871643337585536/t4294967531(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 15968/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.651688:0:21156:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2381e3cc50 with x1871643337585536 ext(0->15475) 00002000:00010000:1.0:1784938450.651693:0:21156:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2381e3cc50 00000100:00100000:1.0:1784938450.652094:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938450.652175:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.652373:0:21157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337584896 00000100:00100000:0.0:1784938450.652381:0:21157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337584896 00002000:00100000:0.0:1784938450.652417:0:21157:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x43:0x0] (0->391199) req@ffff9f2482b2b100 x1871643337584896/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.652426:0:21157:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2482b2b100 with x1871643337584896 ext(0->391199) 00002000:00010000:0.0:1784938450.652430:0:21157:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2482b2b100 00000100:00100000:0.0:1784938450.652454:0:21157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337585280 00000100:00100000:0.0:1784938450.652457:0:21157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337585280 00002000:00100000:0.0:1784938450.652473:0:21157:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x44:0x0] (0->38516) req@ffff9f2482b2aa00 x1871643337585280/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.652481:0:21157:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2482b2aa00 with x1871643337585280 ext(0->38516) 00002000:00010000:0.0:1784938450.652485:0:21157:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2482b2aa00 00000100:00100000:0.0:1784938450.652502:0:21157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 241 00000100:00100000:0.0:1784938450.652510:0:21157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7ea6e988-18ba-4c98-b179-17995571b98b+134:10959:x1871643337584896:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.653007:0:23328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 242 00000100:00100000:0.0:1784938450.653015:0:23328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7ea6e988-18ba-4c98-b179-17995571b98b+159:10958:x1871643337585280:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938450.656328:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938450.656380:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938450.656404:0:23329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337585408 00000100:00100000:1.0:1784938450.656411:0:23329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337585408 00002000:00100000:1.0:1784938450.656449:0:23329:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x45:0x0] (0->39342) req@ffff9f2482b28380 x1871643337585408/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784938450.656450:0:25746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7ea6e988-18ba-4c98-b179-17995571b98b+136:10957:x1871643337585152:12345-192.168.202.54@tcp:4:cp.0 Request processed in 9769us (10095us total) trans 4294967527 rc 0/0 00002000:00100000:1.0:1784938450.656459:0:23329:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2482b28380 with x1871643337585408 ext(0->39342) 00000100:00100000:3.0:1784938450.656461:0:25746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 239 00002000:00010000:1.0:1784938450.656464:0:23329:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2482b28380 00002000:00100000:3.0:1784938450.656467:0:25746:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000400:0x44:0x0] (0->9973) req@ffff9f24b37cb480 x1871643337585152/t4294967527(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 10464/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.656476:0:25746:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37cb480 with x1871643337585152 ext(0->9973) 00000100:00100000:1.0:1784938450.656482:0:23329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337585664 00000100:00100000:1.0:1784938450.656484:0:23329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337585664 00002000:00100000:1.0:1784938450.656500:0:23329:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x46:0x0] (0->673) req@ffff9f2482b2b480 x1871643337585664/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 1168/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.656508:0:23329:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2482b2b480 with x1871643337585664 ext(0->673) 00002000:00010000:1.0:1784938450.656511:0:23329:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2482b2b480 00000100:00100000:1.0:1784938450.656527:0:23329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 243 00000100:00100000:1.0:1784938450.656535:0:23329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7ea6e988-18ba-4c98-b179-17995571b98b+137:10959:x1871643337585408:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.656623:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.656643:0:21155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337586176 00000100:00100000:2.0:1784938450.656646:0:21155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337586176 00002000:00100000:2.0:1784938450.656664:0:21155:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x48:0x0] (0->28244) req@ffff9f24b37ca300 x1871643337586176/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.656673:0:21155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37ca300 with x1871643337586176 ext(0->28244) 00002000:00010000:2.0:1784938450.656677:0:21155:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b37ca300 00000100:00100000:2.0:1784938450.656692:0:21155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 244 00000100:00100000:2.0:1784938450.656699:0:21155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7ea6e988-18ba-4c98-b179-17995571b98b+139:10957:x1871643337585664:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938450.656705:0:25745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 245 00000100:00100000:1.0:1784938450.656710:0:25745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7ea6e988-18ba-4c98-b179-17995571b98b+139:10957:x1871643337586176:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938450.656809:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938450.656833:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337585792 00000100:00100000:1.0:1784938450.656836:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337585792 00002000:00100000:1.0:1784938450.656869:0:23327:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x46:0x0] (0->9197) req@ffff9f2482b29500 x1871643337585792/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 9688/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.656878:0:23327:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2482b29500 with x1871643337585792 ext(0->9197) 00002000:00010000:1.0:1784938450.656881:0:23327:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2482b29500 00000100:00100000:1.0:1784938450.656897:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 246 00000100:00100000:1.0:1784938450.656903:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7ea6e988-18ba-4c98-b179-17995571b98b+161:10958:x1871643337585792:12345-192.168.202.54@tcp:4:cp.0 00002000:00010000:3.0:1784938450.657075:0:25746:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b37cb480 00000100:00100000:1.0:1784938450.657232:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938450.657247:0:21156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337585920 00000100:00100000:1.0:1784938450.657250:0:21156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337585920 00002000:00100000:1.0:1784938450.657279:0:21156:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x47:0x0] (0->2658) req@ffff9f2482b28a80 x1871643337585920/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 3152/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.657287:0:21156:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2482b28a80 with x1871643337585920 ext(0->2658) 00002000:00010000:1.0:1784938450.657290:0:21156:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2482b28a80 00000100:00100000:1.0:1784938450.657305:0:21156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 247 00000100:00100000:1.0:1784938450.657312:0:21156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7ea6e988-18ba-4c98-b179-17995571b98b+140:10959:x1871643337585920:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:3.0:1784938450.657346:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938450.657383:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938450.657416:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938450.657443:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938450.657477:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938450.657480:0:23337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337586432 00000100:00100000:1.0:1784938450.657483:0:23337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337586432 00002000:00100000:1.0:1784938450.657499:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0x49:0x0] (0->1753) req@ffff9f24bd5a6d80 x1871643337586432/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2248/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.657508:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a6d80 with x1871643337586432 ext(0->1753) 00002000:00010000:1.0:1784938450.657511:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24bd5a6d80 00000100:00100000:1.0:1784938450.657519:0:23337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337586048 00000100:00100000:1.0:1784938450.657521:0:23337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337586048 00002000:00100000:1.0:1784938450.657534:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000400:0x47:0x0] (0->4206) req@ffff9f24bd5a5f80 x1871643337586048/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 4696/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.657541:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a5f80 with x1871643337586048 ext(0->4206) 00002000:00010000:1.0:1784938450.657544:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24bd5a5f80 00000100:00100000:1.0:1784938450.657550:0:23337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337586560 00000100:00100000:1.0:1784938450.657552:0:23337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337586560 00002000:00100000:1.0:1784938450.657564:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000400:0x49:0x0] (0->4914) req@ffff9f24bd5a5c00 x1871643337586560/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 5408/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.657571:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a5c00 with x1871643337586560 ext(0->4914) 00002000:00010000:1.0:1784938450.657574:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24bd5a5c00 00000100:00100000:1.0:1784938450.657580:0:23337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337586304 00000100:00100000:1.0:1784938450.657582:0:23337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337586304 00002000:00100000:1.0:1784938450.657594:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000400:0x48:0x0] (0->703) req@ffff9f24bd5a4e00 x1871643337586304/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 1192/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.657601:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a4e00 with x1871643337586304 ext(0->703) 00002000:00010000:1.0:1784938450.657604:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24bd5a4e00 00000100:00100000:1.0:1784938450.657612:0:23337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 248 00000100:00100000:1.0:1784938450.657619:0:23337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7ea6e988-18ba-4c98-b179-17995571b98b+145:10959:x1871643337586432:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.657628:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 249 00000100:00100000:2.0:1784938450.657635:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7ea6e988-18ba-4c98-b179-17995571b98b+166:10959:x1871643337586048:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938450.657767:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 250 00000100:00100000:1.0:1784938450.657774:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7ea6e988-18ba-4c98-b179-17995571b98b+166:10959:x1871643337586560:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.657802:0:25747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 251 00000100:00100000:2.0:1784938450.657809:0:25747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7ea6e988-18ba-4c98-b179-17995571b98b+168:10958:x1871643337586304:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:3.0:1784938450.658080:0:25746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337586816 00000100:00100000:3.0:1784938450.658084:0:25746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337586816 00002000:00100000:3.0:1784938450.658103:0:25746:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000400:0x4a:0x0] (0->16000) req@ffff9f24bd5a6a00 x1871643337586816/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 16496/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.658110:0:25746:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a6a00 with x1871643337586816 ext(0->16000) 00002000:00010000:3.0:1784938450.658113:0:25746:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24bd5a6a00 00000100:00100000:3.0:1784938450.658123:0:25746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 252 00000100:00100000:3.0:1784938450.658130:0:25746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7ea6e988-18ba-4c98-b179-17995571b98b+173:10958:x1871643337586816:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:3.0:1784938450.658630:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938450.658911:0:25746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7ea6e988-18ba-4c98-b179-17995571b98b+175:10958:x1871643337586816:12345-192.168.202.54@tcp:4:cp.0 Request processed in 780us (1432us total) trans 4294967536 rc 0/0 00000100:00100000:3.0:1784938450.658921:0:25746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 252 00002000:00100000:3.0:1784938450.658928:0:25746:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000400:0x4a:0x0] (0->16000) req@ffff9f24bd5a6a00 x1871643337586816/t4294967536(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 16496/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.658936:0:25746:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a6a00 with x1871643337586816 ext(0->16000) 00002000:00010000:3.0:1784938450.658940:0:25746:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24bd5a6a00 00000100:00100000:3.0:1784938450.658955:0:25746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337586688 00000100:00100000:3.0:1784938450.658959:0:25746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337586688 00002000:00100000:3.0:1784938450.658974:0:25746:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000400:0x4a:0x0] (0->1612) req@ffff9f24bd5a4380 x1871643337586688/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2104/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.658982:0:25746:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a4380 with x1871643337586688 ext(0->1612) 00002000:00010000:3.0:1784938450.658993:0:25746:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24bd5a4380 00000100:00100000:3.0:1784938450.659004:0:25746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 253 00000100:00100000:3.0:1784938450.659015:0:25746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7ea6e988-18ba-4c98-b179-17995571b98b+148:10957:x1871643337586688:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:3.0:1784938450.659610:0:25746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7ea6e988-18ba-4c98-b179-17995571b98b+150:10957:x1871643337586688:12345-192.168.202.54@tcp:4:cp.0 Request processed in 599us (980us total) trans 4294967532 rc 0/0 00000100:00100000:3.0:1784938450.659617:0:25746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 253 00002000:00100000:3.0:1784938450.659623:0:25746:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000400:0x4a:0x0] (0->1612) req@ffff9f24bd5a4380 x1871643337586688/t4294967532(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2104/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.659631:0:25746:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a4380 with x1871643337586688 ext(0->1612) 00002000:00010000:3.0:1784938450.659635:0:25746:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24bd5a4380 00000100:00100000:2.0:1784938450.662787:0:25747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7ea6e988-18ba-4c98-b179-17995571b98b+174:10958:x1871643337586304:12345-192.168.202.54@tcp:4:cp.0 Request processed in 4965us (5330us total) trans 4294967535 rc 0/0 00000100:00100000:2.0:1784938450.662908:0:25747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 251 00002000:00100000:2.0:1784938450.662921:0:25747:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x280000400:0x48:0x0] (0->703) req@ffff9f24bd5a4e00 x1871643337586304/t4294967535(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 1192/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.662931:0:25747:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a4e00 with x1871643337586304 ext(0->703) 00002000:00010000:2.0:1784938450.662937:0:25747:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24bd5a4e00 00010000:00010000:2.0:1784938450.667887:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938450.668203:0:21155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7ea6e988-18ba-4c98-b179-17995571b98b+149:10957:x1871643337585664:12345-192.168.202.54@tcp:4:cp.0 Request processed in 11495us (11814us total) trans 4294967530 rc 0/0 00000100:00100000:0.0:1784938450.668203:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7ea6e988-18ba-4c98-b179-17995571b98b+173:10959:x1871643337586048:12345-192.168.202.54@tcp:4:cp.0 Request processed in 10560us (10811us total) trans 4294967533 rc 0/0 00000100:00100000:3.0:1784938450.668216:0:21155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 244 00002000:00100000:3.0:1784938450.668240:0:21155:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x46:0x0] (0->673) req@ffff9f2482b2b480 x1871643337585664/t4294967530(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 1168/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784938450.668241:0:23337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7ea6e988-18ba-4c98-b179-17995571b98b+149:10959:x1871643337586432:12345-192.168.202.54@tcp:4:cp.0 Request processed in 10620us (10894us total) trans 4294967531 rc 0/0 00002000:00100000:3.0:1784938450.668250:0:21155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2482b2b480 with x1871643337585664 ext(0->673) 00002000:00010000:3.0:1784938450.668260:0:21155:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2482b2b480 00000100:00100000:0.0:1784938450.668261:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 249 00002000:00100000:0.0:1784938450.668276:0:23333:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0x47:0x0] (0->4206) req@ffff9f24bd5a5f80 x1871643337586048/t4294967533(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 4696/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.668284:0:23333:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a5f80 with x1871643337586048 ext(0->4206) 00002000:00010000:0.0:1784938450.668288:0:23333:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24bd5a5f80 00000100:00100000:0.0:1784938450.668373:0:21156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7ea6e988-18ba-4c98-b179-17995571b98b+148:10959:x1871643337585920:12345-192.168.202.54@tcp:4:cp.0 Request processed in 11059us (11140us total) trans 4294967529 rc 0/0 00000100:00100000:0.0:1784938450.668381:0:21156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 247 00002000:00100000:0.0:1784938450.668387:0:21156:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x47:0x0] (0->2658) req@ffff9f2482b28a80 x1871643337585920/t4294967529(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 3152/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.668395:0:21156:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2482b28a80 with x1871643337585920 ext(0->2658) 00002000:00010000:0.0:1784938450.668399:0:21156:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2482b28a80 00000100:00100000:3.0:1784938450.668429:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7ea6e988-18ba-4c98-b179-17995571b98b+172:10958:x1871643337585792:12345-192.168.202.54@tcp:4:cp.0 Request processed in 11525us (11620us total) trans 4294967532 rc 0/0 00000100:00100000:3.0:1784938450.668436:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 246 00002000:00100000:3.0:1784938450.668442:0:23327:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x46:0x0] (0->9197) req@ffff9f2482b29500 x1871643337585792/t4294967532(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 9688/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784938450.668446:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7ea6e988-18ba-4c98-b179-17995571b98b+172:10959:x1871643337586560:12345-192.168.202.54@tcp:4:cp.0 Request processed in 10673us (11030us total) trans 4294967534 rc 0/0 00002000:00100000:3.0:1784938450.668450:0:23327:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2482b29500 with x1871643337585792 ext(0->9197) 00000100:00100000:0.0:1784938450.668452:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 250 00002000:00010000:3.0:1784938450.668454:0:23327:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2482b29500 00002000:00100000:0.0:1784938450.668457:0:23334:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0x49:0x0] (0->4914) req@ffff9f24bd5a5c00 x1871643337586560/t4294967534(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 5408/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.668465:0:23334:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a5c00 with x1871643337586560 ext(0->4914) 00002000:00010000:0.0:1784938450.668468:0:23334:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24bd5a5c00 00000100:00100000:1.0:1784938450.668582:0:23337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 248 00002000:00100000:1.0:1784938450.668591:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0x49:0x0] (0->1753) req@ffff9f24bd5a6d80 x1871643337586432/t4294967531(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2248/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.668599:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a6d80 with x1871643337586432 ext(0->1753) 00002000:00010000:1.0:1784938450.668602:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24bd5a6d80 00000100:00100000:3.0:1784938450.678337:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938450.678409:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.678433:0:25746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337588096 00000100:00100000:3.0:1784938450.678436:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.678443:0:25746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337588096 00000100:00100000:3.0:1784938450.678459:0:25747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337588352 00000100:00100000:3.0:1784938450.678463:0:25747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337588352 00002000:00100000:3.0:1784938450.678490:0:25747:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x2c0000400:0x5e:0x0] (0->143466) req@ffff9f24bd5a4000 x1871643337588352/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.678501:0:25747:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a4000 with x1871643337588352 ext(0->143466) 00002000:00010000:3.0:1784938450.678507:0:25747:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24bd5a4000 00000100:00100000:3.0:1784938450.678531:0:21155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337588480 00000100:00100000:3.0:1784938450.678535:0:21155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337588480 00002000:00100000:3.0:1784938450.678551:0:21155:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5f:0x0] (0->215292) req@ffff9f24bd5a4700 x1871643337588480/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.678559:0:21155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a4700 with x1871643337588480 ext(0->215292) 00002000:00010000:3.0:1784938450.678564:0:21155:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24bd5a4700 00000100:00100000:0.0:1784938450.678574:0:23335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 254 00000100:00100000:3.0:1784938450.678580:0:21155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 255 00000100:00100000:3.0:1784938450.678585:0:21155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7ea6e988-18ba-4c98-b179-17995571b98b+172:10959:x1871643337588480:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.678585:0:23335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7ea6e988-18ba-4c98-b179-17995571b98b+147:10958:x1871643337588352:12345-192.168.202.54@tcp:4:cp.0 00002000:00100000:2.0:1784938450.679580:0:25746:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000400:0x5e:0x0] (0->170594) req@ffff9f24bd5a6680 x1871643337588096/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.679590:0:25746:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a6680 with x1871643337588096 ext(0->170594) 00002000:00010000:2.0:1784938450.679595:0:25746:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24bd5a6680 00000100:00100000:2.0:1784938450.679622:0:21156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 256 00000100:00100000:2.0:1784938450.679632:0:21156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7ea6e988-18ba-4c98-b179-17995571b98b+175:10959:x1871643337588096:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.680298:0:23329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7ea6e988-18ba-4c98-b179-17995571b98b+149:10959:x1871643337585408:12345-192.168.202.54@tcp:4:cp.0 Request processed in 23760us (23976us total) trans 4294967533 rc 0/0 00000100:00100000:0.0:1784938450.680311:0:23329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 243 00002000:00100000:0.0:1784938450.680319:0:23329:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x45:0x0] (0->39342) req@ffff9f2482b28380 x1871643337585408/t4294967533(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.680327:0:23329:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2482b28380 with x1871643337585408 ext(0->39342) 00002000:00010000:0.0:1784938450.680331:0:23329:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2482b28380 00000100:00100000:1.0:1784938450.681377:0:21157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7ea6e988-18ba-4c98-b179-17995571b98b+149:10959:x1871643337584896:12345-192.168.202.54@tcp:4:cp.0 Request processed in 28864us (29280us total) trans 4294967534 rc 0/0 00000100:00100000:1.0:1784938450.681386:0:21157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 241 00002000:00100000:1.0:1784938450.681394:0:21157:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x43:0x0] (0->391199) req@ffff9f2482b2b100 x1871643337584896/t4294967534(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.681401:0:21157:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2482b2b100 with x1871643337584896 ext(0->391199) 00002000:00010000:1.0:1784938450.681405:0:21157:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2482b2b100 00000100:00100000:3.0:1784938450.681571:0:23328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7ea6e988-18ba-4c98-b179-17995571b98b+175:10958:x1871643337585280:12345-192.168.202.54@tcp:4:cp.0 Request processed in 28555us (29394us total) trans 4294967537 rc 0/0 00000100:00100000:3.0:1784938450.681579:0:23328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 242 00002000:00100000:3.0:1784938450.681585:0:23328:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x44:0x0] (0->38516) req@ffff9f2482b2aa00 x1871643337585280/t4294967537(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.681593:0:23328:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2482b2aa00 with x1871643337585280 ext(0->38516) 00002000:00010000:3.0:1784938450.681597:0:23328:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2482b2aa00 00000100:00100000:0.0:1784938450.682866:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.682944:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.682979:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.683007:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.683026:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.683039:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.683058:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.683077:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.683094:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.683113:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.683197:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.683216:0:25746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337588608 00000100:00100000:2.0:1784938450.683223:0:25746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337588608 00002000:00100000:2.0:1784938450.683258:0:25746:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000400:0x5f:0x0] (0->31710) req@ffff9f2388245880 x1871643337588608/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.683278:0:25746:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2388245880 with x1871643337588608 ext(0->31710) 00002000:00010000:2.0:1784938450.683283:0:25746:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2388245880 00000100:00100000:3.0:1784938450.683288:0:23328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337586944 00000100:00100000:3.0:1784938450.683291:0:23328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337586944 00000100:00100000:2.0:1784938450.683296:0:25746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337587072 00000100:00100000:2.0:1784938450.683298:0:25746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337587072 00002000:00100000:3.0:1784938450.683308:0:23328:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x52:0x0] (0->7184) req@ffff9f24b37c8380 x1871643337586944/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 7680/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.683310:0:25746:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000400:0x4b:0x0] (0->2857) req@ffff9f24b37cb800 x1871643337587072/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 3352/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.683317:0:23328:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37c8380 with x1871643337586944 ext(0->7184) 00002000:00100000:2.0:1784938450.683318:0:25746:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37cb800 with x1871643337587072 ext(0->2857) 00002000:00010000:3.0:1784938450.683322:0:23328:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b37c8380 00002000:00010000:2.0:1784938450.683322:0:25746:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b37cb800 00000100:00100000:3.0:1784938450.683329:0:23328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337587456 00000100:00100000:2.0:1784938450.683329:0:25746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337587200 00000100:00100000:3.0:1784938450.683331:0:23328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337587456 00000100:00100000:2.0:1784938450.683331:0:25746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337587200 00002000:00100000:3.0:1784938450.683343:0:23328:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x53:0x0] (0->8440) req@ffff9f24b37c8e00 x1871643337587456/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 8936/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.683343:0:25746:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000400:0x5b:0x0] (0->1653) req@ffff9f24b37cb100 x1871643337587200/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2144/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.683352:0:23328:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37c8e00 with x1871643337587456 ext(0->8440) 00002000:00100000:2.0:1784938450.683352:0:25746:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37cb100 with x1871643337587200 ext(0->1653) 00002000:00010000:3.0:1784938450.683356:0:23328:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b37c8e00 00002000:00010000:2.0:1784938450.683356:0:25746:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b37cb100 00000100:00100000:3.0:1784938450.683362:0:23328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337587712 00000100:00100000:2.0:1784938450.683362:0:25746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337587328 00000100:00100000:3.0:1784938450.683364:0:23328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337587712 00000100:00100000:2.0:1784938450.683364:0:25746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337587328 00002000:00100000:3.0:1784938450.683375:0:23328:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x4f:0x0] (0->6212) req@ffff9f24b37c9880 x1871643337587712/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 6704/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.683375:0:25746:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000400:0x5b:0x0] (0->854) req@ffff9f24b37c9500 x1871643337587328/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 1344/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.683383:0:25746:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37c9500 with x1871643337587328 ext(0->854) 00002000:00010000:2.0:1784938450.683387:0:25746:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b37c9500 00002000:00100000:3.0:1784938450.683390:0:23328:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37c9880 with x1871643337587712 ext(0->6212) 00000100:00100000:2.0:1784938450.683392:0:25746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337587584 00002000:00010000:3.0:1784938450.683394:0:23328:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b37c9880 00000100:00100000:2.0:1784938450.683394:0:25746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337587584 00000100:00100000:3.0:1784938450.683399:0:23328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337587840 00000100:00100000:3.0:1784938450.683401:0:23328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337587840 00002000:00100000:2.0:1784938450.683404:0:25746:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000400:0x5c:0x0] (0->4749) req@ffff9f24b37c9f80 x1871643337587584/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 5240/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.683410:0:23328:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x4f:0x0] (0->6812) req@ffff9f24b37c8700 x1871643337587840/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 7304/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.683411:0:25746:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37c9f80 with x1871643337587584 ext(0->4749) 00002000:00010000:2.0:1784938450.683414:0:25746:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b37c9f80 00002000:00100000:3.0:1784938450.683418:0:23328:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37c8700 with x1871643337587840 ext(0->6812) 00000100:00100000:2.0:1784938450.683419:0:25746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337587968 00000100:00100000:2.0:1784938450.683420:0:25746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337587968 00002000:00010000:3.0:1784938450.683421:0:23328:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b37c8700 00000100:00100000:3.0:1784938450.683425:0:23328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337588224 00000100:00100000:3.0:1784938450.683427:0:23328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337588224 00002000:00100000:2.0:1784938450.683430:0:25746:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000400:0x54:0x0] (0->6429) req@ffff9f24b37cbb80 x1871643337587968/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 6920/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.683436:0:23328:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x54:0x0] (0->1693) req@ffff9f24b37c9c00 x1871643337588224/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2184/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.683438:0:25746:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37cbb80 with x1871643337587968 ext(0->6429) 00002000:00010000:2.0:1784938450.683441:0:25746:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b37cbb80 00002000:00100000:3.0:1784938450.683444:0:23328:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37c9c00 with x1871643337588224 ext(0->1693) 00002000:00010000:3.0:1784938450.683447:0:23328:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b37c9c00 00000100:00100000:2.0:1784938450.683450:0:25746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 257 00000100:00100000:2.0:1784938450.683457:0:25746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388245880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7ea6e988-18ba-4c98-b179-17995571b98b+155:10960:x1871643337588608:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:3.0:1784938450.683639:0:23328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 258 00000100:00100000:3.0:1784938450.683646:0:23328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7ea6e988-18ba-4c98-b179-17995571b98b+180:10960:x1871643337587072:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:3.0:1784938450.683871:0:25747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 259 00000100:00100000:3.0:1784938450.683879:0:25747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7ea6e988-18ba-4c98-b179-17995571b98b+182:10959:x1871643337586944:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.684647:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 260 00000100:00100000:0.0:1784938450.684658:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7ea6e988-18ba-4c98-b179-17995571b98b+156:10960:x1871643337587456:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.684901:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 261 00000100:00100000:0.0:1784938450.684907:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7ea6e988-18ba-4c98-b179-17995571b98b+182:10957:x1871643337587200:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.685069:0:23329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 262 00000100:00100000:0.0:1784938450.685074:0:23329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7ea6e988-18ba-4c98-b179-17995571b98b+158:10957:x1871643337587328:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.685256:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 263 00000100:00100000:0.0:1784938450.685273:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7ea6e988-18ba-4c98-b179-17995571b98b+184:10958:x1871643337587712:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938450.685592:0:23337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 264 00000100:00100000:1.0:1784938450.685602:0:23337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7ea6e988-18ba-4c98-b179-17995571b98b+186:10960:x1871643337587584:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:3.0:1784938450.687040:0:23328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7ea6e988-18ba-4c98-b179-17995571b98b+186:10960:x1871643337587072:12345-192.168.202.54@tcp:4:cp.0 Request processed in 3388us (4053us total) trans 4294967538 rc 0/0 00000100:00100000:3.0:1784938450.687051:0:23328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 258 00002000:00100000:3.0:1784938450.687061:0:23328:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x4b:0x0] (0->2857) req@ffff9f24b37cb800 x1871643337587072/t4294967538(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 3352/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.687076:0:23328:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37cb800 with x1871643337587072 ext(0->2857) 00002000:00010000:3.0:1784938450.687082:0:23328:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b37cb800 00000100:00100000:3.0:1784938450.687109:0:23328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 265 00000100:00100000:3.0:1784938450.687117:0:23328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7ea6e988-18ba-4c98-b179-17995571b98b+160:10957:x1871643337587840:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.687412:0:25745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7ea6e988-18ba-4c98-b179-17995571b98b+159:10957:x1871643337586176:12345-192.168.202.54@tcp:4:cp.0 Request processed in 30699us (30788us total) trans 4294967535 rc 0/0 00000100:00100000:0.0:1784938450.687419:0:25745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 245 00002000:00100000:0.0:1784938450.687426:0:25745:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000400:0x48:0x0] (0->28244) req@ffff9f24b37ca300 x1871643337586176/t4294967535(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.687434:0:25745:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37ca300 with x1871643337586176 ext(0->28244) 00002000:00010000:0.0:1784938450.687438:0:25745:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b37ca300 00000100:00100000:0.0:1784938450.687462:0:25745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 266 00000100:00100000:0.0:1784938450.687469:0:25745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7ea6e988-18ba-4c98-b179-17995571b98b+185:10959:x1871643337587968:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938450.688348:0:23337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7ea6e988-18ba-4c98-b179-17995571b98b+189:10960:x1871643337587584:12345-192.168.202.54@tcp:4:cp.0 Request processed in 2746us (5268us total) trans 4294967542 rc 0/0 00000100:00100000:1.0:1784938450.688356:0:23337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 264 00002000:00100000:1.0:1784938450.688363:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000400:0x5c:0x0] (0->4749) req@ffff9f24b37c9f80 x1871643337587584/t4294967542(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 5240/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.688372:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37c9f80 with x1871643337587584 ext(0->4749) 00002000:00010000:1.0:1784938450.688376:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b37c9f80 00000100:00100000:1.0:1784938450.688391:0:23337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 267 00000100:00100000:1.0:1784938450.688399:0:23337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7ea6e988-18ba-4c98-b179-17995571b98b+158:10958:x1871643337588224:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.689713:0:23337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7ea6e988-18ba-4c98-b179-17995571b98b+160:10958:x1871643337588224:12345-192.168.202.54@tcp:4:cp.0 Request processed in 1309us (6510us total) trans 4294967538 rc 0/0 00000100:00100000:2.0:1784938450.689723:0:23337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 267 00002000:00100000:2.0:1784938450.689730:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0x54:0x0] (0->1693) req@ffff9f24b37c9c00 x1871643337588224/t4294967538(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2184/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.689738:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37c9c00 with x1871643337588224 ext(0->1693) 00002000:00010000:2.0:1784938450.689743:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b37c9c00 00000100:00100000:0.0:1784938450.689948:0:23329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7ea6e988-18ba-4c98-b179-17995571b98b+159:10957:x1871643337587328:12345-192.168.202.54@tcp:4:cp.0 Request processed in 4870us (6905us total) trans 4294967537 rc 0/0 00000100:00100000:0.0:1784938450.689955:0:23329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 262 00002000:00100000:0.0:1784938450.689971:0:23329:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x5b:0x0] (0->854) req@ffff9f24b37c9500 x1871643337587328/t4294967537(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 1344/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.689980:0:23329:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37c9500 with x1871643337587328 ext(0->854) 00002000:00010000:0.0:1784938450.689985:0:23329:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b37c9500 00000100:00100000:0.0:1784938450.690026:0:25745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7ea6e988-18ba-4c98-b179-17995571b98b+190:10959:x1871643337587968:12345-192.168.202.54@tcp:4:cp.0 Request processed in 2557us (6912us total) trans 4294967541 rc 0/0 00000100:00100000:0.0:1784938450.690033:0:25745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 266 00002000:00100000:0.0:1784938450.690039:0:25745:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000400:0x54:0x0] (0->6429) req@ffff9f24b37cbb80 x1871643337587968/t4294967541(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 6920/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.690046:0:25745:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37cbb80 with x1871643337587968 ext(0->6429) 00002000:00010000:0.0:1784938450.690050:0:25745:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b37cbb80 00000100:00100000:0.0:1784938450.690087:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7ea6e988-18ba-4c98-b179-17995571b98b+189:10957:x1871643337587200:12345-192.168.202.54@tcp:4:cp.0 Request processed in 5179us (7078us total) trans 4294967539 rc 0/0 00000100:00100000:0.0:1784938450.690097:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 261 00002000:00100000:0.0:1784938450.690103:0:23327:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x5b:0x0] (0->1653) req@ffff9f24b37cb100 x1871643337587200/t4294967539(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2144/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.690110:0:23327:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37cb100 with x1871643337587200 ext(0->1653) 00002000:00010000:0.0:1784938450.690114:0:23327:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b37cb100 00000100:00100000:0.0:1784938450.690162:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7ea6e988-18ba-4c98-b179-17995571b98b+188:10958:x1871643337587712:12345-192.168.202.54@tcp:4:cp.0 Request processed in 4900us (7103us total) trans 4294967540 rc 0/0 00000100:00100000:0.0:1784938450.690166:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 263 00002000:00100000:0.0:1784938450.690170:0:23333:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0x4f:0x0] (0->6212) req@ffff9f24b37c9880 x1871643337587712/t4294967540(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 6704/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.690174:0:23333:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37c9880 with x1871643337587712 ext(0->6212) 00002000:00010000:0.0:1784938450.690177:0:23333:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b37c9880 00000100:00100000:1.0:1784938450.690301:0:25747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7ea6e988-18ba-4c98-b179-17995571b98b+187:10959:x1871643337586944:12345-192.168.202.54@tcp:4:cp.0 Request processed in 6422us (7357us total) trans 4294967543 rc 0/0 00000100:00100000:1.0:1784938450.690307:0:25747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 259 00002000:00100000:1.0:1784938450.690311:0:25747:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x280000400:0x52:0x0] (0->7184) req@ffff9f24b37c8380 x1871643337586944/t4294967543(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 7680/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.690316:0:25747:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37c8380 with x1871643337586944 ext(0->7184) 00002000:00010000:1.0:1784938450.690318:0:25747:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b37c8380 00000100:00100000:2.0:1784938450.690384:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7ea6e988-18ba-4c98-b179-17995571b98b+158:10960:x1871643337587456:12345-192.168.202.54@tcp:4:cp.0 Request processed in 5729us (7356us total) trans 4294967536 rc 0/0 00000100:00100000:2.0:1784938450.690391:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 260 00002000:00100000:2.0:1784938450.690396:0:23334:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0x53:0x0] (0->8440) req@ffff9f24b37c8e00 x1871643337587456/t4294967536(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 8936/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.690403:0:23334:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37c8e00 with x1871643337587456 ext(0->8440) 00002000:00010000:2.0:1784938450.690406:0:23334:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b37c8e00 00000100:00100000:2.0:1784938450.691277:0:23328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7ea6e988-18ba-4c98-b179-17995571b98b+159:10957:x1871643337587840:12345-192.168.202.54@tcp:4:cp.0 Request processed in 4149us (8169us total) trans 4294967539 rc 0/0 00000100:00100000:2.0:1784938450.691286:0:23328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 265 00002000:00100000:2.0:1784938450.691292:0:23328:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x4f:0x0] (0->6812) req@ffff9f24b37c8700 x1871643337587840/t4294967539(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 7304/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.691303:0:23328:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37c8700 with x1871643337587840 ext(0->6812) 00002000:00010000:2.0:1784938450.691307:0:23328:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b37c8700 00000100:00100000:0.0:1784938450.702606:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938450.702811:0:23331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337588992 00000100:00100000:1.0:1784938450.702821:0:23331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337588992 00000100:00100000:0.0:1784938450.702846:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00002000:00100000:1.0:1784938450.702875:0:23331:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0x61:0x0] (0->159677) req@ffff9f2388246680 x1871643337588992/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.702886:0:23331:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2388246680 with x1871643337588992 ext(0->159677) 00002000:00010000:1.0:1784938450.702891:0:23331:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2388246680 00000100:00100000:1.0:1784938450.702912:0:23331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337589248 00000100:00100000:1.0:1784938450.702915:0:23331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337589248 00002000:00100000:1.0:1784938450.702930:0:23331:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0x62:0x0] (0->254128) req@ffff9f2388245c00 x1871643337589248/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.702938:0:23331:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2388245c00 with x1871643337589248 ext(0->254128) 00002000:00010000:1.0:1784938450.702942:0:23331:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2388245c00 00000100:00100000:1.0:1784938450.702962:0:23331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 268 00000100:00100000:1.0:1784938450.702972:0:23331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7ea6e988-18ba-4c98-b179-17995571b98b+188:10959:x1871643337588992:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.703220:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.703237:0:25745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337588864 00000100:00100000:0.0:1784938450.703241:0:25745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337588864 00002000:00100000:0.0:1784938450.703260:0:25745:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000400:0x50:0x0] (0->233) req@ffff9f2388245f80 x1871643337588864/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 728/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.703279:0:25745:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2388245f80 with x1871643337588864 ext(0->233) 00002000:00010000:0.0:1784938450.703283:0:25745:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2388245f80 00000100:00100000:0.0:1784938450.703299:0:25745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 269 00000100:00100000:0.0:1784938450.703305:0:25745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7ea6e988-18ba-4c98-b179-17995571b98b+190:10957:x1871643337589248:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938450.703323:0:23329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 270 00000100:00100000:1.0:1784938450.703330:0:23329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7ea6e988-18ba-4c98-b179-17995571b98b+190:10957:x1871643337588864:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938450.703694:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.703738:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337589504 00000100:00100000:0.0:1784938450.703743:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337589504 00000100:00100000:1.0:1784938450.703749:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00002000:00100000:0.0:1784938450.703763:0:23333:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0x60:0x0] (0->198049) req@ffff9f2482b28e00 x1871643337589504/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784938450.703768:0:25747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337589760 00000100:00100000:1.0:1784938450.703772:0:25747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337589760 00002000:00100000:0.0:1784938450.703772:0:23333:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2482b28e00 with x1871643337589504 ext(0->198049) 00002000:00010000:0.0:1784938450.703776:0:23333:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2482b28e00 00002000:00100000:1.0:1784938450.703788:0:25747:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x2c0000400:0x61:0x0] (0->227515) req@ffff9f2482b2b800 x1871643337589760/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784938450.703793:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 271 00002000:00100000:1.0:1784938450.703796:0:25747:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2482b2b800 with x1871643337589760 ext(0->227515) 00000100:00100000:0.0:1784938450.703799:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7ea6e988-18ba-4c98-b179-17995571b98b+160:10959:x1871643337589504:12345-192.168.202.54@tcp:4:cp.0 00002000:00010000:1.0:1784938450.703800:0:25747:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2482b2b800 00000100:00100000:1.0:1784938450.703819:0:23328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 272 00000100:00100000:1.0:1784938450.703825:0:23328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7ea6e988-18ba-4c98-b179-17995571b98b+160:10957:x1871643337589760:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.706161:0:21156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7ea6e988-18ba-4c98-b179-17995571b98b+194:10959:x1871643337588096:12345-192.168.202.54@tcp:4:cp.0 Request processed in 26506us (27811us total) trans 4294967545 rc 0/0 00000100:00100000:2.0:1784938450.706175:0:21156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 256 00002000:00100000:2.0:1784938450.706188:0:21156:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5e:0x0] (0->170594) req@ffff9f24bd5a6680 x1871643337588096/t4294967545(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.706197:0:21156:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a6680 with x1871643337588096 ext(0->170594) 00002000:00010000:2.0:1784938450.706204:0:21156:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24bd5a6680 00000100:00100000:2.0:1784938450.706372:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.706421:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.706439:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.706459:0:21157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337589632 00000100:00100000:2.0:1784938450.706465:0:21157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337589632 00002000:00100000:2.0:1784938450.706491:0:21157:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x50:0x0] (0->268) req@ffff9f24b37ca680 x1871643337589632/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 760/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.706499:0:21157:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37ca680 with x1871643337589632 ext(0->268) 00002000:00010000:2.0:1784938450.706504:0:21157:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b37ca680 00000100:00100000:2.0:1784938450.706523:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337589120 00000100:00100000:2.0:1784938450.706526:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337589120 00002000:00100000:2.0:1784938450.706542:0:23334:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0x56:0x0] (0->13878) req@ffff9f24b37caa00 x1871643337589120/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 14368/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.706550:0:23334:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37caa00 with x1871643337589120 ext(0->13878) 00002000:00010000:2.0:1784938450.706553:0:23334:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b37caa00 00000100:00100000:2.0:1784938450.706565:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337589888 00000100:00100000:2.0:1784938450.706567:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337589888 00002000:00100000:2.0:1784938450.706581:0:23334:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0x56:0x0] (0->35426) req@ffff9f24b37c9180 x1871643337589888/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.706589:0:23334:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37c9180 with x1871643337589888 ext(0->35426) 00002000:00010000:2.0:1784938450.706592:0:23334:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b37c9180 00000100:00100000:2.0:1784938450.706610:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 273 00000100:00100000:2.0:1784938450.706618:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7ea6e988-18ba-4c98-b179-17995571b98b+166:10959:x1871643337589632:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.706894:0:21156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 274 00000100:00100000:2.0:1784938450.706902:0:21156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7ea6e988-18ba-4c98-b179-17995571b98b+194:10959:x1871643337589120:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.707104:0:21157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 275 00000100:00100000:2.0:1784938450.707111:0:21157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7ea6e988-18ba-4c98-b179-17995571b98b+168:10957:x1871643337589888:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.707409:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.707437:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.707468:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.707491:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.709419:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337588736 00000100:00100000:0.0:1784938450.709432:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337588736 00002000:00100000:0.0:1784938450.709477:0:23327:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x60:0x0] (0->10933) req@ffff9f24b37c8a80 x1871643337588736/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 11424/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.709489:0:23327:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37c8a80 with x1871643337588736 ext(0->10933) 00002000:00010000:0.0:1784938450.709494:0:23327:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b37c8a80 00000100:00100000:0.0:1784938450.709510:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337590016 00000100:00100000:0.0:1784938450.709513:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337590016 00002000:00100000:0.0:1784938450.709528:0:23327:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x64:0x0] (0->1179442) req@ffff9f24b37cb480 x1871643337590016/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.709537:0:23327:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37cb480 with x1871643337590016 ext(0->1179442) 00002000:00010000:0.0:1784938450.709540:0:23327:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b37cb480 00000100:00100000:0.0:1784938450.709548:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337589376 00000100:00100000:0.0:1784938450.709550:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337589376 00002000:00100000:0.0:1784938450.709566:0:23327:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x4c:0x0] (0->4217) req@ffff9f24b3f3f800 x1871643337589376/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 4712/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.709573:0:23327:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b3f3f800 with x1871643337589376 ext(0->4217) 00002000:00010000:0.0:1784938450.709577:0:23327:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b3f3f800 00000100:00100000:0.0:1784938450.709584:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337590144 00000100:00100000:0.0:1784938450.709587:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337590144 00002000:00100000:0.0:1784938450.709601:0:23327:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x62:0x0] (0->88086) req@ffff9f24b3f3ca80 x1871643337590144/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.709608:0:23327:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b3f3ca80 with x1871643337590144 ext(0->88086) 00002000:00010000:0.0:1784938450.709611:0:23327:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b3f3ca80 00000100:00100000:0.0:1784938450.709624:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 276 00000100:00100000:0.0:1784938450.709632:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7ea6e988-18ba-4c98-b179-17995571b98b+199:10957:x1871643337588736:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.711504:0:23335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7ea6e988-18ba-4c98-b179-17995571b98b+171:10958:x1871643337588352:12345-192.168.202.54@tcp:4:cp.0 Request processed in 32914us (33087us total) trans 4294967540 rc 0/0 00000100:00100000:0.0:1784938450.711516:0:23335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 254 00002000:00100000:0.0:1784938450.711526:0:23335:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0x5e:0x0] (0->143466) req@ffff9f24bd5a4000 x1871643337588352/t4294967540(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.711536:0:23335:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a4000 with x1871643337588352 ext(0->143466) 00002000:00010000:0.0:1784938450.711541:0:23335:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24bd5a4000 00000100:00100000:0.0:1784938450.711563:0:23335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 277 00000100:00100000:0.0:1784938450.711570:0:23335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7ea6e988-18ba-4c98-b179-17995571b98b+201:10959:x1871643337590016:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:3.0:1784938450.713056:0:25746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388245880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7ea6e988-18ba-4c98-b179-17995571b98b+169:10960:x1871643337588608:12345-192.168.202.54@tcp:4:cp.0 Request processed in 29592us (30188us total) trans 4294967542 rc 0/0 00000100:00100000:3.0:1784938450.713067:0:25746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 257 00002000:00100000:3.0:1784938450.713075:0:25746:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000400:0x5f:0x0] (0->31710) req@ffff9f2388245880 x1871643337588608/t4294967542(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.713085:0:25746:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2388245880 with x1871643337588608 ext(0->31710) 00002000:00010000:3.0:1784938450.713089:0:25746:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2388245880 00000100:00100000:3.0:1784938450.713111:0:25746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 278 00000100:00100000:3.0:1784938450.713120:0:25746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7ea6e988-18ba-4c98-b179-17995571b98b+203:10957:x1871643337589376:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:3.0:1784938450.713738:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938450.713958:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.722940:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7ea6e988-18ba-4c98-b179-17995571b98b+208:10957:x1871643337588736:12345-192.168.202.54@tcp:4:cp.0 Request processed in 13297us (15520us total) trans 4294967547 rc 0/0 00000100:00100000:0.0:1784938450.722955:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 276 00002000:00100000:0.0:1784938450.722968:0:23327:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x60:0x0] (0->10933) req@ffff9f24b37c8a80 x1871643337588736/t4294967547(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 11424/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.722978:0:23327:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37c8a80 with x1871643337588736 ext(0->10933) 00002000:00010000:0.0:1784938450.722985:0:23327:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b37c8a80 00000100:00100000:0.0:1784938450.723012:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337590272 00000100:00100000:0.0:1784938450.723020:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337590272 00002000:00100000:0.0:1784938450.723053:0:23327:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x4c:0x0] (0->18268) req@ffff9f24bd5a7800 x1871643337590272/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.723061:0:23327:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a7800 with x1871643337590272 ext(0->18268) 00002000:00010000:0.0:1784938450.723065:0:23327:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24bd5a7800 00000100:00100000:0.0:1784938450.723079:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337590400 00000100:00100000:0.0:1784938450.723082:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337590400 00002000:00100000:0.0:1784938450.723095:0:23327:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x64:0x0] (0->26715) req@ffff9f24bd5a5880 x1871643337590400/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.723103:0:23327:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a5880 with x1871643337590400 ext(0->26715) 00002000:00010000:0.0:1784938450.723106:0:23327:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24bd5a5880 00000100:00100000:0.0:1784938450.723119:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 279 00000100:00100000:0.0:1784938450.723127:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7ea6e988-18ba-4c98-b179-17995571b98b+170:10959:x1871643337590144:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:3.0:1784938450.723766:0:21156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7ea6e988-18ba-4c98-b179-17995571b98b+207:10959:x1871643337589120:12345-192.168.202.54@tcp:4:cp.0 Request processed in 16862us (17342us total) trans 4294967546 rc 0/0 00000100:00100000:3.0:1784938450.723775:0:21156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 274 00002000:00100000:3.0:1784938450.723782:0:21156:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x56:0x0] (0->13878) req@ffff9f24b37caa00 x1871643337589120/t4294967546(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 14368/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.723790:0:21156:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37caa00 with x1871643337589120 ext(0->13878) 00002000:00010000:3.0:1784938450.723795:0:21156:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b37caa00 00000100:00100000:3.0:1784938450.723815:0:21156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 280 00000100:00100000:3.0:1784938450.723823:0:21156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7ea6e988-18ba-4c98-b179-17995571b98b+170:10957:x1871643337590272:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:3.0:1784938450.723959:0:21155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7ea6e988-18ba-4c98-b179-17995571b98b+205:10959:x1871643337588480:12345-192.168.202.54@tcp:4:cp.0 Request processed in 45372us (45521us total) trans 4294967548 rc 0/0 00000100:00100000:3.0:1784938450.723967:0:21155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 255 00002000:00100000:3.0:1784938450.723976:0:21155:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5f:0x0] (0->215292) req@ffff9f24bd5a4700 x1871643337588480/t4294967548(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.723983:0:21155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a4700 with x1871643337588480 ext(0->215292) 00002000:00010000:3.0:1784938450.723987:0:21155:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24bd5a4700 00000100:00100000:3.0:1784938450.724004:0:21155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 281 00000100:00100000:3.0:1784938450.724011:0:21155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7ea6e988-18ba-4c98-b179-17995571b98b+171:10958:x1871643337590400:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:3.0:1784938450.724125:0:25746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7ea6e988-18ba-4c98-b179-17995571b98b+204:10957:x1871643337589376:12345-192.168.202.54@tcp:4:cp.0 Request processed in 11006us (16655us total) trans 4294967549 rc 0/0 00000100:00100000:3.0:1784938450.724132:0:25746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 278 00002000:00100000:3.0:1784938450.724138:0:25746:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000400:0x4c:0x0] (0->4217) req@ffff9f24b3f3f800 x1871643337589376/t4294967549(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 4712/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.724162:0:25746:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b3f3f800 with x1871643337589376 ext(0->4217) 00002000:00010000:3.0:1784938450.724166:0:25746:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b3f3f800 00000100:00100000:3.0:1784938450.725363:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938450.725499:0:25746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337590784 00000100:00100000:3.0:1784938450.725505:0:25746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337590784 00002000:00100000:3.0:1784938450.725534:0:25746:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000400:0x66:0x0] (0->24287) req@ffff9f24bd5a7b80 x1871643337590784/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.725544:0:25746:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a7b80 with x1871643337590784 ext(0->24287) 00002000:00010000:3.0:1784938450.725549:0:25746:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24bd5a7b80 00000100:00100000:3.0:1784938450.725574:0:23337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 282 00000100:00100000:3.0:1784938450.725581:0:23337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7ea6e988-18ba-4c98-b179-17995571b98b+174:10958:x1871643337590784:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938450.725909:0:23329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7ea6e988-18ba-4c98-b179-17995571b98b+203:10957:x1871643337588864:12345-192.168.202.54@tcp:4:cp.0 Request processed in 22577us (22688us total) trans 4294967544 rc 0/0 00000100:00100000:1.0:1784938450.725918:0:23329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 270 00002000:00100000:1.0:1784938450.725925:0:23329:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x50:0x0] (0->233) req@ffff9f2388245f80 x1871643337588864/t4294967544(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 728/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.725932:0:23329:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2388245f80 with x1871643337588864 ext(0->233) 00002000:00010000:1.0:1784938450.725936:0:23329:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2388245f80 00000100:00100000:0.0:1784938450.729978:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7ea6e988-18ba-4c98-b179-17995571b98b+176:10959:x1871643337589504:12345-192.168.202.54@tcp:4:cp.0 Request processed in 26168us (26275us total) trans 4294967543 rc 0/0 00000100:00100000:0.0:1784938450.729991:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 271 00002000:00100000:0.0:1784938450.730004:0:23333:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0x60:0x0] (0->198049) req@ffff9f2482b28e00 x1871643337589504/t4294967543(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.730013:0:23333:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2482b28e00 with x1871643337589504 ext(0->198049) 00002000:00010000:0.0:1784938450.730019:0:23333:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2482b28e00 00000100:00100000:1.0:1784938450.730566:0:25745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7ea6e988-18ba-4c98-b179-17995571b98b+203:10957:x1871643337589248:12345-192.168.202.54@tcp:4:cp.0 Request processed in 27258us (27719us total) trans 4294967550 rc 0/0 00000100:00100000:1.0:1784938450.730575:0:25745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 269 00002000:00100000:1.0:1784938450.730583:0:25745:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000400:0x62:0x0] (0->254128) req@ffff9f2388245c00 x1871643337589248/t4294967550(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.730592:0:25745:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2388245c00 with x1871643337589248 ext(0->254128) 00002000:00010000:1.0:1784938450.730596:0:25745:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2388245c00 00000100:00100000:1.0:1784938450.731023:0:23331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7ea6e988-18ba-4c98-b179-17995571b98b+201:10959:x1871643337588992:12345-192.168.202.54@tcp:4:cp.0 Request processed in 28051us (28426us total) trans 4294967551 rc 0/0 00000100:00100000:1.0:1784938450.731031:0:23331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 268 00002000:00100000:1.0:1784938450.731038:0:23331:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0x61:0x0] (0->159677) req@ffff9f2388246680 x1871643337588992/t4294967551(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.731047:0:23331:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2388246680 with x1871643337588992 ext(0->159677) 00002000:00010000:1.0:1784938450.731051:0:23331:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2388246680 00000100:00100000:1.0:1784938450.734733:0:23328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7ea6e988-18ba-4c98-b179-17995571b98b+176:10957:x1871643337589760:12345-192.168.202.54@tcp:4:cp.0 Request processed in 30898us (30973us total) trans 4294967544 rc 0/0 00000100:00100000:1.0:1784938450.734748:0:23328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 272 00002000:00100000:1.0:1784938450.734761:0:23328:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x61:0x0] (0->227515) req@ffff9f2482b2b800 x1871643337589760/t4294967544(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.734772:0:23328:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2482b2b800 with x1871643337589760 ext(0->227515) 00002000:00010000:1.0:1784938450.734778:0:23328:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2482b2b800 00000100:00100000:2.0:1784938450.735468:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7ea6e988-18ba-4c98-b179-17995571b98b+175:10959:x1871643337589632:12345-192.168.202.54@tcp:4:cp.0 Request processed in 28847us (29092us total) trans 4294967541 rc 0/0 00000100:00100000:2.0:1784938450.735490:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 273 00002000:00100000:2.0:1784938450.735497:0:23334:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0x50:0x0] (0->268) req@ffff9f24b37ca680 x1871643337589632/t4294967541(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 760/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.735505:0:23334:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37ca680 with x1871643337589632 ext(0->268) 00002000:00010000:2.0:1784938450.735509:0:23334:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b37ca680 00000100:00100000:0.0:1784938450.737592:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938450.738044:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938450.738073:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938450.738230:0:23329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337591040 00000100:00100000:1.0:1784938450.738240:0:23329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337591040 00002000:00100000:1.0:1784938450.738296:0:23329:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x4e:0x0] (0->55539) req@ffff9f2388244380 x1871643337591040/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.738307:0:23329:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2388244380 with x1871643337591040 ext(0->55539) 00002000:00010000:1.0:1784938450.738313:0:23329:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2388244380 00000100:00100000:1.0:1784938450.738343:0:23329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337590528 00000100:00100000:1.0:1784938450.738346:0:23329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337590528 00002000:00100000:1.0:1784938450.738362:0:23329:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x65:0x0] (0->2474) req@ffff9f24bd5a7480 x1871643337590528/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2968/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.738371:0:23329:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a7480 with x1871643337590528 ext(0->2474) 00002000:00010000:1.0:1784938450.738375:0:23329:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24bd5a7480 00000100:00100000:1.0:1784938450.738406:0:25745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337591424 00000100:00100000:1.0:1784938450.738410:0:25745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337591424 00002000:00100000:1.0:1784938450.738427:0:25745:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000400:0x5d:0x0] (0->116977) req@ffff9f24bd5a5500 x1871643337591424/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.738435:0:25745:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a5500 with x1871643337591424 ext(0->116977) 00002000:00010000:1.0:1784938450.738439:0:25745:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24bd5a5500 00000100:00100000:1.0:1784938450.738459:0:25745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 283 00000100:00100000:1.0:1784938450.738468:0:25745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7ea6e988-18ba-4c98-b179-17995571b98b+203:10960:x1871643337591040:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.738831:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 284 00000100:00100000:0.0:1784938450.738840:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7ea6e988-18ba-4c98-b179-17995571b98b+204:10959:x1871643337590528:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938450.739856:0:23331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 285 00000100:00100000:1.0:1784938450.739867:0:23331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7ea6e988-18ba-4c98-b179-17995571b98b+206:10958:x1871643337591424:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.740160:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938450.740235:0:23328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337591808 00000100:00100000:1.0:1784938450.740242:0:23328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337591808 00002000:00100000:1.0:1784938450.740277:0:23328:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x63:0x0] (0->429669) req@ffff9f24b3f3f100 x1871643337591808/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.740287:0:23328:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b3f3f100 with x1871643337591808 ext(0->429669) 00002000:00010000:1.0:1784938450.740292:0:23328:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b3f3f100 00000100:00100000:1.0:1784938450.740318:0:23328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 286 00000100:00100000:1.0:1784938450.740326:0:23328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7ea6e988-18ba-4c98-b179-17995571b98b+208:10958:x1871643337591808:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.741100:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7ea6e988-18ba-4c98-b179-17995571b98b+209:10959:x1871643337590528:12345-192.168.202.54@tcp:4:cp.0 Request processed in 2258us (3053us total) trans 4294967552 rc 0/0 00000100:00100000:0.0:1784938450.741111:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 284 00002000:00100000:0.0:1784938450.741119:0:23333:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0x65:0x0] (0->2474) req@ffff9f24bd5a7480 x1871643337590528/t4294967552(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2968/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.741128:0:23333:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a7480 with x1871643337590528 ext(0->2474) 00002000:00010000:0.0:1784938450.741132:0:23333:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24bd5a7480 00000100:00100000:3.0:1784938450.741847:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938450.742400:0:23329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337590656 00000100:00100000:1.0:1784938450.742410:0:23329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337590656 00002000:00100000:1.0:1784938450.742448:0:23329:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x65:0x0] (0->5104) req@ffff9f24bd5a4a80 x1871643337590656/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 5600/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.742457:0:23329:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a4a80 with x1871643337590656 ext(0->5104) 00002000:00010000:1.0:1784938450.742462:0:23329:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24bd5a4a80 00000100:00100000:1.0:1784938450.742504:0:23329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 287 00000100:00100000:1.0:1784938450.742512:0:23329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7ea6e988-18ba-4c98-b179-17995571b98b+175:10960:x1871643337590656:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:3.0:1784938450.743163:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938450.743196:0:25746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337592064 00000100:00100000:3.0:1784938450.743200:0:25746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337592064 00002000:00100000:3.0:1784938450.743221:0:25746:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000400:0x69:0x0] (0->1048575) req@ffff9f24bd5a7100 x1871643337592064/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.743245:0:25746:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a7100 with x1871643337592064 ext(0->1048575) 00002000:00010000:3.0:1784938450.743250:0:25746:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24bd5a7100 00000100:00100000:3.0:1784938450.743277:0:25746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 288 00000100:00100000:3.0:1784938450.743284:0:25746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7ea6e988-18ba-4c98-b179-17995571b98b+178:10959:x1871643337592064:12345-192.168.202.54@tcp:4:dd.0 00000100:00100000:1.0:1784938450.744908:0:23329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7ea6e988-18ba-4c98-b179-17995571b98b+181:10960:x1871643337590656:12345-192.168.202.54@tcp:4:cp.0 Request processed in 2389us (3056us total) trans 4294967545 rc 0/0 00000100:00100000:1.0:1784938450.744918:0:23329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 287 00002000:00100000:1.0:1784938450.744928:0:23329:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x65:0x0] (0->5104) req@ffff9f24bd5a4a80 x1871643337590656/t4294967545(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 5600/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.744936:0:23329:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a4a80 with x1871643337590656 ext(0->5104) 00002000:00010000:1.0:1784938450.744941:0:23329:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24bd5a4a80 00000100:00100000:2.0:1784938450.746647:0:21157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7ea6e988-18ba-4c98-b179-17995571b98b+179:10957:x1871643337589888:12345-192.168.202.54@tcp:4:cp.0 Request processed in 39527us (40197us total) trans 4294967546 rc 0/0 00000100:00100000:2.0:1784938450.746658:0:21157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 275 00002000:00100000:2.0:1784938450.746668:0:21157:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x56:0x0] (0->35426) req@ffff9f24b37c9180 x1871643337589888/t4294967546(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.746679:0:21157:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37c9180 with x1871643337589888 ext(0->35426) 00002000:00010000:2.0:1784938450.746684:0:21157:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b37c9180 00000100:00100000:0.0:1784938450.755918:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.755948:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337590912 00000100:00100000:0.0:1784938450.755957:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337590912 00002000:00100000:0.0:1784938450.756000:0:23333:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0x66:0x0] (0->1610) req@ffff9f2388244000 x1871643337590912/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2104/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.756012:0:23333:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2388244000 with x1871643337590912 ext(0->1610) 00002000:00010000:0.0:1784938450.756018:0:23333:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2388244000 00000100:00100000:0.0:1784938450.756048:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 289 00000100:00100000:0.0:1784938450.756057:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7ea6e988-18ba-4c98-b179-17995571b98b+211:10957:x1871643337590912:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.756363:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.756395:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.756751:0:21156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7ea6e988-18ba-4c98-b179-17995571b98b+183:10957:x1871643337590272:12345-192.168.202.54@tcp:4:cp.0 Request processed in 32928us (43013us total) trans 4294967547 rc 0/0 00000100:00100000:0.0:1784938450.756759:0:21156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 280 00002000:00100000:0.0:1784938450.756766:0:21156:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x4c:0x0] (0->18268) req@ffff9f24bd5a7800 x1871643337590272/t4294967547(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.756775:0:21156:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a7800 with x1871643337590272 ext(0->18268) 00002000:00010000:0.0:1784938450.756780:0:21156:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24bd5a7800 00000100:00100000:0.0:1784938450.756799:0:21156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337591168 00000100:00100000:0.0:1784938450.756803:0:21156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337591168 00002000:00100000:0.0:1784938450.756820:0:21156:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x59:0x0] (0->1658) req@ffff9f2388247800 x1871643337591168/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2152/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.756828:0:21156:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2388247800 with x1871643337591168 ext(0->1658) 00002000:00010000:0.0:1784938450.756832:0:21156:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2388247800 00000100:00100000:0.0:1784938450.756846:0:21156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337591296 00000100:00100000:0.0:1784938450.756849:0:21156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337591296 00002000:00100000:0.0:1784938450.756864:0:21156:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5a:0x0] (0->1407) req@ffff9f2388246a00 x1871643337591296/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 1896/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.756871:0:21156:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2388246a00 with x1871643337591296 ext(0->1407) 00002000:00010000:0.0:1784938450.756874:0:21156:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2388246a00 00000100:00100000:0.0:1784938450.756883:0:21156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 290 00000100:00100000:0.0:1784938450.756890:0:21156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388247800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7ea6e988-18ba-4c98-b179-17995571b98b+215:10960:x1871643337591168:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.757132:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7ea6e988-18ba-4c98-b179-17995571b98b+181:10959:x1871643337590144:12345-192.168.202.54@tcp:4:cp.0 Request processed in 34005us (49639us total) trans 4294967548 rc 0/0 00000100:00100000:0.0:1784938450.757140:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 279 00002000:00100000:0.0:1784938450.757168:0:23327:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x62:0x0] (0->88086) req@ffff9f24b3f3ca80 x1871643337590144/t4294967548(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.757176:0:23327:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b3f3ca80 with x1871643337590144 ext(0->88086) 00002000:00010000:0.0:1784938450.757180:0:23327:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b3f3ca80 00000100:00100000:0.0:1784938450.757197:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 291 00000100:00100000:0.0:1784938450.757204:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388246a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7ea6e988-18ba-4c98-b179-17995571b98b+217:10958:x1871643337591296:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.757420:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7ea6e988-18ba-4c98-b179-17995571b98b+219:10957:x1871643337590912:12345-192.168.202.54@tcp:4:cp.0 Request processed in 1363us (1511us total) trans 4294967554 rc 0/0 00000100:00100000:0.0:1784938450.757428:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 289 00002000:00100000:0.0:1784938450.757433:0:23333:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0x66:0x0] (0->1610) req@ffff9f2388244000 x1871643337590912/t4294967554(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2104/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.757441:0:23333:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2388244000 with x1871643337590912 ext(0->1610) 00002000:00010000:0.0:1784938450.757445:0:23333:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2388244000 00000100:00100000:0.0:1784938450.757698:0:23337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7ea6e988-18ba-4c98-b179-17995571b98b+179:10958:x1871643337590784:12345-192.168.202.54@tcp:4:cp.0 Request processed in 32116us (32338us total) trans 4294967549 rc 0/0 00000100:00100000:0.0:1784938450.757705:0:23337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 282 00002000:00100000:0.0:1784938450.757711:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0x66:0x0] (0->24287) req@ffff9f24bd5a7b80 x1871643337590784/t4294967549(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.757718:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a7b80 with x1871643337590784 ext(0->24287) 00002000:00010000:0.0:1784938450.757722:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24bd5a7b80 00000100:00100000:1.0:1784938450.758247:0:23335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7ea6e988-18ba-4c98-b179-17995571b98b+217:10959:x1871643337590016:12345-192.168.202.54@tcp:4:cp.0 Request processed in 46674us (50805us total) trans 4294967553 rc 0/0 00000100:00100000:1.0:1784938450.758256:0:23335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 277 00002000:00100000:1.0:1784938450.758272:0:23335:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x64:0x0] (0->1179442) req@ffff9f24b37cb480 x1871643337590016/t4294967553(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.758279:0:23335:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b37cb480 with x1871643337590016 ext(0->1179442) 00002000:00010000:1.0:1784938450.758283:0:23335:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b37cb480 00000100:00100000:0.0:1784938450.758603:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.758672:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.758738:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938450.758796:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337591552 00000100:00100000:1.0:1784938450.758803:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337591552 00002000:00100000:1.0:1784938450.758829:0:23333:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0x4d:0x0] (0->2191) req@ffff9f2388245500 x1871643337591552/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2680/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.758837:0:23333:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2388245500 with x1871643337591552 ext(0->2191) 00002000:00010000:1.0:1784938450.758841:0:23333:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2388245500 00000100:00100000:1.0:1784938450.758856:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337591680 00000100:00100000:1.0:1784938450.758859:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337591680 00002000:00100000:1.0:1784938450.758872:0:23333:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0x67:0x0] (0->1764) req@ffff9f24b68d8700 x1871643337591680/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2256/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.758879:0:23333:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b68d8700 with x1871643337591680 ext(0->1764) 00002000:00010000:1.0:1784938450.758882:0:23333:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b68d8700 00000100:00100000:1.0:1784938450.758897:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 292 00000100:00100000:1.0:1784938450.758905:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388245500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7ea6e988-18ba-4c98-b179-17995571b98b+217:10960:x1871643337591552:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938450.759132:0:23335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 293 00000100:00100000:1.0:1784938450.759139:0:23335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7ea6e988-18ba-4c98-b179-17995571b98b+181:10960:x1871643337591680:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.759641:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388246a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7ea6e988-18ba-4c98-b179-17995571b98b+219:10958:x1871643337591296:12345-192.168.202.54@tcp:4:cp.0 Request processed in 2436us (3244us total) trans 4294967556 rc 0/0 00000100:00100000:0.0:1784938450.759648:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 291 00002000:00100000:0.0:1784938450.759655:0:23327:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x5a:0x0] (0->1407) req@ffff9f2388246a00 x1871643337591296/t4294967556(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 1896/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.759663:0:23327:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2388246a00 with x1871643337591296 ext(0->1407) 00002000:00010000:0.0:1784938450.759667:0:23327:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2388246a00 00000100:00100000:0.0:1784938450.759681:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337591936 00000100:00100000:0.0:1784938450.759685:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337591936 00002000:00100000:0.0:1784938450.759702:0:23327:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x68:0x0] (0->4511) req@ffff9f24b68d8000 x1871643337591936/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 5000/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.759710:0:23327:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b68d8000 with x1871643337591936 ext(0->4511) 00002000:00010000:0.0:1784938450.759713:0:23327:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b68d8000 00000100:00100000:0.0:1784938450.759726:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 294 00000100:00100000:0.0:1784938450.759733:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7ea6e988-18ba-4c98-b179-17995571b98b+184:10958:x1871643337591936:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938450.760644:0:21156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388247800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7ea6e988-18ba-4c98-b179-17995571b98b+220:10960:x1871643337591168:12345-192.168.202.54@tcp:4:cp.0 Request processed in 3750us (4278us total) trans 4294967555 rc 0/0 00000100:00100000:1.0:1784938450.760657:0:21156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 290 00002000:00100000:1.0:1784938450.760664:0:21156:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x59:0x0] (0->1658) req@ffff9f2388247800 x1871643337591168/t4294967555(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2152/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.760673:0:21156:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2388247800 with x1871643337591168 ext(0->1658) 00002000:00010000:1.0:1784938450.760677:0:21156:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2388247800 00000100:00100000:1.0:1784938450.760719:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388245500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7ea6e988-18ba-4c98-b179-17995571b98b+219:10960:x1871643337591552:12345-192.168.202.54@tcp:4:cp.0 Request processed in 1815us (2116us total) trans 4294967557 rc 0/0 00000100:00100000:1.0:1784938450.760729:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 292 00002000:00100000:1.0:1784938450.760735:0:23333:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0x4d:0x0] (0->2191) req@ffff9f2388245500 x1871643337591552/t4294967557(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2680/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.760742:0:23333:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2388245500 with x1871643337591552 ext(0->2191) 00002000:00010000:1.0:1784938450.760745:0:23333:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2388245500 00000100:00100000:0.0:1784938450.761649:0:21155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7ea6e988-18ba-4c98-b179-17995571b98b+185:10958:x1871643337590400:12345-192.168.202.54@tcp:4:cp.0 Request processed in 37635us (47687us total) trans 4294967550 rc 0/0 00000100:00100000:0.0:1784938450.761658:0:21155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 281 00002000:00100000:0.0:1784938450.761664:0:21155:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x64:0x0] (0->26715) req@ffff9f24bd5a5880 x1871643337590400/t4294967550(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.761672:0:21155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a5880 with x1871643337590400 ext(0->26715) 00002000:00010000:0.0:1784938450.761676:0:21155:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24bd5a5880 00000100:00100000:3.0:1784938450.763660:0:25745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7ea6e988-18ba-4c98-b179-17995571b98b+219:10960:x1871643337591040:12345-192.168.202.54@tcp:4:cp.0 Request processed in 25182us (26064us total) trans 4294967558 rc 0/0 00000100:00100000:3.0:1784938450.763674:0:25745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 283 00002000:00100000:3.0:1784938450.763685:0:25745:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000400:0x4e:0x0] (0->55539) req@ffff9f2388244380 x1871643337591040/t4294967558(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.763695:0:25745:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2388244380 with x1871643337591040 ext(0->55539) 00002000:00010000:3.0:1784938450.763700:0:25745:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2388244380 00000100:00100000:1.0:1784938450.763900:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7ea6e988-18ba-4c98-b179-17995571b98b+184:10958:x1871643337591936:12345-192.168.202.54@tcp:4:cp.0 Request processed in 4166us (5160us total) trans 4294967552 rc 0/0 00000100:00100000:1.0:1784938450.763908:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 294 00002000:00100000:1.0:1784938450.763915:0:23327:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x68:0x0] (0->4511) req@ffff9f24b68d8000 x1871643337591936/t4294967552(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 5000/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.763923:0:23327:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b68d8000 with x1871643337591936 ext(0->4511) 00002000:00010000:1.0:1784938450.763928:0:23327:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b68d8000 00000100:00100000:3.0:1784938450.764100:0:23331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7ea6e988-18ba-4c98-b179-17995571b98b+217:10958:x1871643337591424:12345-192.168.202.54@tcp:4:cp.0 Request processed in 24235us (26025us total) trans 4294967559 rc 0/0 00000100:00100000:3.0:1784938450.764111:0:23331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 285 00002000:00100000:3.0:1784938450.764117:0:23331:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0x5d:0x0] (0->116977) req@ffff9f24bd5a5500 x1871643337591424/t4294967559(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.764124:0:23331:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a5500 with x1871643337591424 ext(0->116977) 00002000:00010000:3.0:1784938450.764128:0:23331:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24bd5a5500 00000100:00100000:0.0:1784938450.764451:0:23335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7ea6e988-18ba-4c98-b179-17995571b98b+183:10960:x1871643337591680:12345-192.168.202.54@tcp:4:cp.0 Request processed in 5311us (5777us total) trans 4294967551 rc 0/0 00000100:00100000:0.0:1784938450.764459:0:23335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 293 00002000:00100000:0.0:1784938450.764465:0:23335:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0x67:0x0] (0->1764) req@ffff9f24b68d8700 x1871643337591680/t4294967551(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2256/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.764472:0:23335:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b68d8700 with x1871643337591680 ext(0->1764) 00002000:00010000:0.0:1784938450.764476:0:23335:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b68d8700 00000100:00100000:2.0:1784938450.771646:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.771813:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.771845:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.771878:0:21156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337592576 00000100:00100000:2.0:1784938450.771888:0:21156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337592576 00002000:00100000:2.0:1784938450.771937:0:21156:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x67:0x0] (0->316747) req@ffff9f24b3f3ce00 x1871643337592576/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.771950:0:21156:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b3f3ce00 with x1871643337592576 ext(0->316747) 00002000:00010000:2.0:1784938450.771957:0:21156:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b3f3ce00 00000100:00100000:2.0:1784938450.771980:0:21156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337592704 00000100:00100000:2.0:1784938450.771997:0:21156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337592704 00002000:00100000:2.0:1784938450.772015:0:21156:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x55:0x0] (0->111138) req@ffff9f24b3f3ea00 x1871643337592704/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.772023:0:21156:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b3f3ea00 with x1871643337592704 ext(0->111138) 00002000:00010000:2.0:1784938450.772027:0:21156:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b3f3ea00 00000100:00100000:2.0:1784938450.772043:0:21156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337592832 00000100:00100000:2.0:1784938450.772047:0:21156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337592832 00002000:00100000:2.0:1784938450.772060:0:21156:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x58:0x0] (0->422) req@ffff9f24b3f3dc00 x1871643337592832/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 912/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.772068:0:21156:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b3f3dc00 with x1871643337592832 ext(0->422) 00002000:00010000:2.0:1784938450.772072:0:21156:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b3f3dc00 00000100:00100000:2.0:1784938450.772091:0:21156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 295 00000100:00100000:2.0:1784938450.772100:0:21156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7ea6e988-18ba-4c98-b179-17995571b98b+221:10960:x1871643337592576:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.772648:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 296 00000100:00100000:0.0:1784938450.772658:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7ea6e988-18ba-4c98-b179-17995571b98b+221:10960:x1871643337592704:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.772898:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.772921:0:21155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337593088 00000100:00100000:0.0:1784938450.772925:0:21155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337593088 00002000:00100000:0.0:1784938450.772946:0:21155:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x63:0x0] (0->42516) req@ffff9f24b68d8380 x1871643337593088/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.772954:0:21155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b68d8380 with x1871643337593088 ext(0->42516) 00002000:00010000:0.0:1784938450.772958:0:21155:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b68d8380 00000100:00100000:0.0:1784938450.772977:0:21155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 297 00000100:00100000:0.0:1784938450.772997:0:21155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7ea6e988-18ba-4c98-b179-17995571b98b+222:10957:x1871643337592832:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.773371:0:25745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 298 00000100:00100000:0.0:1784938450.773379:0:25745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7ea6e988-18ba-4c98-b179-17995571b98b+183:10959:x1871643337593088:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.774178:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938450.774426:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337593216 00000100:00100000:1.0:1784938450.774434:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337593216 00002000:00100000:1.0:1784938450.774466:0:23327:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x57:0x0] (0->158095) req@ffff9f24b68d8a80 x1871643337593216/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.774475:0:23327:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b68d8a80 with x1871643337593216 ext(0->158095) 00002000:00010000:1.0:1784938450.774558:0:23327:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b68d8a80 00000100:00100000:1.0:1784938450.774588:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 299 00000100:00100000:1.0:1784938450.774596:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7ea6e988-18ba-4c98-b179-17995571b98b+225:10959:x1871643337593216:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:3.0:1784938450.774621:0:23328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7ea6e988-18ba-4c98-b179-17995571b98b+225:10958:x1871643337591808:12345-192.168.202.54@tcp:4:cp.0 Request processed in 34294us (34476us total) trans 4294967560 rc 0/0 00000100:00100000:3.0:1784938450.774629:0:23328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 286 00002000:00100000:3.0:1784938450.774635:0:23328:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x63:0x0] (0->429669) req@ffff9f24b3f3f100 x1871643337591808/t4294967560(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.774643:0:23328:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b3f3f100 with x1871643337591808 ext(0->429669) 00002000:00010000:3.0:1784938450.774647:0:23328:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b3f3f100 00000100:00100000:0.0:1784938450.777127:0:21155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7ea6e988-18ba-4c98-b179-17995571b98b+225:10957:x1871643337592832:12345-192.168.202.54@tcp:4:cp.0 Request processed in 4135us (5272us total) trans 4294967561 rc 0/0 00000100:00100000:0.0:1784938450.777140:0:21155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 297 00002000:00100000:0.0:1784938450.777188:0:21155:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x58:0x0] (0->422) req@ffff9f24b3f3dc00 x1871643337592832/t4294967561(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 912/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.777199:0:21155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b3f3dc00 with x1871643337592832 ext(0->422) 00002000:00010000:0.0:1784938450.777204:0:21155:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b3f3dc00 00000100:00100000:2.0:1784938450.778698:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.778805:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.778840:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.778861:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.778994:0:23337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337593472 00000100:00100000:2.0:1784938450.779003:0:23337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337593472 00002000:00100000:2.0:1784938450.779048:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0x58:0x0] (0->37841) req@ffff9f24b3f3df80 x1871643337593472/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.779059:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b3f3df80 with x1871643337593472 ext(0->37841) 00002000:00010000:2.0:1784938450.779064:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b3f3df80 00000100:00100000:2.0:1784938450.779092:0:23337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337592192 00000100:00100000:2.0:1784938450.779095:0:23337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337592192 00002000:00100000:2.0:1784938450.779131:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0x4b:0x0] (0->837) req@ffff9f24b68db480 x1871643337592192/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 1328/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.779141:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b68db480 with x1871643337592192 ext(0->837) 00002000:00010000:2.0:1784938450.779166:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b68db480 00000100:00100000:2.0:1784938450.779180:0:23337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337592320 00000100:00100000:2.0:1784938450.779183:0:23337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337592320 00002000:00100000:2.0:1784938450.779197:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000400:0x51:0x0] (0->3078) req@ffff9f24b68da300 x1871643337592320/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 3568/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.779204:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b68da300 with x1871643337592320 ext(0->3078) 00002000:00010000:2.0:1784938450.779207:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b68da300 00000100:00100000:2.0:1784938450.779223:0:23337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337592448 00000100:00100000:2.0:1784938450.779227:0:23337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337592448 00002000:00100000:2.0:1784938450.779239:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0x5d:0x0] (0->6820) req@ffff9f24b68d9500 x1871643337592448/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 7312/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.779247:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b68d9500 with x1871643337592448 ext(0->6820) 00002000:00010000:2.0:1784938450.779250:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b68d9500 00000100:00100000:2.0:1784938450.779277:0:23337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 300 00000100:00100000:2.0:1784938450.779286:0:23337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7ea6e988-18ba-4c98-b179-17995571b98b+187:10957:x1871643337593472:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.779468:0:23328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 301 00000100:00100000:2.0:1784938450.779475:0:23328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7ea6e988-18ba-4c98-b179-17995571b98b+188:10960:x1871643337592192:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.779891:0:23335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 302 00000100:00100000:2.0:1784938450.779899:0:23335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7ea6e988-18ba-4c98-b179-17995571b98b+225:10958:x1871643337592320:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.780114:0:23331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 303 00000100:00100000:2.0:1784938450.780122:0:23331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7ea6e988-18ba-4c98-b179-17995571b98b+190:10958:x1871643337592448:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.781766:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.781857:0:23331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7ea6e988-18ba-4c98-b179-17995571b98b+194:10958:x1871643337592448:12345-192.168.202.54@tcp:4:cp.0 Request processed in 1734us (2993us total) trans 4294967554 rc 0/0 00000100:00100000:2.0:1784938450.781868:0:23331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 303 00002000:00100000:2.0:1784938450.781878:0:23331:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x5d:0x0] (0->6820) req@ffff9f24b68d9500 x1871643337592448/t4294967554(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 7312/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.781888:0:23331:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b68d9500 with x1871643337592448 ext(0->6820) 00002000:00010000:2.0:1784938450.781894:0:23331:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b68d9500 00000100:00100000:2.0:1784938450.781917:0:23331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337592960 00000100:00100000:2.0:1784938450.781923:0:23331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337592960 00002000:00100000:2.0:1784938450.781946:0:23331:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x55:0x0] (0->6233) req@ffff9f24b3f3c000 x1871643337592960/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 6728/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.781955:0:23331:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b3f3c000 with x1871643337592960 ext(0->6233) 00002000:00010000:2.0:1784938450.781959:0:23331:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b3f3c000 00000100:00100000:2.0:1784938450.781981:0:23331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 304 00000100:00100000:2.0:1784938450.781989:0:23331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7ea6e988-18ba-4c98-b179-17995571b98b+194:10958:x1871643337592960:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.782290:0:23335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7ea6e988-18ba-4c98-b179-17995571b98b+227:10958:x1871643337592320:12345-192.168.202.54@tcp:4:cp.0 Request processed in 2391us (3448us total) trans 4294967562 rc 0/0 00000100:00100000:2.0:1784938450.782298:0:23335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 302 00002000:00100000:2.0:1784938450.782304:0:23335:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x51:0x0] (0->3078) req@ffff9f24b68da300 x1871643337592320/t4294967562(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 3568/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.782311:0:23335:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b68da300 with x1871643337592320 ext(0->3078) 00002000:00010000:2.0:1784938450.782315:0:23335:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b68da300 00000100:00100000:2.0:1784938450.782778:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.782822:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.782840:0:21157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337593344 00000100:00100000:2.0:1784938450.782845:0:21157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337593344 00002000:00100000:2.0:1784938450.782866:0:21157:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x53:0x0] (0->1789) req@ffff9f24b3f3ed80 x1871643337593344/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2280/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.782874:0:21157:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b3f3ed80 with x1871643337593344 ext(0->1789) 00002000:00010000:2.0:1784938450.782878:0:21157:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b3f3ed80 00000100:00100000:2.0:1784938450.782892:0:21157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337593600 00000100:00100000:2.0:1784938450.782895:0:21157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337593600 00002000:00100000:2.0:1784938450.782908:0:21157:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x4e:0x0] (0->937) req@ffff9f24b3f3d180 x1871643337593600/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 1432/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.782915:0:21157:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b3f3d180 with x1871643337593600 ext(0->937) 00002000:00010000:2.0:1784938450.782918:0:21157:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b3f3d180 00000100:00100000:2.0:1784938450.782939:0:21157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 305 00000100:00100000:2.0:1784938450.782946:0:21157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7ea6e988-18ba-4c98-b179-17995571b98b+227:10957:x1871643337593344:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.783203:0:23335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 306 00000100:00100000:2.0:1784938450.783211:0:23335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7ea6e988-18ba-4c98-b179-17995571b98b+197:10960:x1871643337593600:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.783469:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938450.783604:0:25747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337593728 00000100:00100000:1.0:1784938450.783608:0:25747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337593728 00002000:00100000:1.0:1784938450.783631:0:25747:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x2c0000400:0x59:0x0] (0->1341) req@ffff9f24b3f3e680 x1871643337593728/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 1832/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938450.783648:0:25747:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b3f3e680 with x1871643337593728 ext(0->1341) 00002000:00010000:1.0:1784938450.783652:0:25747:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b3f3e680 00000100:00100000:1.0:1784938450.783665:0:25747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 307 00000100:00100000:1.0:1784938450.783671:0:25747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7ea6e988-18ba-4c98-b179-17995571b98b+200:10959:x1871643337593728:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.783910:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.784297:0:21155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337593856 00000100:00100000:0.0:1784938450.784302:0:21155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337593856 00002000:00100000:0.0:1784938450.784336:0:21155:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x52:0x0] (0->4149) req@ffff9f24b3f3c380 x1871643337593856/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 4640/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.784351:0:21155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b3f3c380 with x1871643337593856 ext(0->4149) 00002000:00010000:0.0:1784938450.784356:0:21155:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b3f3c380 00000100:00100000:0.0:1784938450.784370:0:21155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 308 00000100:00100000:0.0:1784938450.784377:0:21155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7ea6e988-18ba-4c98-b179-17995571b98b+203:10958:x1871643337593856:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:0.0:1784938450.785125:0:23331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7ea6e988-18ba-4c98-b179-17995571b98b+205:10958:x1871643337592960:12345-192.168.202.54@tcp:4:cp.0 Request processed in 3134us (3362us total) trans 4294967556 rc 0/0 00000100:00100000:0.0:1784938450.785135:0:23331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 304 00002000:00100000:0.0:1784938450.785142:0:23331:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x55:0x0] (0->6233) req@ffff9f24b3f3c000 x1871643337592960/t4294967556(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 6728/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.785165:0:23331:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b3f3c000 with x1871643337592960 ext(0->6233) 00002000:00010000:0.0:1784938450.785169:0:23331:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b3f3c000 00000100:00100000:2.0:1784938450.785554:0:23328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7ea6e988-18ba-4c98-b179-17995571b98b+204:10960:x1871643337592192:12345-192.168.202.54@tcp:4:cp.0 Request processed in 6077us (6747us total) trans 4294967553 rc 0/0 00000100:00100000:2.0:1784938450.785561:0:23328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 301 00002000:00100000:2.0:1784938450.785568:0:23328:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x4b:0x0] (0->837) req@ffff9f24b68db480 x1871643337592192/t4294967553(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 1328/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.785581:0:23328:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b68db480 with x1871643337592192 ext(0->837) 00002000:00010000:2.0:1784938450.785584:0:23328:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b68db480 00000100:00100000:2.0:1784938450.786289:0:23335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7ea6e988-18ba-4c98-b179-17995571b98b+203:10960:x1871643337593600:12345-192.168.202.54@tcp:4:cp.0 Request processed in 3076us (3464us total) trans 4294967557 rc 0/0 00000100:00100000:2.0:1784938450.786297:0:23335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 306 00002000:00100000:2.0:1784938450.786303:0:23335:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0x4e:0x0] (0->937) req@ffff9f24b3f3d180 x1871643337593600/t4294967557(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 1432/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.786312:0:23335:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b3f3d180 with x1871643337593600 ext(0->937) 00002000:00010000:2.0:1784938450.786315:0:23335:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b3f3d180 00000100:00100000:0.0:1784938450.786418:0:21157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7ea6e988-18ba-4c98-b179-17995571b98b+231:10957:x1871643337593344:12345-192.168.202.54@tcp:4:cp.0 Request processed in 3472us (3640us total) trans 4294967563 rc 0/0 00000100:00100000:0.0:1784938450.786426:0:21157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 305 00002000:00100000:0.0:1784938450.786432:0:21157:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x53:0x0] (0->1789) req@ffff9f24b3f3ed80 x1871643337593344/t4294967563(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2280/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.786440:0:21157:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b3f3ed80 with x1871643337593344 ext(0->1789) 00002000:00010000:0.0:1784938450.786444:0:21157:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b3f3ed80 00000100:00100000:2.0:1784938450.786860:0:25747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7ea6e988-18ba-4c98-b179-17995571b98b+202:10959:x1871643337593728:12345-192.168.202.54@tcp:4:cp.0 Request processed in 3187us (3391us total) trans 4294967558 rc 0/0 00000100:00100000:2.0:1784938450.786867:0:25747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 307 00002000:00100000:2.0:1784938450.786873:0:25747:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x2c0000400:0x59:0x0] (0->1341) req@ffff9f24b3f3e680 x1871643337593728/t4294967558(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 1832/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.786880:0:25747:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b3f3e680 with x1871643337593728 ext(0->1341) 00002000:00010000:2.0:1784938450.786884:0:25747:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b3f3e680 00000100:00100000:0.0:1784938450.787067:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7ea6e988-18ba-4c98-b179-17995571b98b+229:10960:x1871643337592704:12345-192.168.202.54@tcp:4:cp.0 Request processed in 14410us (15254us total) trans 4294967564 rc 0/0 00000100:00100000:0.0:1784938450.787074:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 296 00002000:00100000:0.0:1784938450.787082:0:23334:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0x55:0x0] (0->111138) req@ffff9f24b3f3ea00 x1871643337592704/t4294967564(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.787094:0:23334:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b3f3ea00 with x1871643337592704 ext(0->111138) 00002000:00010000:0.0:1784938450.787098:0:23334:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b3f3ea00 00000100:00100000:0.0:1784938450.789179:0:25746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7ea6e988-18ba-4c98-b179-17995571b98b+202:10959:x1871643337592064:12345-192.168.202.54@tcp:4:dd.0 Request processed in 45885us (46006us total) trans 4294967555 rc 0/0 00000100:00100000:0.0:1784938450.789192:0:25746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 288 00002000:00100000:0.0:1784938450.789221:0:25746:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000400:0x69:0x0] (0->1048575) req@ffff9f24bd5a7100 x1871643337592064/t4294967555(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.789231:0:25746:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24bd5a7100 with x1871643337592064 ext(0->1048575) 00002000:00010000:0.0:1784938450.789237:0:25746:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24bd5a7100 00000100:00100000:0.0:1784938450.789294:0:25745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7ea6e988-18ba-4c98-b179-17995571b98b+200:10959:x1871643337593088:12345-192.168.202.54@tcp:4:cp.0 Request processed in 15915us (16396us total) trans 4294967560 rc 0/0 00000100:00100000:0.0:1784938450.789301:0:25745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 298 00002000:00100000:0.0:1784938450.789307:0:25745:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000400:0x63:0x0] (0->42516) req@ffff9f24b68d8380 x1871643337593088/t4294967560(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.789314:0:25745:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b68d8380 with x1871643337593088 ext(0->42516) 00002000:00010000:0.0:1784938450.789318:0:25745:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b68d8380 00000100:00100000:2.0:1784938450.789412:0:21155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7ea6e988-18ba-4c98-b179-17995571b98b+199:10958:x1871643337593856:12345-192.168.202.54@tcp:4:cp.0 Request processed in 5035us (5502us total) trans 4294967559 rc 0/0 00000100:00100000:2.0:1784938450.789421:0:21155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 308 00002000:00100000:2.0:1784938450.789426:0:21155:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x52:0x0] (0->4149) req@ffff9f24b3f3c380 x1871643337593856/t4294967559(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 4640/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.789433:0:21155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b3f3c380 with x1871643337593856 ext(0->4149) 00002000:00010000:2.0:1784938450.789436:0:21155:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b3f3c380 00000100:00100000:2.0:1784938450.790827:0:21156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7ea6e988-18ba-4c98-b179-17995571b98b+231:10960:x1871643337592576:12345-192.168.202.54@tcp:4:cp.0 Request processed in 18723us (19186us total) trans 4294967565 rc 0/0 00000100:00100000:2.0:1784938450.790837:0:21156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 295 00002000:00100000:2.0:1784938450.790845:0:21156:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x67:0x0] (0->316747) req@ffff9f24b3f3ce00 x1871643337592576/t4294967565(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.790854:0:21156:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b3f3ce00 with x1871643337592576 ext(0->316747) 00002000:00010000:2.0:1784938450.790858:0:21156:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b3f3ce00 00000100:00100000:3.0:1784938450.791645:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7ea6e988-18ba-4c98-b179-17995571b98b+229:10959:x1871643337593216:12345-192.168.202.54@tcp:4:cp.0 Request processed in 17047us (17466us total) trans 4294967566 rc 0/0 00000100:00100000:3.0:1784938450.791655:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 299 00002000:00100000:3.0:1784938450.791661:0:23327:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x57:0x0] (0->158095) req@ffff9f24b68d8a80 x1871643337593216/t4294967566(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938450.791669:0:23327:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b68d8a80 with x1871643337593216 ext(0->158095) 00002000:00010000:3.0:1784938450.791674:0:23327:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f24b68d8a80 00000100:00100000:2.0:1784938450.792055:0:23337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7ea6e988-18ba-4c98-b179-17995571b98b+199:10957:x1871643337593472:12345-192.168.202.54@tcp:4:cp.0 Request processed in 12769us (13361us total) trans 4294967561 rc 0/0 00000100:00100000:2.0:1784938450.792063:0:23337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 300 00002000:00100000:2.0:1784938450.792069:0:23337:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0x58:0x0] (0->37841) req@ffff9f24b3f3df80 x1871643337593472/t4294967561(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 488/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.792076:0:23337:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b3f3df80 with x1871643337593472 ext(0->37841) 00002000:00010000:2.0:1784938450.792080:0:23337:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b3f3df80 00000100:00100000:1.0:1784938450.793252:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.793334:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337593984 00000100:00100000:0.0:1784938450.793345:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337593984 00002000:00100000:0.0:1784938450.793390:0:23333:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0x5c:0x0] (0->6547) req@ffff9f2482b29880 x1871643337593984/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 7040/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938450.793399:0:23333:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2482b29880 with x1871643337593984 ext(0->6547) 00002000:00010000:0.0:1784938450.793403:0:23333:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2482b29880 00000100:00100000:0.0:1784938450.793589:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 309 00000100:00100000:0.0:1784938450.793599:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7ea6e988-18ba-4c98-b179-17995571b98b+199:10958:x1871643337593984:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938450.796391:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.796551:0:23328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337594112 00000100:00100000:2.0:1784938450.796561:0:23328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337594112 00002000:00100000:2.0:1784938450.796608:0:23328:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x4d:0x0] (0->3005) req@ffff9f2482b2a680 x1871643337594112/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 3496/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.796619:0:23328:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2482b2a680 with x1871643337594112 ext(0->3005) 00002000:00010000:2.0:1784938450.796623:0:23328:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2482b2a680 00000100:00100000:2.0:1784938450.796655:0:23328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 310 00000100:00100000:2.0:1784938450.796663:0:23328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7ea6e988-18ba-4c98-b179-17995571b98b+202:10959:x1871643337594112:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.798665:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7ea6e988-18ba-4c98-b179-17995571b98b+204:10958:x1871643337593984:12345-192.168.202.54@tcp:4:cp.0 Request processed in 5059us (5407us total) trans 4294967562 rc 0/0 00000100:00100000:2.0:1784938450.798680:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 309 00002000:00100000:2.0:1784938450.798691:0:23333:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0x5c:0x0] (0->6547) req@ffff9f2482b29880 x1871643337593984/t4294967562(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 7040/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.798699:0:23333:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2482b29880 with x1871643337593984 ext(0->6547) 00002000:00010000:2.0:1784938450.798704:0:23333:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2482b29880 00000100:00100000:2.0:1784938450.801574:0:23328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7ea6e988-18ba-4c98-b179-17995571b98b+203:10959:x1871643337594112:12345-192.168.202.54@tcp:4:cp.0 Request processed in 4899us (5178us total) trans 4294967563 rc 0/0 00000100:00100000:2.0:1784938450.801589:0:23328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 310 00002000:00100000:2.0:1784938450.801603:0:23328:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x4d:0x0] (0->3005) req@ffff9f2482b2a680 x1871643337594112/t4294967563(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 3496/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.801614:0:23328:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2482b2a680 with x1871643337594112 ext(0->3005) 00002000:00010000:2.0:1784938450.801620:0:23328:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2482b2a680 00000100:00100000:0.0:1784938450.804813:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.804915:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.805425:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.805444:0:21157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337594240 00000100:00100000:2.0:1784938450.805454:0:21157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337594240 00000100:00100000:1.0:1784938450.805475:0:25747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337594496 00002000:00100000:2.0:1784938450.805501:0:21157:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x51:0x0] (0->4116) req@ffff9f24b68da680 x1871643337594240/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 4608/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.805511:0:21157:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b68da680 with x1871643337594240 ext(0->4116) 00002000:00010000:2.0:1784938450.805517:0:21157:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b68da680 00000100:00100000:2.0:1784938450.805593:0:21157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 311 00000100:00100000:2.0:1784938450.805608:0:21157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7ea6e988-18ba-4c98-b179-17995571b98b+203:10959:x1871643337594240:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:1.0:1784938450.806416:0:25747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337594496 00002000:00100000:1.0:1784938450.806439:0:25747:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x2c0000400:0x5a:0x0] (0->1752) req@ffff9f24b68dad80 x1871643337594496/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2248/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784938450.806445:0:21157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7ea6e988-18ba-4c98-b179-17995571b98b+206:10959:x1871643337594240:12345-192.168.202.54@tcp:4:cp.0 Request processed in 842us (1640us total) trans 4294967564 rc 0/0 00002000:00100000:1.0:1784938450.806449:0:25747:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b68dad80 with x1871643337594496 ext(0->1752) 00002000:00010000:1.0:1784938450.806453:0:25747:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b68dad80 00000100:00100000:2.0:1784938450.806454:0:21157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 311 00002000:00100000:2.0:1784938450.806460:0:21157:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x51:0x0] (0->4116) req@ffff9f24b68da680 x1871643337594240/t4294967564(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 4608/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.806468:0:21157:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b68da680 with x1871643337594240 ext(0->4116) 00002000:00010000:2.0:1784938450.806476:0:21157:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b68da680 00000100:00100000:2.0:1784938450.806816:0:21157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337594368 00000100:00100000:2.0:1784938450.806830:0:21157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337594368 00002000:00100000:2.0:1784938450.806849:0:21157:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x57:0x0] (0->2128) req@ffff9f24b68daa00 x1871643337594368/t0(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2624/0 e 0 to 0 dl 1784938461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.806857:0:21157:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b68daa00 with x1871643337594368 ext(0->2128) 00002000:00010000:2.0:1784938450.806861:0:21157:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b68daa00 00000100:00100000:2.0:1784938450.806880:0:21157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 312 00000100:00100000:2.0:1784938450.806888:0:21157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7ea6e988-18ba-4c98-b179-17995571b98b+206:10958:x1871643337594496:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.807526:0:21157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7ea6e988-18ba-4c98-b179-17995571b98b+208:10958:x1871643337594496:12345-192.168.202.54@tcp:4:cp.0 Request processed in 637us (2609us total) trans 4294967565 rc 0/0 00000100:00100000:2.0:1784938450.807534:0:21157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 312 00002000:00100000:2.0:1784938450.807541:0:21157:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x5a:0x0] (0->1752) req@ffff9f24b68dad80 x1871643337594496/t4294967565(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2248/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.807549:0:21157:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b68dad80 with x1871643337594496 ext(0->1752) 00002000:00010000:2.0:1784938450.807553:0:21157:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b68dad80 00000100:00100000:2.0:1784938450.807568:0:21157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 313 00000100:00100000:2.0:1784938450.807575:0:21157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7ea6e988-18ba-4c98-b179-17995571b98b+207:10958:x1871643337594368:12345-192.168.202.54@tcp:4:cp.0 00000100:00100000:2.0:1784938450.809142:0:21157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7ea6e988-18ba-4c98-b179-17995571b98b+209:10958:x1871643337594368:12345-192.168.202.54@tcp:4:cp.0 Request processed in 1561us (3710us total) trans 4294967566 rc 0/0 00000100:00100000:2.0:1784938450.809177:0:21157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 313 00002000:00100000:2.0:1784938450.809187:0:21157:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x57:0x0] (0->2128) req@ffff9f24b68daa00 x1871643337594368/t4294967566(0) o4->7ea6e988-18ba-4c98-b179-17995571b98b@192.168.202.54@tcp:681/0 lens 2624/448 e 0 to 0 dl 1784938461 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938450.809197:0:21157:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f24b68daa00 with x1871643337594368 ext(0->2128) 00002000:00010000:2.0:1784938450.809202:0:21157:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f24b68daa00 00000100:00100000:1.0:1784938450.866236:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938450.866406:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.866480:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337594624 00000100:00100000:0.0:1784938450.866489:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337594624 00000100:00100000:0.0:1784938450.866551:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337594752 00000100:00100000:0.0:1784938450.866554:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337594752 00000100:00100000:0.0:1784938450.866577:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 24 00000100:00100000:0.0:1784938450.866584:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:357535a6-3234-42c0-bf92-af4663775ca3+11:10959:x1871643337594624:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938450.866599:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938450.866615:0:25731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f24b379c200/0x7b044d4128f98758 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947662ec9 expref: 11 pid: 24194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.866631:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938450.866669:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:357535a6-3234-42c0-bf92-af4663775ca3+10:10959:x1871643337594624:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 86us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938450.866674:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 24 00000100:00100000:0.0:1784938450.866685:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 25 00000100:00100000:0.0:1784938450.866689:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:357535a6-3234-42c0-bf92-af4663775ca3+9:10959:x1871643337594752:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938450.866696:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938450.866701:0:25731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f24b379c400/0x7b044d4128f9875f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947662efa expref: 9 pid: 24192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.866706:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938450.866715:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:357535a6-3234-42c0-bf92-af4663775ca3+8:10959:x1871643337594752:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 26us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938450.866721:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 25 00000100:00100000:3.0:1784938450.870186:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938450.870469:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337594880 00000100:00100000:1.0:1784938450.870478:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337594880 00000100:00100000:1.0:1784938450.870545:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 26 00000100:00100000:1.0:1784938450.870553:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24c5a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:357535a6-3234-42c0-bf92-af4663775ca3+8:10958:x1871643337594880:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938450.870566:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938450.870581:0:22955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f238db38c00/0x7b044d4128f98766 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947662f01 expref: 8 pid: 24193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938450.870594:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938450.870640:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24c5a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:357535a6-3234-42c0-bf92-af4663775ca3+7:10958:x1871643337594880:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 88us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938450.870648:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 26 00000100:00100000:1.0:1784938450.891711:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938450.891946:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337604992 00000100:00100000:2.0:1784938450.891959:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337604992 00000100:00100000:2.0:1784938450.892029:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 980 00000100:00100000:2.0:1784938450.892037:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+209:10956:x1871643337604992:12345-192.168.202.54@tcp:9:umount.0 00000020:00000080:2.0:1784938450.892064:0:25722:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f98782 00000020:00010000:2.0:1784938450.892071:0:25722:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9f2489213800: total 0 00000100:00080000:2.0:1784938450.892074:0:25722:0:(import.c:65:import_set_state_nolock()) ffff9f2489210000 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1784938450.892118:0:19222:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9f2489213800: total 0 00000001:00000004:2.0:1784938450.892118:0:25722:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967566 00000100:00100000:2.0:1784938450.892318:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7ea6e988-18ba-4c98-b179-17995571b98b+207:10956:x1871643337604992:12345-192.168.202.54@tcp:9:umount.0 Request processed in 281us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938450.892325:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 980 00010000:00010000:3.0:1784938450.892549:0:19222:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9f2489213800, canceled 0 locks, left on hash table 78. 00002000:00010000:3.0:1784938450.892587:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x53:0x0] updating lvb size from disk: 0 -> 8441 00002000:00010000:3.0:1784938450.892591:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x53:0x0] updating lvb mtime from disk: 0 -> 1784938446 00002000:00010000:3.0:1784938450.892594:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x53:0x0] updating lvb ctime from disk: 0 -> 1784938446 00002000:00010000:3.0:1784938450.892597:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x53:0x0] updating lvb blocks from disk: 0 -> 24 00010000:00010000:3.0:1784938450.892625:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037f49eba/0x7b044d4128f9deca lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476647dc expref: 206 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938450.892653:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5e:0x0] updating lvb size from disk: 0 -> 170595 00002000:00010000:3.0:1784938450.892655:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5e:0x0] updating lvb mtime from disk: 0 -> 1784938442 00002000:00010000:3.0:1784938450.892657:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5e:0x0] updating lvb ctime from disk: 0 -> 1784938442 00002000:00010000:3.0:1784938450.892659:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5e:0x0] updating lvb blocks from disk: 0 -> 336 00010000:00010000:3.0:1784938450.892669:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c746802/0x7b044d4128f9c82d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664026 expref: 205 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938450.892685:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x47:0x0] updating lvb size from disk: 0 -> 4207 00002000:00010000:3.0:1784938450.892688:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x47:0x0] updating lvb mtime from disk: 0 -> 1784938440 00002000:00010000:3.0:1784938450.892690:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x47:0x0] updating lvb ctime from disk: 0 -> 1784938440 00002000:00010000:3.0:1784938450.892692:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x47:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:3.0:1784938450.892701:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4b1af9e/0x7b044d4128f9b5d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476639dc expref: 204 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938450.892718:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x62:0x0] updating lvb size from disk: 0 -> 88087 00002000:00010000:3.0:1784938450.892720:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x62:0x0] updating lvb mtime from disk: 0 -> 1784938448 00002000:00010000:3.0:1784938450.892722:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x62:0x0] updating lvb ctime from disk: 0 -> 1784938448 00002000:00010000:3.0:1784938450.892724:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x62:0x0] updating lvb blocks from disk: 0 -> 176 00010000:00010000:3.0:1784938450.892731:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051f4609e/0x7b044d4128f9e99e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664bf6 expref: 203 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938450.892758:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x4b:0x0] updating lvb size from disk: 0 -> 838 00002000:00010000:3.0:1784938450.892761:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x4b:0x0] updating lvb mtime from disk: 0 -> 1784938445 00002000:00010000:3.0:1784938450.892763:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x4b:0x0] updating lvb ctime from disk: 0 -> 1784938445 00002000:00010000:3.0:1784938450.892764:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x4b:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784938450.892772:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024cec4ff/0x7b044d4128f9d91a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476645ac expref: 202 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938450.892789:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x56:0x0] updating lvb size from disk: 0 -> 13879 00002000:00010000:3.0:1784938450.892791:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x56:0x0] updating lvb mtime from disk: 0 -> 1784938442 00002000:00010000:3.0:1784938450.892793:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x56:0x0] updating lvb ctime from disk: 0 -> 1784938442 00002000:00010000:3.0:1784938450.892795:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x56:0x0] updating lvb blocks from disk: 0 -> 32 00010000:00010000:3.0:1784938450.892802:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008352c51b/0x7b044d4128f9c07e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663df6 expref: 201 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938450.892817:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb size from disk: 0 -> 2475 00002000:00010000:3.0:1784938450.892820:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb mtime from disk: 0 -> 1784938443 00002000:00010000:3.0:1784938450.892822:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb ctime from disk: 0 -> 1784938443 00002000:00010000:3.0:1784938450.892824:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784938450.892832:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015b67b51/0x7b044d4128f9cf50 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664210 expref: 200 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938450.892858:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x4e:0x0] updating lvb size from disk: 0 -> 938 00002000:00010000:3.0:1784938450.892861:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x4e:0x0] updating lvb mtime from disk: 0 -> 1784938446 00002000:00010000:3.0:1784938450.892863:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x4e:0x0] updating lvb ctime from disk: 0 -> 1784938446 00002000:00010000:3.0:1784938450.892865:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x4e:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784938450.892876:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073ebaa12/0x7b044d4128f9db3c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766467e expref: 199 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938450.892895:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 5634 00002000:00010000:3.0:1784938450.892897:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1784938440 00002000:00010000:3.0:1784938450.892900:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 0 -> 1784938440 00002000:00010000:3.0:1784938450.892902:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:3.0:1784938450.892910:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079f5821f/0x7b044d4128f9b246 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766387e expref: 198 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938450.892997:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x5d:0x0] updating lvb size from disk: 0 -> 6821 00002000:00010000:3.0:1784938450.892999:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x5d:0x0] updating lvb mtime from disk: 0 -> 1784938447 00002000:00010000:3.0:1784938450.893001:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x5d:0x0] updating lvb ctime from disk: 0 -> 1784938447 00002000:00010000:3.0:1784938450.893003:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x5d:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:3.0:1784938450.893013:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b91bb11/0x7b044d4128f9e610 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664a98 expref: 197 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938450.893032:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x46:0x0] updating lvb size from disk: 0 -> 674 00002000:00010000:3.0:1784938450.893034:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x46:0x0] updating lvb mtime from disk: 0 -> 1784938445 00002000:00010000:3.0:1784938450.893036:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x46:0x0] updating lvb ctime from disk: 0 -> 1784938445 00002000:00010000:3.0:1784938450.893038:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x46:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784938450.893047:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3ec11b4/0x7b044d4128f9d58c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766444e expref: 196 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938450.893063:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x51:0x0] updating lvb size from disk: 0 -> 3079 00002000:00010000:3.0:1784938450.893065:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x51:0x0] updating lvb mtime from disk: 0 -> 1784938441 00002000:00010000:3.0:1784938450.893067:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x51:0x0] updating lvb ctime from disk: 0 -> 1784938441 00002000:00010000:3.0:1784938450.893069:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x51:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784938450.893077:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090940899/0x7b044d4128f9bcf0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663c98 expref: 195 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938450.893091:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x55:0x0] updating lvb size from disk: 0 -> 6234 00002000:00010000:3.0:1784938450.893094:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x55:0x0] updating lvb mtime from disk: 0 -> 1784938446 00002000:00010000:3.0:1784938450.893095:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x55:0x0] updating lvb ctime from disk: 0 -> 1784938446 00002000:00010000:3.0:1784938450.893098:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x55:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:3.0:1784938450.893104:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b66bf565/0x7b044d4128f9e036 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664868 expref: 194 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938450.893118:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x60:0x0] updating lvb size from disk: 0 -> 10934 00002000:00010000:3.0:1784938450.893121:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x60:0x0] updating lvb mtime from disk: 0 -> 1784938443 00002000:00010000:3.0:1784938450.893123:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x60:0x0] updating lvb ctime from disk: 0 -> 1784938443 00002000:00010000:3.0:1784938450.893672:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x60:0x0] updating lvb blocks from disk: 0 -> 24 00010000:00010000:3.0:1784938450.893687:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0567aa1/0x7b044d4128f9c999 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476640b2 expref: 193 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938450.893709:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x49:0x0] updating lvb size from disk: 0 -> 1754 00002000:00010000:3.0:1784938450.893711:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x49:0x0] updating lvb mtime from disk: 0 -> 1784938445 00002000:00010000:3.0:1784938450.893713:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x49:0x0] updating lvb ctime from disk: 0 -> 1784938445 00002000:00010000:3.0:1784938450.893715:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x49:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784938450.893722:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d109a39b/0x7b044d4128f9d7ae lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664520 expref: 192 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938450.893736:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x58:0x0] updating lvb size from disk: 0 -> 37842 00002000:00010000:3.0:1784938450.893738:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x58:0x0] updating lvb mtime from disk: 0 -> 1784938447 00002000:00010000:3.0:1784938450.893740:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x58:0x0] updating lvb ctime from disk: 0 -> 1784938447 00002000:00010000:3.0:1784938450.893742:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x58:0x0] updating lvb blocks from disk: 0 -> 80 00010000:00010000:3.0:1784938450.893815:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4d7eeea/0x7b044d4128f9e258 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766493a expref: 191 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938450.893834:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x63:0x0] updating lvb size from disk: 0 -> 429670 00002000:00010000:3.0:1784938450.893837:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x63:0x0] updating lvb mtime from disk: 0 -> 1784938443 00002000:00010000:3.0:1784938450.893885:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x63:0x0] updating lvb ctime from disk: 0 -> 1784938443 00002000:00010000:3.0:1784938450.893889:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x63:0x0] updating lvb blocks from disk: 0 -> 840 00010000:00010000:3.0:1784938450.893900:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca51f3c2/0x7b044d4128f9cbbb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664184 expref: 190 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938450.894012:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4c:0x0] updating lvb size from disk: 0 -> 4218 00002000:00010000:3.0:1784938450.894016:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4c:0x0] updating lvb mtime from disk: 0 -> 1784938441 00002000:00010000:3.0:1784938450.894018:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4c:0x0] updating lvb ctime from disk: 0 -> 1784938441 00002000:00010000:3.0:1784938450.894020:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4c:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:3.0:1784938450.894030:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9e05033/0x7b044d4128f9b962 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663b3a expref: 189 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938450.894049:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x67:0x0] updating lvb size from disk: 0 -> 1765 00002000:00010000:3.0:1784938450.894052:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x67:0x0] updating lvb mtime from disk: 0 -> 1784938448 00002000:00010000:3.0:1784938450.894054:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x67:0x0] updating lvb ctime from disk: 0 -> 1784938448 00002000:00010000:3.0:1784938450.894056:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x67:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784938450.894064:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b20eee20/0x7b044d4128f9ed2c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664d54 expref: 188 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938450.894079:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x50:0x0] updating lvb size from disk: 0 -> 269 00002000:00010000:3.0:1784938450.894081:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x50:0x0] updating lvb mtime from disk: 0 -> 1784938446 00002000:00010000:3.0:1784938450.894083:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x50:0x0] updating lvb ctime from disk: 0 -> 1784938446 00002000:00010000:3.0:1784938450.894085:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x50:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784938450.894093:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d902d1a6/0x7b044d4128f9dca8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766470a expref: 187 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938450.894106:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5b:0x0] updating lvb size from disk: 0 -> 1654 00002000:00010000:3.0:1784938450.894109:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5b:0x0] updating lvb mtime from disk: 0 -> 1784938442 00002000:00010000:3.0:1784938450.894110:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5b:0x0] updating lvb ctime from disk: 0 -> 1784938442 00002000:00010000:3.0:1784938450.894112:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5b:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784938450.894119:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003298af1d/0x7b044d4128f9c60b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663f54 expref: 186 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938450.894279:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x44:0x0] updating lvb size from disk: 0 -> 38517 00002000:00010000:3.0:1784938450.894282:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x44:0x0] updating lvb mtime from disk: 0 -> 1784938440 00002000:00010000:3.0:1784938450.894284:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x44:0x0] updating lvb ctime from disk: 0 -> 1784938440 00002000:00010000:3.0:1784938450.894286:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x44:0x0] updating lvb blocks from disk: 0 -> 80 00010000:00010000:3.0:1784938450.894298:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f355ae29/0x7b044d4128f9b3b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766390a expref: 185 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938450.894316:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x5f:0x0] updating lvb size from disk: 0 -> 31711 00002000:00010000:3.0:1784938450.894318:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x5f:0x0] updating lvb mtime from disk: 0 -> 1784938447 00002000:00010000:3.0:1784938450.894320:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x5f:0x0] updating lvb ctime from disk: 0 -> 1784938447 00002000:00010000:3.0:1784938450.894322:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x5f:0x0] updating lvb blocks from disk: 0 -> 64 00010000:00010000:3.0:1784938450.894345:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b04cfea/0x7b044d4128f9e77c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664b24 expref: 184 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.894879:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x48:0x0] updating lvb size from disk: 0 -> 28245 00002000:00010000:2.0:1784938450.894883:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x48:0x0] updating lvb mtime from disk: 0 -> 1784938445 00002000:00010000:2.0:1784938450.894885:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x48:0x0] updating lvb ctime from disk: 0 -> 1784938445 00002000:00010000:2.0:1784938450.894887:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x48:0x0] updating lvb blocks from disk: 0 -> 56 00010000:00010000:2.0:1784938450.894899:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c1f297b/0x7b044d4128f9d6f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476644da expref: 183 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.894930:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x53:0x0] updating lvb size from disk: 0 -> 1790 00002000:00010000:2.0:1784938450.894934:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x53:0x0] updating lvb mtime from disk: 0 -> 1784938441 00002000:00010000:2.0:1784938450.894936:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x53:0x0] updating lvb ctime from disk: 0 -> 1784938441 00002000:00010000:2.0:1784938450.894938:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x53:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1784938450.894947:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9ba2df7/0x7b044d4128f9be5c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663d24 expref: 182 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.894974:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x57:0x0] updating lvb size from disk: 0 -> 2129 00002000:00010000:2.0:1784938450.894976:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x57:0x0] updating lvb mtime from disk: 0 -> 1784938446 00002000:00010000:2.0:1784938450.894978:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x57:0x0] updating lvb ctime from disk: 0 -> 1784938446 00002000:00010000:2.0:1784938450.894980:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x57:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1784938450.894989:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a481461f/0x7b044d4128f9e1a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476648f4 expref: 181 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.895005:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x62:0x0] updating lvb size from disk: 0 -> 254129 00002000:00010000:2.0:1784938450.895008:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x62:0x0] updating lvb mtime from disk: 0 -> 1784938443 00002000:00010000:2.0:1784938450.895010:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x62:0x0] updating lvb ctime from disk: 0 -> 1784938443 00002000:00010000:2.0:1784938450.895012:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x62:0x0] updating lvb blocks from disk: 0 -> 504 00010000:00010000:2.0:1784938450.895019:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002f45a6a/0x7b044d4128f9cb05 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766413e expref: 180 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.895035:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x5a:0x0] updating lvb size from disk: 0 -> 1753 00002000:00010000:2.0:1784938450.895038:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x5a:0x0] updating lvb mtime from disk: 0 -> 1784938447 00002000:00010000:2.0:1784938450.895040:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x5a:0x0] updating lvb ctime from disk: 0 -> 1784938447 00002000:00010000:2.0:1784938450.895042:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x5a:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1784938450.895049:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc245ddc/0x7b044d4128f9e3c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476649c6 expref: 179 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.895065:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x43:0x0] updating lvb size from disk: 0 -> 391200 00002000:00010000:2.0:1784938450.895068:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x43:0x0] updating lvb mtime from disk: 0 -> 1784938444 00002000:00010000:2.0:1784938450.895070:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x43:0x0] updating lvb ctime from disk: 0 -> 1784938444 00002000:00010000:2.0:1784938450.895071:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x43:0x0] updating lvb blocks from disk: 0 -> 768 00010000:00010000:2.0:1784938450.895080:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000735f81e4/0x7b044d4128f9d36a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->393215) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766437c expref: 178 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.895096:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4e:0x0] updating lvb size from disk: 0 -> 55540 00002000:00010000:2.0:1784938450.895098:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4e:0x0] updating lvb mtime from disk: 0 -> 1784938441 00002000:00010000:2.0:1784938450.895100:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4e:0x0] updating lvb ctime from disk: 0 -> 1784938441 00002000:00010000:2.0:1784938450.895102:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4e:0x0] updating lvb blocks from disk: 0 -> 112 00010000:00010000:2.0:1784938450.895110:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c6719e5/0x7b044d4128f9bace lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663bc6 expref: 177 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.895125:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x52:0x0] updating lvb size from disk: 0 -> 4150 00002000:00010000:2.0:1784938450.895128:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x52:0x0] updating lvb mtime from disk: 0 -> 1784938446 00002000:00010000:2.0:1784938450.895130:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x52:0x0] updating lvb ctime from disk: 0 -> 1784938446 00002000:00010000:2.0:1784938450.895132:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x52:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:2.0:1784938450.895140:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baaa6dd1/0x7b044d4128f9de14 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664796 expref: 176 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.895191:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5d:0x0] updating lvb size from disk: 0 -> 116978 00002000:00010000:2.0:1784938450.895193:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5d:0x0] updating lvb mtime from disk: 0 -> 1784938442 00002000:00010000:2.0:1784938450.895195:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5d:0x0] updating lvb ctime from disk: 0 -> 1784938442 00002000:00010000:2.0:1784938450.895197:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5d:0x0] updating lvb blocks from disk: 0 -> 232 00010000:00010000:2.0:1784938450.895206:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097a14a2c/0x7b044d4128f9c777 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663fe0 expref: 175 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.895222:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x61:0x0] updating lvb size from disk: 0 -> 227516 00002000:00010000:2.0:1784938450.895224:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x61:0x0] updating lvb mtime from disk: 0 -> 1784938447 00002000:00010000:2.0:1784938450.895226:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x61:0x0] updating lvb ctime from disk: 0 -> 1784938447 00002000:00010000:2.0:1784938450.895228:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x61:0x0] updating lvb blocks from disk: 0 -> 448 00010000:00010000:2.0:1784938450.895235:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b7dca5e/0x7b044d4128f9e8e8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664bb0 expref: 174 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.895249:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x49:0x0] updating lvb size from disk: 0 -> 4915 00002000:00010000:2.0:1784938450.895252:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x49:0x0] updating lvb mtime from disk: 0 -> 1784938440 00002000:00010000:2.0:1784938450.895254:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x49:0x0] updating lvb ctime from disk: 0 -> 1784938440 00002000:00010000:2.0:1784938450.895255:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x49:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:2.0:1784938450.895270:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce195e5a/0x7b044d4128f9b740 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663a68 expref: 173 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.895286:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x64:0x0] updating lvb size from disk: 0 -> 26716 00002000:00010000:2.0:1784938450.895288:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x64:0x0] updating lvb mtime from disk: 0 -> 1784938448 00002000:00010000:2.0:1784938450.895290:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x64:0x0] updating lvb ctime from disk: 0 -> 1784938448 00002000:00010000:2.0:1784938450.895292:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x64:0x0] updating lvb blocks from disk: 0 -> 56 00010000:00010000:2.0:1784938450.895300:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000208c6716/0x7b044d4128f9eb0a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664c82 expref: 172 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.895314:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x4d:0x0] updating lvb size from disk: 0 -> 3006 00002000:00010000:2.0:1784938450.895316:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x4d:0x0] updating lvb mtime from disk: 0 -> 1784938445 00002000:00010000:2.0:1784938450.895317:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x4d:0x0] updating lvb ctime from disk: 0 -> 1784938445 00002000:00010000:2.0:1784938450.895319:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x4d:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1784938450.895326:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b85dfb87/0x7b044d4128f9da86 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664638 expref: 171 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.895343:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x58:0x0] updating lvb size from disk: 0 -> 423 00002000:00010000:2.0:1784938450.895345:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x58:0x0] updating lvb mtime from disk: 0 -> 1784938442 00002000:00010000:2.0:1784938450.895348:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x58:0x0] updating lvb ctime from disk: 0 -> 1784938442 00002000:00010000:2.0:1784938450.895349:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x58:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1784938450.895356:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084429e5d/0x7b044d4128f9c1ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663e82 expref: 170 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.895383:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x5c:0x0] updating lvb size from disk: 0 -> 6548 00002000:00010000:2.0:1784938450.895385:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x5c:0x0] updating lvb mtime from disk: 0 -> 1784938447 00002000:00010000:2.0:1784938450.895387:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x5c:0x0] updating lvb ctime from disk: 0 -> 1784938447 00002000:00010000:2.0:1784938450.895389:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x5c:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:2.0:1784938450.895396:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a14dc117/0x7b044d4128f9e55a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664a52 expref: 169 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.895412:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x67:0x0] updating lvb size from disk: 0 -> 316748 00002000:00010000:2.0:1784938450.895414:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x67:0x0] updating lvb mtime from disk: 0 -> 1784938443 00002000:00010000:2.0:1784938450.895416:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x67:0x0] updating lvb ctime from disk: 0 -> 1784938443 00002000:00010000:2.0:1784938450.895417:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x67:0x0] updating lvb blocks from disk: 0 -> 624 00010000:00010000:2.0:1784938450.895424:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042554b23/0x7b044d4128f9d0bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766429c expref: 168 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.895439:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x69:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:2.0:1784938450.895441:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x69:0x0] updating lvb mtime from disk: 0 -> 1784938448 00002000:00010000:2.0:1784938450.895443:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x69:0x0] updating lvb ctime from disk: 0 -> 1784938448 00002000:00010000:2.0:1784938450.895445:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x69:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:2.0:1784938450.895451:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d1223b5/0x7b044d4128f9ee6e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664dbd expref: 167 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.895466:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4b:0x0] updating lvb size from disk: 0 -> 2858 00002000:00010000:2.0:1784938450.895469:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4b:0x0] updating lvb mtime from disk: 0 -> 1784938441 00002000:00010000:2.0:1784938450.895471:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4b:0x0] updating lvb ctime from disk: 0 -> 1784938441 00002000:00010000:2.0:1784938450.895472:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4b:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1784938450.895557:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000317a9dcc/0x7b044d4128f9b8ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663af4 expref: 166 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.895578:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x66:0x0] updating lvb size from disk: 0 -> 24288 00002000:00010000:2.0:1784938450.895580:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x66:0x0] updating lvb mtime from disk: 0 -> 1784938448 00002000:00010000:2.0:1784938450.895582:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x66:0x0] updating lvb ctime from disk: 0 -> 1784938448 00002000:00010000:2.0:1784938450.895584:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x66:0x0] updating lvb blocks from disk: 0 -> 48 00010000:00010000:2.0:1784938450.895592:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066613dfd/0x7b044d4128f9ec76 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664d0e expref: 165 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.895606:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x4f:0x0] updating lvb size from disk: 0 -> 6813 00002000:00010000:2.0:1784938450.895609:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x4f:0x0] updating lvb mtime from disk: 0 -> 1784938446 00002000:00010000:2.0:1784938450.895611:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x4f:0x0] updating lvb ctime from disk: 0 -> 1784938446 00002000:00010000:2.0:1784938450.895613:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x4f:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:2.0:1784938450.895621:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e022c2b/0x7b044d4128f9dbf2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476646c4 expref: 164 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.895635:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5a:0x0] updating lvb size from disk: 0 -> 1408 00002000:00010000:2.0:1784938450.895638:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5a:0x0] updating lvb mtime from disk: 0 -> 1784938442 00002000:00010000:2.0:1784938450.895640:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5a:0x0] updating lvb ctime from disk: 0 -> 1784938442 00002000:00010000:2.0:1784938450.895642:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5a:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1784938450.895649:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000527ab402/0x7b044d4128f9c555 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663f0e expref: 163 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.895669:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x43:0x0] updating lvb size from disk: 0 -> 1735 00002000:00010000:2.0:1784938450.895672:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x43:0x0] updating lvb mtime from disk: 0 -> 1784938440 00002000:00010000:2.0:1784938450.895674:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x43:0x0] updating lvb ctime from disk: 0 -> 1784938440 00002000:00010000:2.0:1784938450.895676:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x43:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1784938450.895683:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060abbce8/0x7b044d4128f9b2fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476638c4 expref: 162 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.895697:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x5e:0x0] updating lvb size from disk: 0 -> 143467 00002000:00010000:2.0:1784938450.895700:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x5e:0x0] updating lvb mtime from disk: 0 -> 1784938447 00002000:00010000:2.0:1784938450.895702:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x5e:0x0] updating lvb ctime from disk: 0 -> 1784938447 00002000:00010000:2.0:1784938450.895704:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x5e:0x0] updating lvb blocks from disk: 0 -> 288 00010000:00010000:2.0:1784938450.895712:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c010a79b/0x7b044d4128f9e6c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664ade expref: 161 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.895725:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x42:0x0] updating lvb size from disk: 0 -> 903 00002000:00010000:2.0:1784938450.895727:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x42:0x0] updating lvb mtime from disk: 0 -> 1784938444 00002000:00010000:2.0:1784938450.895729:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x42:0x0] updating lvb ctime from disk: 0 -> 1784938444 00002000:00010000:2.0:1784938450.895730:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x42:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1784938450.895736:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053c02e33/0x7b044d4128f9d28a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664328 expref: 160 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.895749:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb size from disk: 0 -> 9198 00002000:00010000:2.0:1784938450.895752:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb mtime from disk: 0 -> 1784938440 00002000:00010000:2.0:1784938450.895754:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb ctime from disk: 0 -> 1784938440 00002000:00010000:2.0:1784938450.895756:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb blocks from disk: 0 -> 24 00010000:00010000:2.0:1784938450.895764:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a5e02e4/0x7b044d4128f9b51e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663996 expref: 159 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.895778:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x4a:0x0] updating lvb size from disk: 0 -> 1613 00002000:00010000:2.0:1784938450.895780:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x4a:0x0] updating lvb mtime from disk: 0 -> 1784938445 00002000:00010000:2.0:1784938450.895782:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x4a:0x0] updating lvb ctime from disk: 0 -> 1784938445 00002000:00010000:2.0:1784938450.895784:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x4a:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1784938450.895791:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061bd733a/0x7b044d4128f9d864 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664566 expref: 158 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.895804:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x55:0x0] updating lvb size from disk: 0 -> 111139 00002000:00010000:2.0:1784938450.895806:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x55:0x0] updating lvb mtime from disk: 0 -> 1784938441 00002000:00010000:2.0:1784938450.895808:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x55:0x0] updating lvb ctime from disk: 0 -> 1784938441 00002000:00010000:2.0:1784938450.895810:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x55:0x0] updating lvb blocks from disk: 0 -> 224 00010000:00010000:2.0:1784938450.895817:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d3e07c9/0x7b044d4128f9bfc8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663db0 expref: 157 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.895832:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x59:0x0] updating lvb size from disk: 0 -> 1342 00002000:00010000:2.0:1784938450.895835:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x59:0x0] updating lvb mtime from disk: 0 -> 1784938447 00002000:00010000:2.0:1784938450.895837:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x59:0x0] updating lvb ctime from disk: 0 -> 1784938447 00002000:00010000:2.0:1784938450.895838:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x59:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1784938450.895846:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fcd2670/0x7b044d4128f9e30e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664980 expref: 156 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.895860:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x64:0x0] updating lvb size from disk: 0 -> 1179443 00002000:00010000:2.0:1784938450.895862:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x64:0x0] updating lvb mtime from disk: 0 -> 1784938443 00002000:00010000:2.0:1784938450.895864:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x64:0x0] updating lvb ctime from disk: 0 -> 1784938443 00002000:00010000:2.0:1784938450.895866:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x64:0x0] updating lvb blocks from disk: 0 -> 2304 00010000:00010000:2.0:1784938450.895874:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000247bc25a/0x7b044d4128f9cd58 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1179647) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476641ca expref: 155 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.895888:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4d:0x0] updating lvb size from disk: 0 -> 2192 00002000:00010000:2.0:1784938450.895890:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4d:0x0] updating lvb mtime from disk: 0 -> 1784938441 00002000:00010000:2.0:1784938450.895892:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4d:0x0] updating lvb ctime from disk: 0 -> 1784938441 00002000:00010000:2.0:1784938450.895894:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4d:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1784938450.895901:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000548150d6/0x7b044d4128f9ba18 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663b80 expref: 154 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.895915:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x68:0x0] updating lvb size from disk: 0 -> 4512 00002000:00010000:2.0:1784938450.895917:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x68:0x0] updating lvb mtime from disk: 0 -> 1784938448 00002000:00010000:2.0:1784938450.895919:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x68:0x0] updating lvb ctime from disk: 0 -> 1784938448 00002000:00010000:2.0:1784938450.895921:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x68:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:2.0:1784938450.895929:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7577f35/0x7b044d4128f9ede2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664d9a expref: 153 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.895946:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x45:0x0] updating lvb size from disk: 0 -> 39343 00002000:00010000:2.0:1784938450.895948:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x45:0x0] updating lvb mtime from disk: 0 -> 1784938445 00002000:00010000:2.0:1784938450.895950:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x45:0x0] updating lvb ctime from disk: 0 -> 1784938445 00002000:00010000:2.0:1784938450.895951:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x45:0x0] updating lvb blocks from disk: 0 -> 80 00010000:00010000:2.0:1784938450.895958:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f9d2d67/0x7b044d4128f9d4d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664408 expref: 152 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.895972:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x50:0x0] updating lvb size from disk: 0 -> 234 00002000:00010000:2.0:1784938450.895975:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x50:0x0] updating lvb mtime from disk: 0 -> 1784938441 00002000:00010000:2.0:1784938450.895977:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x50:0x0] updating lvb ctime from disk: 0 -> 1784938441 00002000:00010000:2.0:1784938450.895979:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x50:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1784938450.895985:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc854c8a/0x7b044d4128f9bc3a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663c52 expref: 151 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.896000:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x54:0x0] updating lvb size from disk: 0 -> 1694 00002000:00010000:2.0:1784938450.896002:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x54:0x0] updating lvb mtime from disk: 0 -> 1784938446 00002000:00010000:2.0:1784938450.896004:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x54:0x0] updating lvb ctime from disk: 0 -> 1784938446 00002000:00010000:2.0:1784938450.896006:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x54:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1784938450.896013:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f2d18e0/0x7b044d4128f9df80 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664822 expref: 150 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.896028:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5f:0x0] updating lvb size from disk: 0 -> 215293 00002000:00010000:2.0:1784938450.896031:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5f:0x0] updating lvb mtime from disk: 0 -> 1784938442 00002000:00010000:2.0:1784938450.896032:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5f:0x0] updating lvb ctime from disk: 0 -> 1784938442 00002000:00010000:2.0:1784938450.896034:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5f:0x0] updating lvb blocks from disk: 0 -> 424 00010000:00010000:2.0:1784938450.896043:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010729705/0x7b044d4128f9c8e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766406c expref: 149 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.896057:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x48:0x0] updating lvb size from disk: 0 -> 704 00002000:00010000:2.0:1784938450.896059:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x48:0x0] updating lvb mtime from disk: 0 -> 1784938440 00002000:00010000:2.0:1784938450.896061:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x48:0x0] updating lvb ctime from disk: 0 -> 1784938440 00002000:00010000:2.0:1784938450.896062:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x48:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1784938450.896070:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bcdde69f/0x7b044d4128f9b68a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663a22 expref: 148 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.896084:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x63:0x0] updating lvb size from disk: 0 -> 42517 00002000:00010000:2.0:1784938450.896087:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x63:0x0] updating lvb mtime from disk: 0 -> 1784938448 00002000:00010000:2.0:1784938450.896089:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x63:0x0] updating lvb ctime from disk: 0 -> 1784938448 00002000:00010000:2.0:1784938450.896090:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x63:0x0] updating lvb blocks from disk: 0 -> 88 00010000:00010000:2.0:1784938450.896098:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7d699b7/0x7b044d4128f9ea54 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664c3c expref: 147 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.896112:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x4c:0x0] updating lvb size from disk: 0 -> 18269 00002000:00010000:2.0:1784938450.896115:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x4c:0x0] updating lvb mtime from disk: 0 -> 1784938445 00002000:00010000:2.0:1784938450.896117:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x4c:0x0] updating lvb ctime from disk: 0 -> 1784938445 00002000:00010000:2.0:1784938450.896119:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x4c:0x0] updating lvb blocks from disk: 0 -> 40 00010000:00010000:2.0:1784938450.896126:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023ff2a33/0x7b044d4128f9d9d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476645f2 expref: 146 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.896141:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x57:0x0] updating lvb size from disk: 0 -> 158096 00002000:00010000:2.0:1784938450.896168:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x57:0x0] updating lvb mtime from disk: 0 -> 1784938442 00002000:00010000:2.0:1784938450.896170:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x57:0x0] updating lvb ctime from disk: 0 -> 1784938442 00002000:00010000:2.0:1784938450.896173:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x57:0x0] updating lvb blocks from disk: 0 -> 312 00010000:00010000:2.0:1784938450.896181:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fda55582/0x7b044d4128f9c134 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663e3c expref: 145 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.896198:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x5b:0x0] updating lvb size from disk: 0 -> 855 00002000:00010000:2.0:1784938450.896200:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x5b:0x0] updating lvb mtime from disk: 0 -> 1784938447 00002000:00010000:2.0:1784938450.896203:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x5b:0x0] updating lvb ctime from disk: 0 -> 1784938447 00002000:00010000:2.0:1784938450.896205:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x5b:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1784938450.896212:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029fd9487/0x7b044d4128f9e47a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664a0c expref: 144 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.896231:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x66:0x0] updating lvb size from disk: 0 -> 1611 00002000:00010000:2.0:1784938450.896234:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x66:0x0] updating lvb mtime from disk: 0 -> 1784938443 00002000:00010000:2.0:1784938450.896236:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x66:0x0] updating lvb ctime from disk: 0 -> 1784938443 00002000:00010000:2.0:1784938450.896238:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x66:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1784938450.896246:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e25b04f/0x7b044d4128f9d006 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664256 expref: 143 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.896260:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x44:0x0] updating lvb size from disk: 0 -> 9974 00002000:00010000:2.0:1784938450.896273:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x44:0x0] updating lvb mtime from disk: 0 -> 1784938444 00002000:00010000:2.0:1784938450.896275:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x44:0x0] updating lvb ctime from disk: 0 -> 1784938444 00002000:00010000:2.0:1784938450.896277:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x44:0x0] updating lvb blocks from disk: 0 -> 24 00010000:00010000:2.0:1784938450.896286:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e54ea8ff/0x7b044d4128f9d420 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476643c2 expref: 142 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.896300:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4f:0x0] updating lvb size from disk: 0 -> 6213 00002000:00010000:2.0:1784938450.896303:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4f:0x0] updating lvb mtime from disk: 0 -> 1784938441 00002000:00010000:2.0:1784938450.896304:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4f:0x0] updating lvb ctime from disk: 0 -> 1784938441 00002000:00010000:2.0:1784938450.896306:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4f:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:2.0:1784938450.896313:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0b73105/0x7b044d4128f9bb84 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663c0c expref: 141 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.896326:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x47:0x0] updating lvb size from disk: 0 -> 2659 00002000:00010000:2.0:1784938450.896328:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x47:0x0] updating lvb mtime from disk: 0 -> 1784938445 00002000:00010000:2.0:1784938450.896329:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x47:0x0] updating lvb ctime from disk: 0 -> 1784938445 00002000:00010000:2.0:1784938450.896331:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x47:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1784938450.896339:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077eceeb9/0x7b044d4128f9d642 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664494 expref: 140 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.896352:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x52:0x0] updating lvb size from disk: 0 -> 7185 00002000:00010000:2.0:1784938450.896355:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x52:0x0] updating lvb mtime from disk: 0 -> 1784938441 00002000:00010000:2.0:1784938450.896357:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x52:0x0] updating lvb ctime from disk: 0 -> 1784938441 00002000:00010000:2.0:1784938450.896360:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x52:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:2.0:1784938450.896367:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a00afcf/0x7b044d4128f9bda6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663cde expref: 139 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.896384:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x56:0x0] updating lvb size from disk: 0 -> 35427 00002000:00010000:2.0:1784938450.896386:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x56:0x0] updating lvb mtime from disk: 0 -> 1784938446 00002000:00010000:2.0:1784938450.896388:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x56:0x0] updating lvb ctime from disk: 0 -> 1784938446 00002000:00010000:2.0:1784938450.896390:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x56:0x0] updating lvb blocks from disk: 0 -> 72 00010000:00010000:2.0:1784938450.896398:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005777c505/0x7b044d4128f9e0ec lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476648ae expref: 138 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.896412:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x61:0x0] updating lvb size from disk: 0 -> 159678 00002000:00010000:2.0:1784938450.896415:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x61:0x0] updating lvb mtime from disk: 0 -> 1784938443 00002000:00010000:2.0:1784938450.896417:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x61:0x0] updating lvb ctime from disk: 0 -> 1784938443 00002000:00010000:2.0:1784938450.896419:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x61:0x0] updating lvb blocks from disk: 0 -> 312 00010000:00010000:2.0:1784938450.896427:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc902b02/0x7b044d4128f9ca4f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476640f8 expref: 137 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.896443:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4a:0x0] updating lvb size from disk: 0 -> 16001 00002000:00010000:2.0:1784938450.896445:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4a:0x0] updating lvb mtime from disk: 0 -> 1784938441 00002000:00010000:2.0:1784938450.896447:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4a:0x0] updating lvb ctime from disk: 0 -> 1784938441 00002000:00010000:2.0:1784938450.896450:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4a:0x0] updating lvb blocks from disk: 0 -> 32 00010000:00010000:2.0:1784938450.896457:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005890b19b/0x7b044d4128f9b7f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663aae expref: 136 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.896473:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x65:0x0] updating lvb size from disk: 0 -> 5105 00002000:00010000:2.0:1784938450.897050:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x65:0x0] updating lvb mtime from disk: 0 -> 1784938448 00002000:00010000:2.0:1784938450.897055:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x65:0x0] updating lvb ctime from disk: 0 -> 1784938448 00002000:00010000:2.0:1784938450.897057:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x65:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:2.0:1784938450.897073:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097541b4a/0x7b044d4128f9ebc0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664cc8 expref: 135 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.897093:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x59:0x0] updating lvb size from disk: 0 -> 1659 00002000:00010000:2.0:1784938450.897096:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x59:0x0] updating lvb mtime from disk: 0 -> 1784938442 00002000:00010000:2.0:1784938450.897097:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x59:0x0] updating lvb ctime from disk: 0 -> 1784938442 00002000:00010000:2.0:1784938450.897099:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x59:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1784938450.897106:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f10ec8f1/0x7b044d4128f9c43d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663ec8 expref: 134 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.897120:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x51:0x0] updating lvb size from disk: 0 -> 4117 00002000:00010000:2.0:1784938450.897122:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x51:0x0] updating lvb mtime from disk: 0 -> 1784938446 00002000:00010000:2.0:1784938450.897123:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x51:0x0] updating lvb ctime from disk: 0 -> 1784938446 00002000:00010000:2.0:1784938450.897126:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x51:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:2.0:1784938450.897133:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4e718c3/0x7b044d4128f9dd5e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664750 expref: 133 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.897220:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5c:0x0] updating lvb size from disk: 0 -> 4750 00002000:00010000:2.0:1784938450.897223:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5c:0x0] updating lvb mtime from disk: 0 -> 1784938442 00002000:00010000:2.0:1784938450.897226:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5c:0x0] updating lvb ctime from disk: 0 -> 1784938442 00002000:00010000:2.0:1784938450.897227:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5c:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:2.0:1784938450.897236:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb1ec7ed/0x7b044d4128f9c6c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663f9a expref: 132 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.897251:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x45:0x0] updating lvb size from disk: 0 -> 15476 00002000:00010000:2.0:1784938450.897253:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x45:0x0] updating lvb mtime from disk: 0 -> 1784938440 00002000:00010000:2.0:1784938450.897255:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x45:0x0] updating lvb ctime from disk: 0 -> 1784938440 00002000:00010000:2.0:1784938450.897257:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x45:0x0] updating lvb blocks from disk: 0 -> 32 00010000:00010000:2.0:1784938450.897274:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006680760a/0x7b044d4128f9b468 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663950 expref: 131 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.897289:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x60:0x0] updating lvb size from disk: 0 -> 198050 00002000:00010000:2.0:1784938450.897291:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x60:0x0] updating lvb mtime from disk: 0 -> 1784938447 00002000:00010000:2.0:1784938450.897292:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x60:0x0] updating lvb ctime from disk: 0 -> 1784938447 00002000:00010000:2.0:1784938450.897294:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x60:0x0] updating lvb blocks from disk: 0 -> 392 00010000:00010000:2.0:1784938450.897302:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea7f802e/0x7b044d4128f9e832 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664b6a expref: 130 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938450.897316:0:19222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x54:0x0] updating lvb size from disk: 0 -> 6430 00002000:00010000:2.0:1784938450.897318:0:19222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x54:0x0] updating lvb mtime from disk: 0 -> 1784938441 00002000:00010000:2.0:1784938450.897320:0:19222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x54:0x0] updating lvb ctime from disk: 0 -> 1784938441 00002000:00010000:2.0:1784938450.897322:0:19222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x54:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:2.0:1784938450.897329:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004766fa96/0x7b044d4128f9bf12 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663d6a expref: 129 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.897342:0:19222:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9f2489213800, canceled 78 locks, left on hash table 0. 00010000:00010000:2.0:1784938450.897560:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938450.897563:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938450.897565:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938450.931675:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938450.931812:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337615104 00000100:00100000:3.0:1784938450.931821:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337615104 00000100:00100000:3.0:1784938450.931886:0:25720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 981 00000100:00100000:3.0:1784938450.931896:0:25720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7ea6e988-18ba-4c98-b179-17995571b98b+229:10956:x1871643337615104:12345-192.168.202.54@tcp:9:umount.0 00000020:00000080:3.0:1784938450.931927:0:25720:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9877b 00000020:00010000:3.0:1784938450.931936:0:25720:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9f2489217000: total 0 00000100:00080000:3.0:1784938450.931941:0:25720:0:(import.c:65:import_set_state_nolock()) ffff9f2489212000 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1784938450.932328:0:19223:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9f2489217000: total 0 00010000:00010000:0.0:1784938450.932539:0:19223:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9f2489217000, canceled 0 locks, left on hash table 78. 00002000:00010000:0.0:1784938450.932568:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x55:0x0] updating lvb size from disk: 0 -> 111139 00002000:00010000:0.0:1784938450.932571:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x55:0x0] updating lvb mtime from disk: 0 -> 1784938446 00002000:00010000:0.0:1784938450.932572:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x55:0x0] updating lvb ctime from disk: 0 -> 1784938446 00002000:00010000:0.0:1784938450.932574:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x55:0x0] updating lvb blocks from disk: 0 -> 224 00010000:00010000:0.0:1784938450.932596:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d60587d/0x7b044d4128f9e091 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766488b expref: 228 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.932617:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x61:0x0] updating lvb size from disk: 0 -> 227516 00002000:00010000:0.0:1784938450.932618:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x61:0x0] updating lvb mtime from disk: 0 -> 1784938443 00002000:00010000:0.0:1784938450.932619:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x61:0x0] updating lvb ctime from disk: 0 -> 1784938443 00002000:00010000:0.0:1784938450.932621:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x61:0x0] updating lvb blocks from disk: 0 -> 448 00010000:00010000:0.0:1784938450.932625:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac59fab1/0x7b044d4128f9c9f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476640d5 expref: 227 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.932636:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4a:0x0] updating lvb size from disk: 0 -> 1613 00002000:00010000:0.0:1784938450.932638:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4a:0x0] updating lvb mtime from disk: 0 -> 1784938441 00002000:00010000:0.0:1784938450.932639:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4a:0x0] updating lvb ctime from disk: 0 -> 1784938441 00002000:00010000:0.0:1784938450.932641:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4a:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784938450.932645:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018157374/0x7b044d4128f9b79b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663a8b expref: 226 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.932653:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x64:0x0] updating lvb size from disk: 0 -> 1179443 00002000:00010000:0.0:1784938450.932654:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x64:0x0] updating lvb mtime from disk: 0 -> 1784938448 00002000:00010000:0.0:1784938450.932656:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x64:0x0] updating lvb ctime from disk: 0 -> 1784938448 00002000:00010000:0.0:1784938450.932658:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x64:0x0] updating lvb blocks from disk: 0 -> 2304 00010000:00010000:0.0:1784938450.932662:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a97217e/0x7b044d4128f9eb65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1179647) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664ca5 expref: 225 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.932672:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4d:0x0] updating lvb size from disk: 0 -> 2192 00002000:00010000:0.0:1784938450.932673:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4d:0x0] updating lvb mtime from disk: 0 -> 1784938445 00002000:00010000:0.0:1784938450.932674:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4d:0x0] updating lvb ctime from disk: 0 -> 1784938445 00002000:00010000:0.0:1784938450.932675:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4d:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784938450.932679:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0e9597c/0x7b044d4128f9dae1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766465b expref: 224 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.932690:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x59:0x0] updating lvb size from disk: 0 -> 1342 00002000:00010000:0.0:1784938450.932691:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x59:0x0] updating lvb mtime from disk: 0 -> 1784938442 00002000:00010000:0.0:1784938450.932692:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x59:0x0] updating lvb ctime from disk: 0 -> 1784938442 00002000:00010000:0.0:1784938450.932694:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x59:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784938450.932698:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e0722b4/0x7b044d4128f9c245 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663ea5 expref: 223 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.932707:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x68:0x0] updating lvb size from disk: 0 -> 4512 00002000:00010000:0.0:1784938450.932708:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x68:0x0] updating lvb mtime from disk: 0 -> 1784938443 00002000:00010000:0.0:1784938450.932709:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x68:0x0] updating lvb ctime from disk: 0 -> 1784938443 00002000:00010000:0.0:1784938450.932710:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x68:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:0.0:1784938450.932715:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e54e2326/0x7b044d4128f9d117 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476642bf expref: 222 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.932725:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x50:0x0] updating lvb size from disk: 0 -> 234 00002000:00010000:0.0:1784938450.932727:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x50:0x0] updating lvb mtime from disk: 0 -> 1784938446 00002000:00010000:0.0:1784938450.932728:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x50:0x0] updating lvb ctime from disk: 0 -> 1784938446 00002000:00010000:0.0:1784938450.932729:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x50:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784938450.932734:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c14136c/0x7b044d4128f9dd03 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766472d expref: 221 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.932742:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5c:0x0] updating lvb size from disk: 0 -> 6548 00002000:00010000:0.0:1784938450.932744:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5c:0x0] updating lvb mtime from disk: 0 -> 1784938442 00002000:00010000:0.0:1784938450.932745:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5c:0x0] updating lvb ctime from disk: 0 -> 1784938442 00002000:00010000:0.0:1784938450.932747:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5c:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:0.0:1784938450.932754:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ae1c5a0/0x7b044d4128f9c666 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663f77 expref: 220 pid: 25719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.932768:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x45:0x0] updating lvb size from disk: 0 -> 39343 00002000:00010000:0.0:1784938450.932770:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x45:0x0] updating lvb mtime from disk: 0 -> 1784938440 00002000:00010000:0.0:1784938450.932772:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x45:0x0] updating lvb ctime from disk: 0 -> 1784938440 00002000:00010000:0.0:1784938450.932774:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x45:0x0] updating lvb blocks from disk: 0 -> 80 00010000:00010000:0.0:1784938450.932781:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000347a1fc2/0x7b044d4128f9b40d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766392d expref: 219 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.932797:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb size from disk: 0 -> 215293 00002000:00010000:0.0:1784938450.932799:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb mtime from disk: 0 -> 1784938447 00002000:00010000:0.0:1784938450.932801:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb ctime from disk: 0 -> 1784938447 00002000:00010000:0.0:1784938450.932803:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5f:0x0] updating lvb blocks from disk: 0 -> 424 00010000:00010000:0.0:1784938450.932809:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ff6aa56/0x7b044d4128f9e7d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664b47 expref: 218 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.932832:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x48:0x0] updating lvb size from disk: 0 -> 704 00002000:00010000:0.0:1784938450.932834:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x48:0x0] updating lvb mtime from disk: 0 -> 1784938445 00002000:00010000:0.0:1784938450.932836:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x48:0x0] updating lvb ctime from disk: 0 -> 1784938445 00002000:00010000:0.0:1784938450.932837:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x48:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784938450.932843:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a322968/0x7b044d4128f9d753 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476644fd expref: 217 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.932858:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x54:0x0] updating lvb size from disk: 0 -> 1694 00002000:00010000:0.0:1784938450.932860:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x54:0x0] updating lvb mtime from disk: 0 -> 1784938441 00002000:00010000:0.0:1784938450.932862:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x54:0x0] updating lvb ctime from disk: 0 -> 1784938441 00002000:00010000:0.0:1784938450.932864:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x54:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784938450.932871:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000016c25f1/0x7b044d4128f9beb7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663d47 expref: 216 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.932885:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x63:0x0] updating lvb size from disk: 0 -> 42517 00002000:00010000:0.0:1784938450.932888:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x63:0x0] updating lvb mtime from disk: 0 -> 1784938443 00002000:00010000:0.0:1784938450.932890:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x63:0x0] updating lvb ctime from disk: 0 -> 1784938443 00002000:00010000:0.0:1784938450.932892:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x63:0x0] updating lvb blocks from disk: 0 -> 88 00010000:00010000:0.0:1784938450.932900:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000164ff879/0x7b044d4128f9cb60 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664161 expref: 215 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.932912:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x69:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:0.0:1784938450.932913:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x69:0x0] updating lvb mtime from disk: 0 -> 1784938444 00002000:00010000:0.0:1784938450.932915:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x69:0x0] updating lvb ctime from disk: 0 -> 1784938444 00002000:00010000:0.0:1784938450.932917:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x69:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:0.0:1784938450.932925:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000057fcbbb/0x7b044d4128f9d1a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642e2 expref: 214 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.932940:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4b:0x0] updating lvb size from disk: 0 -> 2858 00002000:00010000:0.0:1784938450.932942:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4b:0x0] updating lvb mtime from disk: 0 -> 1784938445 00002000:00010000:0.0:1784938450.932945:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4b:0x0] updating lvb ctime from disk: 0 -> 1784938445 00002000:00010000:0.0:1784938450.932947:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4b:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784938450.932954:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1d7f9cb/0x7b044d4128f9d975 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476645cf expref: 213 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.932970:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5a:0x0] updating lvb size from disk: 0 -> 1408 00002000:00010000:0.0:1784938450.932972:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5a:0x0] updating lvb mtime from disk: 0 -> 1784938447 00002000:00010000:0.0:1784938450.932974:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5a:0x0] updating lvb ctime from disk: 0 -> 1784938447 00002000:00010000:0.0:1784938450.932976:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5a:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784938450.933275:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0f0b59d/0x7b044d4128f9e41f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476649e9 expref: 212 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.933293:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x66:0x0] updating lvb size from disk: 0 -> 24288 00000001:00000004:3.0:1784938450.933390:0:25720:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967566 00000100:00100000:3.0:1784938450.933543:0:25720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7ea6e988-18ba-4c98-b179-17995571b98b+210:10956:x1871643337615104:12345-192.168.202.54@tcp:9:umount.0 Request processed in 1648us (1874us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938450.933550:0:25720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 981 00002000:00010000:0.0:1784938450.936668:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x66:0x0] updating lvb mtime from disk: 0 -> 1784938443 00002000:00010000:0.0:1784938450.936672:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x66:0x0] updating lvb ctime from disk: 0 -> 1784938443 00002000:00010000:0.0:1784938450.936674:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x66:0x0] updating lvb blocks from disk: 0 -> 48 00010000:00010000:0.0:1784938450.936706:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021eb4aad/0x7b044d4128f9cfab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664233 expref: 209 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.936736:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x43:0x0] updating lvb size from disk: 0 -> 1735 00002000:00010000:0.0:1784938450.936738:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x43:0x0] updating lvb mtime from disk: 0 -> 1784938444 00002000:00010000:0.0:1784938450.936739:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x43:0x0] updating lvb ctime from disk: 0 -> 1784938444 00002000:00010000:0.0:1784938450.936741:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x43:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784938450.936748:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095b82f9b/0x7b044d4128f9d3c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766439f expref: 208 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.936765:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4f:0x0] updating lvb size from disk: 0 -> 6813 00002000:00010000:0.0:1784938450.936767:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4f:0x0] updating lvb mtime from disk: 0 -> 1784938441 00002000:00010000:0.0:1784938450.936769:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4f:0x0] updating lvb ctime from disk: 0 -> 1784938441 00002000:00010000:0.0:1784938450.936771:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4f:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:0.0:1784938450.936779:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e6c75cd/0x7b044d4128f9bb29 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663be9 expref: 207 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.936796:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x52:0x0] updating lvb size from disk: 0 -> 7185 00002000:00010000:0.0:1784938450.936799:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x52:0x0] updating lvb mtime from disk: 0 -> 1784938446 00002000:00010000:0.0:1784938450.936801:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x52:0x0] updating lvb ctime from disk: 0 -> 1784938446 00002000:00010000:0.0:1784938450.936803:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x52:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:0.0:1784938450.936809:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023cf0f55/0x7b044d4128f9de6f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476647b9 expref: 206 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.936823:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5e:0x0] updating lvb size from disk: 0 -> 143467 00002000:00010000:0.0:1784938450.936833:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5e:0x0] updating lvb mtime from disk: 0 -> 1784938442 00002000:00010000:0.0:1784938450.936834:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5e:0x0] updating lvb ctime from disk: 0 -> 1784938442 00002000:00010000:0.0:1784938450.936836:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5e:0x0] updating lvb blocks from disk: 0 -> 288 00010000:00010000:0.0:1784938450.936841:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004915a1de/0x7b044d4128f9c7d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664003 expref: 205 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.936857:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5c:0x0] updating lvb size from disk: 0 -> 4750 00002000:00010000:0.0:1784938450.936860:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5c:0x0] updating lvb mtime from disk: 0 -> 1784938447 00002000:00010000:0.0:1784938450.936863:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5c:0x0] updating lvb ctime from disk: 0 -> 1784938447 00002000:00010000:0.0:1784938450.936865:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5c:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:0.0:1784938450.936873:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e45c1791/0x7b044d4128f9e5b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664a75 expref: 204 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.936889:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x45:0x0] updating lvb size from disk: 0 -> 15476 00002000:00010000:0.0:1784938450.936892:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x45:0x0] updating lvb mtime from disk: 0 -> 1784938445 00002000:00010000:0.0:1784938450.936894:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x45:0x0] updating lvb ctime from disk: 0 -> 1784938445 00002000:00010000:0.0:1784938450.936896:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x45:0x0] updating lvb blocks from disk: 0 -> 32 00010000:00010000:0.0:1784938450.936902:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dc2a334/0x7b044d4128f9d531 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766442b expref: 203 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.936913:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x51:0x0] updating lvb size from disk: 0 -> 4117 00002000:00010000:0.0:1784938450.936916:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x51:0x0] updating lvb mtime from disk: 0 -> 1784938441 00002000:00010000:0.0:1784938450.936918:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x51:0x0] updating lvb ctime from disk: 0 -> 1784938441 00002000:00010000:0.0:1784938450.936920:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x51:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:0.0:1784938450.936927:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e757f76/0x7b044d4128f9bc95 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663c75 expref: 202 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.936940:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x54:0x0] updating lvb size from disk: 0 -> 6430 00002000:00010000:0.0:1784938450.936943:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x54:0x0] updating lvb mtime from disk: 0 -> 1784938446 00002000:00010000:0.0:1784938450.936945:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x54:0x0] updating lvb ctime from disk: 0 -> 1784938446 00002000:00010000:0.0:1784938450.936947:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x54:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:0.0:1784938450.936954:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb99348e/0x7b044d4128f9dfdb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664845 expref: 201 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.936969:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x60:0x0] updating lvb size from disk: 0 -> 198050 00002000:00010000:0.0:1784938450.936972:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x60:0x0] updating lvb mtime from disk: 0 -> 1784938443 00002000:00010000:0.0:1784938450.936973:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x60:0x0] updating lvb ctime from disk: 0 -> 1784938443 00002000:00010000:0.0:1784938450.936975:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x60:0x0] updating lvb blocks from disk: 0 -> 392 00010000:00010000:0.0:1784938450.936981:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027f9ef8c/0x7b044d4128f9c93e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766408f expref: 200 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.937567:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x57:0x0] updating lvb size from disk: 0 -> 158096 00002000:00010000:0.0:1784938450.937569:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x57:0x0] updating lvb mtime from disk: 0 -> 1784938446 00002000:00010000:0.0:1784938450.937572:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x57:0x0] updating lvb ctime from disk: 0 -> 1784938446 00002000:00010000:0.0:1784938450.937574:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x57:0x0] updating lvb blocks from disk: 0 -> 312 00010000:00010000:0.0:1784938450.937585:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007634da25/0x7b044d4128f9e1fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664917 expref: 199 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.937602:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb size from disk: 0 -> 18269 00002000:00010000:0.0:1784938450.937605:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb mtime from disk: 0 -> 1784938441 00002000:00010000:0.0:1784938450.937607:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb ctime from disk: 0 -> 1784938441 00002000:00010000:0.0:1784938450.937609:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb blocks from disk: 0 -> 40 00010000:00010000:0.0:1784938450.937616:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a53361ef/0x7b044d4128f9b907 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663b17 expref: 198 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.937633:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x66:0x0] updating lvb size from disk: 0 -> 1611 00002000:00010000:0.0:1784938450.937635:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x66:0x0] updating lvb mtime from disk: 0 -> 1784938448 00002000:00010000:0.0:1784938450.937637:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x66:0x0] updating lvb ctime from disk: 0 -> 1784938448 00002000:00010000:0.0:1784938450.937639:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x66:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784938450.937646:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d7f4af6/0x7b044d4128f9ecd1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664d31 expref: 197 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.937667:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4f:0x0] updating lvb size from disk: 0 -> 6213 00002000:00010000:0.0:1784938450.937669:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4f:0x0] updating lvb mtime from disk: 0 -> 1784938446 00002000:00010000:0.0:1784938450.937671:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4f:0x0] updating lvb ctime from disk: 0 -> 1784938446 00002000:00010000:0.0:1784938450.937672:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4f:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:0.0:1784938450.937679:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f7640b/0x7b044d4128f9dc4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476646e7 expref: 196 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.937692:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5b:0x0] updating lvb size from disk: 0 -> 855 00002000:00010000:0.0:1784938450.937694:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5b:0x0] updating lvb mtime from disk: 0 -> 1784938442 00002000:00010000:0.0:1784938450.937696:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5b:0x0] updating lvb ctime from disk: 0 -> 1784938442 00002000:00010000:0.0:1784938450.937698:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5b:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784938450.937705:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1519450/0x7b044d4128f9c5b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663f31 expref: 195 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.937720:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5e:0x0] updating lvb size from disk: 0 -> 170595 00002000:00010000:0.0:1784938450.937722:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5e:0x0] updating lvb mtime from disk: 0 -> 1784938447 00002000:00010000:0.0:1784938450.937724:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5e:0x0] updating lvb ctime from disk: 0 -> 1784938447 00002000:00010000:0.0:1784938450.937726:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5e:0x0] updating lvb blocks from disk: 0 -> 336 00010000:00010000:0.0:1784938450.937734:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4b367e8/0x7b044d4128f9e721 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664b01 expref: 194 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.937749:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x47:0x0] updating lvb size from disk: 0 -> 2659 00002000:00010000:0.0:1784938450.937752:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x47:0x0] updating lvb mtime from disk: 0 -> 1784938440 00002000:00010000:0.0:1784938450.937753:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x47:0x0] updating lvb ctime from disk: 0 -> 1784938440 00002000:00010000:0.0:1784938450.937755:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x47:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784938450.937762:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893bc602/0x7b044d4128f9b579 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476639b9 expref: 193 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.937776:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x61:0x0] updating lvb size from disk: 0 -> 159678 00002000:00010000:0.0:1784938450.937778:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x61:0x0] updating lvb mtime from disk: 0 -> 1784938447 00002000:00010000:0.0:1784938450.937780:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x61:0x0] updating lvb ctime from disk: 0 -> 1784938447 00002000:00010000:0.0:1784938450.937782:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x61:0x0] updating lvb blocks from disk: 0 -> 312 00010000:00010000:0.0:1784938450.937788:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c8cb00d/0x7b044d4128f9e943 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664bd3 expref: 192 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.937804:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4a:0x0] updating lvb size from disk: 0 -> 16001 00002000:00010000:0.0:1784938450.937807:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4a:0x0] updating lvb mtime from disk: 0 -> 1784938445 00002000:00010000:0.0:1784938450.937808:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4a:0x0] updating lvb ctime from disk: 0 -> 1784938445 00002000:00010000:0.0:1784938450.937810:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4a:0x0] updating lvb blocks from disk: 0 -> 32 00010000:00010000:0.0:1784938450.937818:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4ff9adf/0x7b044d4128f9d8bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664589 expref: 191 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.937833:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x56:0x0] updating lvb size from disk: 0 -> 35427 00002000:00010000:0.0:1784938450.937835:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x56:0x0] updating lvb mtime from disk: 0 -> 1784938442 00002000:00010000:0.0:1784938450.937837:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x56:0x0] updating lvb ctime from disk: 0 -> 1784938442 00002000:00010000:0.0:1784938450.937840:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x56:0x0] updating lvb blocks from disk: 0 -> 72 00010000:00010000:0.0:1784938450.937847:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049f8ae0e/0x7b044d4128f9c023 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663dd3 expref: 190 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.937862:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x59:0x0] updating lvb size from disk: 0 -> 1659 00002000:00010000:0.0:1784938450.937864:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x59:0x0] updating lvb mtime from disk: 0 -> 1784938447 00002000:00010000:0.0:1784938450.937866:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x59:0x0] updating lvb ctime from disk: 0 -> 1784938447 00002000:00010000:0.0:1784938450.937868:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x59:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784938450.937876:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000895de66e/0x7b044d4128f9e369 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476649a3 expref: 189 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.937891:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb size from disk: 0 -> 5105 00002000:00010000:0.0:1784938450.937893:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb mtime from disk: 0 -> 1784938443 00002000:00010000:0.0:1784938450.937895:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb ctime from disk: 0 -> 1784938443 00002000:00010000:0.0:1784938450.937897:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:0.0:1784938450.937905:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086e06a59/0x7b044d4128f9cef5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476641ed expref: 188 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.937920:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 0 -> 5634 00002000:00010000:0.0:1784938450.937923:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb mtime from disk: 0 -> 1784938444 00002000:00010000:0.0:1784938450.937924:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb ctime from disk: 0 -> 1784938444 00002000:00010000:0.0:1784938450.937927:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:0.0:1784938450.937934:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6280b1e/0x7b044d4128f9d30f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664359 expref: 187 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.937948:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4e:0x0] updating lvb size from disk: 0 -> 938 00002000:00010000:0.0:1784938450.937951:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4e:0x0] updating lvb mtime from disk: 0 -> 1784938441 00002000:00010000:0.0:1784938450.937953:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4e:0x0] updating lvb ctime from disk: 0 -> 1784938441 00002000:00010000:0.0:1784938450.937967:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4e:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784938450.937977:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087694d84/0x7b044d4128f9ba73 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663ba3 expref: 186 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.938003:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x51:0x0] updating lvb size from disk: 0 -> 3079 00002000:00010000:0.0:1784938450.938006:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x51:0x0] updating lvb mtime from disk: 0 -> 1784938446 00002000:00010000:0.0:1784938450.938009:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x51:0x0] updating lvb ctime from disk: 0 -> 1784938446 00002000:00010000:0.0:1784938450.938011:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x51:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784938450.938019:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000692e1c3/0x7b044d4128f9ddb9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664773 expref: 185 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.938033:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5d:0x0] updating lvb size from disk: 0 -> 6821 00002000:00010000:0.0:1784938450.938035:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5d:0x0] updating lvb mtime from disk: 0 -> 1784938442 00002000:00010000:0.0:1784938450.938037:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5d:0x0] updating lvb ctime from disk: 0 -> 1784938442 00002000:00010000:0.0:1784938450.938039:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5d:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:0.0:1784938450.938045:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000705d1dae/0x7b044d4128f9c71c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663fbd expref: 184 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.938058:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x46:0x0] updating lvb size from disk: 0 -> 674 00002000:00010000:0.0:1784938450.938060:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x46:0x0] updating lvb mtime from disk: 0 -> 1784938440 00002000:00010000:0.0:1784938450.938062:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x46:0x0] updating lvb ctime from disk: 0 -> 1784938440 00002000:00010000:0.0:1784938450.938064:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x46:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784938450.938071:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033558f11/0x7b044d4128f9b4c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663973 expref: 183 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.938086:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x60:0x0] updating lvb size from disk: 0 -> 10934 00002000:00010000:0.0:1784938450.938088:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x60:0x0] updating lvb mtime from disk: 0 -> 1784938447 00002000:00010000:0.0:1784938450.938090:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x60:0x0] updating lvb ctime from disk: 0 -> 1784938447 00002000:00010000:0.0:1784938450.938092:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x60:0x0] updating lvb blocks from disk: 0 -> 24 00010000:00010000:0.0:1784938450.938099:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eeb7f5ab/0x7b044d4128f9e88d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664b8d expref: 182 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.938112:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x49:0x0] updating lvb size from disk: 0 -> 1754 00002000:00010000:0.0:1784938450.938115:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x49:0x0] updating lvb mtime from disk: 0 -> 1784938440 00002000:00010000:0.0:1784938450.938117:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x49:0x0] updating lvb ctime from disk: 0 -> 1784938440 00002000:00010000:0.0:1784938450.938118:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x49:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784938450.938125:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000337df334/0x7b044d4128f9b6e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663a45 expref: 181 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.938632:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x63:0x0] updating lvb size from disk: 0 -> 429670 00002000:00010000:0.0:1784938450.938634:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x63:0x0] updating lvb mtime from disk: 0 -> 1784938448 00002000:00010000:0.0:1784938450.938636:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x63:0x0] updating lvb ctime from disk: 0 -> 1784938448 00002000:00010000:0.0:1784938450.938637:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x63:0x0] updating lvb blocks from disk: 0 -> 840 00010000:00010000:0.0:1784938450.938648:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c9e6d5b/0x7b044d4128f9eaaf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664c5f expref: 180 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.938662:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4c:0x0] updating lvb size from disk: 0 -> 4218 00002000:00010000:0.0:1784938450.938664:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4c:0x0] updating lvb mtime from disk: 0 -> 1784938445 00002000:00010000:0.0:1784938450.938666:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4c:0x0] updating lvb ctime from disk: 0 -> 1784938445 00002000:00010000:0.0:1784938450.938668:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4c:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:0.0:1784938450.938676:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5a6dfda/0x7b044d4128f9da2b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664615 expref: 179 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.938688:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x58:0x0] updating lvb size from disk: 0 -> 37842 00002000:00010000:0.0:1784938450.938690:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x58:0x0] updating lvb mtime from disk: 0 -> 1784938442 00002000:00010000:0.0:1784938450.938693:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x58:0x0] updating lvb ctime from disk: 0 -> 1784938442 00002000:00010000:0.0:1784938450.938694:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x58:0x0] updating lvb blocks from disk: 0 -> 80 00010000:00010000:0.0:1784938450.938701:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004078d00f/0x7b044d4128f9c18f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663e5f expref: 178 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.938721:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5b:0x0] updating lvb size from disk: 0 -> 1654 00002000:00010000:0.0:1784938450.938723:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5b:0x0] updating lvb mtime from disk: 0 -> 1784938447 00002000:00010000:0.0:1784938450.938725:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5b:0x0] updating lvb ctime from disk: 0 -> 1784938447 00002000:00010000:0.0:1784938450.938727:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5b:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784938450.938734:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c72994c/0x7b044d4128f9e4d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664a2f expref: 177 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.938748:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x67:0x0] updating lvb size from disk: 0 -> 1765 00002000:00010000:0.0:1784938450.938750:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x67:0x0] updating lvb mtime from disk: 0 -> 1784938443 00002000:00010000:0.0:1784938450.938752:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x67:0x0] updating lvb ctime from disk: 0 -> 1784938443 00002000:00010000:0.0:1784938450.938754:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x67:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784938450.938761:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f8d5b00/0x7b044d4128f9d061 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664279 expref: 176 pid: 25718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.938776:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 903 00002000:00010000:0.0:1784938450.938779:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1784938440 00002000:00010000:0.0:1784938450.938781:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 0 -> 1784938440 00002000:00010000:0.0:1784938450.938782:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784938450.938790:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093f69a35/0x7b044d4128f9b1cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663854 expref: 175 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.938804:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x44:0x0] updating lvb size from disk: 0 -> 9974 00002000:00010000:0.0:1784938450.938807:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x44:0x0] updating lvb mtime from disk: 0 -> 1784938440 00002000:00010000:0.0:1784938450.938809:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x44:0x0] updating lvb ctime from disk: 0 -> 1784938440 00002000:00010000:0.0:1784938450.938811:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x44:0x0] updating lvb blocks from disk: 0 -> 24 00010000:00010000:0.0:1784938450.938819:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069cbea22/0x7b044d4128f9b357 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476638e7 expref: 174 pid: 21629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.938847:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x47:0x0] updating lvb size from disk: 0 -> 4207 00002000:00010000:0.0:1784938450.938850:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x47:0x0] updating lvb mtime from disk: 0 -> 1784938445 00002000:00010000:0.0:1784938450.938852:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x47:0x0] updating lvb ctime from disk: 0 -> 1784938445 00002000:00010000:0.0:1784938450.938854:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x47:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:0.0:1784938450.938863:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4e6532c/0x7b044d4128f9d69d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476644b7 expref: 173 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.938880:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x53:0x0] updating lvb size from disk: 0 -> 8441 00002000:00010000:0.0:1784938450.938882:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x53:0x0] updating lvb mtime from disk: 0 -> 1784938441 00002000:00010000:0.0:1784938450.938884:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x53:0x0] updating lvb ctime from disk: 0 -> 1784938441 00002000:00010000:0.0:1784938450.938886:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x53:0x0] updating lvb blocks from disk: 0 -> 24 00010000:00010000:0.0:1784938450.938894:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d8bba03/0x7b044d4128f9be01 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663d01 expref: 172 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.938909:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x56:0x0] updating lvb size from disk: 0 -> 13879 00002000:00010000:0.0:1784938450.938911:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x56:0x0] updating lvb mtime from disk: 0 -> 1784938446 00002000:00010000:0.0:1784938450.938913:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x56:0x0] updating lvb ctime from disk: 0 -> 1784938446 00002000:00010000:0.0:1784938450.938915:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x56:0x0] updating lvb blocks from disk: 0 -> 32 00010000:00010000:0.0:1784938450.938923:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de3acb31/0x7b044d4128f9e147 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476648d1 expref: 171 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.938939:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x62:0x0] updating lvb size from disk: 0 -> 88087 00002000:00010000:0.0:1784938450.938941:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x62:0x0] updating lvb mtime from disk: 0 -> 1784938443 00002000:00010000:0.0:1784938450.938943:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x62:0x0] updating lvb ctime from disk: 0 -> 1784938443 00002000:00010000:0.0:1784938450.938946:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x62:0x0] updating lvb blocks from disk: 0 -> 176 00010000:00010000:0.0:1784938450.938953:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd3706f6/0x7b044d4128f9caaa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766411b expref: 170 pid: 25724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.938968:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb size from disk: 0 -> 838 00002000:00010000:0.0:1784938450.938970:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb mtime from disk: 0 -> 1784938441 00002000:00010000:0.0:1784938450.938972:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb ctime from disk: 0 -> 1784938441 00002000:00010000:0.0:1784938450.938974:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784938450.938982:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8c084d2/0x7b044d4128f9b851 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663ad1 expref: 169 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.939476:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x65:0x0] updating lvb size from disk: 0 -> 2475 00002000:00010000:0.0:1784938450.939478:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x65:0x0] updating lvb mtime from disk: 0 -> 1784938448 00002000:00010000:0.0:1784938450.939480:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x65:0x0] updating lvb ctime from disk: 0 -> 1784938448 00002000:00010000:0.0:1784938450.939482:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x65:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784938450.939493:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ac23323/0x7b044d4128f9ec1b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664ceb expref: 168 pid: 25729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.939509:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x49:0x0] updating lvb size from disk: 0 -> 4915 00002000:00010000:0.0:1784938450.939512:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x49:0x0] updating lvb mtime from disk: 0 -> 1784938445 00002000:00010000:0.0:1784938450.939514:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x49:0x0] updating lvb ctime from disk: 0 -> 1784938445 00002000:00010000:0.0:1784938450.939516:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x49:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:0.0:1784938450.939523:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067784924/0x7b044d4128f9d809 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664543 expref: 167 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.939539:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x55:0x0] updating lvb size from disk: 0 -> 6234 00002000:00010000:0.0:1784938450.939541:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x55:0x0] updating lvb mtime from disk: 0 -> 1784938441 00002000:00010000:0.0:1784938450.939544:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x55:0x0] updating lvb ctime from disk: 0 -> 1784938441 00002000:00010000:0.0:1784938450.939546:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x55:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:0.0:1784938450.939553:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000705500be/0x7b044d4128f9bf6d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663d8d expref: 166 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.939569:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x58:0x0] updating lvb size from disk: 0 -> 423 00002000:00010000:0.0:1784938450.939571:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x58:0x0] updating lvb mtime from disk: 0 -> 1784938447 00002000:00010000:0.0:1784938450.939573:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x58:0x0] updating lvb ctime from disk: 0 -> 1784938447 00002000:00010000:0.0:1784938450.939574:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x58:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784938450.939581:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea074bdc/0x7b044d4128f9e2b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e94766495d expref: 165 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.939596:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x64:0x0] updating lvb size from disk: 0 -> 26716 00002000:00010000:0.0:1784938450.939598:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x64:0x0] updating lvb mtime from disk: 0 -> 1784938443 00002000:00010000:0.0:1784938450.939601:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x64:0x0] updating lvb ctime from disk: 0 -> 1784938443 00002000:00010000:0.0:1784938450.939603:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x64:0x0] updating lvb blocks from disk: 0 -> 56 00010000:00010000:0.0:1784938450.939609:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f273c168/0x7b044d4128f9cc16 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476641a7 expref: 164 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.939622:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4d:0x0] updating lvb size from disk: 0 -> 3006 00002000:00010000:0.0:1784938450.939624:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4d:0x0] updating lvb mtime from disk: 0 -> 1784938441 00002000:00010000:0.0:1784938450.939626:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4d:0x0] updating lvb ctime from disk: 0 -> 1784938441 00002000:00010000:0.0:1784938450.939628:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4d:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784938450.939634:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051a08011/0x7b044d4128f9b9bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663b5d expref: 163 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.939648:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x67:0x0] updating lvb size from disk: 0 -> 316748 00002000:00010000:0.0:1784938450.939651:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x67:0x0] updating lvb mtime from disk: 0 -> 1784938448 00002000:00010000:0.0:1784938450.939653:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x67:0x0] updating lvb ctime from disk: 0 -> 1784938448 00002000:00010000:0.0:1784938450.939655:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x67:0x0] updating lvb blocks from disk: 0 -> 624 00010000:00010000:0.0:1784938450.939663:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fcea42e/0x7b044d4128f9ed87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664d77 expref: 162 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.939678:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x44:0x0] updating lvb size from disk: 0 -> 38517 00002000:00010000:0.0:1784938450.939680:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x44:0x0] updating lvb mtime from disk: 0 -> 1784938444 00002000:00010000:0.0:1784938450.939681:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x44:0x0] updating lvb ctime from disk: 0 -> 1784938444 00002000:00010000:0.0:1784938450.939684:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x44:0x0] updating lvb blocks from disk: 0 -> 80 00010000:00010000:0.0:1784938450.939690:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016494a26/0x7b044d4128f9d47b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476643e5 expref: 161 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.939704:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x50:0x0] updating lvb size from disk: 0 -> 269 00002000:00010000:0.0:1784938450.939706:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x50:0x0] updating lvb mtime from disk: 0 -> 1784938441 00002000:00010000:0.0:1784938450.939707:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x50:0x0] updating lvb ctime from disk: 0 -> 1784938441 00002000:00010000:0.0:1784938450.939709:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x50:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784938450.939715:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c5c832f/0x7b044d4128f9bbdf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663c2f expref: 160 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.939728:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x53:0x0] updating lvb size from disk: 0 -> 1790 00002000:00010000:0.0:1784938450.939730:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x53:0x0] updating lvb mtime from disk: 0 -> 1784938446 00002000:00010000:0.0:1784938450.939732:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x53:0x0] updating lvb ctime from disk: 0 -> 1784938446 00002000:00010000:0.0:1784938450.939734:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x53:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784938450.939740:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a6a8420/0x7b044d4128f9df25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476647ff expref: 159 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.939760:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5f:0x0] updating lvb size from disk: 0 -> 31711 00002000:00010000:0.0:1784938450.939762:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5f:0x0] updating lvb mtime from disk: 0 -> 1784938442 00002000:00010000:0.0:1784938450.939764:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5f:0x0] updating lvb ctime from disk: 0 -> 1784938442 00002000:00010000:0.0:1784938450.939766:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5f:0x0] updating lvb blocks from disk: 0 -> 64 00010000:00010000:0.0:1784938450.939773:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4a6658/0x7b044d4128f9c888 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664049 expref: 158 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.939786:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x48:0x0] updating lvb size from disk: 0 -> 28245 00002000:00010000:0.0:1784938450.939788:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x48:0x0] updating lvb mtime from disk: 0 -> 1784938440 00002000:00010000:0.0:1784938450.939790:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x48:0x0] updating lvb ctime from disk: 0 -> 1784938440 00002000:00010000:0.0:1784938450.939792:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x48:0x0] updating lvb blocks from disk: 0 -> 56 00010000:00010000:0.0:1784938450.939800:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022e2f3b3/0x7b044d4128f9b62f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476639ff expref: 157 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.939813:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x62:0x0] updating lvb size from disk: 0 -> 254129 00002000:00010000:0.0:1784938450.939816:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x62:0x0] updating lvb mtime from disk: 0 -> 1784938448 00002000:00010000:0.0:1784938450.939818:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x62:0x0] updating lvb ctime from disk: 0 -> 1784938448 00002000:00010000:0.0:1784938450.939820:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x62:0x0] updating lvb blocks from disk: 0 -> 504 00010000:00010000:0.0:1784938450.939939:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4b45686/0x7b044d4128f9e9f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664c19 expref: 156 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.939967:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x57:0x0] updating lvb size from disk: 0 -> 2129 00002000:00010000:0.0:1784938450.939970:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x57:0x0] updating lvb mtime from disk: 0 -> 1784938442 00002000:00010000:0.0:1784938450.939972:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x57:0x0] updating lvb ctime from disk: 0 -> 1784938442 00002000:00010000:0.0:1784938450.939974:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x57:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784938450.940701:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db15c6a5/0x7b044d4128f9c0d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663e19 expref: 155 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.940726:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4e:0x0] updating lvb size from disk: 0 -> 55540 00002000:00010000:0.0:1784938450.940729:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4e:0x0] updating lvb mtime from disk: 0 -> 1784938446 00002000:00010000:0.0:1784938450.940731:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4e:0x0] updating lvb ctime from disk: 0 -> 1784938446 00002000:00010000:0.0:1784938450.940733:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4e:0x0] updating lvb blocks from disk: 0 -> 112 00010000:00010000:0.0:1784938450.940743:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d73d028a/0x7b044d4128f9db97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476646a1 expref: 154 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.940759:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5a:0x0] updating lvb size from disk: 0 -> 1753 00002000:00010000:0.0:1784938450.940761:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5a:0x0] updating lvb mtime from disk: 0 -> 1784938442 00002000:00010000:0.0:1784938450.940763:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5a:0x0] updating lvb ctime from disk: 0 -> 1784938442 00002000:00010000:0.0:1784938450.940765:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5a:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784938450.940771:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cff32a8e/0x7b044d4128f9c4fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663eeb expref: 153 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.940787:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x43:0x0] updating lvb size from disk: 0 -> 391200 00002000:00010000:0.0:1784938450.940789:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x43:0x0] updating lvb mtime from disk: 0 -> 1784938440 00002000:00010000:0.0:1784938450.940791:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x43:0x0] updating lvb ctime from disk: 0 -> 1784938440 00002000:00010000:0.0:1784938450.940793:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x43:0x0] updating lvb blocks from disk: 0 -> 768 00010000:00010000:0.0:1784938450.940801:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6d2a71d/0x7b044d4128f9b2a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->393215) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e9476638a1 expref: 152 pid: 25715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.940816:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5d:0x0] updating lvb size from disk: 0 -> 116978 00002000:00010000:0.0:1784938450.940819:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5d:0x0] updating lvb mtime from disk: 0 -> 1784938447 00002000:00010000:0.0:1784938450.940820:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5d:0x0] updating lvb ctime from disk: 0 -> 1784938447 00002000:00010000:0.0:1784938450.940914:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5d:0x0] updating lvb blocks from disk: 0 -> 232 00010000:00010000:0.0:1784938450.940927:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea2da067/0x7b044d4128f9e66b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664abb expref: 151 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.940947:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x46:0x0] updating lvb size from disk: 0 -> 9198 00002000:00010000:0.0:1784938450.940949:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x46:0x0] updating lvb mtime from disk: 0 -> 1784938445 00002000:00010000:0.0:1784938450.940951:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x46:0x0] updating lvb ctime from disk: 0 -> 1784938445 00002000:00010000:0.0:1784938450.941091:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x46:0x0] updating lvb blocks from disk: 0 -> 24 00010000:00010000:0.0:1784938450.941103:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003889d17a/0x7b044d4128f9d5e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947664471 expref: 150 pid: 25723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938450.941122:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x52:0x0] updating lvb size from disk: 0 -> 4150 00002000:00010000:0.0:1784938450.941124:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x52:0x0] updating lvb mtime from disk: 0 -> 1784938441 00002000:00010000:0.0:1784938450.941126:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x52:0x0] updating lvb ctime from disk: 0 -> 1784938441 00002000:00010000:0.0:1784938450.941200:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x52:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:0.0:1784938450.941212:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049aad0c1/0x7b044d4128f9bd4b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.54@tcp remote: 0x571025e947663cbb expref: 149 pid: 21149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.941353:0:19223:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9f2489217000, canceled 78 locks, left on hash table 0. 00010000:00010000:0.0:1784938450.941489:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938450.941492:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938450.941494:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938450.965639:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938450.965740:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337626240 00000100:00100000:0.0:1784938450.965749:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337626240 00000100:00100000:0.0:1784938450.965846:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 736 00000100:00100000:0.0:1784938450.965857:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+91:10956:x1871643337626240:12345-192.168.202.54@tcp:39:umount.0 00000020:00000080:0.0:1784938450.965897:0:24945:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9876d 00000020:00010000:0.0:1784938450.965908:0:24945:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9f248a93d000: total 0 00000100:00080000:0.0:1784938450.965912:0:24945:0:(import.c:65:import_set_state_nolock()) ffff9f248a93c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784938450.965980:0:24945:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934864 00000100:00100000:0.0:1784938450.966131:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ea6e988-18ba-4c98-b179-17995571b98b+90:10956:x1871643337626240:12345-192.168.202.54@tcp:39:umount.0 Request processed in 270us (494us total) trans 8589934865 rc 0/0 00000100:00100000:0.0:1784938450.966139:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 736 00000020:00010000:3.0:1784938450.967585:0:25733:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9f248a93d000: total 0 00010000:00010000:2.0:1784938450.972259:0:25733:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9f248a93d000, canceled 0 locks, left on hash table 86. 00010000:00010000:2.0:1784938450.972318:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4a:0x0].0x0 (ffff9f2484afd600) 00010000:00010000:2.0:1784938450.972322:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.972333:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0000/0x7b044d4128f9cf3b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664202 expref: 89 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.972560:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1c:0x0].0x0 (ffff9f238dd49b00) 00010000:00010000:2.0:1784938450.972564:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.972570:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00a00/0x7b044d4128f9bab9 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663bb8 expref: 88 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.972589:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x27:0x0].0x0 (ffff9f2487e3a600) 00010000:00010000:2.0:1784938450.972592:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.972596:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7e00/0x7b044d4128f9bea2 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d39 expref: 87 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.972610:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x45:0x0].0x0 (ffff9f24898e0400) 00010000:00010000:2.0:1784938450.972612:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.972615:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d800/0x7b044d4128f9cb4b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664153 expref: 86 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.972632:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x17:0x0].0x0 (ffff9f24898dc500) 00010000:00010000:2.0:1784938450.972635:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.972638:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db7bc00/0x7b044d4128f9b8f2 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b09 expref: 85 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.972658:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x22:0x0].0x0 (ffff9f23823e1700) 00010000:00010000:2.0:1784938450.972660:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.972664:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34600/0x7b044d4128f9bcdb lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c8a expref: 84 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.972695:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x40:0x0].0x0 (ffff9f238d49ef00) 00010000:00010000:2.0:1784938450.972698:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.972702:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27d400/0x7b044d4128f9c984 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476640a4 expref: 83 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.972718:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x12:0x0].0x0 (ffff9f23823e2f00) 00010000:00010000:2.0:1784938450.972720:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.972724:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480031200/0x7b044d4128f9b72b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a5a expref: 82 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.972741:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1d:0x0].0x0 (ffff9f2487e3af00) 00010000:00010000:2.0:1784938450.973730:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.973740:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625f800/0x7b044d4128f9bb14 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663bdb expref: 81 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.974325:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f248300a200) 00010000:00010000:2.0:1784938450.974328:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784938450.974333:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038800/0x7b044d4128f9b0b7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663800 expref: 80 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.974350:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x3b:0x0].0x0 (ffff9f23823e0700) 00010000:00010000:2.0:1784938450.974354:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.974358:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7a00/0x7b044d4128f9c7bd lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ff5 expref: 79 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.974386:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd:0x0].0x0 (ffff9f24898dd400) 00010000:00010000:2.0:1784938450.974388:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.974393:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01000/0x7b044d4128f9b564 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476639ab expref: 78 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.974409:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x18:0x0].0x0 (ffff9f24898dc400) 00010000:00010000:2.0:1784938450.974411:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.974415:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039000/0x7b044d4128f9b94d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b2c expref: 77 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.974431:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x36:0x0].0x0 (ffff9f248390ad00) 00010000:00010000:2.0:1784938450.974433:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.974437:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24ce00/0x7b044d4128f9c5f6 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f46 expref: 76 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.974454:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x8:0x0].0x0 (ffff9f23823e3700) 00010000:00010000:2.0:1784938450.974457:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.974460:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff800/0x7b044d4128f9b39d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476638fc expref: 75 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.974818:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x26:0x0].0x0 (ffff9f23823dc600) 00010000:00010000:2.0:1784938450.974822:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.974946:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217cc00/0x7b044d4128f9be47 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d16 expref: 74 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.974975:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x13:0x0].0x0 (ffff9f23823e2300) 00010000:00010000:2.0:1784938450.974978:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.974982:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db39600/0x7b044d4128f9b786 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a7d expref: 73 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.974998:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x31:0x0].0x0 (ffff9f23823dcf00) 00010000:00010000:2.0:1784938450.975001:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.975005:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244400/0x7b044d4128f9c230 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e97 expref: 72 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.975021:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4f:0x0].0x0 (ffff9f24898dd800) 00010000:00010000:2.0:1784938450.975024:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.975027:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c558e00/0x7b044d4128f9d102 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642b1 expref: 71 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.975046:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x21:0x0].0x0 (ffff9f23872e6900) 00010000:00010000:2.0:1784938450.975049:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.975053:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217da00/0x7b044d4128f9bc80 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c67 expref: 70 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.975066:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xe:0x0].0x0 (ffff9f23823e3200) 00010000:00010000:2.0:1784938450.975069:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.975072:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e5800/0x7b044d4128f9b5bf lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476639ce expref: 69 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.975086:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2c:0x0].0x0 (ffff9f238727c000) 00010000:00010000:2.0:1784938450.975089:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.975092:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b2f3f400/0x7b044d4128f9c069 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663de8 expref: 68 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.975106:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2f:0x0].0x0 (ffff9f248390a000) 00010000:00010000:2.0:1784938450.975108:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.975112:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c625fc00/0x7b044d4128f9c17a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e51 expref: 67 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.975460:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x3a:0x0].0x0 (ffff9f248390a400) 00010000:00010000:2.0:1784938450.975464:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.975468:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c600/0x7b044d4128f9c762 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663fd2 expref: 66 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.976186:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xc:0x0].0x0 (ffff9f23823e3600) 00010000:00010000:2.0:1784938450.976190:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.976196:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffe00/0x7b044d4128f9b509 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663988 expref: 65 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.976212:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2:0x0].0x0 (ffff9f2381d78e00) 00010000:00010000:2.0:1784938450.976214:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784938450.976218:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fee00/0x7b044d4128f9b1eb lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766385b expref: 64 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.976233:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2a:0x0].0x0 (ffff9f23823dcd00) 00010000:00010000:2.0:1784938450.976235:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.976239:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b6b8a800/0x7b044d4128f9bfb3 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663da2 expref: 63 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.976271:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x35:0x0].0x0 (ffff9f238d49ea00) 00010000:00010000:2.0:1784938450.976274:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.976278:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245a00/0x7b044d4128f9c59b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f23 expref: 62 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.976295:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7:0x0].0x0 (ffff9f23823e3f00) 00010000:00010000:2.0:1784938450.976298:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.976302:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe400/0x7b044d4128f9b342 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476638d9 expref: 61 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.976317:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x25:0x0].0x0 (ffff9f23823e1c00) 00010000:00010000:2.0:1784938450.976320:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.976323:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f7000/0x7b044d4128f9bdec lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663cf3 expref: 60 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.976340:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x30:0x0].0x0 (ffff9f238727ca00) 00010000:00010000:2.0:1784938450.976342:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.976345:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0800/0x7b044d4128f9c1d5 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e74 expref: 59 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.976371:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4e:0x0].0x0 (ffff9f23861e4800) 00010000:00010000:2.0:1784938450.976374:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.976378:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b000/0x7b044d4128f9d0a7 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766428e expref: 58 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.976395:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x20:0x0].0x0 (ffff9f2487e3a300) 00010000:00010000:2.0:1784938450.976398:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.976402:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7800/0x7b044d4128f9bc25 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c44 expref: 57 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.976418:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x3e:0x0].0x0 (ffff9f23823e0e00) 00010000:00010000:2.0:1784938450.976421:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.976425:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6000/0x7b044d4128f9c8ce lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766405e expref: 56 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.976438:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2b:0x0].0x0 (ffff9f2485293700) 00010000:00010000:2.0:1784938450.976440:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.976444:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6600/0x7b044d4128f9c00e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663dc5 expref: 55 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.976457:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x49:0x0].0x0 (ffff9f23861f4c00) 00010000:00010000:2.0:1784938450.976460:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.976464:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17be00/0x7b044d4128f9ced2 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641df expref: 54 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.976595:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1b:0x0].0x0 (ffff9f248fb6c100) 00010000:00010000:2.0:1784938450.976598:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.976603:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382394e00/0x7b044d4128f9ba5e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b95 expref: 53 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.976622:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x39:0x0].0x0 (ffff9f2496483b00) 00010000:00010000:2.0:1784938450.976624:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.976628:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2480030400/0x7b044d4128f9c707 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663faf expref: 52 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.976649:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2381d78600) 00010000:00010000:2.0:1784938450.976652:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784938450.976655:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e02c00/0x7b044d4128f9b09b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476637f9 expref: 51 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.976669:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x44:0x0].0x0 (ffff9f2485cb4d00) 00010000:00010000:2.0:1784938450.976672:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.976676:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6c00/0x7b044d4128f9caf0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664130 expref: 50 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.976694:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x16:0x0].0x0 (ffff9f238dd49100) 00010000:00010000:2.0:1784938450.976696:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.976700:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00400/0x7b044d4128f9b897 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ae6 expref: 49 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.976714:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x52:0x0].0x0 (ffff9f24898dd600) 00010000:00010000:2.0:1784938450.976716:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.976720:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559c00/0x7b044d4128f9d195 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642db expref: 48 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.976733:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x34:0x0].0x0 (ffff9f238d49e100) 00010000:00010000:2.0:1784938450.976736:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.976740:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245800/0x7b044d4128f9c540 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f00 expref: 47 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.976755:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x3f:0x0].0x0 (ffff9f23823e0100) 00010000:00010000:2.0:1784938450.976758:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.976761:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34000/0x7b044d4128f9c929 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664081 expref: 46 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.976775:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x11:0x0].0x0 (ffff9f23861f4700) 00010000:00010000:2.0:1784938450.976777:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.976780:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9e4800/0x7b044d4128f9b6d0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a37 expref: 45 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.976793:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x42:0x0].0x0 (ffff9f2484afdb00) 00010000:00010000:2.0:1784938450.976795:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.976798:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1a00/0x7b044d4128f9ca3a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476640ea expref: 44 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.976812:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0x0 (ffff9f2381d78100) 00010000:00010000:2.0:1784938450.976814:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784938450.976818:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42ca00/0x7b044d4128f9b0d3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663807 expref: 43 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.976830:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4d:0x0].0x0 (ffff9f24898e0000) 00010000:00010000:2.0:1784938450.976832:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.976836:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c800/0x7b044d4128f9d04c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766426b expref: 42 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.976848:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1f:0x0].0x0 (ffff9f23823e2100) 00010000:00010000:2.0:1784938450.976850:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.976854:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34e00/0x7b044d4128f9bbca lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663c21 expref: 41 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.976872:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x3:0x0].0x0 (ffff9f2381d78d00) 00010000:00010000:2.0:1784938450.976874:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.976877:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ff200/0x7b044d4128f9b1ba lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663846 expref: 40 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.976888:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x3d:0x0].0x0 (ffff9f23823e0900) 00010000:00010000:2.0:1784938450.976890:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.976893:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6a00/0x7b044d4128f9c873 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766403b expref: 39 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.976905:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x48:0x0].0x0 (ffff9f23861f4a00) 00010000:00010000:2.0:1784938450.976908:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.976911:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d42c800/0x7b044d4128f9cce1 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476641bc expref: 38 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.976924:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1a:0x0].0x0 (ffff9f24898dc600) 00010000:00010000:2.0:1784938450.976927:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.976930:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b379d600/0x7b044d4128f9ba03 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b72 expref: 37 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.976944:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x38:0x0].0x0 (ffff9f238727cd00) 00010000:00010000:2.0:1784938450.976946:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.976949:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0c00/0x7b044d4128f9c6ac lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f8c expref: 36 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.976960:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x43:0x0].0x0 (ffff9f24898e0c00) 00010000:00010000:2.0:1784938450.976963:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.976966:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27c600/0x7b044d4128f9ca95 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766410d expref: 35 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.976978:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x15:0x0].0x0 (ffff9f23823e2900) 00010000:00010000:2.0:1784938450.976981:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.976984:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d5dac00/0x7b044d4128f9b83c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663ac3 expref: 34 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.976999:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x33:0x0].0x0 (ffff9f248390af00) 00010000:00010000:2.0:1784938450.977002:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.977005:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24c800/0x7b044d4128f9c4e5 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663edd expref: 33 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.977020:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x10:0x0].0x0 (ffff9f23861f4100) 00010000:00010000:2.0:1784938450.977023:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.977027:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382038e00/0x7b044d4128f9b675 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663a14 expref: 32 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.977041:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2e:0x0].0x0 (ffff9f23823e1a00) 00010000:00010000:2.0:1784938450.977044:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.977047:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f20b800/0x7b044d4128f9c11f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e2e expref: 31 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.977061:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4c:0x0].0x0 (ffff9f2484afd100) 00010000:00010000:2.0:1784938450.977064:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.977067:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf1c00/0x7b044d4128f9cff1 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664248 expref: 30 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.977091:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb:0x0].0x0 (ffff9f2485293000) 00010000:00010000:2.0:1784938450.977094:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.977097:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e01c00/0x7b044d4128f9b4ae lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663965 expref: 29 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.977113:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x29:0x0].0x0 (ffff9f238dd4ac00) 00010000:00010000:2.0:1784938450.977116:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.977119:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fd600/0x7b044d4128f9bf58 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d7f expref: 28 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.977451:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x47:0x0].0x0 (ffff9f24898e0600) 00010000:00010000:2.0:1784938450.977454:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.977459:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f245200/0x7b044d4128f9cc01 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664199 expref: 27 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.977474:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x6:0x0].0x0 (ffff9f248300a300) 00010000:00010000:2.0:1784938450.977622:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.977627:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2382039200/0x7b044d4128f9b2e7 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476638b6 expref: 26 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.977647:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x24:0x0].0x0 (ffff9f238dd4a800) 00010000:00010000:2.0:1784938450.977649:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.977652:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24827c6a00/0x7b044d4128f9bd91 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663cd0 expref: 25 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.977665:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x9:0x0].0x0 (ffff9f23823e3e00) 00010000:00010000:2.0:1784938450.977667:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.977670:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe000/0x7b044d4128f9b3f8 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766391f expref: 24 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.977682:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x14:0x0].0x0 (ffff9f238dd49c00) 00010000:00010000:2.0:1784938450.977684:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.977687:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d00800/0x7b044d4128f9b7e1 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663aa0 expref: 23 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.977700:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1:0x0].0x0 (ffff9f2387231d00) 00010000:00010000:2.0:1784938450.977702:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784938450.977705:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823ffc00/0x7b044d4128f9b16d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663831 expref: 22 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.977716:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x32:0x0].0x0 (ffff9f238d49e700) 00010000:00010000:2.0:1784938450.977719:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.977722:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f244000/0x7b044d4128f9c380 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663eba expref: 21 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.977736:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4:0x0].0x0 (ffff9f248fb6e600) 00010000:00010000:2.0:1784938450.977738:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.977741:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f23823fe200/0x7b044d4128f9b231 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663870 expref: 20 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.977753:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x51:0x0].0x0 (ffff9f23861e4100) 00010000:00010000:2.0:1784938450.977755:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784938450.977758:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34200/0x7b044d4128f9d179 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x51:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642d4 expref: 19 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.977777:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xf:0x0].0x0 (ffff9f23823e2200) 00010000:00010000:2.0:1784938450.977779:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.977782:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238db38e00/0x7b044d4128f9b61a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476639f1 expref: 18 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.977796:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x2d:0x0].0x0 (ffff9f2487e3a000) 00010000:00010000:2.0:1784938450.977798:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.977801:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6e00/0x7b044d4128f9c0c4 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663e0b expref: 17 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.980414:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x4b:0x0].0x0 (ffff9f2484afda00) 00010000:00010000:2.0:1784938450.980424:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.980437:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238dbf0a00/0x7b044d4128f9cf96 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664225 expref: 16 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.981326:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa:0x0].0x0 (ffff9f2485293a00) 00010000:00010000:2.0:1784938450.981331:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.981338:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2386e00400/0x7b044d4128f9b453 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663942 expref: 15 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.981373:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x28:0x0].0x0 (ffff9f23823dcb00) 00010000:00010000:2.0:1784938450.981376:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.981381:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3ca00/0x7b044d4128f9befd lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663d5c expref: 14 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.981399:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x46:0x0].0x0 (ffff9f2491e62500) 00010000:00010000:2.0:1784938450.981403:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.981407:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d61a600/0x7b044d4128f9cba6 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664176 expref: 13 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.981423:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x5:0x0].0x0 (ffff9f248fb6b900) 00010000:00010000:2.0:1784938450.981426:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.981430:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238217d200/0x7b044d4128f9b28c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663893 expref: 12 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.981446:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x23:0x0].0x0 (ffff9f248fb6a500) 00010000:00010000:2.0:1784938450.981448:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.981452:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2381d3ce00/0x7b044d4128f9bd36 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663cad expref: 11 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.981467:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x41:0x0].0x0 (ffff9f24898e2200) 00010000:00010000:2.0:1784938450.981470:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.982268:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b29e00/0x7b044d4128f9c9df lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476640c7 expref: 10 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.982304:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x1e:0x0].0x0 (ffff9f2487e3a900) 00010000:00010000:2.0:1784938450.982307:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.982313:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6800/0x7b044d4128f9bb6f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663bfe expref: 9 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.982330:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x3c:0x0].0x0 (ffff9f248390ae00) 00010000:00010000:2.0:1784938450.982332:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.982336:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238f24de00/0x7b044d4128f9c818 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664018 expref: 8 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.982371:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x50:0x0].0x0 (ffff9f24985e9900) 00010000:00010000:2.0:1784938450.982374:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784938450.982378:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2488b34800/0x7b044d4128f9d148 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x50:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476642c6 expref: 7 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.982397:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f248fb8fa00) 00010000:00010000:2.0:1784938450.982399:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784938450.982404:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d27cc00/0x7b044d4128f9d228 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664305 expref: 6 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.982419:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x19:0x0].0x0 (ffff9f24898dca00) 00010000:00010000:2.0:1784938450.982422:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.982426:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24c5b28a00/0x7b044d4128f9b9a8 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663b4f expref: 5 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.982441:0:25733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x37:0x0].0x0 (ffff9f23823e0800) 00010000:00010000:2.0:1784938450.982444:0:25733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.982447:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c9f6800/0x7b044d4128f9c651 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947663f69 expref: 4 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.982461:0:25733:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9f248a93d000, canceled 86 locks, left on hash table 0. 00010000:00010000:2.0:1784938450.983994:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938450.983999:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938450.984003:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938450.996666:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938450.996775:0:25738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337636736 00000100:00100000:1.0:1784938450.996785:0:25738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337636736 00000100:00100000:1.0:1784938450.996926:0:25738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 737 00000100:00100000:1.0:1784938450.996936:0:25738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+172:10956:x1871643337636736:12345-192.168.202.54@tcp:39:umount.0 00000020:00000080:1.0:1784938450.996977:0:25738:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f98774 00000020:00010000:1.0:1784938450.996986:0:25738:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9f248a938000: total 0 00000100:00080000:1.0:1784938450.996990:0:25738:0:(import.c:65:import_set_state_nolock()) ffff9f238c91c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784938450.997047:0:25738:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934848 00010000:00010000:0.0:1784938450.997069:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9ee3d lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x50:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997079:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9ee3d lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x50:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997086:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9ee3d lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x50:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997092:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a6a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938450.997096:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9ee3d lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x50:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997103:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9ee3d lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x50:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997120:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x50:0x0].0x0 (ffff9f2387231500) 00010000:00010000:0.0:1784938450.997123:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938450.997137:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9ee3d lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x50:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997168:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a6a00/0x7b044d4128f9ee3d lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x50:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997187:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9edf0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x5b337780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997198:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9edf0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x5b337780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997203:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9edf0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x5b337780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997208:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d01c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938450.997210:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9edf0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x5b337780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997215:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9edf0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x5b337780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997222:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x5b337780 (ffff9f23861e5b00) 00010000:00010000:0.0:1784938450.997224:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938450.997238:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9edf0 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x5b337780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997244:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01c00/0x7b044d4128f9edf0 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x5b337780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938450.997251:0:25738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ea6e988-18ba-4c98-b179-17995571b98b+170:10956:x1871643337636736:12345-192.168.202.54@tcp:39:umount.0 Request processed in 316us (595us total) trans 8589934849 rc 0/0 00000100:00100000:1.0:1784938450.997258:0:25738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 737 00010000:00010000:0.0:1784938450.997271:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9edf7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997277:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9edf7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997283:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9edf7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997287:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d5da000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938450.997291:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9edf7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997306:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9edf7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997314:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x4f:0x0].0x0 (ffff9f23861f8c00) 00010000:00010000:0.0:1784938450.997317:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938450.997320:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9edf7 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997325:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da000/0x7b044d4128f9edf7 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997335:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42c400/0x7b044d4128f9ed6b lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997341:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42c400/0x7b044d4128f9ed6b lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997346:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42c400/0x7b044d4128f9ed6b lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997351:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42c400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938450.997354:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42c400/0x7b044d4128f9ed6b lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997359:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42c400/0x7b044d4128f9ed6b lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997365:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x6caa4986 (ffff9f238dd4bf00) 00010000:00010000:0.0:1784938450.997368:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938450.997371:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42c400/0x7b044d4128f9ed6b lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997376:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42c400/0x7b044d4128f9ed6b lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997402:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245c00/0x7b044d4128f9ecb5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997409:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245c00/0x7b044d4128f9ecb5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997414:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245c00/0x7b044d4128f9ecb5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997418:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238f245c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938450.997421:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245c00/0x7b044d4128f9ecb5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997427:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245c00/0x7b044d4128f9ecb5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997434:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x22eacdcf (ffff9f23872e6800) 00010000:00010000:0.0:1784938450.997436:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938450.997439:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245c00/0x7b044d4128f9ecb5 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997445:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245c00/0x7b044d4128f9ecb5 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997460:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9ebff lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997469:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9ebff lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997474:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9ebff lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997479:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fc000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938450.997482:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9ebff lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997488:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9ebff lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997496:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xf2ca543e (ffff9f24898dd300) 00010000:00010000:0.0:1784938450.997498:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938450.997501:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9ebff lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997506:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc000/0x7b044d4128f9ebff lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997523:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9eb49 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997529:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9eb49 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997534:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9eb49 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997539:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d3c600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938450.997542:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9eb49 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997549:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9eb49 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997556:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x4d2290fc (ffff9f23872e6300) 00010000:00010000:0.0:1784938450.997559:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938450.997561:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9eb49 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997566:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c600/0x7b044d4128f9eb49 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997580:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9ea93 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997585:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9ea93 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997591:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9ea93 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997595:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938450.997598:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9ea93 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997604:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9ea93 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997611:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x7772308b (ffff9f24b67c7d00) 00010000:00010000:0.0:1784938450.997613:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938450.997616:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9ea93 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997620:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39800/0x7b044d4128f9ea93 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997633:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00c00/0x7b044d4128f9e9dd lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997639:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00c00/0x7b044d4128f9e9dd lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997645:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00c00/0x7b044d4128f9e9dd lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997650:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938450.997653:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00c00/0x7b044d4128f9e9dd lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997659:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00c00/0x7b044d4128f9e9dd lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997666:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xaa0c2c16 (ffff9f23823dc500) 00010000:00010000:0.0:1784938450.997669:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938450.997672:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00c00/0x7b044d4128f9e9dd lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997677:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00c00/0x7b044d4128f9e9dd lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00010000:2.0:1784938450.997691:0:22954:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9f248a938000: total 0 00010000:00010000:0.0:1784938450.997691:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e927 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.997695:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938450.997701:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e927 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997706:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e927 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997710:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61b000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938450.997713:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e927 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997718:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e927 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997725:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xc701cb36 (ffff9f24975b2500) 00010000:00010000:0.0:1784938450.997727:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938450.997729:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e927 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997734:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b000/0x7b044d4128f9e927 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997746:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e871 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.997749:0:22954:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9f248a938000, canceled 0 locks, left on hash table 81. 00010000:00010000:0.0:1784938450.997752:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e871 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997758:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e871 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997763:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d00600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938450.997767:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e871 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997772:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e871 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.997773:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x32:0x0].0x0 (ffff9f24898dc800) 00010000:00010000:2.0:1784938450.997776:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938450.997779:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xe708c894 (ffff9f24975b2800) 00010000:00010000:2.0:1784938450.997781:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217c800/0x7b044d4128f9e3af lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476649b8 expref: 161 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997781:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938450.997784:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e871 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997790:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00600/0x7b044d4128f9e871 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.997798:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0xf:0x0].0x0 (ffff9f238dcb3e00) 00010000:00010000:2.0:1784938450.997801:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938450.997801:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9e7bb lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.997805:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27ca00/0x7b044d4128f9d73e lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476644ef expref: 159 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997807:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9e7bb lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997813:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9e7bb lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997817:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382038c00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938450.997820:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2d:0x0].0x0 (ffff9f238727cb00) 00010000:00010000:0.0:1784938450.997820:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9e7bb lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997826:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9e7bb lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.997831:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938450.997834:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x52815b39 (ffff9f248fb6ad00) 00010000:00010000:2.0:1784938450.997835:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b28600/0x7b044d4128f9e1e8 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664909 expref: 158 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997836:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938450.997839:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9e7bb lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997844:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038c00/0x7b044d4128f9e7bb lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997858:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394400/0x7b044d4128f9e705 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997864:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394400/0x7b044d4128f9e705 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997869:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394400/0x7b044d4128f9e705 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997874:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382394400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938450.997877:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394400/0x7b044d4128f9e705 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997884:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394400/0x7b044d4128f9e705 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997890:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x1a616f3f (ffff9f248fb6cc00) 00010000:00010000:0.0:1784938450.997893:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938450.997896:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394400/0x7b044d4128f9e705 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997901:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394400/0x7b044d4128f9e705 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997915:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00e00/0x7b044d4128f9e64f lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997925:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00e00/0x7b044d4128f9e64f lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997930:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00e00/0x7b044d4128f9e64f lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997936:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d00e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938450.997939:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00e00/0x7b044d4128f9e64f lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997945:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00e00/0x7b044d4128f9e64f lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997952:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xa38d6329 (ffff9f23861e4400) 00010000:00010000:0.0:1784938450.997954:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938450.997957:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00e00/0x7b044d4128f9e64f lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997962:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d00e00/0x7b044d4128f9e64f lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.997972:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x4b:0x0].0x0 (ffff9f23823e0200) 00010000:00010000:0.0:1784938450.997974:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01800/0x7b044d4128f9e599 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.997975:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.997980:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f600/0x7b044d4128f9ecbc lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d23 expref: 154 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997980:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01800/0x7b044d4128f9e599 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997986:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01800/0x7b044d4128f9e599 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.997991:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2381d01800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938450.997994:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0xa:0x0].0x0 (ffff9f238dcb3400) 00010000:00010000:0.0:1784938450.997995:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01800/0x7b044d4128f9e599 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.997996:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.998000:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1800/0x7b044d4128f9d577 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664440 expref: 153 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998001:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01800/0x7b044d4128f9e599 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998008:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xe3541c1d (ffff9f23861e4700) 00010000:00010000:0.0:1784938450.998010:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938450.998013:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x28:0x0].0x0 (ffff9f248fb6a900) 00010000:00010000:0.0:1784938450.998013:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01800/0x7b044d4128f9e599 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998016:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938450.998018:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01800/0x7b044d4128f9e599 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998020:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038a00/0x7b044d4128f9e021 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766485a expref: 152 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998032:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x46:0x0].0x0 (ffff9f24898dda00) 00010000:00010000:2.0:1784938450.998034:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.998038:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f7600/0x7b044d4128f9eaf5 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c74 expref: 150 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998041:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42cc00/0x7b044d4128f9ee59 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x4f:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998046:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42cc00/0x7b044d4128f9ee59 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x4f:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998052:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x5:0x0].0x0 (ffff9f2382049d00) 00010000:00010000:0.0:1784938450.998052:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42cc00/0x7b044d4128f9ee59 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x4f:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998054:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.998058:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a400/0x7b044d4128f9d3b0 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664391 expref: 149 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998058:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42cc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938450.998061:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42cc00/0x7b044d4128f9ee59 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x4f:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998066:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42cc00/0x7b044d4128f9ee59 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x4f:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998072:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x4f:0x0].0x45fac828 (ffff9f238dd4b200) 00010000:00010000:2.0:1784938450.998074:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x23:0x0].0x0 (ffff9f23861f8d00) 00010000:00010000:0.0:1784938450.998074:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938450.998076:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938450.998077:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42cc00/0x7b044d4128f9ee59 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x4f:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998080:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dbe00/0x7b044d4128f9de5a lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476647ab expref: 148 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998083:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42cc00/0x7b044d4128f9ee59 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x4f:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998093:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x41:0x0].0x0 (ffff9f24975b2f00) 00010000:00010000:0.0:1784938450.998095:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9ee28 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x4f:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998096:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.998099:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a400/0x7b044d4128f9e92e lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664bc5 expref: 146 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998100:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9ee28 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x4f:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998107:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9ee28 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x4f:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998111:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17b600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938450.998112:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1e:0x0].0x0 (ffff9f23823dd900) 00010000:00010000:2.0:1784938450.998114:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938450.998115:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9ee28 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x4f:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998117:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823ff600/0x7b044d4128f9dc93 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476646fc expref: 145 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998121:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9ee28 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x4f:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998127:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x4f:0x0].0x1cda55a (ffff9f23861f8800) 00010000:00010000:2.0:1784938450.998129:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x3c:0x0].0x0 (ffff9f248fb6a600) 00010000:00010000:0.0:1784938450.998129:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938450.998132:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938450.998132:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9ee28 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x4f:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998136:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fec00/0x7b044d4128f9e767 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b16 expref: 144 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998138:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17b600/0x7b044d4128f9ee28 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x4f:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998175:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x19:0x0].0x0 (ffff9f24898dd900) 00010000:00010000:2.0:1784938450.998178:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938450.998180:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9edc6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998182:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38400/0x7b044d4128f9dacc lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766464d expref: 142 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998190:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9edc6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998196:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x37:0x0].0x0 (ffff9f23861e4500) 00010000:00010000:0.0:1784938450.998196:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9edc6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998198:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.998202:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01000/0x7b044d4128f9e5a0 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a67 expref: 141 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998202:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3e800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938450.998205:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9edc6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998211:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9edc6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998214:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x14:0x0].0x0 (ffff9f2382048900) 00010000:00010000:2.0:1784938450.998216:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938450.998217:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x47a21a83 (ffff9f23823e0000) 00010000:00010000:0.0:1784938450.998219:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938450.998220:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3fe00/0x7b044d4128f9d905 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766459e expref: 140 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998222:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9edc6 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998228:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3e800/0x7b044d4128f9edc6 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998233:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x45:0x0].0x0 (ffff9f24b67c7800) 00010000:00010000:2.0:1784938450.998235:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.998239:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db39200/0x7b044d4128f9ea9a lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c51 expref: 138 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998240:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d800/0x7b044d4128f9ed10 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998246:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d800/0x7b044d4128f9ed10 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998251:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d800/0x7b044d4128f9ed10 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998253:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x17:0x0].0x0 (ffff9f248fb6f600) 00010000:00010000:2.0:1784938450.998255:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938450.998256:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42d800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938450.998259:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3c200/0x7b044d4128f9da16 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664607 expref: 137 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998260:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d800/0x7b044d4128f9ed10 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998277:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d800/0x7b044d4128f9ed10 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998284:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x9ce4d69c (ffff9f23823e1f00) 00010000:00010000:0.0:1784938450.998286:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938450.998289:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x4:0x0].0x0 (ffff9f248fb8f800) 00010000:00010000:0.0:1784938450.998289:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d800/0x7b044d4128f9ed10 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998292:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938450.998295:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d800/0x7b044d4128f9ed10 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998296:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1400/0x7b044d4128f9d355 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766436e expref: 136 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998308:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x22:0x0].0x0 (ffff9f248fb6a100) 00010000:00010000:0.0:1784938450.998308:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42dc00/0x7b044d4128f9ec5a lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998311:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.998315:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039600/0x7b044d4128f9ddff lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664788 expref: 134 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998315:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42dc00/0x7b044d4128f9ec5a lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998321:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42dc00/0x7b044d4128f9ec5a lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998325:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d42dc00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938450.998327:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x40:0x0].0x0 (ffff9f248fb6cf00) 00010000:00010000:0.0:1784938450.998328:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42dc00/0x7b044d4128f9ec5a lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998329:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.998333:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da200/0x7b044d4128f9e8d3 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664ba2 expref: 133 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998334:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42dc00/0x7b044d4128f9ec5a lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998341:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xd06bcd9f (ffff9f23823e1100) 00010000:00010000:0.0:1784938450.998343:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938450.998346:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x12:0x0].0x0 (ffff9f2382048a00) 00010000:00010000:0.0:1784938450.998346:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42dc00/0x7b044d4128f9ec5a lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998348:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.998352:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf1000/0x7b044d4128f9d84f lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664558 expref: 132 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998352:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42dc00/0x7b044d4128f9ec5a lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998364:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f9eba4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998365:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1d:0x0].0x0 (ffff9f23823dde00) 00010000:00010000:2.0:1784938450.998367:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938450.998370:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f9eba4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998371:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fea00/0x7b044d4128f9dc38 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476646d9 expref: 130 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998376:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f9eba4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998381:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c559200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938450.998383:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x3b:0x0].0x0 (ffff9f248fb6c500) 00010000:00010000:0.0:1784938450.998384:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f9eba4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998386:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.998389:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395a00/0x7b044d4128f9e70c lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664af3 expref: 129 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998390:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f9eba4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998396:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x489b8eb2 (ffff9f24898ddb00) 00010000:00010000:0.0:1784938450.998398:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938450.998400:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f9eba4 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998403:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x4f:0x0].0x0 (ffff9f23861f8c00) 00010000:00010000:2.0:1784938450.998405:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784938450.998407:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559200/0x7b044d4128f9eba4 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998408:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238dbf0600/0x7b044d4128f9ee13 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664da1 expref: 128 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998418:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f9eaee lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998421:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0xd:0x0].0x0 (ffff9f2382049900) 00010000:00010000:2.0:1784938450.998424:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.998427:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a600/0x7b044d4128f9d688 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476644a9 expref: 126 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998428:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f9eaee lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998434:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f9eaee lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998439:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db38000 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938450.998440:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x18:0x0].0x0 (ffff9f248fb6f000) 00010000:00010000:0.0:1784938450.998441:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f9eaee lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998442:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.998445:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f244a00/0x7b044d4128f9da71 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766462a expref: 125 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998447:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f9eaee lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998454:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xe087ee79 (ffff9f24898ddc00) 00010000:00010000:0.0:1784938450.998456:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938450.998457:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x36:0x0].0x0 (ffff9f23823dc100) 00010000:00010000:0.0:1784938450.998458:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f9eaee lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998460:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.998463:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01600/0x7b044d4128f9e545 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a44 expref: 124 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998464:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38000/0x7b044d4128f9eaee lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25738 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998476:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38800/0x7b044d4128f9ea38 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998477:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x8:0x0].0x0 (ffff9f24898dd100) 00010000:00010000:2.0:1784938450.998479:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.998483:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559a00/0x7b044d4128f9d4c1 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643fa expref: 122 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998483:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38800/0x7b044d4128f9ea38 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998489:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38800/0x7b044d4128f9ea38 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998494:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db38800 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938450.998498:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38800/0x7b044d4128f9ea38 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998501:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x13:0x0].0x0 (ffff9f248fb6f100) 00010000:00010000:2.0:1784938450.998503:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938450.998504:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38800/0x7b044d4128f9ea38 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998507:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3de00/0x7b044d4128f9d8aa lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766457b expref: 121 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998510:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xd47b514a (ffff9f24b67c7600) 00010000:00010000:0.0:1784938450.998513:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938450.998516:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38800/0x7b044d4128f9ea38 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998519:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x31:0x0].0x0 (ffff9f23872e6000) 00010000:00010000:2.0:1784938450.998521:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938450.998521:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38800/0x7b044d4128f9ea38 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24203 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998524:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395000/0x7b044d4128f9e354 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664995 expref: 120 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998531:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e982 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998537:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x3:0x0].0x0 (ffff9f2382049b00) 00010000:00010000:0.0:1784938450.998537:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e982 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998539:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.998543:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7400/0x7b044d4128f9d2fa lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766434b expref: 118 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998543:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e982 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998548:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fd400 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938450.998551:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e982 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998555:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x50:0x0].0x0 (ffff9f2387231500) 00010000:00010000:2.0:1784938450.998557:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784938450.998557:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e982 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998560:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d200/0x7b044d4128f9ee44 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x50:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664daf expref: 117 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998564:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x322afea2 (ffff9f24b67c7a00) 00010000:00010000:0.0:1784938450.998566:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938450.998569:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e982 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998572:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0xe:0x0].0x0 (ffff9f2382048f00) 00010000:00010000:2.0:1784938450.998574:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938450.998575:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd400/0x7b044d4128f9e982 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998578:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f800/0x7b044d4128f9d6e3 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476644cc expref: 116 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998586:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e8cc lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998590:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2c:0x0].0x0 (ffff9f248fb6af00) 00010000:00010000:0.0:1784938450.998591:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e8cc lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998593:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.998597:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01a00/0x7b044d4128f9e18d lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648e6 expref: 114 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998597:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e8cc lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998602:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382395200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938450.998605:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e8cc lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998610:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e8cc lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998611:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x4a:0x0].0x0 (ffff9f23823e1300) 00010000:00010000:2.0:1784938450.998613:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938450.998616:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xd13f1037 (ffff9f248fb6c800) 00010000:00010000:2.0:1784938450.998617:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42c600/0x7b044d4128f9ec61 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d00 expref: 113 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998619:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938450.998621:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e8cc lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998627:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395200/0x7b044d4128f9e8cc lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998629:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x9:0x0].0x0 (ffff9f248fb8fb00) 00010000:00010000:2.0:1784938450.998631:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.998635:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d27d000/0x7b044d4128f9d51c lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766441d expref: 112 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998638:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00a00/0x7b044d4128f9e816 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998648:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x27:0x0].0x0 (ffff9f248390a800) 00010000:00010000:0.0:1784938450.998648:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00a00/0x7b044d4128f9e816 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998650:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.998654:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238217dc00/0x7b044d4128f9dfc6 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664837 expref: 110 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998654:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00a00/0x7b044d4128f9e816 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998659:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938450.998662:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00a00/0x7b044d4128f9e816 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998667:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2a:0x0].0x0 (ffff9f249863b200) 00010000:00010000:0.0:1784938450.998667:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00a00/0x7b044d4128f9e816 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998669:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.998673:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61bc00/0x7b044d4128f9e0d7 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648a0 expref: 109 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998673:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x9cfce7b5 (ffff9f2497006e00) 00010000:00010000:0.0:1784938450.998676:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938450.998679:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00a00/0x7b044d4128f9e816 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998683:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e00a00/0x7b044d4128f9e816 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998686:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x35:0x0].0x0 (ffff9f24b67c7000) 00010000:00010000:2.0:1784938450.998688:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.998691:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd000/0x7b044d4128f9e4c0 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a21 expref: 108 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998694:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e760 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998701:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e760 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998706:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e760 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998709:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x7:0x0].0x0 (ffff9f248fb6f200) 00010000:00010000:2.0:1784938450.998711:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938450.998711:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2382039e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938450.998714:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e760 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998715:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b35800/0x7b044d4128f9d466 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643d7 expref: 106 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998721:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e760 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998727:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x25:0x0].0x0 (ffff9f23823e0500) 00010000:00010000:0.0:1784938450.998727:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x6d38f012 (ffff9f23861e4d00) 00010000:00010000:2.0:1784938450.998729:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938450.998729:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938450.998731:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e760 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.998732:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b28c00/0x7b044d4128f9df10 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476647f1 expref: 105 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.998738:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039e00/0x7b044d4128f9e760 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.999184:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x30:0x0].0x0 (ffff9f23872e6400) 00010000:00010000:2.0:1784938450.999187:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938450.999193:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395c00/0x7b044d4128f9e2f9 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664972 expref: 104 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784938450.999519:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1784938451.000783:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd200/0x7b044d4128f9e6aa lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938451.000796:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd200/0x7b044d4128f9e6aa lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938451.000803:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd200/0x7b044d4128f9e6aa lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938451.000809:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fd200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938451.000814:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd200/0x7b044d4128f9e6aa lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938451.000821:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd200/0x7b044d4128f9e6aa lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938451.000835:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xbb599949 (ffff9f24b67c7300) 00010000:00010000:0.0:1784938451.000838:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938451.000844:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd200/0x7b044d4128f9e6aa lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938451.000850:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd200/0x7b044d4128f9e6aa lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938451.000870:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fda00/0x7b044d4128f9e5f4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938451.000876:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fda00/0x7b044d4128f9e5f4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938451.000881:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fda00/0x7b044d4128f9e5f4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938451.000886:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f23823fda00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938451.000889:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fda00/0x7b044d4128f9e5f4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938451.000894:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fda00/0x7b044d4128f9e5f4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938451.000902:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x89d48c8d (ffff9f24b67c7200) 00010000:00010000:0.0:1784938451.000905:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938451.000907:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fda00/0x7b044d4128f9e5f4 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938451.000913:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fda00/0x7b044d4128f9e5f4 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938451.000928:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e53e lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938451.000940:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e53e lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938451.000945:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e53e lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938451.000951:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61b600 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938451.000954:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e53e lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938451.001087:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e53e lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938451.001096:0:16375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xbf580d0c (ffff9f24975b2c00) 00010000:00010000:0.0:1784938451.001098:0:16375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938451.001102:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e53e lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938451.001107:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61b600/0x7b044d4128f9e53e lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.002246:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x4e:0x0].0x0 (ffff9f23861f8500) 00010000:00010000:2.0:1784938451.002251:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.002270:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5da600/0x7b044d4128f9edcd lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d8c expref: 99 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.002295:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x20:0x0].0x0 (ffff9f23823ddd00) 00010000:00010000:2.0:1784938451.002299:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.002303:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382039a00/0x7b044d4128f9dd49 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664742 expref: 98 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.002319:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2b:0x0].0x0 (ffff9f248fb6ae00) 00010000:00010000:2.0:1784938451.002323:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.002327:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d200/0x7b044d4128f9e132 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476648c3 expref: 97 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.002345:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x49:0x0].0x0 (ffff9f24898ddd00) 00010000:00010000:2.0:1784938451.002348:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.002351:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c559000/0x7b044d4128f9ec06 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664cdd expref: 96 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.002822:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1b:0x0].0x0 (ffff9f23823dd100) 00010000:00010000:2.0:1784938451.002835:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.002905:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d3a7600/0x7b044d4128f9db82 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664693 expref: 95 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.002928:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x26:0x0].0x0 (ffff9f23823e0300) 00010000:00010000:2.0:1784938451.002930:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.002935:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245400/0x7b044d4128f9df6b lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664814 expref: 94 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.002952:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x44:0x0].0x0 (ffff9f24b67c7c00) 00010000:00010000:2.0:1784938451.002955:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.002959:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238db38200/0x7b044d4128f9ea3f lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c2e expref: 93 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.002975:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x16:0x0].0x0 (ffff9f238dcb3100) 00010000:00010000:2.0:1784938451.002978:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.002982:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6800/0x7b044d4128f9d9bb lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476645e4 expref: 92 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.003004:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x34:0x0].0x0 (ffff9f238727c500) 00010000:00010000:2.0:1784938451.003006:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.003010:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382395800/0x7b044d4128f9e465 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476649fe expref: 91 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.003026:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x21:0x0].0x0 (ffff9f23861f8b00) 00010000:00010000:2.0:1784938451.003029:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.003032:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5dba00/0x7b044d4128f9dda4 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664765 expref: 90 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.003048:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x3f:0x0].0x0 (ffff9f24975b2400) 00010000:00010000:2.0:1784938451.003050:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.003054:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d61a200/0x7b044d4128f9e878 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b7f expref: 89 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.003070:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x11:0x0].0x0 (ffff9f2382048000) 00010000:00010000:2.0:1784938451.003073:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.003077:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3f000/0x7b044d4128f9d7f4 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664535 expref: 88 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.003090:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2f:0x0].0x0 (ffff9f23872e6100) 00010000:00010000:2.0:1784938451.003093:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.003095:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382394000/0x7b044d4128f9e29e lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766494f expref: 87 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.003108:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1c:0x0].0x0 (ffff9f23823dd500) 00010000:00010000:2.0:1784938451.003111:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.003115:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d17a800/0x7b044d4128f9dbdd lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476646b6 expref: 86 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.003129:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x3a:0x0].0x0 (ffff9f24b67c7700) 00010000:00010000:2.0:1784938451.003131:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.003135:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc600/0x7b044d4128f9e6b1 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664ad0 expref: 85 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.003960:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2:0x0].0x0 (ffff9f24985e9f00) 00010000:00010000:2.0:1784938451.004176:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.004184:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c9f6400/0x7b044d4128f9d275 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766431a expref: 84 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.004207:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0xc:0x0].0x0 (ffff9f238dcb3b00) 00010000:00010000:2.0:1784938451.004210:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.004214:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f245000/0x7b044d4128f9d62d lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664486 expref: 83 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.004232:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x3d:0x0].0x0 (ffff9f248fb6a700) 00010000:00010000:2.0:1784938451.004234:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.004238:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2382038200/0x7b044d4128f9e7c2 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b39 expref: 82 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.004255:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x48:0x0].0x0 (ffff9f24898ddf00) 00010000:00010000:2.0:1784938451.004257:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.004270:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558800/0x7b044d4128f9ebab lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664cba expref: 81 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.004295:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1a:0x0].0x0 (ffff9f248fb6ef00) 00010000:00010000:2.0:1784938451.004297:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.004301:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3da00/0x7b044d4128f9db27 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664670 expref: 80 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.004315:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x38:0x0].0x0 (ffff9f24b67c7400) 00010000:00010000:2.0:1784938451.004318:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.004322:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fd800/0x7b044d4128f9e5fb lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664a8a expref: 79 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.004336:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x43:0x0].0x0 (ffff9f23823dce00) 00010000:00010000:2.0:1784938451.004338:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.004341:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01400/0x7b044d4128f9e9e4 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c0b expref: 78 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.004354:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x15:0x0].0x0 (ffff9f248fb6fd00) 00010000:00010000:2.0:1784938451.004357:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.004361:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d3d800/0x7b044d4128f9d960 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476645c1 expref: 77 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.004539:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x51:0x0].0x0 (ffff9f238dd4b000) 00010000:00010000:2.0:1784938451.004542:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.004547:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d600/0x7b044d4128f9ee60 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664db6 expref: 76 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.004563:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x33:0x0].0x0 (ffff9f24b67c7f00) 00010000:00010000:2.0:1784938451.004566:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.004570:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fc400/0x7b044d4128f9e40a lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476649db expref: 75 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.004585:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x3e:0x0].0x0 (ffff9f2497006c00) 00010000:00010000:2.0:1784938451.004588:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.004592:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2386e01800/0x7b044d4128f9e81d lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664b5c expref: 74 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.004606:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x10:0x0].0x0 (ffff9f2382048b00) 00010000:00010000:2.0:1784938451.004608:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.004612:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ee00/0x7b044d4128f9d799 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664512 expref: 73 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.004627:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x2e:0x0].0x0 (ffff9f238727c100) 00010000:00010000:2.0:1784938451.004630:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.004634:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238f24dc00/0x7b044d4128f9e243 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766492c expref: 72 pid: 24202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.004649:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x4c:0x0].0x0 (ffff9f23823e1000) 00010000:00010000:2.0:1784938451.004651:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.004654:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42c000/0x7b044d4128f9ed17 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d46 expref: 71 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.004669:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x39:0x0].0x0 (ffff9f23861e4300) 00010000:00010000:2.0:1784938451.004672:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.004675:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2381d01e00/0x7b044d4128f9e656 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664aad expref: 70 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.004695:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0xb:0x0].0x0 (ffff9f24898dde00) 00010000:00010000:2.0:1784938451.004697:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.004700:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558400/0x7b044d4128f9d5d2 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664463 expref: 69 pid: 24203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.004715:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938451.004717:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1784938451.004721:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238c558a00/0x7b044d4128f9d2b4 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664336 expref: 68 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.004734:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x29:0x0].0x0 (ffff9f249863ba00) 00010000:00010000:2.0:1784938451.004736:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.004740:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24827c6000/0x7b044d4128f9e07c lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766487d expref: 67 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.006672:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x47:0x0].0x0 (ffff9f238727c300) 00010000:00010000:2.0:1784938451.006677:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.006686:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24b2f3ec00/0x7b044d4128f9eb50 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664c97 expref: 66 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.006708:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x6:0x0].0x0 (ffff9f24898e0e00) 00010000:00010000:2.0:1784938451.006710:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.006714:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f2488b34400/0x7b044d4128f9d40b lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476643b4 expref: 65 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.006733:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x24:0x0].0x0 (ffff9f248fb6ed00) 00010000:00010000:2.0:1784938451.006737:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.006740:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f24c5b29200/0x7b044d4128f9deb5 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e9476647ce expref: 64 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.006770:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x42:0x0].0x0 (ffff9f24b67c7b00) 00010000:00010000:2.0:1784938451.006773:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.006777:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f23823fcc00/0x7b044d4128f9e989 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664be8 expref: 63 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.006795:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x4d:0x0].0x0 (ffff9f238dd4b900) 00010000:00010000:2.0:1784938451.006797:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.006801:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d42d000/0x7b044d4128f9ed72 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664d69 expref: 62 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.006817:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1f:0x0].0x0 (ffff9f238dcb3500) 00010000:00010000:2.0:1784938451.006820:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938451.006824:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9f238d5db000/0x7b044d4128f9dcee lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e94766471f expref: 61 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938451.006838:0:22954:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9f248a938000, canceled 81 locks, left on hash table 0. 00010000:00010000:2.0:1784938451.006884:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938451.006895:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938451.006898:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938451.053071:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938451.054747:0:24192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337636992 00000100:00100000:0.0:1784938451.054761:0:24192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337636992 00000100:00100000:0.0:1784938451.054830:0:24192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 102 00000100:00100000:0.0:1784938451.054840:0:24192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:357535a6-3234-42c0-bf92-af4663775ca3+7:10956:x1871643337636992:12345-192.168.202.54@tcp:251:umount.0 00000020:00000080:0.0:1784938451.054887:0:24192:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9874a 00000020:00010000:0.0:1784938451.054895:0:24192:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9f238c91d000: total 0 00000100:00080000:0.0:1784938451.054899:0:24192:0:(import.c:65:import_set_state_nolock()) ffff9f238c918800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1784938451.054982:0:24192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:357535a6-3234-42c0-bf92-af4663775ca3+3:10956:x1871643337636992:12345-192.168.202.54@tcp:251:umount.0 Request processed in 143us (2024us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938451.054990:0:24192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 102 00000020:00010000:3.0:1784938451.060592:0:25732:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9f238c91d000: total 0 00010000:00010000:3.0:1784938451.060668:0:25732:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9f238c91d000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1784938451.060709:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f24b379c600/0x7b044d4128f98751 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947662ec2 expref: 2 pid: 24194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938451.060728:0:25732:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9f238c91d000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1784938451.060739:0:25732:0:(genops.c:906:class_export_put()) final put ffff9f238c91d000/357535a6-3234-42c0-bf92-af4663775ca3 00010000:00010000:3.0:1784938451.060762:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938451.060764:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938451.060766:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784938451.060808:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f238c91d000/357535a6-3234-42c0-bf92-af4663775ca3 for MGS 00000020:00000080:0.0:1784938451.060854:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f238c918800 for MGS 00010000:00010000:2.0:1784938451.688292:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938452.648565:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b3f3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350911744:192.168.202.154@tcp:41:osp-pre-1-0.0 00000100:00100000:2.0:1784938452.648757:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b3f3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350911872:192.168.202.154@tcp:13:osp-pre-0-1.0 00000100:00100000:1.0:1784938452.649513:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938452.649894:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938452.650855:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350912000:192.168.202.154@tcp:13:osp-pre-1-1.0 00000100:00100000:3.0:1784938452.650933:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:16392:1871643350912512:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938452.650962:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2489ae6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:16392:1871643350913024:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938452.650993:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1784938452.650999:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:16392:1871643350912384:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938452.651043:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2489ae7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350912896:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938452.651063:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2489ae5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:16392:1871643350913408:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938452.651110:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e07296-2a01-411c-abf2-6d190cb69ef0:16389:1871643350912128:0@lo:400:kworker.0 00000100:00100000:3.0:1784938452.651177:0:16389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938452.651209:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2489ae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:16389:1871643350912640:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938452.651236:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2489ae5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350913152:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938452.651272:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1784938452.651279:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:16389:1871643350912256:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938452.651297:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2489ae6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350912768:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938452.651314:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2489ae4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350913280:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938452.651344:0:24194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350912128 00000100:00100000:3.0:1784938452.651353:0:24194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350912128 00000100:00100000:3.0:1784938452.651406:0:24194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784938452.651415:0:24194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+24:16389:x1871643350912128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784938452.651477:0:24194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+24:16389:x1871643350912128:12345-0@lo:400:kworker.0 Request processed in 63us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938452.651484:0:24194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784938452.651543:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e07296-2a01-411c-abf2-6d190cb69ef0:16389:1871643350912128:0@lo:400:kworker.0 00000100:00100000:3.0:1784938452.651622:0:21161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350911744 00000100:00100000:3.0:1784938452.651626:0:21161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350911744 00000100:00100000:3.0:1784938452.651659:0:21161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 83 00000100:00100000:3.0:1784938452.651667:0:21161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:16390:x1871643350911744:12345-192.168.202.154@tcp:41:osp-pre-1-0.0 00000004:00000024:3.0:1784938452.651701:0:21161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 218423296 avail 191397888 00000100:00100000:3.0:1784938452.651727:0:21161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:16390:x1871643350911744:12345-192.168.202.154@tcp:41:osp-pre-1-0.0 Request processed in 61us (1833us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938452.651733:0:21161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 83 00000100:00100000:3.0:1784938452.651769:0:21153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350911872 00000100:00100000:3.0:1784938452.651774:0:21153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350911872 00000100:00100000:3.0:1784938452.651810:0:21153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 78 00000100:00100000:3.0:1784938452.651817:0:21153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16391:x1871643350911872:12345-192.168.202.154@tcp:13:osp-pre-0-1.0 00002000:00000024:3.0:1784938452.651839:0:21153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 7592384 pending 7319552 free 313057280 avail 285245440 00000100:00100000:3.0:1784938452.651862:0:21153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16391:x1871643350911872:12345-192.168.202.154@tcp:13:osp-pre-0-1.0 Request processed in 45us (2353us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938452.651868:0:21153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 78 00000100:00080000:3.0:1784938452.651885:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938452.655460:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938452.655494:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938452.655512:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938452.655535:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938452.655626:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938452.655657:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938452.655695:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938452.655717:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938452.655733:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938452.655747:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938452.655843:0:25727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350913280 00000100:00100000:1.0:1784938452.655856:0:25727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350913280 00000100:00100000:1.0:1784938452.655925:0:25727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350912896 00000100:00100000:1.0:1784938452.655928:0:25727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350912896 00000100:00100000:1.0:1784938452.655955:0:25727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 85 00000100:00100000:1.0:1784938452.655965:0:25727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:16389:x1871643350913280:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938452.656051:0:25727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:16389:x1871643350913280:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 87us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938452.656059:0:25727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 85 00000100:00100000:2.0:1784938452.657203:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 86 00000100:00100000:2.0:1784938452.657226:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386363480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:16392:x1871643350912896:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938452.660577:0:21153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350912000 00000100:00100000:3.0:1784938452.660598:0:21153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350912000 00000100:00100000:3.0:1784938452.660671:0:21153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 79 00000100:00100000:3.0:1784938452.660683:0:21153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16392:x1871643350912000:12345-192.168.202.154@tcp:13:osp-pre-1-1.0 00002000:00000024:3.0:1784938452.660731:0:21153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 7526848 pending 7254016 free 313057280 avail 285245440 00000100:00100000:2.0:1784938452.671795:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386363480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:16392:x1871643350912896:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 14560us (16055us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938452.671818:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 86 00000100:00100000:3.0:1784938452.679917:0:21153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16392:x1871643350912000:12345-192.168.202.154@tcp:13:osp-pre-1-1.0 Request processed in 19218us (24402us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938452.679938:0:21153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 79 00000100:00100000:3.0:1784938452.680030:0:16389:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967492 gen 2 00000004:00080000:3.0:1784938452.680052:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238d3ac700, transno 4294967487 00000004:00080000:3.0:1784938452.680137:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f22df80, transno 4294967488 00000004:00080000:3.0:1784938452.680142:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238d3ad500, transno 4294967489 00000004:00080000:3.0:1784938452.680161:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238d3ad880, transno 4294967490 00000004:00080000:3.0:1784938452.680165:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f22fb80, transno 4294967491 00000004:00080000:3.0:1784938452.680168:0:16389:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f238f22c000, transno 4294967492 00000100:00100000:3.0:1784938452.680177:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2489ae4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350913280:192.168.202.154@tcp:400:kworker.0 00000100:00080000:3.0:1784938452.680608:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784938452.684484:0:16391:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967491 gen 2 00000100:00100000:3.0:1784938452.684535:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b3f3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350911872:192.168.202.154@tcp:13:osp-pre-0-1.0 00000004:00080000:2.0:1784938452.685016:0:24947:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 6 done 00000100:00100000:0.0:1784938452.688454:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938452.706673:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350912640 00000100:00100000:0.0:1784938452.706690:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350912640 00000100:00100000:0.0:1784938452.706753:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350912256 00000100:00100000:0.0:1784938452.706756:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350912256 00000100:00100000:0.0:1784938452.706770:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350912512 00000100:00100000:0.0:1784938452.706773:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350912512 00000100:00100000:0.0:1784938452.706787:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350913024 00000100:00100000:0.0:1784938452.706789:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350913024 00000100:00100000:0.0:1784938452.706801:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350912384 00000100:00100000:0.0:1784938452.706803:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350912384 00000100:00100000:0.0:1784938452.706813:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350913408 00000100:00100000:0.0:1784938452.706816:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350913408 00000100:00100000:0.0:1784938452.706837:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 47 00000100:00100000:0.0:1784938452.706849:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:16389:x1871643350912640:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938452.706936:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:16389:x1871643350912640:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 90us (51488us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938452.706944:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 47 00000100:00100000:0.0:1784938452.706963:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 48 00000100:00100000:0.0:1784938452.706969:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:16389:x1871643350912256:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938452.706995:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:16389:x1871643350912256:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 26us (51481us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938452.707001:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 48 00000100:00100000:0.0:1784938452.707015:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 49 00000100:00100000:0.0:1784938452.707021:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:16392:x1871643350912512:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938452.707044:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:16392:x1871643350912512:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 22us (51508us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938452.707049:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 49 00000100:00100000:0.0:1784938452.707060:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 50 00000100:00100000:0.0:1784938452.710341:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:16392:x1871643350913024:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938452.710454:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:16392:x1871643350913024:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 3387us (54795us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938452.710465:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 50 00000100:00100000:0.0:1784938452.710510:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 51 00000100:00100000:0.0:1784938452.710521:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:16392:x1871643350912384:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938452.710550:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:16392:x1871643350912384:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 32us (54854us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938452.710557:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 51 00000100:00100000:0.0:1784938452.710572:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 52 00000100:00100000:0.0:1784938452.710579:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386361f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:16392:x1871643350913408:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938452.710604:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386361f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:16392:x1871643350913408:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 26us (54871us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938452.710611:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 52 00000100:00100000:0.0:1784938452.710668:0:25714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350913152 00000100:00100000:0.0:1784938452.710679:0:25714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350913152 00000100:00100000:0.0:1784938452.710734:0:25714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 84 00000100:00100000:0.0:1784938452.710740:0:25714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:16389:x1871643350913152:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938452.710775:0:25714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:16389:x1871643350913152:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 35us (55027us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938452.710781:0:25714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 84 00000100:00080000:0.0:1784938452.711196:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784938452.711203:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784938452.722794:0:25721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350912768 00000100:00100000:3.0:1784938452.722815:0:25721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350912768 00000100:00100000:3.0:1784938452.722914:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 87 00000100:00100000:3.0:1784938452.722925:0:25721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386362a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:16389:x1871643350912768:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938452.723044:0:25721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386362a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:16389:x1871643350912768:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 120us (34604us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938452.723052:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 87 00000100:00080000:3.0:1784938452.724183:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938452.724383:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:16392:1871643350912384:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938452.724406:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2489ae7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350912896:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938452.724423:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2489ae5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:16392:1871643350913408:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938452.724451:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350912000:192.168.202.154@tcp:13:osp-pre-1-1.0 00000100:00100000:3.0:1784938452.724467:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:16392:1871643350912512:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938452.724480:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2489ae6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:16392:1871643350913024:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938452.728558:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:16389:1871643350912256:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938452.728628:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2489ae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:16389:1871643350912640:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938452.728649:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2489ae5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350913152:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938452.728804:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b3f3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350911744:192.168.202.154@tcp:41:osp-pre-1-0.0 00000001:00100000:3.0:1784938452.735638:0:24936:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7ea6e988-18ba-4c98-b179-17995571b98b 00000001:00080000:3.0:1784938452.735661:0:24936:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934849 is committed 00000020:00000080:3.0:1784938452.735766:0:24936:0:(genops.c:906:class_export_put()) final put ffff9f248a938000/7ea6e988-18ba-4c98-b179-17995571b98b 00000020:00080000:3.0:1784938452.735788:0:24936:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 4294967465 batchid updated 00000001:00100000:3.0:1784938452.735834:0:24188:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7ea6e988-18ba-4c98-b179-17995571b98b 00000001:00080000:3.0:1784938452.735844:0:24188:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934865 is committed 00000020:00000080:3.0:1784938452.735847:0:24188:0:(genops.c:906:class_export_put()) final put ffff9f248a93d000/7ea6e988-18ba-4c98-b179-17995571b98b 00000001:00080000:3.0:1784938452.735857:0:24188:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934864 is committed 00000020:00000080:3.0:1784938452.735950:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f248a938000/7ea6e988-18ba-4c98-b179-17995571b98b for lustre-MDT0001 00000020:00000080:3.0:1784938452.736030:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f248a93d000/7ea6e988-18ba-4c98-b179-17995571b98b for lustre-MDT0000 00000020:00000080:3.0:1784938452.736082:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f238c91c000 for lustre-MDT0001 00000020:00000080:3.0:1784938452.736087:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f248a93c000 for lustre-MDT0000 00000020:00080000:3.0:1784938452.736097:0:24957:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294967465 00000004:00080000:3.0:1784938452.736197:0:24957:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9f238ec68240 with version 10 00000020:00080000:3.0:1784938452.736208:0:24957:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4294967465 cancel update log [0x200000bd1:0x1:0x0].2: rc = 0 00000020:00080000:3.0:1784938452.736310:0:24957:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4294967465 cancel update log [0x240000bd0:0x1:0x0].2: rc = 0 00000020:00080000:3.0:1784938452.736320:0:24957:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294967465 00000100:00100000:3.0:1784938452.736389:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2489ae6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350912768:192.168.202.154@tcp:400:kworker.0 00000004:00080000:3.0:1784938452.736431:0:24942:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9f238ec48000 version 10 rpc_version 10 00000020:00100000:3.0:1784938452.736471:0:24942:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1784938452.736481:0:24942:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9f2489ae6680 x1871643350913664/t0(0) o1000->lustre-MDT0000-osp-MDT0001@192.168.202.154@tcp:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784938452.736515:0:24942:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2489ae6680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:24942:1871643350913664:192.168.202.154@tcp:1000:osp_up0-1.0 00000100:00100000:3.0:1784938452.736600:0:24942:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2482d95540 going to sleep for 11 seconds 00000100:00100000:3.0:1784938452.736744:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938452.736774:0:21160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350913664 00000100:00100000:3.0:1784938452.736781:0:21160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350913664 00000100:00100000:3.0:1784938452.736833:0:21160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 85 00000100:00100000:3.0:1784938452.736844:0:21160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2383a11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:24942:x1871643350913664:12345-192.168.202.154@tcp:1000:osp_up0-1.0 00000100:00100000:3.0:1784938452.737000:0:21160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2383a11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:24942:x1871643350913664:12345-192.168.202.154@tcp:1000:osp_up0-1.0 Request processed in 156us (256us total) trans 8589934866 rc 0/0 00000100:00100000:3.0:1784938452.737010:0:21160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 85 00010000:00010000:0.0:1784938452.745093:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938452.754454:0:24942:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 8589934864 gen 2 00000004:00080000:3.0:1784938452.754469:0:24942:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934864 committed transno 8589934864 00000100:00100000:3.0:1784938452.754521:0:24942:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9f2489ae6680 x1871643350913664/t8589934866(8589934866) o1000->lustre-MDT0000-osp-MDT0001@192.168.202.154@tcp:24/4 lens 488/4320 e 0 to 0 dl 1784938468 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938452.754562:0:24942:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2489ae6680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:24942:1871643350913664:192.168.202.154@tcp:1000:osp_up0-1.0 00000100:00100000:2.0:1784938453.160428:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b3f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350913792:192.168.202.154@tcp:41:osp-pre-0-1.0 00000100:00100000:0.0:1784938453.161225:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938453.161267:0:16390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784938453.161281:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350913920:192.168.202.154@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938453.161399:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938453.161426:0:21161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350913792 00000100:00100000:0.0:1784938453.161435:0:21161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350913792 00000100:00100000:0.0:1784938453.161505:0:21161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 86 00000100:00100000:0.0:1784938453.161515:0:21161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386362d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:16392:x1871643350913792:12345-192.168.202.154@tcp:41:osp-pre-0-1.0 00000004:00000024:0.0:1784938453.161578:0:21161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 218308608 avail 191283200 00000100:00100000:2.0:1784938453.162266:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784938453.162282:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2482b2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350914048:192.168.202.154@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938453.162408:0:21161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386362d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:16392:x1871643350913792:12345-192.168.202.154@tcp:41:osp-pre-0-1.0 Request processed in 893us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938453.162422:0:21161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 86 00000100:00100000:3.0:1784938453.168361:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938453.168399:0:21153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350913920 00000100:00100000:3.0:1784938453.168411:0:21153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350913920 00000100:00100000:3.0:1784938453.168460:0:21153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350914048 00000100:00100000:3.0:1784938453.168463:0:21153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350914048 00000100:00100000:3.0:1784938453.168482:0:21153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 80 00000100:00100000:3.0:1784938453.168494:0:21153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386362680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:16390:x1871643350913920:12345-192.168.202.154@tcp:13:osp-pre-1-0.0 00002000:00000024:3.0:1784938453.168530:0:21153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 7526848 pending 7254016 free 313057280 avail 285245440 00000100:00100000:3.0:1784938453.168905:0:21153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386362680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:16390:x1871643350913920:12345-192.168.202.154@tcp:13:osp-pre-1-0.0 Request processed in 119us (7211us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938453.168917:0:21153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 80 00000100:00100000:3.0:1784938453.168941:0:21153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 81 00000100:00100000:3.0:1784938453.168949:0:21153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:16389:x1871643350914048:12345-192.168.202.154@tcp:13:osp-pre-0-0.0 00002000:00000024:3.0:1784938453.168962:0:21153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 7592384 pending 7319552 free 313057280 avail 285245440 00000100:00100000:3.0:1784938453.168989:0:21153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:16389:x1871643350914048:12345-192.168.202.154@tcp:13:osp-pre-0-0.0 Request processed in 42us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938453.168997:0:21153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 81 00000100:00100000:3.0:1784938453.169269:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b3f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350913792:192.168.202.154@tcp:41:osp-pre-0-1.0 00000100:00100000:3.0:1784938453.169327:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2482b2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350914048:192.168.202.154@tcp:13:osp-pre-0-0.0 00000100:00100000:3.0:1784938453.169382:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350913920:192.168.202.154@tcp:13:osp-pre-1-0.0 00010000:00010000:2.0:1784938453.739513:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784938454.482403:0:24188:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934866 is committed 00010000:00010000:2.0:1784938454.761571:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784938455.735417:0:21144:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7ea6e988-18ba-4c98-b179-17995571b98b 00000001:00080000:1.0:1784938455.735437:0:21144:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967566 is committed 00000020:00000080:1.0:1784938455.735716:0:21144:0:(genops.c:906:class_export_put()) final put ffff9f2489217000/7ea6e988-18ba-4c98-b179-17995571b98b 00000020:00000080:2.0:1784938455.738695:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f2489217000/7ea6e988-18ba-4c98-b179-17995571b98b for lustre-OST0000 00000020:00000080:2.0:1784938455.738766:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f2489212000 for lustre-OST0000 00000001:00100000:0.0:1784938455.738999:0:22178:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7ea6e988-18ba-4c98-b179-17995571b98b 00000001:00080000:0.0:1784938455.739011:0:22178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967566 is committed 00000020:00000080:0.0:1784938455.739287:0:22178:0:(genops.c:906:class_export_put()) final put ffff9f2489213800/7ea6e988-18ba-4c98-b179-17995571b98b 00000020:00000080:3.0:1784938455.739354:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f2489213800/7ea6e988-18ba-4c98-b179-17995571b98b for lustre-OST0001 00000020:00000080:3.0:1784938455.739391:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f2489210000 for lustre-OST0001 00010000:00010000:3.0:1784938455.786686:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938456.808910:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938457.768858:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784938457.768885:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2489ae5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350914176:192.168.202.154@tcp:13:osp-pre-1-1.0 00000100:00100000:3.0:1784938457.769252:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938457.769279:0:21153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350914176 00000100:00100000:3.0:1784938457.769286:0:21153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350914176 00000100:00100000:3.0:1784938457.769339:0:21153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 82 00000100:00100000:3.0:1784938457.769351:0:21153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16392:x1871643350914176:12345-192.168.202.154@tcp:13:osp-pre-1-1.0 00002000:00000024:3.0:1784938457.769381:0:21153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 272832 pending 0 free 313057280 avail 285245440 00000100:00100000:3.0:1784938457.769420:0:21153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16392:x1871643350914176:12345-192.168.202.154@tcp:13:osp-pre-1-1.0 Request processed in 71us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938457.769427:0:21153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 82 00000100:00080000:3.0:1784938457.769459:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784938457.769590:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938457.769602:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b3f3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350914304:192.168.202.154@tcp:41:osp-pre-1-0.0 00000100:00100000:1.0:1784938457.770217:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938457.770349:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2482b29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e07296-2a01-411c-abf2-6d190cb69ef0:16389:1871643350914432:0@lo:400:kworker.0 00000100:00100000:1.0:1784938457.770389:0:16389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938457.770412:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:16389:1871643350914944:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938457.770445:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387daca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350915456:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938457.770474:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1784938457.770480:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2482b29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:16389:1871643350914560:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938457.770505:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350915072:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938457.770529:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350915584:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938457.770644:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938457.770695:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938457.770718:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938457.770738:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938457.770757:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938457.770853:0:24193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350914432 00000100:00100000:2.0:1784938457.770859:0:24193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350914432 00000100:00100000:2.0:1784938457.770907:0:24193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784938457.770917:0:24193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+24:16389:x1871643350914432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938457.770963:0:24193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+24:16389:x1871643350914432:12345-0@lo:400:kworker.0 Request processed in 47us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938457.770970:0:24193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784938457.771004:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350915072 00000100:00100000:2.0:1784938457.771007:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350915072 00000100:00100000:2.0:1784938457.771038:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350915584 00000100:00100000:2.0:1784938457.771041:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350915584 00000100:00100000:2.0:1784938457.771062:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 88 00000100:00100000:2.0:1784938457.771068:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:16389:x1871643350915072:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938457.771099:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:16389:x1871643350915072:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 32us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938457.771105:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 88 00000100:00100000:2.0:1784938457.771117:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 89 00000100:00100000:2.0:1784938457.771122:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:16389:x1871643350915584:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938457.771183:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:16389:x1871643350915584:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 60us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938457.771189:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 89 00000100:00080000:2.0:1784938457.771217:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938457.771232:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2482b2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:16391:1871643350914688:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938457.771265:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387dad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350915200:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938457.771289:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d4e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:16391:1871643350915712:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938457.771314:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784938457.771320:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2482b29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:16391:1871643350914816:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938457.771346:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387dafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:16391:1871643350915328:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938457.771500:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938457.771523:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938457.771542:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938457.771560:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938457.771579:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938457.773252:0:21161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350914304 00000100:00100000:0.0:1784938457.773261:0:21161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350914304 00000100:00100000:0.0:1784938457.773307:0:21161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350915456 00000100:00100000:0.0:1784938457.773310:0:21161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350915456 00000100:00100000:0.0:1784938457.773332:0:21161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 87 00000100:00100000:0.0:1784938457.773340:0:21161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:16391:x1871643350914304:12345-192.168.202.154@tcp:41:osp-pre-1-0.0 00000004:00000024:0.0:1784938457.773378:0:21161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 218423296 avail 191397888 00000100:00100000:0.0:1784938457.773451:0:21161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:16391:x1871643350914304:12345-192.168.202.154@tcp:41:osp-pre-1-0.0 Request processed in 110us (3245us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938457.773459:0:21161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 87 00000100:00100000:0.0:1784938457.773482:0:21161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 88 00000100:00100000:0.0:1784938457.773489:0:21161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:16389:x1871643350915456:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938457.773519:0:21161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:16389:x1871643350915456:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 31us (2875us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938457.773526:0:21161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 88 00000100:00100000:0.0:1784938457.773545:0:25729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350915200 00000100:00100000:0.0:1784938457.773549:0:25729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350915200 00000100:00100000:0.0:1784938457.773590:0:25729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 90 00000100:00100000:0.0:1784938457.773597:0:25729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:16391:x1871643350915200:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938457.773623:0:25729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:16391:x1871643350915200:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 27us (2100us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938457.773633:0:25729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 90 00000100:00100000:0.0:1784938457.773651:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350914944 00000100:00100000:0.0:1784938457.773654:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350914944 00000100:00100000:0.0:1784938457.773673:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350914560 00000100:00100000:0.0:1784938457.773675:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350914560 00000100:00100000:0.0:1784938457.773686:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350914688 00000100:00100000:0.0:1784938457.773689:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350914688 00000100:00100000:0.0:1784938457.773700:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350915712 00000100:00100000:0.0:1784938457.773702:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350915712 00000100:00100000:0.0:1784938457.773711:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350914816 00000100:00100000:0.0:1784938457.773714:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350914816 00000100:00100000:0.0:1784938457.773725:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350915328 00000100:00100000:0.0:1784938457.773727:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350915328 00000100:00100000:0.0:1784938457.773739:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 53 00000100:00100000:0.0:1784938457.773746:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:16389:x1871643350914944:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938457.773789:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:16389:x1871643350914944:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 43us (3070us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938457.773796:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 53 00000100:00100000:0.0:1784938457.773809:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 54 00000100:00100000:0.0:1784938457.773815:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:16389:x1871643350914560:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938457.773840:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:16389:x1871643350914560:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 25us (3102us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938457.773846:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 54 00000100:00100000:0.0:1784938457.773857:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 55 00000100:00100000:0.0:1784938457.773863:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:16391:x1871643350914688:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938457.773887:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:16391:x1871643350914688:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 24us (2388us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938457.773893:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 55 00000100:00100000:0.0:1784938457.773905:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 56 00000100:00100000:0.0:1784938457.773910:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:16391:x1871643350915712:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938457.773928:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:16391:x1871643350915712:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 18us (2385us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938457.773933:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 56 00000100:00100000:0.0:1784938457.773942:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 57 00000100:00100000:0.0:1784938457.773947:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:16391:x1871643350914816:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938457.773965:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:16391:x1871643350914816:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 18us (2404us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938457.773970:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 57 00000100:00100000:0.0:1784938457.773981:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 58 00000100:00100000:0.0:1784938457.773987:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:16391:x1871643350915328:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938457.774004:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:16391:x1871643350915328:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 18us (2426us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938457.774009:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 58 00000100:00080000:0.0:1784938457.774053:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784938457.774057:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784938457.774059:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784938457.774720:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350915072:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938457.774740:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350915584:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938457.774752:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2482b29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e07296-2a01-411c-abf2-6d190cb69ef0:16389:1871643350914432:0@lo:400:kworker.0 00000100:00100000:2.0:1784938457.775988:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938457.776020:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386361500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350915840:192.168.202.154@tcp:13:osp-pre-0-1.0 00000100:00100000:2.0:1784938457.776455:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938457.776641:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2482b29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:16391:1871643350914816:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938457.776656:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387dafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:16391:1871643350915328:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938457.776667:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2482b2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:16391:1871643350914688:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938457.776677:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387dad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350915200:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938457.776689:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d4e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:16391:1871643350915712:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938457.776707:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b3f3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350914304:192.168.202.154@tcp:41:osp-pre-1-0.0 00000100:00100000:1.0:1784938457.777867:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2482b29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:16389:1871643350914560:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938457.777885:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:16389:1871643350914944:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938457.777896:0:16389:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 8589934866 gen 2 00000004:00080000:1.0:1784938457.777903:0:16389:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934866 committed transno 8589934866 00000100:00100000:1.0:1784938457.777920:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387daca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350915456:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938457.779298:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2489ae5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350914176:192.168.202.154@tcp:13:osp-pre-1-1.0 00000100:00100000:3.0:1784938457.779337:0:21153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350915840 00000100:00100000:3.0:1784938457.779344:0:21153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350915840 00000100:00100000:3.0:1784938457.779418:0:21153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 83 00000100:00100000:3.0:1784938457.779440:0:21153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16391:x1871643350915840:12345-192.168.202.154@tcp:13:osp-pre-0-1.0 00002000:00000024:3.0:1784938457.779471:0:21153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 272832 pending 0 free 313057280 avail 285245440 00000100:00100000:3.0:1784938457.779540:0:21153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16391:x1871643350915840:12345-192.168.202.154@tcp:13:osp-pre-0-1.0 Request processed in 112us (3085us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938457.779548:0:21153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 83 00000100:00100000:2.0:1784938457.779952:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386361500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350915840:192.168.202.154@tcp:13:osp-pre-0-1.0 00010000:00010000:0.0:1784938457.837022:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938458.280611:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2489ae5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350915968:192.168.202.154@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938458.280976:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d4e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350916096:192.168.202.154@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938458.281324:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938458.281414:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938458.281439:0:21154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350915968 00000100:00100000:1.0:1784938458.281446:0:21154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350915968 00000100:00100000:1.0:1784938458.281485:0:21154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350916096 00000100:00100000:1.0:1784938458.281488:0:21154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350916096 00000100:00100000:1.0:1784938458.281506:0:21154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 84 00000100:00100000:1.0:1784938458.281516:0:21154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:16389:x1871643350915968:12345-192.168.202.154@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938458.281543:0:21154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 272832 pending 0 free 313057280 avail 285245440 00000100:00100000:1.0:1784938458.281583:0:21154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:16389:x1871643350915968:12345-192.168.202.154@tcp:13:osp-pre-1-0.0 Request processed in 68us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938458.281590:0:21154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 84 00000100:00100000:1.0:1784938458.281608:0:21154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 85 00000100:00100000:1.0:1784938458.281614:0:21154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:16390:x1871643350916096:12345-192.168.202.154@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938458.281625:0:21154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 272832 pending 0 free 313057280 avail 285245440 00000100:00100000:1.0:1784938458.281646:0:21154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:16390:x1871643350916096:12345-192.168.202.154@tcp:13:osp-pre-0-0.0 Request processed in 32us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938458.281652:0:21154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 85 00000100:00100000:3.0:1784938458.281948:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2489ae5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350915968:192.168.202.154@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938458.282162:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23823baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350916224:192.168.202.154@tcp:41:osp-pre-0-1.0 00000100:00100000:3.0:1784938458.283187:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938458.283339:0:21161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350916224 00000100:00100000:0.0:1784938458.283347:0:21161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350916224 00000100:00100000:0.0:1784938458.283391:0:21161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 89 00000100:00100000:0.0:1784938458.283400:0:21161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:16391:x1871643350916224:12345-192.168.202.154@tcp:41:osp-pre-0-1.0 00000004:00000024:0.0:1784938458.283433:0:21161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 218308608 avail 191283200 00000100:00100000:0.0:1784938458.283474:0:21161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:16391:x1871643350916224:12345-192.168.202.154@tcp:41:osp-pre-0-1.0 Request processed in 75us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938458.283481:0:21161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 89 00000100:00100000:2.0:1784938458.288548:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23823baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350916224:192.168.202.154@tcp:41:osp-pre-0-1.0 00000100:00100000:0.0:1784938458.291883:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d4e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350916096:192.168.202.154@tcp:13:osp-pre-0-0.0 00010000:00010000:2.0:1784938458.859460:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938459.880323:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784938460.847559:0:25943:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1784938460.847618:0:25943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238e482800/0x7b044d4128f982c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f982ce expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938460.847634:0:25943:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238e482800/0x7b044d4128f982c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f982ce expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938460.847647:0:25943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238e482800/0x7b044d4128f982c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b044d4128f982ce expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938460.847654:0:25943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff9f238e482800/0x7b044d4128f982c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b044d4128f982ce expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938460.848067:0:25943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784938460.848075:0:25943:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1784938460.848102:0:25943:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784938460.848106:0:25943:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1784938460.848113:0:25943:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784938460.848138:0:25943:0:(import.c:65:import_set_state_nolock()) ffff9f24b4113000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1784938460.848227:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938460.848236:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9f238e482800/0x7b044d4128f982c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b044d4128f982ce expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.848244:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238e482800 already unused, calling callback (ffffffffc1390c20) 10000000:00010000:3.0:1784938460.848248:0:25732:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9f238e482800/0x7b044d4128f982c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b044d4128f982ce expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.848256:0:25732:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f238e482800/0x7b044d4128f982c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b044d4128f982ce expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938460.848264:0:25732:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f238e482800/0x7b044d4128f982c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b044d4128f982ce expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938460.848270:0:25732:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784938460.848272:0:25732:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1784938460.848274:0:25732:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1784938460.848302:0:25732:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9f238e482800/0x7b044d4128f982c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f982ce expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.848309:0:25732:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938460.848328:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9f238e482800/0x7b044d4128f982c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f982ce expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.848336:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f238e482800/0x7b044d4128f982c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f982ce expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.848350:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938460.848352:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938460.848354:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938460.848382:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d4e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:16388:1871643350916352:192.168.202.154@tcp:39:umount.0 00000100:00100000:2.0:1784938460.848536:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938460.848545:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2489ae6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e07296-2a01-411c-abf2-6d190cb69ef0:16391:1871643350916480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784938460.848590:0:16391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938460.848639:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350916480 00000100:00100000:2.0:1784938460.848646:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350916480 00000100:00100000:2.0:1784938460.848697:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784938460.848707:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73e07296-2a01-411c-abf2-6d190cb69ef0+24:16391:x1871643350916480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784938460.848720:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938460.848735:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f238d17aa00/0x7b044d4128f982ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f982c7 expref: 24 pid: 24193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938460.848759:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938460.848795:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73e07296-2a01-411c-abf2-6d190cb69ef0+23:16391:x1871643350916480:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938460.848802:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784938460.848840:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2489ae6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e07296-2a01-411c-abf2-6d190cb69ef0:16391:1871643350916480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938460.850180:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938460.850630:0:24202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350916352 00000100:00100000:0.0:1784938460.850638:0:24202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350916352 00000100:00100000:0.0:1784938460.851888:0:24202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 738 00000100:00100000:0.0:1784938460.851900:0:24202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:16388:x1871643350916352:12345-192.168.202.154@tcp:39:umount.0 00000020:00000080:0.0:1784938460.851928:0:24202:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f98368 00000100:00080000:0.0:1784938460.851935:0:24202:0:(import.c:65:import_set_state_nolock()) ffff9f2383ab1800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1784938460.852003:0:24202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:16388:x1871643350916352:12345-192.168.202.154@tcp:39:umount.0 Request processed in 106us (1829us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938460.852008:0:24202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 738 00000020:00000080:0.0:1784938460.852017:0:24202:0:(genops.c:906:class_export_put()) final put ffff9f2383ab7000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1784938460.852052:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f2383ab7000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1784938460.852084:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f2383ab1800 for lustre-MDT0000 00010000:00010000:2.0:1784938460.852739:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784938460.852782:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b4113000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1784938460.852802:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d4e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:16388:1871643350916352:192.168.202.154@tcp:39:umount.0 00000100:00080000:3.0:1784938460.852936:0:25943:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784938460.852941:0:25943:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1784938460.852945:0:25943:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1784938460.854249:0:25943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238dc65200/0x7b044d4128f98203 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9820a expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.854265:0:25943:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238dc65200/0x7b044d4128f98203 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9820a expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.854274:0:25943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238dc65200/0x7b044d4128f98203 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b044d4128f9820a expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.854281:0:25943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff9f238dc65200/0x7b044d4128f98203 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b044d4128f9820a expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.854303:0:25943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938460.854310:0:25943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238d17bc00/0x7b044d4128f985d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f985d7 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.854317:0:25943:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238d17bc00/0x7b044d4128f985d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f985d7 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.854324:0:25943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238d17bc00/0x7b044d4128f985d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b044d4128f985d7 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.854331:0:25943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff9f238d17bc00/0x7b044d4128f985d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b044d4128f985d7 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.854347:0:25943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784938460.854351:0:25943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238dc64400/0x7b044d4128f982b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f982b9 expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.854358:0:25943:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238dc64400/0x7b044d4128f982b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f982b9 expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.854364:0:25943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238dc64400/0x7b044d4128f982b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b044d4128f982b9 expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.854370:0:25943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff9f238dc64400/0x7b044d4128f982b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b044d4128f982b9 expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.854385:0:25943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1784938460.854389:0:25943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238dc65000/0x7b044d4128f981f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f981fc expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.854396:0:25943:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238dc65000/0x7b044d4128f981f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f981fc expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.854401:0:25943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238dc65000/0x7b044d4128f981f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b044d4128f981fc expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.854407:0:25943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff9f238dc65000/0x7b044d4128f981f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b044d4128f981fc expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.854419:0:25943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1784938460.854422:0:25943:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1784938460.854456:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784938460.854462:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9f238dc65200/0x7b044d4128f98203 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b044d4128f9820a expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.854469:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dc65200 already unused, calling callback (ffffffffc1390c20) 10000000:00010000:3.0:1784938460.854473:0:25732:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9f238dc65200/0x7b044d4128f98203 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b044d4128f9820a expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.854481:0:25732:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f238dc65200/0x7b044d4128f98203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b044d4128f9820a expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938460.854487:0:25732:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f238dc65200/0x7b044d4128f98203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b044d4128f9820a expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938460.854497:0:25732:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784938460.854499:0:25732:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1784938460.854501:0:25732:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1784938460.854537:0:25732:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9f238dc65200/0x7b044d4128f98203 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f9820a expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.854544:0:25732:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938460.854573:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9f238dc65200/0x7b044d4128f98203 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f9820a expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938460.854579:0:16390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1784938460.854580:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f238dc65200/0x7b044d4128f98203 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f9820a expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.854591:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784938460.854593:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9f238d17bc00/0x7b044d4128f985d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b044d4128f985d7 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938460.854596:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2489ae5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e07296-2a01-411c-abf2-6d190cb69ef0:16390:1871643350916608:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938460.854599:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17bc00 already unused, calling callback (ffffffffc1390c20) 10000000:00010000:3.0:1784938460.854602:0:25732:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9f238d17bc00/0x7b044d4128f985d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b044d4128f985d7 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.854607:0:25732:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f238d17bc00/0x7b044d4128f985d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b044d4128f985d7 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938460.854613:0:25732:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f238d17bc00/0x7b044d4128f985d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b044d4128f985d7 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938460.854617:0:25732:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1784938460.854619:0:25732:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1784938460.854621:0:25732:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1784938460.854631:0:25732:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9f238d17bc00/0x7b044d4128f985d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f985d7 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.854635:0:25732:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938460.854640:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9f238d17bc00/0x7b044d4128f985d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f985d7 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.854646:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f238d17bc00/0x7b044d4128f985d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f985d7 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.854653:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938460.854656:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9f238dc64400/0x7b044d4128f982b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b044d4128f982b9 expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.854661:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dc64400 already unused, calling callback (ffffffffc1390c20) 00000100:00100000:0.0:1784938460.854661:0:16390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1784938460.854664:0:25732:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9f238dc64400/0x7b044d4128f982b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b044d4128f982b9 expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.854670:0:25732:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f238dc64400/0x7b044d4128f982b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b044d4128f982b9 expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938460.854676:0:25732:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f238dc64400/0x7b044d4128f982b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b044d4128f982b9 expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938460.854681:0:25732:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1784938460.854683:0:25732:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1784938460.854685:0:25732:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1784938460.854696:0:25732:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9f238dc64400/0x7b044d4128f982b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f982b9 expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.854701:0:25732:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938460.854715:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9f238dc64400/0x7b044d4128f982b2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f982b9 expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.854722:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f238dc64400/0x7b044d4128f982b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f982b9 expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.854730:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938460.854733:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9f238dc65000/0x7b044d4128f981f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b044d4128f981fc expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.854739:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dc65000 already unused, calling callback (ffffffffc1390c20) 10000000:00010000:3.0:1784938460.854742:0:25732:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9f238dc65000/0x7b044d4128f981f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b044d4128f981fc expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.854749:0:25732:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f238dc65000/0x7b044d4128f981f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b044d4128f981fc expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938460.854754:0:25732:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f238dc65000/0x7b044d4128f981f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b044d4128f981fc expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938460.854758:0:25732:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1784938460.854760:0:25732:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1784938460.854762:0:25732:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1784938460.854773:0:25732:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9f238dc65000/0x7b044d4128f981f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f981fc expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.854778:0:25732:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938460.854783:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9f238dc65000/0x7b044d4128f981f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f981fc expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938460.854789:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f238dc65000/0x7b044d4128f981f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f981fc expref: -99 pid: 24187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938460.854792:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2489ae7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e07296-2a01-411c-abf2-6d190cb69ef0:16390:1871643350916736:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938460.854801:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938460.854803:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938460.854804:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938460.854814:0:16390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938460.854818:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2489ae6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e07296-2a01-411c-abf2-6d190cb69ef0:16392:1871643350916992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938460.854842:0:16392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938460.854859:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350916608 00000100:00100000:0.0:1784938460.854865:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350916608 00000100:00100000:0.0:1784938460.854907:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350916736 00000100:00100000:0.0:1784938460.854909:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350916736 00000100:00100000:0.0:1784938460.854926:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350916992 00000100:00100000:0.0:1784938460.854929:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350916992 00000100:00100000:0.0:1784938460.854943:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784938460.854951:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386360e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:73e07296-2a01-411c-abf2-6d190cb69ef0+25:16390:x1871643350916608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784938460.854964:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938460.854978:0:25731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f238db7b200/0x7b044d4128f9820a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f98203 expref: 25 pid: 24193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938460.854990:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938460.855045:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784938460.855052:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2489ae4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e07296-2a01-411c-abf2-6d190cb69ef0:16392:1871643350916864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938460.855057:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386360e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:73e07296-2a01-411c-abf2-6d190cb69ef0+24:16390:x1871643350916608:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938460.855064:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784938460.855072:0:16392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938460.855079:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350916864 00000100:00100000:0.0:1784938460.855082:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350916864 00000020:01000004:3.0:1784938460.855095:0:25943:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000100:00100000:0.0:1784938460.855096:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000020:01000000:3.0:1784938460.855099:0:25943:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000100:00100000:0.0:1784938460.855101:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386360700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:73e07296-2a01-411c-abf2-6d190cb69ef0+24:16390:x1871643350916736:12345-0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1784938460.855103:0:25943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:0.0:1784938460.855107:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:02000400:3.0:1784938460.855108:0:25943:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:0.0:1784938460.855114:0:25731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f24b2f3fc00/0x7b044d4128f985d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f985d0 expref: 24 pid: 24193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938460.855122:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938460.855593:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386360700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:73e07296-2a01-411c-abf2-6d190cb69ef0+23:16390:x1871643350916736:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938460.855603:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784938460.855620:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784938460.855629:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2489ae6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:73e07296-2a01-411c-abf2-6d190cb69ef0+22:16392:x1871643350916992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784938460.855638:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938460.855648:0:25731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f238e483c00/0x7b044d4128f981fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f981f5 expref: 22 pid: 24192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938460.855658:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938460.855773:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2489ae6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:73e07296-2a01-411c-abf2-6d190cb69ef0+21:16392:x1871643350916992:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938460.855780:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784938460.855795:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784938460.855800:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:73e07296-2a01-411c-abf2-6d190cb69ef0+20:16392:x1871643350916864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784938460.855808:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938460.855816:0:25731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f238e483600/0x7b044d4128f982b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f982b2 expref: 20 pid: 24194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938460.855825:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938460.855829:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938460.855846:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:73e07296-2a01-411c-abf2-6d190cb69ef0+19:16392:x1871643350916864:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938460.855851:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784938460.855883:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2489ae4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e07296-2a01-411c-abf2-6d190cb69ef0:16392:1871643350916864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938460.855893:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2489ae6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e07296-2a01-411c-abf2-6d190cb69ef0:16392:1871643350916992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938460.855920:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2489ae7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e07296-2a01-411c-abf2-6d190cb69ef0:16390:1871643350916736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938460.855929:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2489ae5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e07296-2a01-411c-abf2-6d190cb69ef0:16390:1871643350916608:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784938460.856873:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938460.856882:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:3.0:1784938460.858110:0:25943:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:3.0:1784938460.858664:0:25943:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:3.0:1784938460.858676:0:25943:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9f2486cc0000 lustre-MDT0000-lwp-MDT0001_UUID 192.168.202.154@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784938460.858682:0:25943:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9f2490617000 lustre-MDT0000-lwp-OST0001_UUID 192.168.202.154@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784938460.858687:0:25943:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9f2490617800 lustre-MDT0000-lwp-OST0000_UUID 192.168.202.154@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784938460.858691:0:25943:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9f24b2ce4000 lustre-MDT0001-mdtlov_UUID 192.168.202.154@tcp 6 (0 0 1) 0 0 0 0: 0000000000000000 8589934866 stale:0 00000020:00080000:3.0:1784938460.858696:0:25943:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9f238c830000) has exports, disconnecting them 00000020:00080000:3.0:1784938460.858701:0:25943:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.154@tcp (ffff9f2486cc0000), last request at 1784938416 00000020:00000080:3.0:1784938460.858709:0:25943:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9845d 00000100:00080000:3.0:1784938460.858719:0:25943:0:(import.c:65:import_set_state_nolock()) ffff9f2486cc1800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784938460.858751:0:25943:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.154@tcp (ffff9f2486cc0000): rc 0 00000020:00000080:3.0:1784938460.858753:0:25943:0:(genops.c:906:class_export_put()) final put ffff9f2486cc0000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1784938460.858772:0:25943:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.154@tcp (ffff9f2490617000), last request at 1784938457 00000020:00000080:3.0:1784938460.858776:0:25943:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f98376 00000100:00080000:3.0:1784938460.858780:0:25943:0:(import.c:65:import_set_state_nolock()) ffff9f2490610000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1784938460.858798:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1784938460.858806:0:25943:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.154@tcp (ffff9f2490617000): rc 0 00000020:00000080:3.0:1784938460.858808:0:25943:0:(genops.c:906:class_export_put()) final put ffff9f2490617000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1784938460.858812:0:25943:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.154@tcp (ffff9f2490617800), last request at 1784938457 00000020:00000080:3.0:1784938460.858815:0:25943:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9836f 00000100:00080000:3.0:1784938460.858825:0:25943:0:(import.c:65:import_set_state_nolock()) ffff9f2490616800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784938460.858857:0:25943:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.154@tcp (ffff9f2490617800): rc 0 00000020:00000080:3.0:1784938460.858860:0:25943:0:(genops.c:906:class_export_put()) final put ffff9f2490617800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1784938460.858863:0:25943:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.154@tcp (ffff9f24b2ce4000), last request at 1784938401 00000020:00000080:3.0:1784938460.858867:0:25943:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f98242 00000020:00010000:3.0:1784938460.858875:0:25943:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9f24b2ce4000: total 3 00000100:00080000:3.0:1784938460.858878:0:25943:0:(import.c:65:import_set_state_nolock()) ffff9f24bd508000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784938460.858888:0:25943:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.154@tcp (ffff9f24b2ce4000): rc 0 00000004:00000080:3.0:1784938460.858895:0:25943:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbfdb4faebae0 00000100:00080000:3.0:1784938460.858917:0:25943:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784938460.858921:0:25943:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00010000:2.0:1784938460.859820:0:25733:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9f24b2ce4000: total 3 00010000:00010000:2.0:1784938460.859866:0:25733:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9f24b2ce4000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1784938460.859895:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238c559e00/0x7b044d4128f9d260 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.154@tcp remote: 0x7b044d4128f9d259 expref: 2 pid: 21160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938460.859915:0:25733:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9f24b2ce4000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1784938460.860253:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f2486cc0000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1784938460.860299:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f2490617000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1784938460.860321:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f2490617800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1784938460.860337:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f2486cc1800 for lustre-MDT0000 00000020:00000080:0.0:1784938460.860342:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f2490610000 for lustre-MDT0000 00000020:00000080:0.0:1784938460.860345:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f2490616800 for lustre-MDT0000 00010000:00010000:0.0:1784938460.861233:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784938460.863564:0:25943:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1784938460.863614:0:25943:0:(import.c:65:import_set_state_nolock()) ffff9f23839f2800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1784938460.864889:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784938460.868965:0:25943:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784938460.868974:0:25943:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967483 gen 3 00000004:00080000:3.0:1784938460.868990:0:25943:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1784938460.869051:0:25943:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1784938460.869081:0:25943:0:(import.c:65:import_set_state_nolock()) ffff9f24906a0800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1784938460.869093:0:25943:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784938460.869095:0:25943:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967477 gen 3 00000004:00080000:3.0:1784938460.869106:0:25943:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1784938460.869280:0:25943:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1784938460.869291:0:25943:0:(import.c:65:import_set_state_nolock()) ffff9f238d0ee800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1784938460.869330:0:25943:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9f238c830000) has no exports 00000100:00100000:3.0:1784938460.879736:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd5a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350917120:192.168.202.154@tcp:39:umount.0 00000100:00100000:3.0:1784938460.880828:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350917248:192.168.202.154@tcp:9:umount.0 00000100:00100000:3.0:1784938460.880897:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350917376:192.168.202.154@tcp:9:umount.0 00000100:00100000:1.0:1784938460.883432:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938460.913367:0:25728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350917248 00000100:00100000:1.0:1784938460.913382:0:25728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350917248 00000100:00100000:1.0:1784938460.913464:0:25728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 982 00000100:00080000:0.0:1784938460.913467:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938460.913474:0:25728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:16388:x1871643350917248:12345-192.168.202.154@tcp:9:umount.0 00000020:00000080:1.0:1784938460.913512:0:25728:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f98296 00000100:00080000:1.0:1784938460.913522:0:25728:0:(import.c:65:import_set_state_nolock()) ffff9f24906a1800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1784938460.913573:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1784938460.913577:0:25728:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967566 00000100:00100000:1.0:1784938460.916178:0:25728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+2:16388:x1871643350917248:12345-192.168.202.154@tcp:9:umount.0 Request processed in 2694us (32743us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938460.916203:0:25728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 982 00000100:00100000:1.0:1784938460.916847:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938460.916887:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938460.916911:0:25730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350917376 00000100:00100000:1.0:1784938460.916920:0:25730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350917376 00000100:00100000:1.0:1784938460.916968:0:25730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 983 00000100:00100000:1.0:1784938460.916978:0:25730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:16388:x1871643350917376:12345-192.168.202.154@tcp:9:umount.0 00000020:00000080:1.0:1784938460.917004:0:25730:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f982c0 00000100:00080000:1.0:1784938460.917011:0:25730:0:(import.c:65:import_set_state_nolock()) ffff9f238ef9a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784938460.917056:0:25730:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967566 00000100:00100000:1.0:1784938460.917172:0:25730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+2:16388:x1871643350917376:12345-192.168.202.154@tcp:9:umount.0 Request processed in 195us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938460.917191:0:25730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 983 00000100:00080000:1.0:1784938460.917212:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784938460.917314:0:25714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350917120 00000100:00100000:3.0:1784938460.917319:0:25714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350917120 00000100:00100000:3.0:1784938460.917353:0:25714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 90 00000100:00100000:3.0:1784938460.917423:0:25714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:16388:x1871643350917120:12345-192.168.202.154@tcp:39:umount.0 00000020:00000080:3.0:1784938460.917438:0:25714:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f985ec 00000100:00080000:3.0:1784938460.917442:0:25714:0:(import.c:65:import_set_state_nolock()) ffff9f248a93e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784938460.917456:0:25714:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934849 00000100:00100000:3.0:1784938460.917534:0:25714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:16388:x1871643350917120:12345-192.168.202.154@tcp:39:umount.0 Request processed in 113us (690us total) trans 8589934850 rc 0/0 00000100:00100000:3.0:1784938460.917540:0:25714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 90 00000100:00080000:3.0:1784938460.917582:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24906a0800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1784938460.917593:0:16388:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1784938460.917595:0:16388:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784938460.917599:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350917248:192.168.202.154@tcp:9:umount.0 00000100:00080000:3.0:1784938460.917612:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f238d0ee800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1784938460.917620:0:16388:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1784938460.917621:0:16388:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784938460.917624:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350917376:192.168.202.154@tcp:9:umount.0 00010000:00010000:3.0:1784938460.917652:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784938460.917846:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f23839f2800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1784938460.917852:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd5a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350917120:192.168.202.154@tcp:39:umount.0 00010000:00010000:0.0:1784938460.918875:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1784938460.925068:0:25943:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9f238c830000) has no exports 00000020:00000080:2.0:1784938461.030728:0:25733:0:(genops.c:906:class_export_put()) final put ffff9f24b2ce4000/lustre-MDT0001-mdtlov_UUID 00010000:00010000:2.0:1784938461.030847:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784938461.031222:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f24b2ce4000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1784938461.031282:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f24bd508000 for lustre-MDT0000 00010000:00010000:3.0:1784938461.032240:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938461.032246:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938461.032248:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784938461.125792:0:25943:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f98257 00000020:00000080:0.0:1784938461.125810:0:25943:0:(genops.c:906:class_export_put()) final put ffff9f24b36a7000/lustre-QMT0000_UUID 00000020:01000000:0.0:1784938461.125838:0:25943:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1784938461.125888:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f24b36a7000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1784938461.125957:0:25943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784938461.125969:0:25943:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1784938461.125974:0:25943:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9f238c833380) has no exports 00000020:00000080:3.0:1784938461.126378:0:25943:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f98250 00000020:00000080:3.0:1784938461.126384:0:25943:0:(genops.c:906:class_export_put()) final put ffff9f24906a5800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784938461.126437:0:25943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784938461.126446:0:25943:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1784938461.126449:0:25943:0:(genops.c:906:class_export_put()) final put ffff9f24906a3000/lustre-QMT0000_UUID 00000020:00000080:3.0:1784938461.126451:0:25943:0:(genops.c:865:class_export_destroy()) destroying export ffff9f24906a3000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1784938461.126459:0:25943:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1784938461.126633:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f24906a5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1784938461.126900:0:25943:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9f24af3f92a0 - data ffff9f24895af288/ffff9f238d553800 00000020:01000000:3.0:1784938461.127054:0:25943:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9f24911d0240 - data ffff9f24846370d8/ffff9f248f97c400 00000100:00080000:3.0:1784938461.200106:0:25943:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784938461.200114:0:25943:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1784938461.200132:0:25943:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9f24bd5a5180 x1871643350917120/t8589934850(8589934850) o39->lustre-MDT0001-osp-MDT0000@192.168.202.154@tcp:24/4 lens 224/224 e 0 to 0 dl 1784938470 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938461.201506:0:25943:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1784938461.208313:0:25943:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784938461.208321:0:25943:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967483 gen 4 00000004:00080000:3.0:1784938461.208338:0:25943:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784938461.208341:0:25943:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1784938461.208826:0:24223:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1784938461.208832:0:24223:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 40 count 1 00000040:00080000:0.0:1784938461.208843:0:24223:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1784938461.209789:0:25943:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784938461.209795:0:25943:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967477 gen 4 00000004:00080000:3.0:1784938461.209814:0:25943:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784938461.209816:0:25943:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1784938461.213608:0:24225:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1784938461.213618:0:24225:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 41 count 1 00000040:00080000:0.0:1784938461.213652:0:24225:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1784938461.215486:0:25943:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f98218 00000020:00000080:3.0:1784938461.215497:0:25943:0:(genops.c:906:class_export_put()) final put ffff9f2387dda000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784938461.215756:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f2387dda000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784938461.237007:0:25943:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9822d 00000020:00000080:0.0:1784938461.237022:0:25943:0:(genops.c:906:class_export_put()) final put ffff9f24b2ce0000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1784938461.237036:0:25943:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1784938461.237041:0:25943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784938461.237052:0:25943:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784938461.237056:0:25943:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9f24b4d1b380) has no exports 00000004:01000000:0.0:1784938461.237259:0:25943:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1784938461.237268:0:25943:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9829d 00000020:00000080:0.0:1784938461.237272:0:25943:0:(genops.c:906:class_export_put()) final put ffff9f238ef9f000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1784938461.237276:0:25943:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1784938461.237280:0:25943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784938461.237284:0:25943:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784938461.237287:0:25943:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9f24b4d199c0) has no exports 00000020:00000080:0.0:1784938461.237293:0:25943:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9828f 00000020:00000080:0.0:1784938461.237296:0:25943:0:(genops.c:906:class_export_put()) final put ffff9f238d0ec800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1784938461.237646:0:25943:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1784938461.237651:0:25943:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784938461.237656:0:25943:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967477 gen 5 00000004:00080000:0.0:1784938461.237663:0:25943:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784938461.237665:0:25943:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784938461.237694:0:25943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784938461.237701:0:25943:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784938461.237706:0:25943:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f98281 00000020:00000080:0.0:1784938461.237710:0:25943:0:(genops.c:906:class_export_put()) final put ffff9f238d0e9800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1784938461.237714:0:25943:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1784938461.237718:0:25943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784938461.237721:0:25943:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784938461.237723:0:25943:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9f24b87ccd40) has no exports 00000020:00000080:0.0:1784938461.237727:0:25943:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9827a 00000020:00000080:0.0:1784938461.237730:0:25943:0:(genops.c:906:class_export_put()) final put ffff9f24906a1000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1784938461.238049:0:25943:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1784938461.238053:0:25943:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784938461.238055:0:25943:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967483 gen 5 00000004:00080000:0.0:1784938461.238058:0:25943:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784938461.238060:0:25943:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784938461.238084:0:25943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784938461.238089:0:25943:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1784938461.238098:0:25943:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1784938461.238103:0:25943:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9826c 00000020:00000080:0.0:1784938461.238107:0:25943:0:(genops.c:906:class_export_put()) final put ffff9f24b2ce1000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1784938461.238112:0:25943:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1784938461.238115:0:25943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784938461.238118:0:25943:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784938461.238120:0:25943:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff9f24b4d18000) has no exports 00000020:00000080:0.0:1784938461.238125:0:25943:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f98265 00000020:00000080:0.0:1784938461.238128:0:25943:0:(genops.c:906:class_export_put()) final put ffff9f23839f3800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784938461.238973:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f24b2ce0000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1784938461.238990:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f238ef9f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1784938461.238999:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f238d0ec800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784938461.239006:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f238d0ee800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1784938461.239012:0:38:0:(genops.c:906:class_export_put()) final put ffff9f238d0ee000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784938461.239015:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f238d0ee000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1784938461.239020:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784938461.239107:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f238d0e9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1784938461.239112:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f24906a1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784938461.239115:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f24906a0800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1784938461.239121:0:38:0:(genops.c:906:class_export_put()) final put ffff9f2498583000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784938461.239123:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f2498583000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1784938461.239127:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784938461.239172:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f24b2ce1000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1784938461.239176:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f23839f3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1784938461.247302:0:25943:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1784938461.247311:0:25943:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784938461.247315:0:25943:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1784938461.247323:0:25943:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784938461.247386:0:25943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784938461.247399:0:25943:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784938461.247423:0:25943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784938461.247427:0:25943:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784938461.247433:0:25943:0:(genops.c:906:class_export_put()) final put ffff9f2387ddd800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784938461.247438:0:25943:0:(genops.c:865:class_export_destroy()) destroying export ffff9f2387ddd800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1784938461.247445:0:25943:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784938461.247544:0:25943:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f98234 00000020:00000080:1.0:1784938461.247551:0:25943:0:(genops.c:906:class_export_put()) final put ffff9f24b2ce4800/lustre-MDD0000_UUID 00000020:01000000:1.0:1784938461.247556:0:25943:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1784938461.247559:0:25943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784938461.247563:0:25943:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784938461.247566:0:25943:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9f238c834d40) has no exports 00000020:00000080:1.0:1784938461.247584:0:25943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784938461.247587:0:25943:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1784938461.247591:0:25943:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9823b 00000020:00000080:1.0:1784938461.247595:0:25943:0:(genops.c:906:class_export_put()) final put ffff9f24b2ce0800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1784938461.247602:0:25943:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f2490441000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1784938461.247606:0:25943:0:(obd_mount.c:706:lustre_put_lsi()) put ffff9f2490441000 3 00000020:01000004:1.0:1784938461.247608:0:25943:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f2490441000 from lustre-MDT0000 00000020:00000080:1.0:1784938461.247624:0:25943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784938461.247628:0:25943:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1784938461.247630:0:25943:0:(genops.c:906:class_export_put()) final put ffff9f238ce52800/lustre-MDT0000_UUID 00000020:00000080:1.0:1784938461.247632:0:25943:0:(genops.c:865:class_export_destroy()) destroying export ffff9f238ce52800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1784938461.247638:0:25943:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1784938461.247679:0:25943:0:(obd_mount.c:574:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1784938461.247683:0:25943:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1784938461.247687:0:25943:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1784938461.247689:0:25943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784938461.247692:0:25943:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1784938461.247698:0:25943:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9f238d126000 73e07296-2a01-411c-abf2-6d190cb69ef0 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784938461.247702:0:25943:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9f2389733380) has exports, disconnecting them 00000020:00080000:1.0:1784938461.247706:0:25943:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9f238d126000), last request at 1784938401 00000020:00000080:1.0:1784938461.247721:0:25943:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f981d9 00000020:00010000:1.0:1784938461.247725:0:25943:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9f238d126000: total 2 00000100:00080000:1.0:1784938461.247729:0:25943:0:(import.c:65:import_set_state_nolock()) ffff9f238d120000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784938461.247745:0:25943:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f238d126000): rc 0 00000020:00080000:1.0:1784938461.247749:0:25943:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9f2389733380) has no exports 00000100:00100000:1.0:1784938461.247809:0:24194:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9f24986eb000:24194] 2 exiting: rc = 0 00000020:00000080:3.0:1784938461.247957:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f23839f2800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1784938461.247964:0:38:0:(genops.c:906:class_export_put()) final put ffff9f2498367000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784938461.247966:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f2498367000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1784938461.247976:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784938461.248037:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f24b2ce4800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1784938461.248040:0:38:0:(genops.c:906:class_export_put()) final put ffff9f2498585800/lustre-MDD0000_UUID 00000020:00000080:3.0:1784938461.248042:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f2498585800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1784938461.248045:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1784938461.248069:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f24b2ce0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1784938461.248096:0:24192:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9f24b9731e00:24192] 0 exiting: rc = 1 00000020:00010000:1.0:1784938461.256637:0:22954:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9f238d126000: total 0 00010000:00010000:1.0:1784938461.256717:0:22954:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9f238d126000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1784938461.256753:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f238e482000/0x7b044d4128f98345 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f9833e expref: 14 pid: 24193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938461.256774:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f238dc65600/0x7b044d4128f98337 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f98330 expref: 13 pid: 24194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938461.256786:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f238dc65c00/0x7b044d4128f98353 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f9834c expref: 12 pid: 24193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938461.256799:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f238dc64e00/0x7b044d4128f98392 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f9838b expref: 11 pid: 24194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938461.256815:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f238db7a400/0x7b044d4128f98361 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f9835a expref: 10 pid: 24192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938461.256824:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f238dc64800/0x7b044d4128f983a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f98399 expref: 9 pid: 24193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938461.256834:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f24b379c800/0x7b044d4128f985c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f985c2 expref: 8 pid: 24194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938461.256847:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f238db7b600/0x7b044d4128f982ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f982f8 expref: 7 pid: 24192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938461.256856:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f238db7b800/0x7b044d4128f9830d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f98306 expref: 6 pid: 24192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938461.256866:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f238db7a000/0x7b044d4128f98448 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f98441 expref: 5 pid: 24192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938461.256876:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f238dc64a00/0x7b044d4128f9831b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f98314 expref: 4 pid: 24194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938461.256888:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f238dc65a00/0x7b044d4128f98329 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f98322 expref: 3 pid: 24194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938461.256900:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f238e483e00/0x7b044d4128f9843a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f98433 expref: 2 pid: 24194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938461.256911:0:22954:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9f238d126000, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1784938461.256924:0:22954:0:(genops.c:906:class_export_put()) final put ffff9f238d126000/73e07296-2a01-411c-abf2-6d190cb69ef0 00010000:00010000:1.0:1784938461.256947:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938461.256950:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938461.256952:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784938461.256998:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f238d126000/73e07296-2a01-411c-abf2-6d190cb69ef0 for MGS 00000020:00000080:3.0:1784938461.257035:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f238d120000 for MGS 00000100:00100000:2.0:1784938461.258056:0:24193:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9f238820ca00:24193] 1 exiting: rc = 0 00000100:00100000:1.0:1784938461.258633:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258643:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258650:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258655:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258674:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258682:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258689:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258695:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258701:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258707:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258712:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258719:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258724:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258729:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258735:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258739:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258745:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258750:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258756:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258761:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258767:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258773:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258778:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258784:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258790:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258794:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258799:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258804:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258809:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258816:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258821:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258827:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258832:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258838:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258843:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258848:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258853:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258858:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258864:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258870:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258875:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258881:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258886:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258891:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258896:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258902:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258908:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258914:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258919:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258925:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258931:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258937:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258943:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258948:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258955:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258961:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258966:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258972:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258977:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258983:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258989:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.258994:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.259000:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938461.259006:0:25943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1784938461.266219:0:25943:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9f2488a73f60 - data ffff9f248442d0d8/ffff9f248f966c00 00000020:01000000:1.0:1784938461.266356:0:25943:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9f24b3697300 - data ffff9f238642ba20/ffff9f238cf51800 00000020:00000080:1.0:1784938461.266892:0:25943:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f981d2 00000020:00000080:1.0:1784938461.266903:0:25943:0:(genops.c:906:class_export_put()) final put ffff9f2388197000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1784938461.266922:0:25943:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f2490441000 from MGS, refs=2 00000020:01000004:1.0:1784938461.266925:0:25943:0:(obd_mount.c:706:lustre_put_lsi()) put ffff9f2490441000 2 00000020:01000004:1.0:1784938461.266928:0:25943:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f2490441000 from MGS 00000020:00000080:1.0:1784938461.266948:0:25943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784938461.266955:0:25943:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1784938461.266957:0:25943:0:(genops.c:906:class_export_put()) final put ffff9f2388195800/MGS 00000020:00000080:1.0:1784938461.266960:0:25943:0:(genops.c:865:class_export_destroy()) destroying export ffff9f2388195800/MGS for MGS 00000020:01000000:1.0:1784938461.266966:0:25943:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1784938461.267060:0:25943:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1784938461.267065:0:25943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784938461.267070:0:25943:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1784938461.267079:0:25943:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9f24b4114000 lustre-MDT0000-lwp-MDT0000 192.168.202.154@tcp 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784938461.267085:0:25943:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff9f24b2cc8000) has exports, disconnecting them 00000020:00080000:1.0:1784938461.267089:0:25943:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 192.168.202.154@tcp (ffff9f24b4114000), last request at 1784938401 00000020:00000080:1.0:1784938461.267093:0:25943:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f982dc 00000020:00080000:1.0:1784938461.267103:0:25943:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.154@tcp (ffff9f24b4114000): rc 0 00000020:00000080:1.0:1784938461.267108:0:25943:0:(genops.c:906:class_export_put()) final put ffff9f24b4114000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1784938461.267848:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f2388197000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784938461.267858:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f24b4114000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1784938461.331244:0:25943:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1784938461.331255:0:25943:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784938461.331259:0:25943:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1784938461.331267:0:25943:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784938461.331300:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f24b4113000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1784938461.331493:0:25943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784938461.331503:0:25943:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1784938461.331508:0:25943:0:(genops.c:906:class_export_put()) final put ffff9f24b4117000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1784938461.331512:0:25943:0:(genops.c:865:class_export_destroy()) destroying export ffff9f24b4117000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1784938461.331520:0:25943:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1784938461.331621:0:25943:0:(obd_mount.c:706:lustre_put_lsi()) put ffff9f2490441000 1 00000020:00000080:3.0:1784938461.331627:0:25943:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f981c4 00000020:00000080:3.0:1784938461.331634:0:25943:0:(genops.c:906:class_export_put()) final put ffff9f2490440800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1784938461.331643:0:25943:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1784938461.331651:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f2490440800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784938461.331672:0:25943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784938461.331677:0:25943:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1784938461.331681:0:25943:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9f2389734d40) has no exports 00000020:00000080:3.0:1784938461.406676:0:25943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784938461.406689:0:25943:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1784938461.406695:0:25943:0:(genops.c:906:class_export_put()) final put ffff9f2490447000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784938461.406699:0:25943:0:(genops.c:865:class_export_destroy()) destroying export ffff9f2490447000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1784938461.406712:0:25943:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1784938461.407697:0:25943:0:(obd_mount.c:664:lustre_free_lsi()) Freeing lsi ffff9f2490444800 00000020:02000400:3.0:1784938461.407867:0:25943:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1784938461.998000:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938462.889843:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd5a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:16391:1871643350917760:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938462.889945:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350918272:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938462.889985:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784938462.889992:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:16391:1871643350917888:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938462.890017:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350918400:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938462.890257:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938462.890338:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938462.890362:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938462.890385:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938462.890478:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350917760 00000100:00100000:3.0:1784938462.890485:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350917760 00000100:00100000:3.0:1784938462.890531:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350917888 00000100:00100000:3.0:1784938462.890535:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350917888 00000100:00100000:3.0:1784938462.890551:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 59 00000100:00100000:3.0:1784938462.890560:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:16391:x1871643350917760:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938462.890602:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:16391:x1871643350917760:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 43us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938462.890610:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 59 00000100:00100000:3.0:1784938462.890626:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 739 00000100:00100000:3.0:1784938462.890630:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:16391:x1871643350917888:12345-192.168.202.154@tcp:400:kworker.0 00000020:00080000:3.0:1784938462.890635:0:24945:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.154@tcp 00000100:00100000:3.0:1784938462.890653:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:16391:x1871643350917888:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 22us (316us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784938462.890659:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 739 00000100:00100000:3.0:1784938462.890678:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350918272 00000100:00100000:3.0:1784938462.890682:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350918272 00000100:00100000:3.0:1784938462.890707:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350918400 00000100:00100000:3.0:1784938462.890710:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350918400 00000100:00100000:3.0:1784938462.890729:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 91 00000100:00100000:3.0:1784938462.890734:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:16391:x1871643350918272:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938462.890759:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:16391:x1871643350918272:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 24us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938462.890765:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 91 00000100:00100000:3.0:1784938462.890776:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 92 00000100:00100000:3.0:1784938462.890781:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:16391:x1871643350918400:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938462.890805:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:16391:x1871643350918400:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 22us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938462.890810:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 92 00000100:00080000:3.0:1784938462.890976:0:16391:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@192.168.202.154@tcp abruptly disconnected: reconnecting 00000100:00080000:3.0:1784938462.890980:0:16391:0:(import.c:65:import_set_state_nolock()) ffff9f2383aea800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1784938462.890984:0:16391:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 192.168.202.154@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1784938462.893538:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:16390:1871643350917632:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938462.893635:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350918144:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938462.893662:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350918656:192.168.202.154@tcp:13:osp-pre-1-1.0 00000100:00100000:1.0:1784938462.893694:0:16390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1784938462.893702:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e07296-2a01-411c-abf2-6d190cb69ef0:16390:1871643350917504:0@lo:400:kworker.0 00000400:00000100:1.0:1784938462.893729:0:16390:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871643350917504 offset 0 length 224: 4 00000100:00100000:1.0:1784938462.893768:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:16390:1871643350918016:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938462.893794:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:16390:1871643350918528:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938462.893992:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938462.894016:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938462.894039:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938462.894056:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938462.894074:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00080000:1.0:1784938462.894106:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784938462.894112:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784938462.894116:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784938462.894138:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350917632 00000100:00100000:1.0:1784938462.894163:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350917632 00000100:00100000:1.0:1784938462.894210:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350918016 00000100:00100000:1.0:1784938462.894214:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350918016 00000100:00100000:1.0:1784938462.894242:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350918528 00000100:00100000:1.0:1784938462.894245:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350918528 00000100:00100000:1.0:1784938462.894258:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 60 00000100:00100000:1.0:1784938462.894266:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:16390:x1871643350918016:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938462.894322:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:16390:x1871643350918016:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 56us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938462.894329:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 60 00000100:00100000:1.0:1784938462.894346:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 740 00000100:00100000:1.0:1784938462.894351:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16390:x1871643350917632:12345-192.168.202.154@tcp:400:kworker.0 00000020:00080000:1.0:1784938462.894356:0:24201:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.154@tcp 00000100:00100000:1.0:1784938462.894379:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16390:x1871643350917632:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 27us (389us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784938462.894384:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 740 00000100:00100000:1.0:1784938462.894394:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 741 00000100:00100000:1.0:1784938462.894398:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16390:x1871643350918528:12345-192.168.202.154@tcp:400:kworker.0 00000020:00080000:1.0:1784938462.894404:0:24201:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.154@tcp 00000100:00100000:1.0:1784938462.894418:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16390:x1871643350918528:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 19us (343us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784938462.894423:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 741 00000100:00100000:1.0:1784938462.894439:0:21160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350918144 00000100:00100000:1.0:1784938462.894443:0:21160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350918144 00000100:00100000:1.0:1784938462.894465:0:21160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 91 00000100:00100000:1.0:1784938462.894469:0:21160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:16390:x1871643350918144:12345-192.168.202.154@tcp:400:kworker.0 00000020:00080000:1.0:1784938462.894474:0:21160:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.154@tcp 00000100:00100000:1.0:1784938462.894491:0:21160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:16390:x1871643350918144:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 21us (475us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784938462.894497:0:21160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 91 00000100:00100000:1.0:1784938462.894517:0:21154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350918656 00000100:00100000:1.0:1784938462.894520:0:21154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350918656 00000100:00100000:1.0:1784938462.894542:0:21154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 86 00000100:00100000:1.0:1784938462.894548:0:21154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16390:x1871643350918656:12345-192.168.202.154@tcp:13:osp-pre-1-1.0 00002000:00000024:1.0:1784938462.894570:0:21154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 272832 pending 0 free 313057280 avail 285245440 00000100:00100000:1.0:1784938462.894596:0:21154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16390:x1871643350918656:12345-192.168.202.154@tcp:13:osp-pre-1-1.0 Request processed in 48us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938462.894601:0:21154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 86 00000100:00080000:1.0:1784938462.894614:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784938462.894764:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:16390:1871643350918016:192.168.202.154@tcp:400:kworker.0 00000100:00080000:1.0:1784938462.894775:0:16390:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@192.168.202.154@tcp abruptly disconnected: reconnecting 00000100:00080000:1.0:1784938462.894780:0:16390:0:(import.c:65:import_set_state_nolock()) ffff9f2491e4e000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784938462.894784:0:16390:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 192.168.202.154@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1784938462.894790:0:16390:0:(import.c:65:import_set_state_nolock()) ffff9f2491e4e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784938462.894794:0:16390:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 192.168.202.154@tcp last attempt 683 00000100:00080000:1.0:1784938462.894801:0:16390:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9f2491e4e000 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:1.0:1784938462.894828:0:16390:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b68aa300 x1871643350918784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784938462.894848:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:16390:1871643350918528:192.168.202.154@tcp:400:kworker.0 00000100:00080000:1.0:1784938462.894859:0:16390:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@192.168.202.154@tcp abruptly disconnected: reconnecting 00000100:00080000:1.0:1784938462.894862:0:16390:0:(import.c:65:import_set_state_nolock()) ffff9f24b4116800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784938462.894866:0:16390:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 192.168.202.154@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1784938462.894868:0:16390:0:(import.c:65:import_set_state_nolock()) ffff9f24b4116800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784938462.894871:0:16390:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 192.168.202.154@tcp last attempt 680 00000100:00080000:1.0:1784938462.894876:0:16390:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f24b4116800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:1.0:1784938462.894890:0:16390:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f238f1b7800 x1871643350918912/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784938462.894900:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:16390:1871643350917632:192.168.202.154@tcp:400:kworker.0 00000100:00080000:1.0:1784938462.894910:0:16390:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@192.168.202.154@tcp abruptly disconnected: reconnecting 00000100:00080000:1.0:1784938462.894913:0:16390:0:(import.c:65:import_set_state_nolock()) ffff9f24bd509000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784938462.894916:0:16390:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 192.168.202.154@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1784938462.894919:0:16390:0:(import.c:65:import_set_state_nolock()) ffff9f24bd509000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784938462.894922:0:16390:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 192.168.202.154@tcp last attempt 683 00000100:00080000:1.0:1784938462.894927:0:16390:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9f24bd509000 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:1.0:1784938462.894939:0:16390:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f238f1b5f80 x1871643350919040/t0(0) o38->lustre-MDT0000-osp-MDT0001@192.168.202.154@tcp:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784938462.894950:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350918144:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938462.894967:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350918656:192.168.202.154@tcp:13:osp-pre-1-1.0 00000100:00100000:1.0:1784938462.894999:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:16388:1871643350918784:192.168.202.154@tcp:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1784938462.895033:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:16388:1871643350918912:192.168.202.154@tcp:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1784938462.895051:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:16388:1871643350919040:192.168.202.154@tcp:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1784938462.895137:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938462.895197:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938462.895212:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938462.895229:0:24201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350918784 00000100:00100000:1.0:1784938462.895233:0:24201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350918784 00000100:00100000:1.0:1784938462.895246:0:24201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 742 00000100:00100000:1.0:1784938462.895250:0:24201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16388:x1871643350918784:12345-192.168.202.154@tcp:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1784938462.895267:0:24201:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.154@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784938462.895641:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350918912 00000100:00100000:0.0:1784938462.895646:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350918912 00000100:00100000:0.0:1784938462.895668:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 743 00000100:00100000:0.0:1784938462.895673:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:16388:x1871643350918912:12345-192.168.202.154@tcp:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1784938462.895685:0:24203:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.154@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784938462.895718:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:16388:x1871643350918912:12345-192.168.202.154@tcp:38:ptlrpcd_00_01.0 Request processed in 43us (521us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784938462.895725:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 743 00000100:00100000:0.0:1784938462.895829:0:21161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350919040 00000100:00100000:0.0:1784938462.895833:0:21161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350919040 00000100:00100000:0.0:1784938462.895851:0:21161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 92 00000100:00100000:0.0:1784938462.895869:0:21161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388247100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:16388:x1871643350919040:12345-192.168.202.154@tcp:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1784938462.895879:0:21161:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.154@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784938462.895905:0:21161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388247100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:16388:x1871643350919040:12345-192.168.202.154@tcp:38:ptlrpcd_00_01.0 Request processed in 48us (692us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784938462.895911:0:21161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 92 00000100:00080000:0.0:1784938462.896008:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b4116800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784938462.896013:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.154@tcp failed (-19) 00000100:00100000:0.0:1784938462.896017:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:16388:1871643350918912:192.168.202.154@tcp:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1784938462.896025:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24bd509000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784938462.896029:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.154@tcp failed (-19) 00000100:00100000:0.0:1784938462.896031:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:16388:1871643350919040:192.168.202.154@tcp:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1784938462.898589:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784938462.898614:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386360a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350919168:192.168.202.154@tcp:13:osp-pre-0-1.0 00000100:00100000:0.0:1784938462.898906:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938462.900249:0:21154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350919168 00000100:00100000:0.0:1784938462.900262:0:21154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350919168 00000100:00100000:0.0:1784938462.900316:0:21154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 87 00000100:00100000:0.0:1784938462.900326:0:21154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386363100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16392:x1871643350919168:12345-192.168.202.154@tcp:13:osp-pre-0-1.0 00002000:00000024:0.0:1784938462.900361:0:21154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 272832 pending 0 free 313057280 avail 285245440 00000100:00100000:0.0:1784938462.900419:0:21154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386363100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16392:x1871643350919168:12345-192.168.202.154@tcp:13:osp-pre-0-1.0 Request processed in 93us (1514us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938462.900426:0:21154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 87 00000100:00100000:0.0:1784938462.900585:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386360a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350919168:192.168.202.154@tcp:13:osp-pre-0-1.0 00000100:00080000:3.0:1784938462.925680:0:16391:0:(import.c:65:import_set_state_nolock()) ffff9f2383aea800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938462.925693:0:16391:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 192.168.202.154@tcp last attempt 680 00000100:00080000:3.0:1784938462.925708:0:16391:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f2383aea800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:3.0:1784938462.926274:0:16391:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b6b8e680 x1871643350919296/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784938462.926302:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:16391:1871643350917888:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938462.926576:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:16388:1871643350919296:192.168.202.154@tcp:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1784938462.926692:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350918400:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938462.926707:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd5a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:16391:1871643350917760:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938462.926719:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350918272:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938462.927071:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938462.927116:0:24203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350919296 00000100:00100000:2.0:1784938462.927123:0:24203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350919296 00000100:00100000:2.0:1784938462.927392:0:24203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 744 00000100:00100000:2.0:1784938462.927400:0:24203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:16388:x1871643350919296:12345-192.168.202.154@tcp:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1784938462.927420:0:24203:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.154@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784938462.927463:0:24203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:16388:x1871643350919296:12345-192.168.202.154@tcp:38:ptlrpcd_00_02.0 Request processed in 63us (393us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784938462.927471:0:24203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 744 00000100:00080000:2.0:1784938462.927584:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f2383aea800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784938462.927590:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.154@tcp failed (-19) 00000100:00100000:2.0:1784938462.927593:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:16388:1871643350919296:192.168.202.154@tcp:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1784938463.016693:0:24201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16388:x1871643350918784:12345-192.168.202.154@tcp:38:ptlrpcd_00_01.0 Request processed in 121428us (121543us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784938463.016708:0:24201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 742 00000100:00080000:3.0:1784938463.016957:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f2491e4e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784938463.016963:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.154@tcp failed (-19) 00000100:00100000:3.0:1784938463.016968:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:16388:1871643350918784:192.168.202.154@tcp:38:ptlrpcd_00_01.0 00010000:00010000:1.0:1784938463.029374:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938464.065408:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938465.068042:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938466.088898:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784938466.844881:0:26144:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1784938466.844940:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238e482e00/0x7b044d4128f98441 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f98448 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938466.844954:0:26144:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238e482e00/0x7b044d4128f98441 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f98448 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938466.844962:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238e482e00/0x7b044d4128f98441 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b044d4128f98448 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938466.844970:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff9f238e482e00/0x7b044d4128f98441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b044d4128f98448 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938466.844995:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784938466.845000:0:26144:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1784938466.845028:0:26144:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784938466.845032:0:26144:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1784938466.845038:0:26144:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784938466.845043:0:26144:0:(import.c:65:import_set_state_nolock()) ffff9f2491e4e000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1784938466.845047:0:26144:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784938466.845049:0:26144:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784938466.845051:0:26144:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1784938466.846001:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238e483800/0x7b044d4128f98399 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f983a0 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938466.846013:0:26144:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238e483800/0x7b044d4128f98399 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f983a0 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938466.846020:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238e483800/0x7b044d4128f98399 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b044d4128f983a0 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938466.846025:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff9f238e483800/0x7b044d4128f98399 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b044d4128f983a0 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938466.846047:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784938466.846062:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784938466.846067:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9f238e482e00/0x7b044d4128f98441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b044d4128f98448 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938466.846079:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238e482e00 already unused, calling callback (ffffffffc1390c20) 10000000:00010000:1.0:1784938466.846082:0:25732:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9f238e482e00/0x7b044d4128f98441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b044d4128f98448 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938466.846091:0:25732:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f238e482e00/0x7b044d4128f98441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b044d4128f98448 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784938466.846098:0:25732:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f238e482e00/0x7b044d4128f98441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b044d4128f98448 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938466.846103:0:25732:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784938466.846106:0:25732:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1784938466.846108:0:25732:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1784938466.846178:0:25732:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9f238e482e00/0x7b044d4128f98441 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f98448 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938466.846185:0:25732:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784938466.846205:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9f238e482e00/0x7b044d4128f98441 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f98448 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938466.846211:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f238e482e00/0x7b044d4128f98441 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f98448 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938466.846224:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938466.846228:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9f238e483800/0x7b044d4128f98399 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b044d4128f983a0 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938466.846233:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238e483800 already unused, calling callback (ffffffffc1390c20) 10000000:00010000:1.0:1784938466.846236:0:25732:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9f238e483800/0x7b044d4128f98399 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b044d4128f983a0 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938466.846242:0:25732:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f238e483800/0x7b044d4128f98399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b044d4128f983a0 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784938466.846248:0:25732:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f238e483800/0x7b044d4128f98399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b044d4128f983a0 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938466.846253:0:25732:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784938466.846255:0:25732:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:1.0:1784938466.846266:0:25732:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9f238e483800/0x7b044d4128f98399 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f983a0 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938466.846271:0:25732:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784938466.846282:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9f238e483800/0x7b044d4128f98399 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f983a0 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938466.846289:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f238e483800/0x7b044d4128f98399 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f983a0 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938466.846297:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938466.846299:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938466.846301:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938466.846311:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24b2f3e000/0x7b044d4128f985c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f985c9 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938466.846318:0:26144:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24b2f3e000/0x7b044d4128f985c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f985c9 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938466.846323:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24b2f3e000/0x7b044d4128f985c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b044d4128f985c9 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938466.846333:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff9f24b2f3e000/0x7b044d4128f985c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b044d4128f985c9 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938466.846343:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938466.846347:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238dc64200/0x7b044d4128f98433 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9843a expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938466.846353:0:26144:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238dc64200/0x7b044d4128f98433 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9843a expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938466.846358:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238dc64200/0x7b044d4128f98433 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b044d4128f9843a expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938466.846363:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff9f238dc64200/0x7b044d4128f98433 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b044d4128f9843a expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938466.846371:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784938466.846375:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238e482a00/0x7b044d4128f9838b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f98392 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938466.846380:0:26144:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238e482a00/0x7b044d4128f9838b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f98392 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938466.846386:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238e482a00/0x7b044d4128f9838b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b044d4128f98392 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938466.846390:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff9f238e482a00/0x7b044d4128f9838b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b044d4128f98392 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938466.846412:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1784938466.846416:0:26144:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:1.0:1784938466.846419:0:26144:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1784938466.846440:0:26144:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1784938466.846444:0:26144:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='FA') 00000020:00000080:1.0:1784938466.846447:0:26144:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1784938466.846452:0:26144:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0001 00010000:00010000:3.0:1784938466.848317:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784938466.848331:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9f24b2f3e000/0x7b044d4128f985c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b044d4128f985c9 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938466.848346:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b2f3e000 already unused, calling callback (ffffffffc1390c20) 10000000:00010000:3.0:1784938466.848351:0:19223:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9f24b2f3e000/0x7b044d4128f985c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b044d4128f985c9 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938466.848360:0:19223:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f24b2f3e000/0x7b044d4128f985c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b044d4128f985c9 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938466.848367:0:19223:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f24b2f3e000/0x7b044d4128f985c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b044d4128f985c9 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938466.848373:0:19223:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1784938466.848376:0:19223:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1784938466.848379:0:19223:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1784938466.848415:0:19223:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9f24b2f3e000/0x7b044d4128f985c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f985c9 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938466.848422:0:19223:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938466.848434:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9f24b2f3e000/0x7b044d4128f985c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f985c9 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938466.848440:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f24b2f3e000/0x7b044d4128f985c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f985c9 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938466.848458:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938466.848462:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9f238dc64200/0x7b044d4128f98433 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b044d4128f9843a expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938466.848468:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238dc64200 already unused, calling callback (ffffffffc1390c20) 10000000:00010000:3.0:1784938466.848471:0:19223:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9f238dc64200/0x7b044d4128f98433 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b044d4128f9843a expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938466.848478:0:19223:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f238dc64200/0x7b044d4128f98433 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b044d4128f9843a expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938466.848484:0:19223:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f238dc64200/0x7b044d4128f98433 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b044d4128f9843a expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938466.848489:0:19223:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1784938466.848491:0:19223:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1784938466.848493:0:19223:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1784938466.848503:0:19223:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9f238dc64200/0x7b044d4128f98433 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f9843a expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938466.848509:0:19223:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938466.848516:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9f238dc64200/0x7b044d4128f98433 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f9843a expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938466.848523:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f238dc64200/0x7b044d4128f98433 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f9843a expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938466.848532:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938466.848535:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9f238e482a00/0x7b044d4128f9838b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b044d4128f98392 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938466.848541:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238e482a00 already unused, calling callback (ffffffffc1390c20) 10000000:00010000:3.0:1784938466.848544:0:19223:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9f238e482a00/0x7b044d4128f9838b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b044d4128f98392 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938466.848549:0:19223:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f238e482a00/0x7b044d4128f9838b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b044d4128f98392 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938466.848559:0:19223:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f238e482a00/0x7b044d4128f9838b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b044d4128f98392 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938466.848563:0:19223:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1784938466.848565:0:19223:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1784938466.848567:0:19223:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1784938466.848576:0:19223:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9f238e482a00/0x7b044d4128f9838b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f98392 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938466.848582:0:19223:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938466.848586:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9f238e482a00/0x7b044d4128f9838b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f98392 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938466.848593:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f238e482a00/0x7b044d4128f9838b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f98392 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938466.848609:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938466.848611:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938466.848613:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938466.848632:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e07296-2a01-411c-abf2-6d190cb69ef0:16391:1871643350919808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938466.848699:0:16391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938466.848762:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784938466.848769:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e07296-2a01-411c-abf2-6d190cb69ef0:16391:1871643350919424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938466.848794:0:16391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938466.848809:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e07296-2a01-411c-abf2-6d190cb69ef0:16391:1871643350919936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938466.848842:0:16391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784938466.848867:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938466.848872:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938466.849338:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938466.850628:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e07296-2a01-411c-abf2-6d190cb69ef0:16389:1871643350919552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938466.850689:0:16389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938466.850723:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938466.850729:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e07296-2a01-411c-abf2-6d190cb69ef0:16389:1871643350919680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938466.850757:0:16389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938466.850797:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350919808 00000100:00100000:0.0:1784938466.850804:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350919808 00000100:00100000:0.0:1784938466.850842:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350919424 00000100:00100000:0.0:1784938466.850845:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350919424 00000100:00100000:0.0:1784938466.850852:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350919936 00000100:00100000:0.0:1784938466.850855:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350919936 00000100:00100000:0.0:1784938466.850860:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350919552 00000100:00100000:0.0:1784938466.850862:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350919552 00000100:00100000:0.0:1784938466.850868:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350919680 00000100:00100000:0.0:1784938466.850870:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350919680 00000100:00100000:0.0:1784938466.850880:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784938466.850887:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:16391:x1871643350919808:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1784938466.850893:0:25731:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784938466 with bad export cookie 8864294908827632089 00000100:00100000:2.0:1784938466.853407:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784938466.853418:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24c5a44850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:16391:x1871643350919424:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1784938466.853427:0:19220:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784938466 with bad export cookie 8864294908827632089 00000100:00100000:2.0:1784938466.853522:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24c5a44850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:16391:x1871643350919424:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (4726us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784938466.853530:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784938466.853556:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784938466.853560:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:16391:x1871643350919936:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1784938466.853564:0:19220:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784938466 with bad export cookie 8864294908827632089 00000100:00100000:2.0:1784938466.853589:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:16391:x1871643350919936:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (4746us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784938466.853595:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784938466.853606:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784938466.853623:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386360a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:16389:x1871643350919552:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1784938466.853628:0:19220:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784938466 with bad export cookie 8864294908827632089 00000100:00100000:2.0:1784938466.853659:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386360a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:16389:x1871643350919552:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (2970us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784938466.853665:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784938466.853677:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784938466.853680:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386361c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:16389:x1871643350919680:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1784938466.853684:0:19220:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784938466 with bad export cookie 8864294908827632089 00000100:00100000:2.0:1784938466.853707:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386361c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:16389:x1871643350919680:12345-0@lo:103:ldlm_bl.0 Request processed in 25us (2959us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784938466.853712:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1784938466.853751:0:16389:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.154@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1784938466.853756:0:16389:0:(import.c:65:import_set_state_nolock()) ffff9f2490614000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1784938466.853760:0:16389:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.154@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000004:00000080:1.0:1784938466.854961:0:26144:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0001: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000100:00080000:3.0:1784938466.863522:0:16391:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.154@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000001:00100000:1.0:1784938466.865106:0:24936:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1784938466.865121:0:24936:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934850 is committed 00000020:00000080:1.0:1784938466.865126:0:24936:0:(genops.c:906:class_export_put()) final put ffff9f24906aa800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784938466.865246:0:26144:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/7 00000020:00080000:1.0:1784938466.865257:0:26144:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff9f2486cc6000 lustre-MDT0001-lwp-OST0001_UUID 192.168.202.154@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784938466.865263:0:26144:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff9f2486cc7000 lustre-MDT0001-lwp-OST0000_UUID 192.168.202.154@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784938466.865269:0:26144:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff9f24b2e34d40) has exports, disconnecting them 00000020:00080000:1.0:1784938466.865273:0:26144:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 192.168.202.154@tcp (ffff9f2486cc6000), last request at 1784938462 00000020:00000080:1.0:1784938466.865282:0:26144:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f985e5 00000100:00080000:1.0:1784938466.865293:0:26144:0:(import.c:65:import_set_state_nolock()) ffff9f2486cc3000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1784938466.865322:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1784938466.865333:0:26144:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.154@tcp (ffff9f2486cc6000): rc 0 00000020:00000080:1.0:1784938466.865335:0:26144:0:(genops.c:906:class_export_put()) final put ffff9f2486cc6000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1784938466.865340:0:26144:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 192.168.202.154@tcp (ffff9f2486cc7000), last request at 1784938462 00000020:00000080:1.0:1784938466.865343:0:26144:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f985de 00000100:00080000:1.0:1784938466.865349:0:26144:0:(import.c:65:import_set_state_nolock()) ffff9f2486cc7800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784938466.865364:0:26144:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.154@tcp (ffff9f2486cc7000): rc 0 00000020:00000080:1.0:1784938466.865366:0:26144:0:(genops.c:906:class_export_put()) final put ffff9f2486cc7000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1784938466.865375:0:26144:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffbfdb4189bae0 00000100:00080000:1.0:1784938466.865406:0:26144:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784938466.865411:0:26144:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 8589934866 gen 3 00010000:00010000:1.0:1784938466.865573:0:26144:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238c9f7e00/0x7b044d4128f9d259 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x110e400000000 nid: local remote: 0x7b044d4128f9d260 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938466.865587:0:26144:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238c9f7e00/0x7b044d4128f9d259 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x110f400000000 nid: local remote: 0x7b044d4128f9d260 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938466.865633:0:26144:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1784938466.865651:0:26144:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784938466.865662:0:26144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9f238c9f7e00/0x7b044d4128f9d259 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x590f400000000 nid: local remote: 0x7b044d4128f9d260 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784938466.866789:0:26144:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784938466.866797:0:26144:0:(import.c:65:import_set_state_nolock()) ffff9f24bd509000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:0.0:1784938466.867692:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:16391:x1871643350919808:12345-0@lo:103:ldlm_bl.0 Request processed in 16801us (18989us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784938466.867705:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1784938466.867934:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784938466.868222:0:26144:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1784938466.868227:0:26144:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967491 gen 3 00000004:00080000:1.0:1784938466.868238:0:26144:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1784938466.868298:0:26144:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1784938466.868319:0:26144:0:(import.c:65:import_set_state_nolock()) ffff9f24b65ad800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1784938466.868335:0:26144:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1784938466.868337:0:26144:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967492 gen 3 00000004:00080000:1.0:1784938466.868344:0:26144:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1784938466.868406:0:26144:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1784938466.868414:0:26144:0:(import.c:65:import_set_state_nolock()) ffff9f24906ae800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1784938466.868466:0:26144:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9f24b2e34d40) has no exports 00000100:00100000:0.0:1784938466.868728:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:16388:1871643350920064:192.168.202.154@tcp:9:umount.0 00000100:00100000:0.0:1784938466.868808:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:16388:1871643350920192:192.168.202.154@tcp:9:umount.0 00000100:00100000:0.0:1784938466.869007:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938466.869064:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938466.869093:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350920064 00000100:00100000:0.0:1784938466.869099:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350920064 00000100:00100000:0.0:1784938466.869174:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350920192 00000100:00100000:0.0:1784938466.869178:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350920192 00000100:00100000:0.0:1784938466.869201:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 984 00000100:00100000:0.0:1784938466.869209:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386360e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:16388:x1871643350920064:12345-192.168.202.154@tcp:9:umount.0 00000020:00000080:0.0:1784938466.869230:0:21151:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f98402 00000100:00080000:0.0:1784938466.869237:0:21151:0:(import.c:65:import_set_state_nolock()) ffff9f24b65af800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784938466.869273:0:21151:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967566 00000100:00100000:0.0:1784938466.869384:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386360e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:16388:x1871643350920064:12345-192.168.202.154@tcp:9:umount.0 Request processed in 175us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938466.869391:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 984 00000100:00100000:0.0:1784938466.869405:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 985 00000100:00100000:0.0:1784938466.869411:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:16388:x1871643350920192:12345-192.168.202.154@tcp:9:umount.0 00000020:00000080:0.0:1784938466.869421:0:21151:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9842c 00000100:00080000:0.0:1784938466.869425:0:21151:0:(import.c:65:import_set_state_nolock()) ffff9f24b65ae000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784938466.869442:0:21151:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967566 00000100:00100000:0.0:1784938466.869653:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:16388:x1871643350920192:12345-192.168.202.154@tcp:9:umount.0 Request processed in 241us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938466.869660:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 985 00000100:00080000:0.0:1784938466.869677:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784938466.869681:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784938466.870097:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938466.870103:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784938466.870293:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b65ad800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1784938466.870306:0:16388:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1784938466.870308:0:16388:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784938466.870313:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:16388:1871643350920064:192.168.202.154@tcp:9:umount.0 00000100:00080000:0.0:1784938466.870325:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24906ae800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1784938466.870332:0:16388:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1784938466.870334:0:16388:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784938466.870337:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:16388:1871643350920192:192.168.202.154@tcp:9:umount.0 00000040:00080000:1.0:1784938466.875453:0:26144:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000401:0x1:0x0] first idx 2, last_idx 4 00000040:00080000:1.0:1784938466.875489:0:26144:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000401:0x1:0x0] first idx 3, last_idx 4 00000020:00000080:0.0:1784938466.876180:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f24906aa800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1784938466.876245:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f2486cc6000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1784938466.876276:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f2486cc7000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1784938466.876297:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f248a93e000 for lustre-MDT0001 00000020:00000080:0.0:1784938466.876302:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f2486cc3000 for lustre-MDT0001 00000020:00000080:0.0:1784938466.876306:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f2486cc7800 for lustre-MDT0001 00000020:00080000:1.0:1784938466.877377:0:26144:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9f24b2e34d40) has no exports 00000001:00100000:0.0:1784938466.885045:0:22178:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1784938466.885055:0:22178:0:(genops.c:906:class_export_put()) final put ffff9f24b65a9000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1784938466.885076:0:22178:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784938466.885079:0:22178:0:(genops.c:906:class_export_put()) final put ffff9f238ef9a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784938466.885093:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f24b65a9000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1784938466.885130:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f238ef9a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1784938466.885174:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f24b65ae000 for lustre-OST0001 00000020:00000080:0.0:1784938466.885181:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f238ef9a800 for lustre-OST0001 00000001:00100000:0.0:1784938466.888988:0:21144:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1784938466.888997:0:21144:0:(genops.c:906:class_export_put()) final put ffff9f24b65af000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1784938466.889018:0:21144:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784938466.889021:0:21144:0:(genops.c:906:class_export_put()) final put ffff9f2488d2f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784938466.889038:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f24b65af000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1784938466.889073:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f2488d2f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1784938466.889099:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f24b65af800 for lustre-OST0000 00000020:00000080:0.0:1784938466.889103:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f24906a1800 for lustre-OST0000 00000100:00080000:2.0:1784938466.898670:0:16389:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.154@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1784938466.898675:0:16389:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1784938466.898685:0:16389:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f24b37c8000 x1871643350917504/t0(0) o400->MGC192.168.202.154@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784938478 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938466.898711:0:16389:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f24b6b8ed80 x1871643350919808/t0(0) o103->MGC192.168.202.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784938482 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938466.898722:0:16389:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f2388246d80 x1871643350919424/t0(0) o103->MGC192.168.202.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784938482 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938466.898734:0:16389:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f24b6b8d500 x1871643350919936/t0(0) o103->MGC192.168.202.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784938482 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938466.898754:0:16389:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f2388247480 x1871643350919552/t0(0) o103->MGC192.168.202.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784938482 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938466.898763:0:16389:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f24b6b8e300 x1871643350919680/t0(0) o103->MGC192.168.202.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784938482 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1784938466.898773:0:16389:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1784938466.898776:0:16389:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1784938466.898777:0:16389:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1784938466.898886:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e07296-2a01-411c-abf2-6d190cb69ef0:16390:1871643350917504:0@lo:400:kworker.0 00000100:00080000:3.0:1784938466.904685:0:16391:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9f2490614000 already not connected (conn 4, was 4): DISCONN 00000100:00100000:3.0:1784938466.904819:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e07296-2a01-411c-abf2-6d190cb69ef0:16391:1871643350919936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938466.904842:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e07296-2a01-411c-abf2-6d190cb69ef0:16391:1871643350919808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938466.904872:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e07296-2a01-411c-abf2-6d190cb69ef0:16391:1871643350919424:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1784938466.908013:0:16389:0:(import.c:65:import_set_state_nolock()) ffff9f2490614000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784938466.908027:0:16389:0:(import.c:510:import_select_connection()) MGC192.168.202.154@tcp: connect to NID 0@lo last attempt 667 00000100:00080000:2.0:1784938466.908038:0:16389:0:(import.c:624:import_select_connection()) MGC192.168.202.154@tcp: import ffff9f2490614000 using connection 73e07296-2a01-411c-abf2-6d190cb69ef0/0@lo 00000100:00100000:2.0:1784938466.908101:0:16389:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f23823b9880 x1871643350920320/t0(0) o250->MGC192.168.202.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784938466.908187:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e07296-2a01-411c-abf2-6d190cb69ef0:16389:1871643350919552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784938466.908214:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e07296-2a01-411c-abf2-6d190cb69ef0:16389:1871643350919680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938466.908864:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23823b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73e07296-2a01-411c-abf2-6d190cb69ef0:16388:1871643350920320:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1784938466.908914:0:16388:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871643350920320 offset 0 length 520: 4 00000020:01000000:0.0:1784938466.955955:0:26144:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9f2488a73ba0 - data ffff9f24897fd5e8/ffff9f248f964c00 00000020:01000000:0.0:1784938466.956116:0:26144:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9f238dcb72a0 - data ffff9f2484456ca8/ffff9f238890c000 00000001:00000004:0.0:1784938466.977594:0:26144:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934850 00000100:00080000:2.0:1784938467.033086:0:26144:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784938467.033473:0:26144:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 8589934866 gen 4 00000100:00100000:2.0:1784938467.033482:0:26144:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1784938467.039967:0:26144:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784938467.039975:0:26144:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967491 gen 4 00000004:00080000:3.0:1784938467.040030:0:26144:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784938467.040033:0:26144:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1784938467.043807:0:24944:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1784938467.043814:0:24944:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 41 count 1 00000040:00080000:1.0:1784938467.043826:0:24944:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1784938467.046666:0:26144:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784938467.046675:0:26144:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967492 gen 4 00000004:00080000:2.0:1784938467.046699:0:26144:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784938467.046702:0:26144:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1784938467.047219:0:24947:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1784938467.047223:0:24947:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 40 count 1 00000040:00080000:3.0:1784938467.047243:0:24947:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1784938467.048407:0:26144:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f983ae 00000020:00000080:2.0:1784938467.048419:0:26144:0:(genops.c:906:class_export_put()) final put ffff9f24bd50e800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1784938467.048866:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f24bd50e800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1784938467.049236:0:26144:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f983c3 00000020:00000080:2.0:1784938467.049485:0:26144:0:(genops.c:906:class_export_put()) final put ffff9f24bd56c800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1784938467.049499:0:26144:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1784938467.049504:0:26144:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784938467.049512:0:26144:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784938467.049516:0:26144:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9f2389730000) has no exports 00000004:01000000:2.0:1784938467.049665:0:26144:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1784938467.049672:0:26144:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f98417 00000020:00000080:2.0:1784938467.049676:0:26144:0:(genops.c:906:class_export_put()) final put ffff9f2389c28800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1784938467.049680:0:26144:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1784938467.049684:0:26144:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784938467.049691:0:26144:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784938467.049693:0:26144:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9f2483220000) has no exports 00000020:00000080:2.0:1784938467.049698:0:26144:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f98410 00000020:00000080:2.0:1784938467.049701:0:26144:0:(genops.c:906:class_export_put()) final put ffff9f24906af800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1784938467.049911:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f24bd56c800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:1.0:1784938467.049921:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f2389c28800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1784938467.049924:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f24906af800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1784938467.050387:0:26144:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1784938467.050391:0:26144:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784938467.050395:0:26144:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967492 gen 5 00000004:00080000:2.0:1784938467.050402:0:26144:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784938467.050404:0:26144:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784938467.050443:0:26144:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938467.050451:0:26144:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1784938467.050456:0:26144:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f983fb 00000020:00000080:1.0:1784938467.050495:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f24906ae800 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1784938467.050767:0:36:0:(genops.c:906:class_export_put()) final put ffff9f2389c2e800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784938467.050770:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f2389c2e800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1784938467.050775:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1784938467.051030:0:26144:0:(genops.c:906:class_export_put()) final put ffff9f2389c29800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1784938467.051035:0:26144:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1784938467.051039:0:26144:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784938467.051044:0:26144:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784938467.051047:0:26144:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9f24b2e33380) has no exports 00000020:00000080:2.0:1784938467.051052:0:26144:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f983f4 00000020:00000080:2.0:1784938467.051055:0:26144:0:(genops.c:906:class_export_put()) final put ffff9f2388348800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1784938467.051286:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f2389c29800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1784938467.051648:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f2388348800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1784938467.051713:0:26144:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1784938467.051717:0:26144:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784938467.051720:0:26144:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967491 gen 5 00000004:00080000:2.0:1784938467.051724:0:26144:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784938467.051727:0:26144:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784938467.051796:0:26144:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938467.051803:0:26144:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1784938467.051813:0:26144:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1784938467.051819:0:26144:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f983e6 00000020:00000080:2.0:1784938467.051824:0:26144:0:(genops.c:906:class_export_put()) final put ffff9f238834f000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784938467.055513:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f24b65ad800 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1784938467.055537:0:36:0:(genops.c:906:class_export_put()) final put ffff9f2386215000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784938467.055541:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f2386215000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1784938467.055549:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1784938467.058001:0:26144:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1784938467.058015:0:26144:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784938467.058028:0:26144:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784938467.058033:0:26144:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9f238cd799c0) has no exports 00000020:00000080:2.0:1784938467.058043:0:26144:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f983df 00000020:00000080:2.0:1784938467.058052:0:26144:0:(genops.c:906:class_export_put()) final put ffff9f24bd50d800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1784938467.059834:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f238834f000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00010000:01000000:2.0:1784938467.065452:0:26144:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1784938467.065463:0:26144:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784938467.065467:0:26144:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 8589934866 gen 5 00000100:00100000:2.0:1784938467.065482:0:26144:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784938467.065591:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f24bd50d800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1784938467.067639:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f24bd509000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1784938467.067736:0:26144:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938467.067750:0:26144:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1784938467.067756:0:26144:0:(genops.c:906:class_export_put()) final put ffff9f238834c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1784938467.067759:0:26144:0:(genops.c:865:class_export_destroy()) destroying export ffff9f238834c800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1784938467.067766:0:26144:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1784938467.068202:0:26144:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938467.068207:0:26144:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1784938467.068210:0:26144:0:(genops.c:906:class_export_put()) final put ffff9f24bd50b800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1784938467.068212:0:26144:0:(genops.c:865:class_export_destroy()) destroying export ffff9f24bd50b800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1784938467.068216:0:26144:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1784938467.068475:0:26144:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f983ca 00000020:00000080:2.0:1784938467.068483:0:26144:0:(genops.c:906:class_export_put()) final put ffff9f24bd569000/lustre-MDD0001_UUID 00000020:01000000:2.0:1784938467.068490:0:26144:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1784938467.068494:0:26144:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784938467.068499:0:26144:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784938467.068503:0:26144:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9f24b2e30000) has no exports 00000020:00000080:2.0:1784938467.068529:0:26144:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938467.068533:0:26144:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1784938467.068537:0:26144:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f983d1 00000020:00000080:2.0:1784938467.068540:0:26144:0:(genops.c:906:class_export_put()) final put ffff9f2386210000/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1784938467.068547:0:26144:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f2488a41800 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1784938467.068550:0:26144:0:(obd_mount.c:706:lustre_put_lsi()) put ffff9f2488a41800 2 00000020:01000004:2.0:1784938467.068553:0:26144:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f2488a41800 from lustre-MDT0001 00000020:00000080:2.0:1784938467.068570:0:26144:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938467.068573:0:26144:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1784938467.068576:0:26144:0:(genops.c:906:class_export_put()) final put ffff9f24bd50e000/lustre-MDT0001_UUID 00000020:00000080:2.0:1784938467.068578:0:26144:0:(genops.c:865:class_export_destroy()) destroying export ffff9f24bd50e000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1784938467.068584:0:26144:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1784938467.068619:0:26144:0:(obd_mount.c:574:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1784938467.068622:0:26144:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1784938467.068627:0:26144:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784938467.068633:0:26144:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784938467.068641:0:26144:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9f2488cf4800 lustre-MDT0000-lwp-MDT0001 192.168.202.154@tcp 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784938467.068648:0:26144:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9f248fac8000) has exports, disconnecting them 00000020:00080000:2.0:1784938467.068653:0:26144:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 192.168.202.154@tcp (ffff9f2488cf4800), last request at 1784938416 00000020:00000080:2.0:1784938467.068656:0:26144:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f98456 00000020:00080000:2.0:1784938467.068666:0:26144:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.154@tcp (ffff9f2488cf4800): rc 0 00000020:00000080:2.0:1784938467.068669:0:26144:0:(genops.c:906:class_export_put()) final put ffff9f2488cf4800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1784938467.069248:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f24bd569000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1784938467.069253:0:36:0:(genops.c:906:class_export_put()) final put ffff9f2386213000/lustre-MDD0001_UUID 00000020:00000080:1.0:1784938467.069255:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f2386213000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1784938467.069263:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1784938467.069386:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f2386210000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1784938467.069391:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f2488cf4800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1784938467.070369:0:26144:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1784938467.070379:0:26144:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784938467.070383:0:26144:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1784938467.070390:0:26144:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784938467.070411:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f2491e4e000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1784938467.070512:0:26144:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784938467.070521:0:26144:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1784938467.070524:0:26144:0:(genops.c:906:class_export_put()) final put ffff9f2488cf0800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1784938467.070527:0:26144:0:(genops.c:865:class_export_destroy()) destroying export ffff9f2488cf0800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1784938467.070530:0:26144:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1784938467.070569:0:26144:0:(obd_mount.c:706:lustre_put_lsi()) put ffff9f2488a41800 1 00000020:00000080:1.0:1784938467.070573:0:26144:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f98384 00000020:00000080:1.0:1784938467.070577:0:26144:0:(genops.c:906:class_export_put()) final put ffff9f24bd508800/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1784938467.070585:0:26144:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1784938467.070591:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f24bd508800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1784938467.070601:0:26144:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784938467.070605:0:26144:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784938467.070608:0:26144:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9f248facb380) has no exports 00010000:00010000:2.0:1784938467.202526:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784938467.225217:0:26144:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784938467.225229:0:26144:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1784938467.225235:0:26144:0:(genops.c:906:class_export_put()) final put ffff9f2488a42000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1784938467.225239:0:26144:0:(genops.c:865:class_export_destroy()) destroying export ffff9f2488a42000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1784938467.225251:0:26144:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1784938467.225369:0:26144:0:(obd_mount.c:664:lustre_free_lsi()) Freeing lsi ffff9f2488a44000 00000020:01000000:0.0:1784938467.225388:0:26144:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1784938467.225392:0:26144:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784938467.225397:0:26144:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784938467.225400:0:26144:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9f238cd7cd40) has no exports 00000100:00100000:0.0:1784938467.225542:0:24945:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9f24b2e91a00:24945] 3 exiting: rc = 0 00000100:00100000:0.0:1784938467.225659:0:24203:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9f2496700400:24203] 2 exiting: rc = 0 00000100:00100000:1.0:1784938467.225869:0:25738:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9f238f295200:25738] 4 exiting: rc = 0 00000100:00100000:0.0:1784938467.226252:0:24201:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9f249652e000:24201] 0 exiting: rc = 1 00000100:00100000:3.0:1784938467.226878:0:24202:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9f2481380200:24202] 1 exiting: rc = 0 00000100:00100000:0.0:1784938467.228877:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.228889:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.228896:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.228904:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.228909:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.228914:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.228920:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.228925:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.228931:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.228936:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.228942:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.228949:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.228954:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.228960:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.228967:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.228973:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.228979:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.228985:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.228991:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.228996:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229001:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229007:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229012:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229017:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229023:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229027:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229033:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229038:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229043:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229048:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229054:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229060:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229065:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229070:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229075:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229081:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229086:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229091:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229096:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229355:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229363:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229368:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229373:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229379:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229384:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229390:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229396:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229401:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229406:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229411:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229417:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229423:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229429:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229435:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229441:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229447:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229453:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229465:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229478:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229484:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229492:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229514:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229520:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.229526:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938467.233000:0:25710:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff9f238c7cb200:25710] 2 exiting: rc = 0 00000100:00100000:1.0:1784938467.233364:0:24204:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9f238dc62400:24204] 0 exiting: rc = 1 00000100:00100000:0.0:1784938467.234056:0:24205:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9f238d27ba00:24205] 1 exiting: rc = 0 00000100:00100000:2.0:1784938467.234440:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234449:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234455:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234464:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234470:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234476:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234483:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234489:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234494:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234501:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234506:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234512:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234517:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234522:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234527:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234533:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234539:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234545:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234550:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234556:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234563:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234568:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234573:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234580:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234588:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234594:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234600:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234607:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234613:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234618:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234625:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234630:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234635:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234640:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234644:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234649:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234654:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234659:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234663:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234667:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234671:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234675:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234680:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234685:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234690:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234694:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234699:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234703:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234708:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234713:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234718:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234722:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234727:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234731:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234736:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234739:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234743:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234748:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234752:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234756:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234761:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234765:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234769:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.234773:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235203:0:24207:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9f238dc62e00:24207] 1 exiting: rc = 0 00000100:00100000:3.0:1784938467.235387:0:24206:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9f238dc63c00:24206] 0 exiting: rc = 1 00000100:00100000:2.0:1784938467.235534:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235541:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235546:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235562:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235569:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235575:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235582:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235588:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235593:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235613:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235619:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235626:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235632:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235637:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235643:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235662:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235670:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235675:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235680:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235685:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235690:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235695:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235701:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235707:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235712:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235718:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235723:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235741:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235746:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235751:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235756:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235763:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235769:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235775:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235781:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235786:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235792:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235797:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235802:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235819:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235826:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235832:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235837:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235844:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235850:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235855:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235860:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235866:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235871:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235876:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235882:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235899:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235904:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235910:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235915:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235925:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235931:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235936:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235941:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235947:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235952:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235956:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235962:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.235967:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938467.250056:0:24208:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9f238dd53600:24208] 0 exiting: rc = 1 00000100:00100000:0.0:1784938467.250465:0:24209:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9f238dd52200:24209] 1 exiting: rc = 0 00000100:00100000:1.0:1784938467.250588:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250596:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250602:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250607:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250612:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250617:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250622:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250627:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250633:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250638:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250642:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250647:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250652:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250658:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250663:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250667:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250673:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250678:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250683:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250688:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250693:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250698:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250704:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250708:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250714:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250719:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250724:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250728:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250733:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250738:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250743:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250747:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250752:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250758:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250763:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250768:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250774:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250779:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250784:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250789:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250795:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250800:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250805:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250810:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250815:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250820:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250825:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250829:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250834:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250839:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250844:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250849:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250855:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250860:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250865:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250870:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250875:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250879:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250885:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250889:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250893:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250898:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250902:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.250907:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938467.251552:0:24211:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9f238dd52a00:24211] 1 exiting: rc = 0 00000100:00100000:0.0:1784938467.251673:0:24210:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9f238dd52000:24210] 0 exiting: rc = 1 00000100:00100000:1.0:1784938467.251776:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251782:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251787:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251793:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251798:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251803:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251808:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251813:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251818:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251822:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251828:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251833:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251839:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251844:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251850:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251855:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251860:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251866:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251871:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251877:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251882:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251887:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251892:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251897:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251902:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251907:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251912:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251917:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251922:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251927:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251933:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251937:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251942:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251947:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251952:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251957:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251963:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251968:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251973:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251978:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251983:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251988:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251993:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.251997:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.252002:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.252007:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.252012:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.252017:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.252022:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.252028:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.252033:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.252038:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.252043:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.252048:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.252054:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.252058:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.252063:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.252067:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.252071:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.252076:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.252081:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.252087:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.252580:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.252590:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938467.253397:0:24213:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9f238dd53200:24213] 1 exiting: rc = 0 00000100:00100000:2.0:1784938467.253584:0:24212:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9f238dd53a00:24212] 0 exiting: rc = 1 00000100:00100000:1.0:1784938467.253707:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253713:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253718:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253722:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253727:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253733:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253738:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253742:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253747:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253752:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253757:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253762:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253767:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253772:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253777:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253782:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253787:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253792:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253797:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253802:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253807:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253812:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253817:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253822:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253827:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253832:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253838:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253843:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253848:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253853:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253858:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253863:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253868:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253873:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253878:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253884:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253889:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253893:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253898:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253903:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253908:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253913:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253918:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253923:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253928:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253934:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253939:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253944:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253949:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253954:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253959:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253964:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253969:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253973:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253978:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253982:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253988:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253993:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.253999:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.254003:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.254008:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.254013:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.254018:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.254023:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938467.255604:0:24214:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9f24bd2fd600:24214] 0 exiting: rc = 1 00000100:00100000:3.0:1784938467.255876:0:24215:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9f24bd2fd000:24215] 1 exiting: rc = 0 00000100:00100000:3.0:1784938467.256003:0:24216:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9f24984b5400:24216] 2 exiting: rc = 0 00000100:00100000:1.0:1784938467.256225:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256330:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256351:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256366:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256374:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256380:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256386:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256391:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256459:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256468:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256662:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256671:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256676:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256682:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256687:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256692:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256698:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256703:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256708:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256714:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256721:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256726:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256731:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256737:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256741:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256746:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256771:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256778:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256798:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256805:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256810:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256826:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256832:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256838:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256844:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256850:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256858:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256862:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256866:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256870:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256874:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256877:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256880:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256884:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256889:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256892:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256904:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256908:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256912:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256915:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256919:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256923:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256927:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256930:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256940:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256944:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256949:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256953:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256957:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256961:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256965:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256968:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256972:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938467.256975:0:26144:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1784938467.262333:0:26144:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784938467.262347:0:26144:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1784938467.262354:0:26144:0:(genops.c:906:class_export_put()) final put ffff9f238ef99800/MDS_uuid 00000020:00000080:0.0:1784938467.262359:0:26144:0:(genops.c:865:class_export_destroy()) destroying export ffff9f238ef99800/MDS_uuid for MDS 00000020:01000000:0.0:1784938467.262365:0:26144:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1784938467.262542:0:26144:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00000100:00080000:2.0:1784938468.014643:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73e07296-2a01-411c-abf2-6d190cb69ef0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784938468.014654:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73e07296-2a01-411c-abf2-6d190cb69ef0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784938468.014657:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784938468.014661:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784938468.014665:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f24b4116800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784938468.014676:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 192.168.202.154@tcp last attempt 729 00000100:00080000:2.0:1784938468.016444:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784938468.016461:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f24b4116800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:2.0:1784938468.016511:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f23823b8700 x1871643350920448/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784938468.016585:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784938468.016590:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784938468.016593:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f2383aea800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784938468.016598:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 192.168.202.154@tcp last attempt 729 00000100:00080000:2.0:1784938468.016605:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784938468.016609:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f2383aea800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:2.0:1784938468.016620:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f23823bb800 x1871643350920704/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784938468.016666:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23823bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:16390:1871643350920832:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938468.016882:0:16390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784938468.016889:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23823b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:16390:1871643350920576:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938468.017479:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23823b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:16388:1871643350920448:192.168.202.154@tcp:38:kworker.0 00000100:00100000:3.0:1784938468.034409:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23823bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:16388:1871643350920704:192.168.202.154@tcp:38:kworker.0 00000400:00000100:2.0:1784938468.045316:0:16384:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.202.154@tcp portal 12 match 1871643350920832 offset 0 length 224: 4 00000400:00000100:2.0:1784938468.045364:0:16384:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.202.154@tcp portal 12 match 1871643350920448 offset 0 length 520: 4 00000400:00000100:2.0:1784938468.045376:0:16384:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.202.154@tcp portal 12 match 1871643350920576 offset 0 length 224: 4 00000400:00000100:2.0:1784938468.045386:0:16384:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.202.154@tcp portal 12 match 1871643350920704 offset 0 length 520: 4 00010000:00010000:1.0:1784938468.267659:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938469.288834:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938470.313406:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938471.345895:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784938472.040244:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73e07296-2a01-411c-abf2-6d190cb69ef0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938472.040252:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73e07296-2a01-411c-abf2-6d190cb69ef0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938472.040255:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938472.040258:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938472.040320:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938472.040323:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784938472.040674:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:16392:1871643350921088:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938472.040809:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784938472.040817:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:16392:1871643350920960:192.168.202.154@tcp:400:kworker.0 00000400:00000100:2.0:1784938472.041026:0:16382:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.202.154@tcp portal 12 match 1871643350921088 offset 0 length 224: 4 00000400:00000100:2.0:1784938472.041117:0:16382:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.202.154@tcp portal 12 match 1871643350920960 offset 0 length 224: 4 00010000:00010000:0.0:1784938472.371561:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784938473.068393:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73e07296-2a01-411c-abf2-6d190cb69ef0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784938473.068402:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73e07296-2a01-411c-abf2-6d190cb69ef0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784938473.068405:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784938473.068408:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784938473.068473:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784938473.068477:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784938473.068548:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:16389:1871643350921216:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938473.068664:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784938473.068672:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:16389:1871643350921344:192.168.202.154@tcp:400:kworker.0 00000400:00000100:2.0:1784938473.068927:0:16383:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.202.154@tcp portal 12 match 1871643350921216 offset 0 length 224: 4 00000400:00000100:2.0:1784938473.069000:0:16383:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.202.154@tcp portal 12 match 1871643350921344 offset 0 length 224: 4 00010000:00010000:0.0:1784938473.387054:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938474.408319:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938475.434969:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938476.201414:0:16388:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938466/real 1784938466] req@ffff9f23823b9880 x1871643350920320/t0(0) o250->MGC192.168.202.154@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784938476 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938476.201445:0:16388:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f23823b9880 x1871643350920320/t0(0) o250->MGC192.168.202.154@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784938476 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784938476.201466:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f2490614000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784938476.201525:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1784938476.201528:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23823b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73e07296-2a01-411c-abf2-6d190cb69ef0:16388:1871643350920320:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:1.0:1784938476.207282:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73e07296-2a01-411c-abf2-6d190cb69ef0->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938476.207296:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1784938476.207300:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f2490614000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784938476.207308:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.154@tcp: connect to NID 0@lo last attempt 733 00000100:00080000:1.0:1784938476.207314:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.154@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784938476.207323:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.154@tcp: import ffff9f2490614000 using connection 73e07296-2a01-411c-abf2-6d190cb69ef0/0@lo 00000100:00100000:1.0:1784938476.207364:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f2388247b80 x1871643350921472/t0(0) o250->MGC192.168.202.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784938476.207465:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73e07296-2a01-411c-abf2-6d190cb69ef0:16388:1871643350921472:0@lo:250:kworker.0 00000400:00000100:2.0:1784938476.207524:0:16388:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871643350921472 offset 0 length 520: 4 00000100:00080000:1.0:1784938476.207656:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938476.207662:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938476.207705:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938476.207710:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784938476.209592:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:16392:1871643350921728:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938476.209695:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938476.209703:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:16392:1871643350921600:192.168.202.154@tcp:400:kworker.0 00000400:00000100:3.0:1784938476.210496:0:16382:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.202.154@tcp portal 12 match 1871643350921728 offset 0 length 224: 4 00000400:00000100:2.0:1784938476.212471:0:16383:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.202.154@tcp portal 12 match 1871643350921600 offset 0 length 224: 4 00000020:01000004:0.0:1784938476.254565:0:26593:0:(obd_mount.c:919:lmd_print()) mount data: 00000020:01000004:0.0:1784938476.254570:0:26593:0:(obd_mount.c:922:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1784938476.254571:0:26593:0:(obd_mount.c:925:lmd_print()) options: user_xattr,errors=remount-ro,user_xattr 00000080:01200004:0.0:1784938476.254661:0:26593:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9f238e2b0800 00000020:01000004:0.0:1784938476.254675:0:26593:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1784938476.254687:0:26593:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1784938476.254701:0:26593:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9f2483224d40) 00000020:00000080:0.0:1784938476.254718:0:26593:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1784938476.330421:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1784938476.334782:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1784938476.345121:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1784938476.353350:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1784938476.353668:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1784938476.353940:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1784938476.354198:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1784938476.354438:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1784938476.355341:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1784938476.355572:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1784938476.356030:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1784938476.356515:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1784938476.356736:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1784938476.356948:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1784938476.357216:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1784938476.357447:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1784938476.357761:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1784938476.358027:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1784938476.358292:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1784938476.358535:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1784938476.359239:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1784938476.359472:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1784938476.359700:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1784938476.362522:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1784938476.363604:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1784938476.364014:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1784938476.364447:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1784938476.365002:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1784938476.365481:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1784938476.366000:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1784938476.366318:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1784938476.367290:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1784938476.367690:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1784938476.368022:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1784938476.368441:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1784938476.369484:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1784938476.370325:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1784938476.376970:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1784938476.377708:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1784938476.378035:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1784938476.379531:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1784938476.379835:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1784938476.385134:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1784938476.385700:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1784938476.386050:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1784938476.386456:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1784938476.386745:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1784938476.388597:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1784938476.390342:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1784938476.390682:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1784938476.392048:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1784938476.393041:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1784938476.393789:0:26593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:3.0:1784938476.394767:0:26593:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1784938476.397713:0:26593:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1784938476.397726:0:26593:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784938476.397744:0:26593:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b044d4128f9ee7c 00000020:01000004:3.0:1784938476.397754:0:26593:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1784938476.397765:0:26593:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1784938476.397770:0:26593:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f238e2b0800 from MGS 00000020:01000004:3.0:1784938476.397774:0:26593:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1784938476.397788:0:26593:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9f24b87c99c0) 00000020:00000080:3.0:1784938476.397800:0:26593:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1784938476.397863:0:26593:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f238e2b0800 from MGS, refs=2 00080000:01000000:3.0:1784938476.397868:0:26593:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784938476.397874:0:26593:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b044d4128f9ee8a 00010000:00010000:3.0:1784938476.398304:0:26593:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-2 is initialized 00000040:01000000:1.0:1784938476.429849:0:26593:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1784938476.434400:0:26597:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1784938476.434648:0:26593:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1784938476.434724:0:26593:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784938476.435670:0:26593:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1784938476.436441:0:26593:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784938476.436613:0:26593:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1784938476.436631:0:26593:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00010000:00010000:1.0:1784938476.466953:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938476.478490:0:26593:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1784938476.478506:0:26593:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1784938476.479631:0:26593:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1784938476.479642:0:26593:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1784938476.483866:0:26593:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1784938476.483896:0:26593:0:(obd_mount.c:395:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:3.0:1784938476.483898:0:26593:0:(obd_mount.c:406:lustre_start_mgc()) MGC192.168.202.154@tcp:Set MGC reconnect 2 10000000:01000000:3.0:1784938476.483902:0:26593:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.154@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:3.0:1784938476.483908:0:26593:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9f2490614000 already not connected (conn 6, was 0): CONNECTING 00000100:00100000:3.0:1784938476.483913:0:26593:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1784938477.480546:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938478.504728:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938479.528444:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938480.553510:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784938481.321707:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73e07296-2a01-411c-abf2-6d190cb69ef0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938481.321724:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73e07296-2a01-411c-abf2-6d190cb69ef0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938481.321727:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938481.321730:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938481.321779:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938481.321784:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784938481.321893:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:16390:1871643350921984:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938481.322011:0:16390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784938481.322028:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:16390:1871643350921856:192.168.202.154@tcp:400:kworker.0 00000400:00000100:2.0:1784938481.322210:0:16383:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.202.154@tcp portal 12 match 1871643350921984 offset 0 length 224: 4 00000400:00000100:2.0:1784938481.322284:0:16383:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.202.154@tcp portal 12 match 1871643350921856 offset 0 length 224: 4 00010000:00010000:1.0:1784938481.577216:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938482.600467:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938483.370951:0:16388:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938468/real 1784938468] req@ffff9f23823b8700 x1871643350920448/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 1 dl 1784938483 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938483.370996:0:16388:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f23823b8700 x1871643350920448/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 1 dl 1784938483 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938483.371018:0:16388:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938468/real 1784938468] req@ffff9f23823bb800 x1871643350920704/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 1 dl 1784938483 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938483.371042:0:16388:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f23823bb800 x1871643350920704/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 1 dl 1784938483 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784938483.371055:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b4116800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784938483.371120:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.154@tcp failed (-110) 00000100:00100000:2.0:1784938483.371125:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23823b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:16388:1871643350920448:192.168.202.154@tcp:38:kworker.0 00000100:00080000:2.0:1784938483.371131:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f2383aea800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784938483.376556:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73e07296-2a01-411c-abf2-6d190cb69ef0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784938483.376568:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73e07296-2a01-411c-abf2-6d190cb69ef0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784938483.376571:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784938483.376575:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784938483.376580:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f24b4116800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784938483.376590:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 192.168.202.154@tcp last attempt 734 00000100:00080000:0.0:1784938483.376603:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1784938483.376610:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f24b4116800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:0.0:1784938483.376655:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f2386361f80 x1871643350922112/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784938483.376757:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386363800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:16391:1871643350922240:192.168.202.154@tcp:400:kworker.0 00000400:00000100:1.0:1784938483.377104:0:16382:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.202.154@tcp portal 12 match 1871643350922240 offset 0 length 224: 4 00000100:00080000:0.0:1784938483.377417:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784938483.377422:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784938483.377424:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f2383aea800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784938483.377429:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 192.168.202.154@tcp last attempt 734 00000100:00080000:0.0:1784938483.377434:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1784938483.377440:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f2383aea800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:0.0:1784938483.377460:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f2386363b80 x1871643350922368/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784938483.377524:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386362300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:16392:1871643350922496:192.168.202.154@tcp:400:kworker.0 00000400:00000100:1.0:1784938483.377686:0:16383:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.202.154@tcp portal 12 match 1871643350922496 offset 0 length 224: 4 00000100:00080000:2.0:1784938483.382240:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.154@tcp failed (-110) 00000100:00100000:2.0:1784938483.382253:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23823bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:16388:1871643350920704:192.168.202.154@tcp:38:kworker.0 00000100:00100000:2.0:1784938483.382315:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386361f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:16388:1871643350922112:192.168.202.154@tcp:38:kworker.0 00000100:00100000:2.0:1784938483.382401:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386363b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:16388:1871643350922368:192.168.202.154@tcp:38:kworker.0 00000400:00000100:1.0:1784938483.383665:0:16384:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.202.154@tcp portal 12 match 1871643350922112 offset 0 length 520: 4 00000400:00000100:1.0:1784938483.383741:0:16384:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.202.154@tcp portal 12 match 1871643350922368 offset 0 length 520: 4 00000100:00080000:0.0:1784938483.390535:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73e07296-2a01-411c-abf2-6d190cb69ef0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784938483.390546:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73e07296-2a01-411c-abf2-6d190cb69ef0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1784938483.624433:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1784938484.392454:0:16390:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938468/real 1784938468] req@ffff9f23823b8000 x1871643350920576/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938484 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938484.435512:0:16390:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9f23823b8000 x1871643350920576/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938484 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784938484.435529:0:16390:0:(import.c:65:import_set_state_nolock()) ffff9f24b4115000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784938484.435534:0:16390:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 192.168.202.154@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784938484.458811:0:16390:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00000400:0.0:1784938484.458935:0:16390:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938468/real 1784938468] req@ffff9f23823bb100 x1871643350920832/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938484 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938484.458983:0:16390:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9f23823bb100 x1871643350920832/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938484 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784938484.459004:0:16390:0:(import.c:65:import_set_state_nolock()) ffff9f238ce54800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784938484.459008:0:16390:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 192.168.202.154@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784938484.459011:0:16390:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:1.0:1784938484.463917:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73e07296-2a01-411c-abf2-6d190cb69ef0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938484.463926:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73e07296-2a01-411c-abf2-6d190cb69ef0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938484.463929:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938484.463932:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938484.463934:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938484.463937:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1784938484.463941:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f24b4115000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784938484.464702:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 192.168.202.154@tcp last attempt 688 00000100:00080000:1.0:1784938484.464718:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9f24b4115000 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:3.0:1784938484.465064:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23823b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:16390:1871643350920576:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938484.465161:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23823bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:16390:1871643350920832:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938484.468582:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f238e0efb80 x1871643350922624/t0(0) o38->lustre-MDT0001-lwp-OST0000@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784938484.468625:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938484.468630:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938484.468633:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938484.468636:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1784938484.468639:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f238ce54800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784938484.468644:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 192.168.202.154@tcp last attempt 688 00000100:00080000:1.0:1784938484.468659:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9f238ce54800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:1.0:1784938484.468680:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f238e0eed80 x1871643350922752/t0(0) o38->lustre-MDT0001-lwp-OST0001@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784938484.468700:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73e07296-2a01-411c-abf2-6d190cb69ef0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938484.468703:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73e07296-2a01-411c-abf2-6d190cb69ef0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938484.468706:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938484.468708:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938484.468710:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938484.468713:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784938484.468824:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:16388:1871643350922624:192.168.202.154@tcp:38:kworker.0 00000100:00100000:2.0:1784938484.468950:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:16388:1871643350922752:192.168.202.154@tcp:38:kworker.0 00000400:00000100:1.0:1784938484.469219:0:16384:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.202.154@tcp portal 12 match 1871643350922624 offset 0 length 520: 4 00000400:00000100:1.0:1784938484.469301:0:16384:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.202.154@tcp portal 12 match 1871643350922752 offset 0 length 520: 4 00010000:00010000:0.0:1784938484.651672:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938485.672462:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938486.698443:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938487.720379:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1784938488.488400:0:16392:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938472/real 1784938472] req@ffff9f2388244e00 x1871643350920960/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938488 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938488.488445:0:16392:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9f2388244e00 x1871643350920960/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938488 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784938488.488453:0:16392:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff9f24b4115000 already not connected (conn 9, was 8): CONNECTING 00000100:00000400:1.0:1784938488.488460:0:16392:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938472/real 1784938472] req@ffff9f2388244a80 x1871643350921088/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938488 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938488.488472:0:16392:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9f2388244a80 x1871643350921088/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938488 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784938488.488480:0:16392:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff9f238ce54800 already not connected (conn 9, was 8): CONNECTING 00000100:00100000:1.0:1784938488.488497:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:16392:1871643350920960:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938488.488504:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:16392:1871643350921088:192.168.202.154@tcp:400:kworker.0 00000100:00080000:2.0:1784938488.493846:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73e07296-2a01-411c-abf2-6d190cb69ef0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784938488.493858:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73e07296-2a01-411c-abf2-6d190cb69ef0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784938488.493862:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784938488.493865:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784938488.493868:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784938488.493871:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784938488.493874:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784938488.493877:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784938488.493879:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784938488.493882:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1784938488.747232:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1784938489.256922:0:16389:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938473/real 1784938473] req@ffff9f24b6b8d500 x1871643350921344/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938489 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938489.256972:0:16389:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9f24b6b8d500 x1871643350921344/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938489 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784938489.256981:0:16389:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff9f238ce54800 already not connected (conn 9, was 8): CONNECTING 00000100:00000400:3.0:1784938489.256988:0:16389:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938473/real 1784938473] req@ffff9f24b6b8ed80 x1871643350921216/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938489 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938489.256999:0:16389:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9f24b6b8ed80 x1871643350921216/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938489 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784938489.257006:0:16389:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff9f24b4115000 already not connected (conn 9, was 8): CONNECTING 00000100:00100000:3.0:1784938489.257020:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:16389:1871643350921344:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938489.257027:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:16389:1871643350921216:192.168.202.154@tcp:400:kworker.0 00000100:00080000:2.0:1784938489.512637:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73e07296-2a01-411c-abf2-6d190cb69ef0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784938489.512649:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73e07296-2a01-411c-abf2-6d190cb69ef0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784938489.512652:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784938489.512655:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784938489.512657:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784938489.512660:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784938489.512663:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784938489.512667:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784938489.512670:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784938489.512673:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1784938489.768407:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938490.793843:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938491.624986:0:16388:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938476/real 1784938476] req@ffff9f2388247b80 x1871643350921472/t0(0) o250->MGC192.168.202.154@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784938491 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938491.625168:0:16388:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f2388247b80 x1871643350921472/t0(0) o250->MGC192.168.202.154@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784938491 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784938491.625196:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f2490614000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784938491.625403:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1784938491.625419:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73e07296-2a01-411c-abf2-6d190cb69ef0:16388:1871643350921472:0@lo:250:kworker.0 10000000:01000000:3.0:1784938491.628082:0:26593:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:3.0:1784938491.628105:0:26593:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f238e482400/0x7b044d4128f9834c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x7b044d4128f98353 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938491.628117:0:26593:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f238e482400/0x7b044d4128f9834c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x7b044d4128f98353 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938491.628124:0:26593:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784938491.628175:0:26593:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784938491.628185:0:26593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f238e482400/0x7b044d4128f9834c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x7b044d4128f98353 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938491.628211:0:26593:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f238e483000/0x7b044d4128f982f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x7b044d4128f982ff expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938491.628217:0:26593:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f238e483000/0x7b044d4128f982f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x7b044d4128f982ff expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938491.628222:0:26593:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938491.628473:0:26593:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784938491.628481:0:26593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f238e483000/0x7b044d4128f982f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x7b044d4128f982ff expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938491.628491:0:26593:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f238d17ba00/0x7b044d4128f98306 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x7b044d4128f9830d expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938491.628496:0:26593:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f238d17ba00/0x7b044d4128f98306 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x7b044d4128f9830d expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938491.628501:0:26593:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938491.628504:0:26593:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784938491.628507:0:26593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f238d17ba00/0x7b044d4128f98306 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x7b044d4128f9830d expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938491.628516:0:26593:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f238db7b400/0x7b044d4128f98322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x7b044d4128f98329 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938491.628522:0:26593:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f238db7b400/0x7b044d4128f98322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x7b044d4128f98329 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938491.628527:0:26593:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938491.628531:0:26593:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784938491.628534:0:26593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f238db7b400/0x7b044d4128f98322 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x7b044d4128f98329 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938491.628542:0:26593:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f238dc64600/0x7b044d4128f98330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x7b044d4128f98337 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938491.628548:0:26593:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f238dc64600/0x7b044d4128f98330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x7b044d4128f98337 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938491.628553:0:26593:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938491.628556:0:26593:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784938491.628559:0:26593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f238dc64600/0x7b044d4128f98330 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x7b044d4128f98337 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938491.628567:0:26593:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f238e483400/0x7b044d4128f9835a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x7b044d4128f98361 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938491.628573:0:26593:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f238e483400/0x7b044d4128f9835a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x7b044d4128f98361 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938491.628578:0:26593:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938491.628581:0:26593:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784938491.628584:0:26593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f238e483400/0x7b044d4128f9835a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x7b044d4128f98361 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938491.628601:0:26593:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f238e482200/0x7b044d4128f98314 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x7b044d4128f9831b expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938491.628608:0:26593:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f238e482200/0x7b044d4128f98314 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x7b044d4128f9831b expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938491.628612:0:26593:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784938491.628615:0:26593:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784938491.628618:0:26593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f238e482200/0x7b044d4128f98314 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x7b044d4128f9831b expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938491.628626:0:26593:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f238dc64000/0x7b044d4128f9833e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x7b044d4128f98345 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938491.628631:0:26593:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f238dc64000/0x7b044d4128f9833e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x7b044d4128f98345 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938491.628637:0:26593:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784938491.628640:0:26593:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784938491.628643:0:26593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f238dc64000/0x7b044d4128f9833e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x7b044d4128f98345 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784938491.628659:0:26593:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9f2490614000 already not connected (conn 6, was 0): DISCONN 00000100:00080000:3.0:1784938491.628665:0:26593:0:(import.c:65:import_set_state_nolock()) ffff9f2490614000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938491.628670:0:26593:0:(import.c:510:import_select_connection()) MGC192.168.202.154@tcp: connect to NID 0@lo last attempt 742 00000100:00080000:3.0:1784938491.628675:0:26593:0:(import.c:589:import_select_connection()) MGC192.168.202.154@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784938491.628681:0:26593:0:(import.c:624:import_select_connection()) MGC192.168.202.154@tcp: import ffff9f2490614000 using connection 73e07296-2a01-411c-abf2-6d190cb69ef0/0@lo 00000100:00100000:3.0:1784938491.628717:0:26593:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b6b8ed80 x1871643350922880/t0(0) o250->MGC192.168.202.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784938491.628798:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73e07296-2a01-411c-abf2-6d190cb69ef0:16388:1871643350922880:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1784938491.628874:0:16388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938491.629026:0:26598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350922880 00000100:00100000:2.0:1784938491.629035:0:26598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350922880 00000100:00100000:2.0:1784938491.629070:0:26598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784938491.629077:0:26598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248323b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:16388:x1871643350922880:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1784938491.629100:0:26598:0:(ldlm_lib.c:1468:target_handle_connect()) MGS: connection from 73e07296-2a01-411c-abf2-6d190cb69ef0@0@lo t0 exp 0000000000000000 cur 757 last 0 00000020:00000080:2.0:1784938491.629125:0:26598:0:(genops.c:1406:class_connect()) connect: client 73e07296-2a01-411c-abf2-6d190cb69ef0, cookie 0x7b044d4128f9ee91 00000100:00080000:2.0:1784938491.629295:0:26598:0:(import.c:65:import_set_state_nolock()) ffff9f2489211000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1784938491.630509:0:26593:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:1.0:1784938491.632408:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73e07296-2a01-411c-abf2-6d190cb69ef0->MGS: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938491.632416:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73e07296-2a01-411c-abf2-6d190cb69ef0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938491.632419:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938491.632423:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938491.632425:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938491.632428:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938491.632431:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938491.632434:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938491.632437:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938491.632440:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784938491.632552:0:26598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248323b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+5:16388:x1871643350922880:12345-0@lo:250:mount.lustre.0 Request processed in 3468us (3672us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938491.632568:0:26598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784938491.632673:0:16388:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.154@tcp: committing for last_committed 0 gen 3 00000100:00080000:0.0:1784938491.632685:0:16388:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.154@tcp: connect to target with instance 0 00000100:00080000:0.0:1784938491.632694:0:16388:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.154@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1784938491.632700:0:16388:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1784938491.632704:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f2490614000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1784938491.632706:0:16388:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1784938491.632780:0:16388:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000020:01000000:1.0:1784938491.632887:0:36:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.202.154@tcp 10000000:01000000:1.0:1784938491.632905:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:1.0:1784938491.632909:0:36:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1784938491.632911:0:36:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784938491.632912:0:36:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938491.632913:0:36:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938491.632914:0:36:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938491.632916:0:36:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938491.632918:0:36:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784938491.632919:0:36:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938491.632921:0:36:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1784938491.632984:0:36:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1784938491.632991:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1784938491.632993:0:36:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1784938491.633005:0:36:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784938491.633006:0:36:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938491.633007:0:36:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938491.633008:0:36:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938491.633010:0:36:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938491.633011:0:36:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784938491.633012:0:36:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938491.633013:0:36:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1784938491.633027:0:36:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 00000100:00100000:1.0:1784938491.633070:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e07296-2a01-411c-abf2-6d190cb69ef0:16390:1871643350923136:0@lo:253:kworker.0 00000100:00100000:1.0:1784938491.633125:0:16390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938491.633183:0:16390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784938491.633189:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e07296-2a01-411c-abf2-6d190cb69ef0:16390:1871643350923008:0@lo:253:kworker.0 00000100:00100000:1.0:1784938491.633230:0:16390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938491.633269:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350923136 00000100:00100000:1.0:1784938491.633275:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350923136 00000100:00100000:1.0:1784938491.633310:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350923008 00000100:00100000:1.0:1784938491.633314:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350923008 00000100:00100000:1.0:1784938491.633328:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784938491.633337:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248323b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+6:16390:x1871643350923136:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1784938491.633368:0:26601:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:1.0:1784938491.633412:0:26600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784938491.633420:0:26600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483239050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+6:16390:x1871643350923008:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1784938491.633436:0:26600:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00080000:3.0:1784938491.634377:0:26593:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:3.0:1784938491.634389:0:26593:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1784938491.634398:0:26593:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1784938491.634413:0:26593:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9f24b87cb380) 00000020:00000080:3.0:1784938491.634431:0:26593:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1784938491.640307:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73e07296-2a01-411c-abf2-6d190cb69ef0:16388:1871643350922880:0@lo:250:mount.lustre.0 10000000:01000000:1.0:1784938491.642338:0:26604:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1784938491.644032:0:26601:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:0.0:1784938491.647556:0:26606:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1784938491.647566:0:26606:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1784938491.647569:0:26606:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1784938491.647572:0:26606:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1784938491.647762:0:26606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1784938491.648777:0:26601:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784938491.648900:0:26601:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1784938491.656314:0:26593:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784938491.656522:0:26593:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1784938491.656529:0:26593:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 20000000:01000000:1.0:1784938491.660002:0:26601:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784938491.660016:0:26601:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1784938491.660091:0:26604:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784938491.660098:0:26604:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784938491.660125:0:26604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f24827c6a00/0x7b044d4128f9ee9f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938491.660161:0:26604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f24827c6a00/0x7b044d4128f9ee9f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784938491.660172:0:26604:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000075607s 00010000:00010000:1.0:1784938491.660177:0:26604:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f24827c6a00/0x7b044d4128f9ee9f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938491.660185:0:26604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f24827c6a00/0x7b044d4128f9ee9f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938491.660192:0:26604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f24827c6a00/0x7b044d4128f9ee9f lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938491.660436:0:26604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f24827c6a00/0x7b044d4128f9ee9f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938491.660446:0:26604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c6a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938491.660451:0:26604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f24827c6a00/0x7b044d4128f9ee9f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938491.660460:0:26604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f24827c6a00/0x7b044d4128f9ee9f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938491.660475:0:26604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f24827c6a00/0x7b044d4128f9ee9f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938491.660483:0:26604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f24827c6a00/0x7b044d4128f9ee9f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938491.660502:0:26604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f24827c6a00/0x7b044d4128f9ee9f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938491.660615:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248323b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+6:16390:x1871643350923136:12345-0@lo:253:kworker.0 Request processed in 27275us (27486us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938491.660625:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:1.0:1784938491.660706:0:16390:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1784938491.660709:0:16390:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784938491.660710:0:16390:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938491.660712:0:16390:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938491.660713:0:16390:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938491.660714:0:16390:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938491.660716:0:16390:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784938491.660718:0:16390:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938491.660719:0:16390:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1784938491.660723:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e07296-2a01-411c-abf2-6d190cb69ef0:16390:1871643350923136:0@lo:253:kworker.0 20000000:01000000:3.0:1784938491.660880:0:26600:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1784938491.662502:0:26593:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1784938491.662517:0:26593:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1784938491.662908:0:26593:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1784938491.662914:0:26593:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 20000000:01000000:3.0:1784938491.664517:0:26600:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784938491.664530:0:26600:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1784938491.664781:0:26600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483239050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+5:16390:x1871643350923008:12345-0@lo:253:kworker.0 Request processed in 31358us (31546us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938491.664798:0:26600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:3.0:1784938491.664854:0:16390:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1784938491.664856:0:16390:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784938491.664857:0:16390:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938491.664859:0:16390:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938491.664860:0:16390:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938491.664861:0:16390:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938491.664863:0:16390:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784938491.664864:0:16390:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938491.664866:0:16390:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1784938491.664868:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e07296-2a01-411c-abf2-6d190cb69ef0:16390:1871643350923008:0@lo:253:kworker.0 20000000:01000000:1.0:1784938491.664976:0:26604:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784938491.664981:0:26604:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784938491.665001:0:26604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f24827c6800/0x7b044d4128f9eea6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938491.665021:0:26604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f24827c6800/0x7b044d4128f9eea6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784938491.665030:0:26604:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000075607s 00010000:00010000:1.0:1784938491.665035:0:26604:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f24827c6800/0x7b044d4128f9eea6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938491.665042:0:26604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f24827c6800/0x7b044d4128f9eea6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938491.665048:0:26604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f24827c6800/0x7b044d4128f9eea6 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938491.665056:0:26604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f24827c6800/0x7b044d4128f9eea6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938491.665061:0:26604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c6800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938491.665065:0:26604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f24827c6800/0x7b044d4128f9eea6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938491.665073:0:26604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f24827c6800/0x7b044d4128f9eea6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938491.665086:0:26604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f24827c6800/0x7b044d4128f9eea6 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938491.665092:0:26604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f24827c6800/0x7b044d4128f9eea6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938491.665098:0:26604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f24827c6800/0x7b044d4128f9eea6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938491.665843:0:26593:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784938491.666016:0:26593:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1784938491.666023:0:26593:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1784938491.666829:0:26593:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1784938491.666836:0:26593:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1784938491.753867:0:26593:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784938491.758834:0:26593:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1784938491.758847:0:26593:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1784938491.760724:0:26593:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1784938491.760735:0:26593:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1784938491.764637:0:26593:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784938491.764799:0:26593:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1784938491.764806:0:26593:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1784938491.766856:0:26593:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1784938491.766866:0:26593:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1784938491.767424:0:26593:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784938491.767580:0:26593:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1784938491.767585:0:26593:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1784938491.768173:0:26593:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1784938491.768181:0:26593:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1784938491.774549:0:26593:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784938491.774717:0:26593:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1784938491.774723:0:26593:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1784938491.783209:0:26593:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784938491.783363:0:26593:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1784938491.804427:0:26593:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784938491.804638:0:26593:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1784938491.804645:0:26593:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1784938491.805759:0:26593:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1784938491.805768:0:26593:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1784938491.806582:0:26593:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1784938491.806591:0:26593:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1784938491.811090:0:26593:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1784938491.811136:0:26593:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1784938491.811168:0:26593:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.154@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1784938491.811435:0:26593:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.154@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784938491.811472:0:26593:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.154@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1784938491.811477:0:26593:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784938491.811478:0:26593:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784938491.811480:0:26593:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784938491.811481:0:26593:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784938491.811482:0:26593:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784938491.811483:0:26593:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784938491.811485:0:26593:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784938491.811486:0:26593:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784938491.811488:0:26593:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784938491.811490:0:26593:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784938491.811492:0:26593:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1784938491.811494:0:26593:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784938491.811496:0:26593:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784938491.811497:0:26593:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784938491.811498:0:26593:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784938491.811499:0:26593:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784938491.811500:0:26593:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784938491.811501:0:26593:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784938491.811502:0:26593:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784938491.811503:0:26593:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784938491.811504:0:26593:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784938491.811531:0:26593:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784938491.811654:0:26593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23823bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:26593:1871643350923264:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784938491.811725:0:26593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938491.813728:0:26593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbe240 going to sleep for 11 seconds 00010000:00010000:0.0:1784938491.818854:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938491.819440:0:26598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350923264 00000100:00100000:1.0:1784938491.819452:0:26598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350923264 00000100:00100000:1.0:1784938491.819519:0:26598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784938491.819530:0:26598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483238450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+5:26593:x1871643350923264:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784938491.819603:0:26598:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784938491.819606:0:26598:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1784938491.819609:0:26598:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:1.0:1784938491.819615:0:26598:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1784938491.822534:0:26598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483238450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+5:26593:x1871643350923264:12345-0@lo:253:mount.lustre.0 Request processed in 2996us (10798us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938491.822559:0:26598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784938491.823221:0:26593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23823bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:26593:1871643350923264:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784938491.823236:0:26593:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784938491.823239:0:26593:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784938491.823241:0:26593:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784938491.823242:0:26593:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784938491.823243:0:26593:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784938491.823245:0:26593:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784938491.823246:0:26593:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784938491.823247:0:26593:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784938491.823260:0:26593:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784938491.823261:0:26593:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784938491.823263:0:26593:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784938491.823285:0:26593:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f238e2b0800 from lustre-MDT0000 10000000:01000000:2.0:1784938491.823318:0:26593:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1784938491.823321:0:26593:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1784938491.823328:0:26593:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f238e2b0800 10000000:01000000:2.0:1784938491.823332:0:26593:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1784938491.823337:0:26593:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9f238e2b0800 10000000:01000000:2.0:1784938491.823340:0:26593:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1784938491.823343:0:26593:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9f238e2b0800 from 1 10000000:01000000:2.0:1784938491.823346:0:26593:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1784938491.823383:0:26593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f2386e00600/0x7b044d4128f9eead lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938491.823392:0:26593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f2386e00600/0x7b044d4128f9eead lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938491.823402:0:26593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f2386e00600/0x7b044d4128f9eead lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938491.823421:0:26593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23823bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:26593:1871643350923392:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784938491.823461:0:26593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938491.823505:0:26593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbea80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938491.823696:0:26600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350923392 00000100:00100000:3.0:1784938491.823703:0:26600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350923392 00000100:00100000:3.0:1784938491.823747:0:26600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784938491.823756:0:26600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483239850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+5:26593:x1871643350923392:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938491.823770:0:26600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938491.823787:0:26600:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f238217d800/0x7b044d4128f9eeb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9eead expref: -99 pid: 26600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938491.823807:0:26600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f238217d800/0x7b044d4128f9eeb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9eead expref: 6 pid: 26600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938491.823817:0:26600:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f238217d800/0x7b044d4128f9eeb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9eead expref: 6 pid: 26600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938491.823827:0:26600:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217d800, rc 0) 00000100:00100000:3.0:1784938491.823869:0:26600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483239850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+6:26593:x1871643350923392:12345-0@lo:101:mount.lustre.0 Request processed in 115us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938491.823876:0:26600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784938491.823972:0:26593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23823bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:26593:1871643350923392:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938491.823987:0:26593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f2386e00600/0x7b044d4128f9eead lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9eeb4 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938491.823996:0:26593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f2386e00600/0x7b044d4128f9eead lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9eeb4 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938491.824013:0:26593:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1784938491.824034:0:26593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f2386e00600/0x7b044d4128f9eead lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9eeb4 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938491.824042:0:26593:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f2386e00600/0x7b044d4128f9eead lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9eeb4 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938491.824048:0:26593:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1784938491.824052:0:26593:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784938491.824056:0:26593:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9f238e2b0800 10000000:01000000:0.0:1784938491.824059:0:26593:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1784938491.824062:0:26593:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1784938491.824064:0:26593:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1784938491.824091:0:26593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24b379ca00/0x7b044d4128f9eebb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938491.824099:0:26593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f24b379ca00/0x7b044d4128f9eebb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938491.824107:0:26593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f24b379ca00/0x7b044d4128f9eebb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938491.824120:0:26593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386361500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:26593:1871643350923520:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784938491.824192:0:26593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938491.824209:0:26593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2487fede40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938491.824467:0:26598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350923520 00000100:00100000:1.0:1784938491.824471:0:26598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350923520 00000100:00100000:1.0:1784938491.824504:0:26598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784938491.824511:0:26598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483238850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+6:26593:x1871643350923520:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938491.824518:0:26598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938491.824528:0:26598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f24827c6800/0x7b044d4128f9eec2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9eebb expref: -99 pid: 26598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938491.824541:0:26598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f24827c6800/0x7b044d4128f9eec2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9eebb expref: 7 pid: 26598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938491.824561:0:26598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f24827c6800/0x7b044d4128f9eec2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9eebb expref: 7 pid: 26598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938491.824567:0:26598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c6800, rc 0) 00000100:00100000:1.0:1784938491.825361:0:26598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483238850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+7:26593:x1871643350923520:12345-0@lo:101:mount.lustre.0 Request processed in 847us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938491.825369:0:26598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784938491.828712:0:26593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386361500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:26593:1871643350923520:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938491.828742:0:26593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f24b379ca00/0x7b044d4128f9eebb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9eec2 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938491.828754:0:26593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f24b379ca00/0x7b044d4128f9eebb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9eec2 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938491.828838:0:26593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386361500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:26593:1871643350923648:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784938491.828891:0:26593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938491.829663:0:26593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2487fede40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938491.831572:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350923648 00000100:00100000:2.0:1784938491.831584:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350923648 00000100:00100000:2.0:1784938491.831648:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784938491.831658:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248323b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+7:26593:x1871643350923648:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784938491.831840:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248323b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+8:26593:x1871643350923648:12345-0@lo:501:mount.lustre.0 Request processed in 183us (2947us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938491.831848:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784938491.832130:0:26593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386361500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:26593:1871643350923648:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784938491.832223:0:26593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386361500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:26593:1871643350923776:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784938491.832379:0:26593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938491.832466:0:26593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2487fede40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938491.834202:0:26598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350923776 00000100:00100000:1.0:1784938491.834213:0:26598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350923776 00000100:00100000:0.0:1784938491.834395:0:26598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784938491.834405:0:26598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483239c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+8:26593:x1871643350923776:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784938491.835336:0:26598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483239c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+8:26593:x1871643350923776:12345-0@lo:503:mount.lustre.0 Request processed in 930us (2955us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938491.835346:0:26598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784938491.835612:0:26593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386361500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:26593:1871643350923776:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784938491.836345:0:26623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e07296-2a01-411c-abf2-6d190cb69ef0:26623:1871643350923904:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938491.836395:0:26623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938491.836436:0:26623:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24906dbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938491.836521:0:26600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350923904 00000100:00100000:3.0:1784938491.836529:0:26600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350923904 00000100:00100000:3.0:1784938491.836579:0:26600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784938491.836589:0:26600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248323ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+8:26623:x1871643350923904:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938491.837607:0:26600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248323ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+8:26623:x1871643350923904:12345-0@lo:502:llog_process_th.0 Request processed in 1015us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938491.837622:0:26600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784938491.838095:0:26623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e07296-2a01-411c-abf2-6d190cb69ef0:26623:1871643350923904:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784938491.838127:0:26623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938491.838139:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938491.838142:0:26623:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1784938491.838183:0:26623:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1784938491.838189:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784938491.838357:0:26623:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9f24832219c0) 00000020:00000080:0.0:1784938491.838378:0:26623:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1784938491.838384:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1784938491.838461:0:26623:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:0.0:1784938491.838468:0:26623:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b044d4128f9eed0 00000020:00000080:0.0:1784938491.838728:0:26623:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1784938491.838732:0:26623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938491.838736:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938491.838737:0:26623:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1784938491.838739:0:26623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938491.838742:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938491.838744:0:26623:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1784938491.838746:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784938491.838753:0:26623:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9f2483220000) 00000020:00000080:0.0:1784938491.838763:0:26623:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1784938491.838766:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1784938491.838767:0:26623:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1784938491.838770:0:26623:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1784938491.838775:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1784938491.838823:0:26623:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f238e2b0800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1784938491.838834:0:26623:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9f24b176cd40) 00000020:00000080:0.0:1784938491.838841:0:26623:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1784938491.838892:0:26623:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1784938491.838896:0:26623:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b044d4128f9eee5 00000020:00000080:0.0:1784938491.839197:0:26623:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1784938491.839203:0:26623:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1784938491.839208:0:26623:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x7b044d4128f9eeec 00080000:01000000:0.0:1784938491.839212:0:26623:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:0.0:1784938491.839215:0:26623:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b044d4128f9eef3 00010000:00010000:3.0:1784938491.905879:0:26623:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-3 is initialized 00000001:00080000:3.0:1784938491.906559:0:26623:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 4294967471 srv lr: 8589934864 lx: 0 gen 1 00000001:00000004:3.0:1784938491.906606:0:26623:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934864 00000001:00080000:3.0:1784938491.906882:0:26623:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1784938491.906951:0:26623:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9f238ee37180: xid 1871643350913664, transno 8589934866, client gen 1, slot idx 0 00000001:00080000:3.0:1784938491.906963:0:26623:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9f238ee37c00: xid 1871643350901504, transno 8589934864, client gen 1, slot idx 1 00000001:00080000:3.0:1784938491.906969:0:26623:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9f238ee37840: xid 1871643350886656, transno 8589934862, client gen 1, slot idx 3 00000020:00000080:3.0:1784938491.907695:0:26623:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9f24b87c8000) 00000020:00000080:3.0:1784938491.907714:0:26623:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1784938491.907780:0:26623:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:3.0:1784938491.907788:0:26623:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b044d4128f9ef08 00000020:00000080:0.0:1784938491.915826:0:26623:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1784938491.921582:0:26623:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x7b044d4128f9ef0f 00000020:00000080:0.0:1784938491.921896:0:26623:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1784938491.921907:0:26623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938491.921914:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938491.921916:0:26623:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1784938491.921920:0:26623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784938491.921922:0:26623:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1784938491.921924:0:26623:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784938491.921925:0:26623:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784938491.921927:0:26623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784938491.921939:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938491.921941:0:26623:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784938491.921944:0:26623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938491.921949:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938491.921950:0:26623:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1784938491.921955:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1784938491.921990:0:26623:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1784938491.922104:0:26623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938491.922108:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938491.922109:0:26623:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1784938491.922112:0:26623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938491.922115:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938491.922117:0:26623:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1784938491.922120:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784938491.922125:0:26623:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.154@tcp to nid 0x20000c0a8ca9a (192.168.202.154@tcp) 00000020:00000080:1.0:1784938491.922840:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784938491.922858:0:26623:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9f24b2e30000) 00000020:00000080:1.0:1784938491.922879:0:26623:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1784938491.922885:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784938491.922965:0:26623:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1784938491.922971:0:26623:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:1.0:1784938491.922977:0:26623:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b044d4128f9ef1d 00010000:00080000:1.0:1784938491.923106:0:26623:0:(ldlm_lib.c:125:import_set_conn()) imp ffff9f2387dd9800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.154@tcp at head 00010000:00010000:1.0:1784938491.925754:0:26623:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-5 is initialized 00000020:00000080:3.0:1784938491.927009:0:26623:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784938491.927023:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1784938491.927059:0:26623:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1784938491.927083:0:26623:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b044d4128f9ef24 00000100:00080000:3.0:1784938491.927096:0:26623:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 192.168.202.154@tcp last attempt 0 00000100:00080000:3.0:1784938491.927121:0:26623:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f2387dd9800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:3.0:1784938491.927186:0:26623:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b6b8d500 x1871643350924032/t0(0) o38->lustre-MDT0001-osp-MDT0000@192.168.202.154@tcp:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784938491.927692:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350924032:192.168.202.154@tcp:38:llog_process_th.0 00000100:00100000:1.0:1784938491.928008:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00080000:3.0:1784938491.928108:0:26623:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1784938491.928213:0:26623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938491.928219:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938491.928220:0:26623:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1784938491.928223:0:26623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784938491.928226:0:26623:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1784938491.928227:0:26623:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784938491.928229:0:26623:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784938491.928230:0:26623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784938491.928232:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938491.928234:0:26623:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784938491.928236:0:26623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784938491.928241:0:26623:0:(obd_mount.c:957:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1784938491.928245:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938491.928247:0:26623:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1784938491.928250:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784938491.928254:0:26623:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.154@tcp to nid 0x20000c0a8ca9a (192.168.202.154@tcp) 00000020:01000000:3.0:1784938491.928271:0:26623:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1784938491.928274:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784938491.928288:0:26623:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9f24b87ccd40) 00000020:00000080:3.0:1784938491.928307:0:26623:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1784938491.928312:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784938491.928382:0:26623:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1784938491.928388:0:26623:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000020:00000080:3.0:1784938491.928394:0:26623:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b044d4128f9ef32 00010000:00080000:3.0:1784938491.928442:0:26623:0:(ldlm_lib.c:125:import_set_conn()) imp ffff9f238f2e9800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.154@tcp at head 00010000:00010000:3.0:1784938491.928681:0:26623:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-6 is initialized 00000100:00080000:1.0:1784938491.929925:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938491.929950:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938491.929954:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938491.929957:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938491.929960:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938491.929964:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938491.929967:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938491.929969:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784938491.930230:0:21161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350924032 00000100:00100000:1.0:1784938491.930240:0:21161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350924032 00000100:00100000:1.0:1784938491.930276:0:21161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 93 00000100:00100000:1.0:1784938491.930284:0:21161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:16388:x1871643350924032:12345-192.168.202.154@tcp:38:llog_process_th.0 00010000:00020000:1.0:1784938491.930304:0:21161:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.154@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:3.0:1784938491.931351:0:26623:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1784938491.933185:0:26623:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1784938491.935660:0:26623:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784938491.936315:0:26623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1784938491.936475:0:26623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1784938491.941446:0:26629:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1784938491.941457:0:26629:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:1.0:1784938491.950602:0:21161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:16388:x1871643350924032:12345-192.168.202.154@tcp:38:llog_process_th.0 Request processed in 20307us (22584us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784938491.950617:0:21161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 93 00000020:00000080:3.0:1784938491.955978:0:26623:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784938491.956004:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784938491.956064:0:26623:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1784938491.956090:0:26623:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b044d4128f9ef39 00000100:00080000:3.0:1784938491.956103:0:26623:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 192.168.202.154@tcp last attempt 0 00000100:00080000:3.0:1784938491.956113:0:26623:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f238f2e9800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:3.0:1784938491.956181:0:26623:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b6b8ed80 x1871643350924160/t0(0) o8->lustre-OST0000-osc-MDT0000@192.168.202.154@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784938491.956207:0:26623:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1784938491.956261:0:26623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938491.956265:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938491.956267:0:26623:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1784938491.956271:0:26623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784938491.956273:0:26623:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1784938491.956275:0:26623:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784938491.956276:0:26623:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784938491.956278:0:26623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784938491.956280:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938491.956282:0:26623:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784938491.956284:0:26623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784938491.956288:0:26623:0:(obd_mount.c:957:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1784938491.956292:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938491.956293:0:26623:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1784938491.956296:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784938491.956300:0:26623:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.154@tcp to nid 0x20000c0a8ca9a (192.168.202.154@tcp) 00000020:01000000:3.0:1784938491.956318:0:26623:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1784938491.956320:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784938491.956332:0:26623:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9f24b2cc8000) 00000020:00000080:3.0:1784938491.956347:0:26623:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1784938491.956352:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784938491.956407:0:26623:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1784938491.956414:0:26623:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:3.0:1784938491.956419:0:26623:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b044d4128f9ef47 00010000:00080000:3.0:1784938491.956452:0:26623:0:(ldlm_lib.c:125:import_set_conn()) imp ffff9f2388196800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.154@tcp at head 00000100:00080000:1.0:1784938491.957135:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938491.957141:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938491.957177:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938491.957180:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938491.957183:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938491.957186:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938491.957189:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938491.957192:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784938491.957343:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350924160:192.168.202.154@tcp:8:llog_process_th.0 00000100:00080000:2.0:1784938491.957472:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f2387dd9800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784938491.957478:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.154@tcp failed (-19) 00000100:00100000:2.0:1784938491.957482:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350924032:192.168.202.154@tcp:38:llog_process_th.0 00000100:00100000:2.0:1784938491.957654:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938491.957681:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350924160 00000100:00100000:2.0:1784938491.957688:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350924160 00000100:00100000:2.0:1784938491.958216:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 986 00000100:00100000:2.0:1784938491.958224:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:16388:x1871643350924160:12345-192.168.202.154@tcp:8:llog_process_th.0 00010000:00080000:2.0:1784938491.958255:0:25715:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@192.168.202.154@tcp t0 exp 0000000000000000 cur 758 last 0 00000020:00000080:2.0:1784938491.958287:0:25715:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b044d4128f9ef4e 00002000:00100000:2.0:1784938491.958298:0:25715:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9f238f8bf000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cb ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1784938491.958302:0:25715:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1784938491.958306:0:25715:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1784938491.958379:0:25715:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784938491.958408:0:25715:0:(import.c:65:import_set_state_nolock()) ffff9f24b14ab800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938491.958460:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:16388:x1871643350924160:12345-192.168.202.154@tcp:8:llog_process_th.0 Request processed in 234us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938491.958467:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 986 00010000:00010000:3.0:1784938491.959239:0:26623:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-7 is initialized 00000040:01000000:3.0:1784938491.959312:0:26623:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1784938491.959329:0:26623:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1784938491.960571:0:16388:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784938491.960585:0:16388:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1784938491.960593:0:16388:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784938491.960599:0:16388:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1784938491.960603:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f238f2e9800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784938491.960616:0:16388:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784938491.960627:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350924160:192.168.202.154@tcp:8:llog_process_th.0 00000004:00080000:0.0:1784938491.960656:0:26629:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1784938491.960721:0:26629:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 758127575455ns, next at 0ns, rc = 0 00080000:00080000:0.0:1784938491.960727:0:26629:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000040:00080000:3.0:1784938491.965332:0:26623:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784938491.966052:0:26623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1784938491.966222:0:26623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000004:00080000:0.0:1784938491.966638:0:26594:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:3.0:1784938491.966903:0:26631:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1784938491.966908:0:26631:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000100:00100000:1.0:1784938491.967823:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784938491.967843:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23823bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350924288:192.168.202.154@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938491.968666:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938491.968740:0:21153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350924288 00000100:00100000:3.0:1784938491.968750:0:21153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350924288 00000100:00100000:3.0:1784938491.968803:0:21153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 88 00000100:00100000:3.0:1784938491.968813:0:21153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:16392:x1871643350924288:12345-192.168.202.154@tcp:13:osp-pre-0-0.0 00002000:00000024:3.0:1784938491.968844:0:21153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 272832 pending 0 free 313057280 avail 285245440 00000100:00100000:3.0:1784938491.968909:0:21153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:16392:x1871643350924288:12345-192.168.202.154@tcp:13:osp-pre-0-0.0 Request processed in 97us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938491.968916:0:21153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 88 00000100:00080000:3.0:1784938491.968947:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938491.969732:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23823bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350924288:192.168.202.154@tcp:13:osp-pre-0-0.0 00000020:00000080:3.0:1784938491.970709:0:26623:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784938491.970722:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784938491.970766:0:26623:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1784938491.970787:0:26623:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b044d4128f9ef55 00000100:00080000:3.0:1784938491.970797:0:26623:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 192.168.202.154@tcp last attempt 0 00000100:00080000:3.0:1784938491.970804:0:26623:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f2388196800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:3.0:1784938491.970835:0:26623:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b6b8c380 x1871643350924416/t0(0) o8->lustre-OST0001-osc-MDT0000@192.168.202.154@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784938491.970871:0:26623:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1784938491.970983:0:26623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938491.970987:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938491.970989:0:26623:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1784938491.971002:0:26623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938491.971008:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938491.971009:0:26623:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784938491.971012:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784938491.971014:0:26623:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784938491.971016:0:26623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938491.971018:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938491.971019:0:26623:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1784938491.971022:0:26623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938491.971024:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938491.971025:0:26623:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784938491.971318:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1784938491.971354:0:26623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e07296-2a01-411c-abf2-6d190cb69ef0:26623:1871643350924544:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938491.971425:0:26623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938491.971598:0:26623:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24867ea300 going to sleep for 11 seconds 00000100:00100000:0.0:1784938491.971848:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350924416:192.168.202.154@tcp:8:llog_process_th.0 00000100:00100000:3.0:1784938491.972314:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938491.972384:0:25724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350924416 00000100:00100000:0.0:1784938491.972392:0:25724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350924416 00000100:00100000:0.0:1784938491.972424:0:25724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 987 00000100:00100000:0.0:1784938491.972431:0:25724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:16388:x1871643350924416:12345-192.168.202.154@tcp:8:llog_process_th.0 00010000:00080000:0.0:1784938491.972457:0:25724:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@192.168.202.154@tcp t0 exp 0000000000000000 cur 758 last 0 00000020:00000080:0.0:1784938491.972482:0:25724:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b044d4128f9ef5c 00002000:00100000:0.0:1784938491.972504:0:25724:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9f24b415a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cb ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1784938491.972509:0:25724:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1784938491.972511:0:25724:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784938491.972590:0:25724:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784938491.972614:0:25724:0:(import.c:65:import_set_state_nolock()) ffff9f238c7d5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784938491.972660:0:25724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:16388:x1871643350924416:12345-192.168.202.154@tcp:8:llog_process_th.0 Request processed in 229us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938491.972667:0:25724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 987 00000100:00100000:0.0:1784938491.972768:0:16388:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784938491.972776:0:16388:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1784938491.972782:0:16388:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784938491.972787:0:16388:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1784938491.972789:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f2388196800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784938491.972801:0:16388:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784938491.972807:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350924416:192.168.202.154@tcp:8:llog_process_th.0 00000100:00100000:3.0:1784938491.973481:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938491.973508:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350924672:192.168.202.154@tcp:13:osp-pre-1-0.0 00000004:00080000:3.0:1784938491.973573:0:26631:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1784938491.973627:0:26631:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 758140480840ns, next at 0ns, rc = 0 00080000:00080000:3.0:1784938491.973633:0:26631:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:1.0:1784938491.973700:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938491.973705:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938491.973707:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938491.973710:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938491.973713:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938491.973715:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938491.973718:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938491.973720:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784938491.973922:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938491.974049:0:26598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350924544 00000100:00100000:2.0:1784938491.974056:0:26598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350924544 00000100:00100000:2.0:1784938491.974097:0:26598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784938491.974106:0:26598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+8:26623:x1871643350924544:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938491.974219:0:21153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350924672 00000100:00100000:0.0:1784938491.974224:0:21153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350924672 00000100:00100000:0.0:1784938491.974261:0:21153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 89 00000100:00100000:0.0:1784938491.974267:0:21153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:16391:x1871643350924672:12345-192.168.202.154@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1784938491.974287:0:21153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 272832 pending 0 free 313057280 avail 285245440 00000100:00100000:0.0:1784938491.974324:0:21153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:16391:x1871643350924672:12345-192.168.202.154@tcp:13:osp-pre-1-0.0 Request processed in 57us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938491.974331:0:21153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 89 00000100:00100000:2.0:1784938491.974803:0:26598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+8:26623:x1871643350924544:12345-0@lo:502:llog_process_th.0 Request processed in 697us (3377us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938491.974813:0:26598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1784938491.975309:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938491.977215:0:26623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e07296-2a01-411c-abf2-6d190cb69ef0:26623:1871643350924544:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784938491.977262:0:26623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938491.977269:0:26623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938491.977271:0:26623:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784938491.977276:0:26623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1784938491.977543:0:26593:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1784938491.977565:0:26593:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784938491.977588:0:26593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24b379ca00/0x7b044d4128f9eebb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9eec2 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938491.977600:0:26593:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f24b379ca00/0x7b044d4128f9eebb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9eec2 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938491.977608:0:26593:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9f238e2b0800 from 1 10000000:01000000:1.0:1784938491.977611:0:26593:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784938491.977646:0:26593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24827c6600/0x7b044d4128f9ef63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938491.977655:0:26593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f24827c6600/0x7b044d4128f9ef63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938491.977664:0:26593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f24827c6600/0x7b044d4128f9ef63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938491.977683:0:26593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:26593:1871643350924800:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784938491.977729:0:26593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938491.977758:0:26593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2386c92300 going to sleep for 11 seconds 00000100:00100000:3.0:1784938491.977836:0:26600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350924800 00000100:00100000:3.0:1784938491.977842:0:26600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350924800 00000100:00100000:3.0:1784938491.977883:0:26600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784938491.977891:0:26600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+8:26593:x1871643350924800:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938491.977905:0:26600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938491.977917:0:26600:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f238217de00/0x7b044d4128f9ef6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9ef63 expref: -99 pid: 26600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938491.977949:0:26600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f238217de00/0x7b044d4128f9ef6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9ef63 expref: 9 pid: 26600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938491.977960:0:26600:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f238217de00/0x7b044d4128f9ef6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9ef63 expref: 9 pid: 26600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938491.977968:0:26600:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217de00, rc 0) 00000100:00100000:3.0:1784938491.978008:0:26600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+9:26593:x1871643350924800:12345-0@lo:101:mount.lustre.0 Request processed in 118us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938491.978015:0:26600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784938491.978298:0:26593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:26593:1871643350924800:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938491.978312:0:26593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f24827c6600/0x7b044d4128f9ef63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9ef6a expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938491.978321:0:26593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f24827c6600/0x7b044d4128f9ef63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9ef6a expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938491.978803:0:26593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:26593:1871643350924928:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1784938491.978839:0:26593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938491.978874:0:26593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2386c92300 going to sleep for 11 seconds 00000004:00080000:0.0:1784938491.979080:0:26594:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1784938491.979340:0:26598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350924928 00000100:00100000:3.0:1784938491.979346:0:26598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350924928 00000100:00100000:3.0:1784938491.979386:0:26598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784938491.979393:0:26598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+9:26593:x1871643350924928:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1784938491.979409:0:26598:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1784938491.979428:0:26598:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1784938491.979431:0:26598:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1784938491.979434:0:26598:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 12 00000100:00100000:3.0:1784938491.979521:0:26598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+9:26593:x1871643350924928:12345-0@lo:256:mount.lustre.0 Request processed in 128us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938491.979527:0:26598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784938491.979944:0:26593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:26593:1871643350924928:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1784938491.980634:0:26593:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784938491.980647:0:26593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24827c6600/0x7b044d4128f9ef63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9ef6a expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938491.980657:0:26593:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f24827c6600/0x7b044d4128f9ef63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9ef6a expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938491.980665:0:26593:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9f238e2b0800 from 1 10000000:01000000:1.0:1784938491.980668:0:26593:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784938491.980695:0:26593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24827c7000/0x7b044d4128f9ef71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938491.980702:0:26593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f24827c7000/0x7b044d4128f9ef71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938491.980711:0:26593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f24827c7000/0x7b044d4128f9ef71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938491.980732:0:26593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:26593:1871643350925056:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784938491.980767:0:26593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938491.980795:0:26593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2386c92300 going to sleep for 11 seconds 00000100:00100000:1.0:1784938491.980816:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350925056 00000100:00100000:1.0:1784938491.980820:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350925056 00000100:00100000:1.0:1784938491.980845:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784938491.980852:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+9:26593:x1871643350925056:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938491.980860:0:26601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938491.980871:0:26601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f24827c7e00/0x7b044d4128f9ef78 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9ef71 expref: -99 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938491.980890:0:26601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f24827c7e00/0x7b044d4128f9ef78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9ef71 expref: 10 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938491.980900:0:26601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f24827c7e00/0x7b044d4128f9ef78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9ef71 expref: 10 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938491.980908:0:26601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c7e00, rc 0) 00000100:00100000:1.0:1784938491.980947:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+10:26593:x1871643350925056:12345-0@lo:101:mount.lustre.0 Request processed in 96us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938491.980953:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784938491.980990:0:26593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:26593:1871643350925056:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938491.981016:0:26593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f24827c7000/0x7b044d4128f9ef71 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9ef78 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938491.981025:0:26593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f24827c7000/0x7b044d4128f9ef71 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9ef78 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938491.981620:0:26593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:26593:1871643350925184:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938491.981646:0:26593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938491.981710:0:26593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2386c92300 going to sleep for 11 seconds 00000100:00100000:2.0:1784938491.981869:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350924672:192.168.202.154@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938491.982740:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350925184 00000100:00100000:0.0:1784938491.982748:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350925184 00000100:00100000:0.0:1784938491.982836:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784938491.982845:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+10:26593:x1871643350925184:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938491.983185:0:26593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:26593:1871643350925184:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938491.983235:0:26593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:26593:1871643350925312:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784938491.983287:0:26593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938491.983334:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+10:26593:x1871643350925184:12345-0@lo:501:mount.lustre.0 Request processed in 490us (1686us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938491.983342:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784938491.983555:0:26593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2386c92300 going to sleep for 11 seconds 00000100:00100000:0.0:1784938491.983715:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350925312 00000100:00100000:0.0:1784938491.983721:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350925312 00000100:00100000:0.0:1784938491.983742:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784938491.983748:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+10:26593:x1871643350925312:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784938491.983841:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+10:26593:x1871643350925312:12345-0@lo:503:mount.lustre.0 Request processed in 91us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938491.983847:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784938491.983923:0:26593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:26593:1871643350925312:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784938491.984500:0:26633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e07296-2a01-411c-abf2-6d190cb69ef0:26633:1871643350925440:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938491.984542:0:26633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938491.984571:0:26633:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2386c92cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938491.984665:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350925440 00000100:00100000:0.0:1784938491.984670:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350925440 00000100:00100000:0.0:1784938491.984690:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784938491.984697:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+10:26633:x1871643350925440:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938491.985206:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+10:26633:x1871643350925440:12345-0@lo:502:llog_process_th.0 Request processed in 498us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938491.985214:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784938491.985439:0:26633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e07296-2a01-411c-abf2-6d190cb69ef0:26633:1871643350925440:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784938491.985465:0:26633:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784938491.985474:0:26633:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938491.985476:0:26633:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1784938491.985483:0:26633:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f238e2b0800 00000020:00000080:1.0:1784938491.985486:0:26633:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784938491.985503:0:26633:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938491.985506:0:26633:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938491.985508:0:26633:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1784938491.985510:0:26633:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784938491.985512:0:26633:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938491.985513:0:26633:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1784938491.985516:0:26633:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f238e2b0800 00000020:00000080:1.0:1784938491.985518:0:26633:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784938491.985591:0:26633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e07296-2a01-411c-abf2-6d190cb69ef0:26633:1871643350925568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938491.985627:0:26633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938491.985647:0:26633:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2386c92cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938491.985755:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350925568 00000100:00100000:0.0:1784938491.985761:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350925568 00000100:00100000:0.0:1784938491.985783:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784938491.985790:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+10:26633:x1871643350925568:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938491.985873:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+10:26633:x1871643350925568:12345-0@lo:502:llog_process_th.0 Request processed in 83us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938491.985879:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784938491.985958:0:26633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e07296-2a01-411c-abf2-6d190cb69ef0:26633:1871643350925568:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784938491.985978:0:26633:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938491.985982:0:26633:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938491.985984:0:26633:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1784938491.985987:0:26633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1784938491.986296:0:26593:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1784938491.986318:0:26593:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784938491.986336:0:26593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24827c7000/0x7b044d4128f9ef71 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9ef78 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938491.986346:0:26593:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f24827c7000/0x7b044d4128f9ef71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9ef78 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938491.986398:0:26593:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1784938491.986402:0:26593:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f238e2b0800 10000000:01000000:0.0:1784938491.986405:0:26593:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f238e2b0800 10000000:01000000:0.0:1784938491.986409:0:26593:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784938491.986415:0:26593:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9f238e2b0800 from 1 10000000:01000000:0.0:1784938491.986419:0:26593:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784938491.986443:0:26593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24b379d600/0x7b044d4128f9ef7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938491.986451:0:26593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f24b379d600/0x7b044d4128f9ef7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938491.986459:0:26593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f24b379d600/0x7b044d4128f9ef7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938491.986472:0:26593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:26593:1871643350925696:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784938491.986577:0:26593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938491.986601:0:26593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238108ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938491.986615:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350925696 00000100:00100000:0.0:1784938491.986618:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350925696 00000100:00100000:0.0:1784938491.986638:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784938491.986645:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+10:26593:x1871643350925696:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938491.986653:0:26601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938491.986667:0:26601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f24b379c800/0x7b044d4128f9ef86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9ef7f expref: -99 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938491.986688:0:26601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f24b379c800/0x7b044d4128f9ef86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9ef7f expref: 11 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938491.986699:0:26601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f24b379c800/0x7b044d4128f9ef86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9ef7f expref: 11 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938491.986713:0:26601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b379c800, rc 0) 00000100:00100000:0.0:1784938491.986742:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+11:26593:x1871643350925696:12345-0@lo:101:mount.lustre.0 Request processed in 97us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938491.986748:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784938491.986782:0:26593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:26593:1871643350925696:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938491.986796:0:26593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f24b379d600/0x7b044d4128f9ef7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9ef86 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938491.986805:0:26593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f24b379d600/0x7b044d4128f9ef7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9ef86 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938491.986851:0:26593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:26593:1871643350925824:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784938491.986873:0:26593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938491.986885:0:26593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238108ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938491.986897:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350925824 00000100:00100000:0.0:1784938491.986900:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350925824 00000100:00100000:0.0:1784938491.986915:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784938491.986921:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+11:26593:x1871643350925824:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784938491.987189:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+11:26593:x1871643350925824:12345-0@lo:501:mount.lustre.0 Request processed in 266us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938491.987378:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784938491.987415:0:26593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:26593:1871643350925824:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784938491.987445:0:26593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:26593:1871643350925952:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784938491.987487:0:26593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938491.987644:0:26593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238108ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938491.987761:0:26600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350925952 00000100:00100000:3.0:1784938491.987766:0:26600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350925952 00000100:00100000:3.0:1784938491.987791:0:26600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784938491.987798:0:26600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+11:26593:x1871643350925952:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784938491.987890:0:26600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+11:26593:x1871643350925952:12345-0@lo:503:mount.lustre.0 Request processed in 92us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938491.987896:0:26600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784938491.988001:0:26593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:26593:1871643350925952:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784938491.992697:0:26634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e07296-2a01-411c-abf2-6d190cb69ef0:26634:1871643350926080:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938491.992778:0:26634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938491.992818:0:26600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350926080 00000100:00100000:3.0:1784938491.992824:0:26600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350926080 00000100:00100000:3.0:1784938491.992865:0:26600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784938491.992873:0:26600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+11:26634:x1871643350926080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938491.993015:0:26600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+11:26634:x1871643350926080:12345-0@lo:502:llog_process_th.0 Request processed in 142us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938491.993023:0:26600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784938491.993633:0:26634:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938491.993657:0:26634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e07296-2a01-411c-abf2-6d190cb69ef0:26634:1871643350926080:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1784938491.993715:0:26634:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1784938491.993729:0:26634:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9f238c834d40) 00000020:00000080:3.0:1784938491.993752:0:26634:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1784938491.999820:0:26634:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f238e2b0800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1784938491.999830:0:26634:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f238e2b0800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1784938491.999834:0:26634:0:(obd_mount.c:706:lustre_put_lsi()) put ffff9f238e2b0800 4 00010000:00080000:3.0:1784938491.999885:0:26634:0:(ldlm_lib.c:125:import_set_conn()) imp ffff9f238d120800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.154@tcp at head 00010000:00010000:3.0:1784938492.011385:0:26634:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-8 is initialized 00000020:00000080:3.0:1784938492.011970:0:26634:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1784938492.012340:0:26634:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784938492.012357:0:26634:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x7b044d4128f9ef94 00000100:00080000:3.0:1784938492.012371:0:26634:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 192.168.202.154@tcp last attempt 0 00000100:00080000:3.0:1784938492.012383:0:26634:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9f238d120800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:3.0:1784938492.012422:0:26634:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b6b8d880 x1871643350926208/t0(0) o38->lustre-MDT0000-lwp-MDT0000@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784938492.012483:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:16388:1871643350926208:192.168.202.154@tcp:38:llog_process_th.0 00000100:00080000:3.0:1784938492.015985:0:26634:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1784938492.016648:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938492.016695:0:26607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350926208 00000100:00100000:2.0:1784938492.016703:0:26607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350926208 00000100:00100000:2.0:1784938492.016739:0:26607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 0 00000100:00100000:2.0:1784938492.016747:0:26607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16388:x1871643350926208:12345-192.168.202.154@tcp:38:llog_process_th.0 00000100:00100000:2.0:1784938492.016817:0:26607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16388:x1871643350926208:12345-192.168.202.154@tcp:38:llog_process_th.0 Request processed in 69us (175us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784938492.016825:0:26607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 0 00000100:00100000:3.0:1784938492.019115:0:26634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e07296-2a01-411c-abf2-6d190cb69ef0:26634:1871643350926336:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938492.019233:0:26634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938492.019271:0:26634:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34cc0 going to sleep for 11 seconds 00000100:00080000:1.0:1784938492.020320:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938492.020326:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938492.020329:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938492.020332:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938492.020335:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938492.020337:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938492.020340:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938492.020342:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784938492.020364:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350926336 00000100:00100000:1.0:1784938492.020371:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350926336 00000100:00100000:1.0:1784938492.020799:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784938492.020809:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+11:26634:x1871643350926336:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938492.021024:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+11:26634:x1871643350926336:12345-0@lo:502:llog_process_th.0 Request processed in 216us (1790us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938492.021033:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784938492.026755:0:16388:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784938492.026771:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f238d120800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784938492.026783:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.154@tcp failed (-11) 00000100:00100000:0.0:1784938492.026789:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:16388:1871643350926208:192.168.202.154@tcp:38:llog_process_th.0 00000100:00100000:2.0:1784938492.026925:0:26634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e07296-2a01-411c-abf2-6d190cb69ef0:26634:1871643350926336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938492.027036:0:26634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23823ba680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e07296-2a01-411c-abf2-6d190cb69ef0:26634:1871643350926464:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938492.027111:0:26634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938492.027181:0:26598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350926464 00000100:00100000:2.0:1784938492.027187:0:26598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350926464 00000100:00100000:2.0:1784938492.027243:0:26598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784938492.027251:0:26598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+11:26634:x1871643350926464:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938492.027360:0:26598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+11:26634:x1871643350926464:12345-0@lo:502:llog_process_th.0 Request processed in 109us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938492.027368:0:26598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784938492.027416:0:26634:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2389fdb780 going to sleep for 11 seconds 00000100:00100000:2.0:1784938492.027428:0:26634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23823ba680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e07296-2a01-411c-abf2-6d190cb69ef0:26634:1871643350926464:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784938492.027448:0:26634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1784938492.027824:0:26593:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1784938492.027847:0:26593:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784938492.027861:0:26593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24b379d600/0x7b044d4128f9ef7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9ef86 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938492.027872:0:26593:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f24b379d600/0x7b044d4128f9ef7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9ef86 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784938492.027918:0:26593:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784938492.027921:0:26593:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784938492.027922:0:26593:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938492.027923:0:26593:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784938492.027925:0:26593:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938492.027926:0:26593:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938492.027937:0:26593:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784938492.027939:0:26593:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784938492.027941:0:26593:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938492.027942:0:26593:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784938492.027946:0:26593:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1784938492.027949:0:26593:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784938492.027950:0:26593:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784938492.027951:0:26593:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938492.027952:0:26593:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784938492.027953:0:26593:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938492.027955:0:26593:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938492.027956:0:26593:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784938492.027957:0:26593:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784938492.027959:0:26593:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938492.027960:0:26593:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784938492.027976:0:26593:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1784938492.027987:0:26593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:26593:1871643350926592:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784938492.028033:0:26593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938492.028062:0:26593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24906db6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938492.029663:0:26600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350926592 00000100:00100000:2.0:1784938492.029675:0:26600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350926592 00000100:00100000:2.0:1784938492.029724:0:26600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784938492.029733:0:26600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+11:26593:x1871643350926592:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784938492.029764:0:26600:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1784938492.029777:0:26600:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1784938492.041806:0:26600:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784938492.041861:0:26600:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1784938492.042408:0:26600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+11:26593:x1871643350926592:12345-0@lo:253:mount.lustre.0 Request processed in 12672us (14370us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938492.042420:0:26600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784938492.042611:0:26593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:26593:1871643350926592:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784938492.042626:0:26593:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1784938492.042629:0:26593:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784938492.042631:0:26593:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784938492.042632:0:26593:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938492.042634:0:26593:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784938492.042635:0:26593:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938492.042637:0:26593:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938492.042638:0:26593:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784938492.042640:0:26593:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784938492.042642:0:26593:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938492.042643:0:26593:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784938492.042658:0:26593:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1784938492.046340:0:26604:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784938492.046350:0:26604:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784938492.048660:0:26604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f2386e00e00/0x7b044d4128f9ef9b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938492.048682:0:26604:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f238217de00/0x7b044d4128f9ef6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9ef63 expref: 10 pid: 26600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938492.048691:0:26604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f2386e00e00/0x7b044d4128f9ef9b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938492.048734:0:26604:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f238217de00/0x7b044d4128f9ef6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b044d4128f9ef63 expref: 10 pid: 26600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938492.048748:0:26604:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f238217de00/0x7b044d4128f9ef6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b044d4128f9ef63 expref: 10 pid: 26600 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938492.048764:0:26604:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23823ba680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:26604:1871643350926720:0@lo:104: 00000100:00100000:2.0:1784938492.048826:0:26604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938492.048869:0:26604:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485dbe240 going to sleep for 11 seconds 00000100:00100000:2.0:1784938492.048899:0:19217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350926720 00000100:00100000:2.0:1784938492.048905:0:19217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350926720 00000100:00100000:2.0:1784938492.048961:0:19217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784938492.048971:0:19217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e07296-2a01-411c-abf2-6d190cb69ef0+3:26604:x1871643350926720:12345-0@lo:104: 00010000:00010000:2.0:1784938492.048985:0:19217:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9f24827c6600/0x7b044d4128f9ef63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b044d4128f9ef6a expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938492.049049:0:19217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784938492.049055:0:19217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e07296-2a01-411c-abf2-6d190cb69ef0+3:26604:x1871643350926720:12345-0@lo:104: Request processed in 87us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938492.049063:0:19217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784938492.049101:0:26604:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23823ba680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:26604:1871643350926720:0@lo:104: 00010000:00010000:2.0:1784938492.049119:0:26604:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f2386e00e00/0x7b044d4128f9ef9b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938492.049233:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938492.049241:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9f24827c6600/0x7b044d4128f9ef63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b044d4128f9ef6a expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938492.049248:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c6600 already unused, calling callback (ffffffffc1390c20) 10000000:00010000:0.0:1784938492.049252:0:22954:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9f24827c6600/0x7b044d4128f9ef63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b044d4128f9ef6a expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938492.049261:0:22954:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f24827c6600/0x7b044d4128f9ef63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b044d4128f9ef6a expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938492.049268:0:22954:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f24827c6600/0x7b044d4128f9ef63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b044d4128f9ef6a expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938492.049274:0:22954:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784938492.049307:0:22954:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9f24827c6600/0x7b044d4128f9ef63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b044d4128f9ef6a expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938492.049314:0:22954:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784938492.049335:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9f24827c6600/0x7b044d4128f9ef63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b044d4128f9ef6a expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938492.049342:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f24827c6600/0x7b044d4128f9ef63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b044d4128f9ef6a expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938492.049358:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938492.049360:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938492.049362:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938492.049381:0:16390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784938492.049390:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e07296-2a01-411c-abf2-6d190cb69ef0:16390:1871643350926848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938492.049420:0:16390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938492.049455:0:19221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350926848 00000100:00100000:0.0:1784938492.049459:0:19221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350926848 00010000:00010000:0.0:1784938492.049476:0:19221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f238217de00/0x7b044d4128f9ef6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b044d4128f9ef63 expref: 11 pid: 26600 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938492.049641:0:19221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:0.0:1784938492.049649:0:19221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386361500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73e07296-2a01-411c-abf2-6d190cb69ef0+11:16390:x1871643350926848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784938492.049661:0:19221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938492.049667:0:19221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f238217de00/0x7b044d4128f9ef6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b044d4128f9ef63 expref: 11 pid: 26600 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938492.049677:0:19221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f238217de00/0x7b044d4128f9ef6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b044d4128f9ef63 expref: 11 pid: 26600 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938492.049689:0:19221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f238217de00/0x7b044d4128f9ef6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b044d4128f9ef63 expref: 11 pid: 26600 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938492.049702:0:19221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f2386e00e00/0x7b044d4128f9ef9b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938492.049709:0:19221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2386e00e00/0x7b044d4128f9ef9b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784938492.049723:0:19221:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003373868s 00010000:00010000:0.0:1784938492.049728:0:19221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f2386e00e00/0x7b044d4128f9ef9b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938492.049735:0:19221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f2386e00e00/0x7b044d4128f9ef9b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938492.049741:0:19221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f2386e00e00/0x7b044d4128f9ef9b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938492.049748:0:19221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f2386e00e00/0x7b044d4128f9ef9b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938492.049753:0:19221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00e00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938492.049757:0:19221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f2386e00e00/0x7b044d4128f9ef9b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938492.049763:0:19221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f2386e00e00/0x7b044d4128f9ef9b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938492.049776:0:19221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f2386e00e00/0x7b044d4128f9ef9b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938492.049785:0:19221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938492.049811:0:19221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386361500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73e07296-2a01-411c-abf2-6d190cb69ef0+10:16390:x1871643350926848:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938492.049818:0:19221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:0.0:1784938492.049845:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e07296-2a01-411c-abf2-6d190cb69ef0:16390:1871643350926848:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784938492.049861:0:26604:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f2386e00e00/0x7b044d4128f9ef9b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938492.049868:0:26604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f2386e00e00/0x7b044d4128f9ef9b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938492.049873:0:26604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2386e00e00/0x7b044d4128f9ef9b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:0.0:1784938492.058891:0:26593:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1784938492.059421:0:26642:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1784938492.059790:0:26642:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1784938492.060573:0:26593:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:3.0:1784938492.060864:0:26643:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9f24b6b8c700 x1871643350926976/t0(0) o1000->lustre-MDT0001-osp-MDT0000@192.168.202.154@tcp:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938492.060877:0:26643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34e40 going to sleep for 0 seconds 00000040:01000000:1.0:1784938492.062178:0:26593:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1784938492.062304:0:26593:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1784938492.063461:0:26641:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1784938492.063468:0:26641:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000004:00000080:1.0:1784938492.064179:0:26593:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1784938492.065286:0:26593:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1784938492.065383:0:26593:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784938492.067998:0:26642:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1784938492.068883:0:26642:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1784938492.069312:0:26593:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1784938492.072514:0:26593:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1784938492.072599:0:26593:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1784938492.072731:0:26593:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1784938492.073312:0:26593:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00010000:00080000:3.0:1784938492.084020:0:26593:0:(ldlm_lib.c:3076:target_recovery_init()) RECOVERY: service lustre-MDT0000, 1 recoverable clients, last_transno 8589934866 00010000:00080000:0.0:1784938492.085130:0:26644:0:(ldlm_lib.c:2876:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 26644 00010000:02000000:0.0:1784938492.085313:0:26644:0:(ldlm_lib.c:2358:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00000020:01000004:3.0:1784938492.085623:0:26593:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784938492.085640:0:26593:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.154@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784938492.085659:0:26593:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1784938492.085686:0:26593:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1784938492.092689:0:26593:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784938492.092991:0:26593:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00080000:0.0:1784938492.101850:0:26644:0:(ldlm_lib.c:2568:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 1 abort 0 expired 0 00010000:00080000:0.0:1784938492.101857:0:26644:0:(ldlm_lib.c:2568:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 1 abort 0 expired 0 00010000:00010000:1.0:1784938492.840418:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784938492.840480:0:19231:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784938492.840494:0:19231:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9f238e2b0800 from 13 10000000:01000000:0.0:1784938492.840499:0:19231:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784938492.840542:0:19231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24b379ce00/0x7b044d4128f9efa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938492.840559:0:19231:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f24b379ce00/0x7b044d4128f9efa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938492.840569:0:19231:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f24b379ce00/0x7b044d4128f9efa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938492.840592:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350927104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784938492.840667:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938492.840737:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b14860c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938492.843672:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350927104 00000100:00100000:1.0:1784938492.843684:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350927104 00000100:00100000:2.0:1784938492.843867:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784938492.843879:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+10:19231:x1871643350927104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938492.843895:0:26601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938492.843913:0:26601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2386e00c00/0x7b044d4128f9efa9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9efa2 expref: -99 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938492.843951:0:26601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2386e00c00/0x7b044d4128f9efa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9efa2 expref: 11 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938492.843963:0:26601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2386e00c00/0x7b044d4128f9efa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9efa2 expref: 11 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938492.843973:0:26601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e00c00, rc 0) 00000100:00100000:2.0:1784938492.844093:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+11:19231:x1871643350927104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 216us (3425us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938492.844101:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784938492.846839:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350927104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938492.846864:0:19231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f24b379ce00/0x7b044d4128f9efa2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9efa9 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938492.846875:0:19231:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f24b379ce00/0x7b044d4128f9efa2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9efa9 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938492.847000:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350927232:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1784938492.847060:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938492.847102:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b1486900 going to sleep for 11 seconds 00000100:00100000:1.0:1784938492.847271:0:26600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350927232 00000100:00100000:1.0:1784938492.847344:0:26600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350927232 00000100:00100000:1.0:1784938492.847476:0:26600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784938492.847495:0:26600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+11:19231:x1871643350927232:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784938492.847516:0:26600:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784938492.847532:0:26600:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784938492.847535:0:26600:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1784938492.847785:0:26600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+11:19231:x1871643350927232:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 300us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938492.847796:0:26600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784938492.847855:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350927232:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1784938492.847901:0:19231:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784938492.847908:0:19231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24b379ce00/0x7b044d4128f9efa2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9efa9 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938492.847917:0:19231:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f24b379ce00/0x7b044d4128f9efa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9efa9 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938492.847937:0:19231:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784938492.847939:0:19231:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9f24b2d31000 from 52 10000000:01000000:3.0:1784938492.847942:0:19231:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784938492.847967:0:19231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238217dc00/0x7b044d4128f9efb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938492.847974:0:19231:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f238217dc00/0x7b044d4128f9efb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938492.847983:0:19231:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f238217dc00/0x7b044d4128f9efb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938492.847998:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350927360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938492.848025:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938492.852192:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2487e94a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938492.855612:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350927360 00000100:00100000:0.0:1784938492.855634:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350927360 00000100:00100000:0.0:1784938492.855802:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784938492.855812:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+11:19231:x1871643350927360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938492.855828:0:26601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938492.855846:0:26601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f24b379c200/0x7b044d4128f9efb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9efb0 expref: -99 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938492.855872:0:26601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f24b379c200/0x7b044d4128f9efb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9efb0 expref: 12 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938492.855884:0:26601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f24b379c200/0x7b044d4128f9efb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9efb0 expref: 12 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938492.855894:0:26601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b379c200, rc 0) 00000100:00100000:0.0:1784938492.855980:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+12:19231:x1871643350927360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (7952us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938492.855988:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784938492.856039:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350927360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938492.856056:0:19231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f238217dc00/0x7b044d4128f9efb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9efb7 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938492.856065:0:19231:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f238217dc00/0x7b044d4128f9efb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9efb7 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938492.856585:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350927488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938492.856679:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938492.856708:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b1486900 going to sleep for 11 seconds 00000100:00100000:0.0:1784938492.856721:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350927488 00000100:00100000:0.0:1784938492.856725:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350927488 00000100:00100000:0.0:1784938492.856744:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784938492.856750:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+12:19231:x1871643350927488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938492.856858:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+12:19231:x1871643350927488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938492.856865:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784938492.856894:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350927488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938492.856947:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350927616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938492.856987:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938492.857000:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b1486900 going to sleep for 11 seconds 00000100:00100000:0.0:1784938492.857084:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350927616 00000100:00100000:0.0:1784938492.857087:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350927616 00000100:00100000:0.0:1784938492.857103:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784938492.857108:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b2ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+12:19231:x1871643350927616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938492.858992:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b2ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+12:19231:x1871643350927616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1877us (1998us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938492.859003:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784938492.859390:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350927616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784938492.862434:0:26678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1784938492.869075:0:19231:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1784938492.869112:0:19231:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784938492.869125:0:19231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238217dc00/0x7b044d4128f9efb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9efb7 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938492.869357:0:19231:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f238217dc00/0x7b044d4128f9efb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9efb7 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938492.869366:0:19231:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1784938492.869368:0:19231:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1784938492.869371:0:19231:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1784938492.869411:0:19231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24b379d400/0x7b044d4128f9efbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938492.869420:0:19231:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f24b379d400/0x7b044d4128f9efbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938492.869431:0:19231:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f24b379d400/0x7b044d4128f9efbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938492.869455:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350927744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784938492.869718:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938492.869763:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b68ae240 going to sleep for 11 seconds 00000100:00100000:2.0:1784938492.869882:0:26598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350927744 00000100:00100000:2.0:1784938492.869890:0:26598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350927744 00000100:00100000:2.0:1784938492.869950:0:26598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784938492.869961:0:26598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b2ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+12:19231:x1871643350927744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938492.869974:0:26598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938492.869988:0:26598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2386e00a00/0x7b044d4128f9efc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9efbe expref: -99 pid: 26598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938492.870011:0:26598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2386e00a00/0x7b044d4128f9efc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9efbe expref: 13 pid: 26598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938492.870021:0:26598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2386e00a00/0x7b044d4128f9efc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9efbe expref: 13 pid: 26598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938492.870029:0:26598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e00a00, rc 0) 00000100:00100000:2.0:1784938492.870074:0:26598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b2ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+13:19231:x1871643350927744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938492.870081:0:26598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784938492.870125:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350927744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938492.870754:0:19231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f24b379d400/0x7b044d4128f9efbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9efc5 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938492.870764:0:19231:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f24b379d400/0x7b044d4128f9efbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9efc5 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938492.870826:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23823ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350927872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938492.870857:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938492.870914:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b4050900 going to sleep for 11 seconds 00000100:00100000:0.0:1784938492.883960:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350927872 00000100:00100000:0.0:1784938492.883974:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350927872 00000100:00100000:0.0:1784938492.884029:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784938492.884039:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b2ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+13:19231:x1871643350927872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938492.884454:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b2ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+13:19231:x1871643350927872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 416us (13596us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938492.884463:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784938492.884582:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23823ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350927872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938492.884855:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350928000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938492.884904:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938492.884946:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b68ae3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938492.884961:0:26600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350928000 00000100:00100000:0.0:1784938492.884966:0:26600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350928000 00000100:00100000:0.0:1784938492.884991:0:26600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784938492.884997:0:26600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b2ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+13:19231:x1871643350928000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938492.888823:0:26600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b2ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+13:19231:x1871643350928000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3817us (3910us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938492.888838:0:26600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784938492.888912:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350928000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784938492.894249:0:26681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1784938492.897589:0:19231:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1784938492.898365:0:19231:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1784938492.898379:0:19231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24b379d400/0x7b044d4128f9efbe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9efc5 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938492.898390:0:19231:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f24b379d400/0x7b044d4128f9efbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9efc5 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938492.898400:0:19231:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784938492.898403:0:19231:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9f24b2d31000 from 7 10000000:01000000:1.0:1784938492.898406:0:19231:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784938492.898443:0:19231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24827c7c00/0x7b044d4128f9efcc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938492.898451:0:19231:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f24827c7c00/0x7b044d4128f9efcc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938492.898462:0:19231:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f24827c7c00/0x7b044d4128f9efcc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938492.898498:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350928128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784938492.898563:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938492.898843:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828cee40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938492.901405:0:26600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350928128 00000100:00100000:2.0:1784938492.901420:0:26600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350928128 00000100:00100000:2.0:1784938492.901527:0:26600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784938492.901537:0:26600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b2ee6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+13:19231:x1871643350928128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938492.901554:0:26600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938492.901571:0:26600:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2386e00400/0x7b044d4128f9efd3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9efcc expref: -99 pid: 26600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938492.901599:0:26600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2386e00400/0x7b044d4128f9efd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9efcc expref: 14 pid: 26600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938492.901608:0:26600:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2386e00400/0x7b044d4128f9efd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9efcc expref: 14 pid: 26600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938492.902363:0:26600:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e00400, rc 0) 00000100:00100000:2.0:1784938492.902441:0:26600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b2ee6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+14:19231:x1871643350928128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 904us (3877us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938492.902448:0:26600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784938492.906455:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350928128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938492.906513:0:19231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f24827c7c00/0x7b044d4128f9efcc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9efd3 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938492.906526:0:19231:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f24827c7c00/0x7b044d4128f9efcc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9efd3 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938492.906991:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350928256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938492.907052:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938492.909262:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b68ae780 going to sleep for 11 seconds 00000100:00100000:1.0:1784938492.909456:0:26598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350928256 00000100:00100000:1.0:1784938492.909464:0:26598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350928256 00000100:00100000:1.0:1784938492.909520:0:26598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784938492.909529:0:26598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b2ee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+14:19231:x1871643350928256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938492.909790:0:26598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b2ee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+14:19231:x1871643350928256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 262us (2736us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938492.909798:0:26598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784938492.910633:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350928256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938492.910681:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350928384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938492.910727:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938492.910756:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b68ae780 going to sleep for 11 seconds 00000100:00100000:1.0:1784938492.910876:0:26598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350928384 00000100:00100000:1.0:1784938492.910881:0:26598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350928384 00000100:00100000:1.0:1784938492.910906:0:26598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784938492.910913:0:26598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b2ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+14:19231:x1871643350928384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938492.911012:0:26598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b2ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+14:19231:x1871643350928384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938492.911020:0:26598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784938492.912424:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350928384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784938492.917403:0:26685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1784938492.918122:0:19231:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1784938492.918161:0:19231:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784938492.918174:0:19231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24827c7c00/0x7b044d4128f9efcc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9efd3 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938492.918185:0:19231:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f24827c7c00/0x7b044d4128f9efcc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9efd3 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938492.918199:0:19231:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784938492.918202:0:19231:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9f24b65ac800 from 52 10000000:01000000:2.0:1784938492.918205:0:19231:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784938492.918242:0:19231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f2386e01c00/0x7b044d4128f9efda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938492.918250:0:19231:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f2386e01c00/0x7b044d4128f9efda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938492.918261:0:19231:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f2386e01c00/0x7b044d4128f9efda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938492.918298:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23823b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350928512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784938492.918361:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938492.918403:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b4050600 going to sleep for 11 seconds 00000100:00100000:1.0:1784938492.919105:0:26598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350928512 00000100:00100000:1.0:1784938492.919114:0:26598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350928512 00000100:00100000:1.0:1784938492.919186:0:26598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784938492.919195:0:26598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b2ee5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+14:19231:x1871643350928512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938492.919209:0:26598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938492.919222:0:26598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f24827c7600/0x7b044d4128f9efe1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9efda expref: -99 pid: 26598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938492.919246:0:26598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f24827c7600/0x7b044d4128f9efe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9efda expref: 15 pid: 26598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938492.919257:0:26598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f24827c7600/0x7b044d4128f9efe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9efda expref: 15 pid: 26598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938492.919266:0:26598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c7600, rc 0) 00000100:00100000:1.0:1784938492.919383:0:26598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b2ee5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+15:19231:x1871643350928512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938492.919394:0:26598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784938492.920768:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23823b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350928512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938492.920795:0:19231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f2386e01c00/0x7b044d4128f9efda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9efe1 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938492.920808:0:19231:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f2386e01c00/0x7b044d4128f9efda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9efe1 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938492.920887:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350928640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938492.920947:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938492.920983:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2487e94b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938492.921000:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350928640 00000100:00100000:3.0:1784938492.921005:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350928640 00000100:00100000:3.0:1784938492.921045:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784938492.921053:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b2ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+15:19231:x1871643350928640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938492.921183:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b2ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+15:19231:x1871643350928640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938492.921195:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784938492.921228:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350928640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938492.921252:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350928768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938492.921300:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938492.921314:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2487e94b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938492.921324:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350928768 00000100:00100000:3.0:1784938492.921328:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350928768 00000100:00100000:3.0:1784938492.921343:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784938492.921349:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b2ee4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+15:19231:x1871643350928768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938492.921417:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b2ee4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+15:19231:x1871643350928768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938492.921424:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784938492.921460:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350928768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784938492.924396:0:26686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1784938492.924790:0:19231:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1784938492.924816:0:19231:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784938492.924826:0:19231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f2386e01c00/0x7b044d4128f9efda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9efe1 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938492.924838:0:19231:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f2386e01c00/0x7b044d4128f9efda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9efe1 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938492.924848:0:19231:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1784938492.924851:0:19231:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1784938492.924855:0:19231:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784938492.924889:0:19231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238217d000/0x7b044d4128f9efe8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938492.924903:0:19231:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f238217d000/0x7b044d4128f9efe8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938492.924914:0:19231:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f238217d000/0x7b044d4128f9efe8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938492.924951:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350928896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938492.925011:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938492.925056:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2487e94b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938492.927262:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350928896 00000100:00100000:2.0:1784938492.927283:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350928896 00000100:00100000:2.0:1784938492.927333:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784938492.927343:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b2ee6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+15:19231:x1871643350928896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938492.927360:0:26601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938492.927377:0:26601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2386e01000/0x7b044d4128f9efef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9efe8 expref: -99 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938492.927402:0:26601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2386e01000/0x7b044d4128f9efef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9efe8 expref: 16 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938492.927413:0:26601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2386e01000/0x7b044d4128f9efef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9efe8 expref: 16 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938492.927423:0:26601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e01000, rc 0) 00000100:00100000:2.0:1784938492.927805:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b2ee6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+16:19231:x1871643350928896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 462us (2791us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938492.927812:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784938492.927866:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350928896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938492.927883:0:19231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f238217d000/0x7b044d4128f9efe8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9efef expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938492.927893:0:19231:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f238217d000/0x7b044d4128f9efe8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9efef expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938492.927977:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23823b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350929024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938492.928008:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938492.928036:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238cad7000 going to sleep for 11 seconds 00000100:00100000:2.0:1784938492.928051:0:26600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350929024 00000100:00100000:2.0:1784938492.928055:0:26600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350929024 00000100:00100000:2.0:1784938492.928079:0:26600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784938492.928085:0:26600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238c302850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+16:19231:x1871643350929024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938492.928238:0:26600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238c302850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+16:19231:x1871643350929024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938492.928244:0:26600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784938492.929590:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23823b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350929024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938492.929747:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23823b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350929152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938492.929803:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938492.929844:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238cad7000 going to sleep for 11 seconds 00000100:00100000:3.0:1784938492.930590:0:26600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350929152 00000100:00100000:3.0:1784938492.930597:0:26600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350929152 00000100:00100000:3.0:1784938492.930650:0:26600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784938492.930658:0:26600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238c300c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+16:19231:x1871643350929152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938492.932346:0:26600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238c300c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+16:19231:x1871643350929152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1683us (2537us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938492.932358:0:26600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784938492.932708:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23823b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350929152:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784938492.933747:0:26688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1784938492.934003:0:19231:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1784938492.934030:0:19231:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784938492.934041:0:19231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238217d000/0x7b044d4128f9efe8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9efef expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938492.934051:0:19231:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f238217d000/0x7b044d4128f9efe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9efef expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938492.934061:0:19231:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784938492.934063:0:19231:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9f24b65ac800 from 7 10000000:01000000:3.0:1784938492.934065:0:19231:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784938492.934099:0:19231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238217c800/0x7b044d4128f9eff6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938492.934107:0:19231:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f238217c800/0x7b044d4128f9eff6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938492.934117:0:19231:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f238217c800/0x7b044d4128f9eff6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938492.934139:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350929280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938492.934215:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938492.934247:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2487e94cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938492.934311:0:26598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350929280 00000100:00100000:1.0:1784938492.934318:0:26598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350929280 00000100:00100000:1.0:1784938492.934366:0:26598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784938492.934375:0:26598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238c302050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+16:19231:x1871643350929280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938492.934388:0:26598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938492.934400:0:26598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f24827c7a00/0x7b044d4128f9effd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9eff6 expref: -99 pid: 26598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938492.934423:0:26598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f24827c7a00/0x7b044d4128f9effd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9eff6 expref: 17 pid: 26598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938492.934435:0:26598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f24827c7a00/0x7b044d4128f9effd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9eff6 expref: 17 pid: 26598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938492.934444:0:26598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24827c7a00, rc 0) 00000100:00100000:1.0:1784938492.934608:0:26598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238c302050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+17:19231:x1871643350929280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938492.934677:0:26598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784938492.935525:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350929280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938492.935542:0:19231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f238217c800/0x7b044d4128f9eff6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9effd expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938492.935553:0:19231:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f238217c800/0x7b044d4128f9eff6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9effd expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938492.935613:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23823b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350929408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938492.935771:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938492.935812:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238cad73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938492.935855:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350929408 00000100:00100000:3.0:1784938492.935861:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350929408 00000100:00100000:3.0:1784938492.935896:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784938492.935904:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238c301c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+17:19231:x1871643350929408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938492.936040:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238c301c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+17:19231:x1871643350929408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938492.936048:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784938492.937460:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23823b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350929408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938492.937579:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23823b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350929536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938492.937697:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938492.937731:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238cad73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938492.937747:0:26600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350929536 00000100:00100000:2.0:1784938492.937752:0:26600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350929536 00000100:00100000:2.0:1784938492.937786:0:26600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784938492.937794:0:26600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238c301850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+17:19231:x1871643350929536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938492.937888:0:26600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238c301850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+17:19231:x1871643350929536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938492.937896:0:26600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784938492.937957:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23823b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350929536:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784938492.941538:0:26689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1784938492.941869:0:19231:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1784938492.941895:0:19231:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784938492.941905:0:19231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238217c800/0x7b044d4128f9eff6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9effd expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938492.941918:0:19231:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f238217c800/0x7b044d4128f9eff6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9effd expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938492.941941:0:19231:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784938492.941944:0:19231:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9f24b17699c0 from 1 10000000:01000000:1.0:1784938492.941947:0:19231:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784938492.941988:0:19231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24827c6c00/0x7b044d4128f9f004 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938492.941997:0:19231:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f24827c6c00/0x7b044d4128f9f004 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938492.942009:0:19231:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f24827c6c00/0x7b044d4128f9f004 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938492.942035:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350929664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784938492.942097:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938492.942139:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828cec00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938492.942395:0:26598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350929664 00000100:00100000:0.0:1784938492.942401:0:26598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350929664 00000100:00100000:0.0:1784938492.942462:0:26598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784938492.942471:0:26598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238c300850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+17:19231:x1871643350929664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938492.942685:0:26598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938492.942701:0:26598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f24b379da00/0x7b044d4128f9f00b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9f004 expref: -99 pid: 26598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938492.942725:0:26598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f24b379da00/0x7b044d4128f9f00b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9f004 expref: 18 pid: 26598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938492.942737:0:26598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f24b379da00/0x7b044d4128f9f00b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9f004 expref: 18 pid: 26598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938492.942747:0:26598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b379da00, rc 0) 00000100:00100000:0.0:1784938492.942839:0:26598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238c300850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+18:19231:x1871643350929664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 368us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938492.942847:0:26598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784938492.945608:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350929664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938492.945705:0:19231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f24827c6c00/0x7b044d4128f9f004 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f00b expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938492.945717:0:19231:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f24827c6c00/0x7b044d4128f9f004 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9f00b expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938492.945740:0:19231:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784938492.945745:0:19231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24827c6c00/0x7b044d4128f9f004 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f00b expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938492.945752:0:19231:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f24827c6c00/0x7b044d4128f9f004 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f00b expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938492.945760:0:19231:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1784938492.945762:0:19231:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9f24b17699c0 from 1 10000000:01000000:1.0:1784938492.945766:0:19231:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784938492.945798:0:19231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24827c6200/0x7b044d4128f9f012 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938492.945806:0:19231:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f24827c6200/0x7b044d4128f9f012 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938492.945814:0:19231:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f24827c6200/0x7b044d4128f9f012 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938492.945832:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350929792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784938492.945883:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938492.945936:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828cec00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938492.946687:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350929792 00000100:00100000:2.0:1784938492.946694:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350929792 00000100:00100000:2.0:1784938492.946748:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784938492.946757:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238c302450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+18:19231:x1871643350929792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938492.946771:0:26601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938492.946785:0:26601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2386e01800/0x7b044d4128f9f019 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9f012 expref: -99 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938492.946808:0:26601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2386e01800/0x7b044d4128f9f019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9f012 expref: 19 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938492.946819:0:26601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2386e01800/0x7b044d4128f9f019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9f012 expref: 19 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938492.946828:0:26601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e01800, rc 0) 00000100:00100000:2.0:1784938492.946878:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238c302450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+19:19231:x1871643350929792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938492.946885:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784938492.946938:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350929792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938492.946952:0:19231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f24827c6200/0x7b044d4128f9f012 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f019 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938492.946960:0:19231:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f24827c6200/0x7b044d4128f9f012 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9f019 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938492.947020:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23823b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350929920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938492.947046:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938492.947062:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b4050600 going to sleep for 11 seconds 00000100:00100000:0.0:1784938492.947107:0:26598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350929920 00000100:00100000:0.0:1784938492.947112:0:26598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350929920 00000100:00100000:0.0:1784938492.947167:0:26598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784938492.947175:0:26598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238c303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+19:19231:x1871643350929920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938492.947247:0:26598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238c303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+19:19231:x1871643350929920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 73us (200us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784938492.947254:0:26598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784938492.947772:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23823b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350929920:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1784938492.947801:0:19231:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1784938492.947808:0:19231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24827c6200/0x7b044d4128f9f012 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f019 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938492.947817:0:19231:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f24827c6200/0x7b044d4128f9f012 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f019 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000400:1.0:1784938492.971538:0:16392:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938476/real 1784938476] req@ffff9f2388247480 x1871643350921600/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938492 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938493.045681:0:16392:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9f2388247480 x1871643350921600/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938492 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784938493.045696:0:16392:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff9f24b4115000 already not connected (conn 9, was 8): CONNECTING 00000100:00000400:2.0:1784938493.067288:0:16392:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938476/real 1784938476] req@ffff9f2388246d80 x1871643350921728/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938492 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938493.067325:0:16392:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9f2388246d80 x1871643350921728/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938492 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784938493.067334:0:16392:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff9f238ce54800 already not connected (conn 9, was 8): CONNECTING 00000100:00100000:2.0:1784938493.067355:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:16392:1871643350921600:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938493.067362:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:16392:1871643350921728:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938493.096681:0:26643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34e40 going to sleep for 0 seconds 00010000:00010000:0.0:1784938493.864272:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938494.056518:0:16388:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938484/real 1784938484] req@ffff9f238e0efb80 x1871643350922624/t0(0) o38->lustre-MDT0001-lwp-OST0000@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 1 dl 1784938494 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938494.056564:0:16388:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f238e0efb80 x1871643350922624/t0(0) o38->lustre-MDT0001-lwp-OST0000@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 1 dl 1784938494 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938494.056576:0:16388:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938484/real 1784938484] req@ffff9f238e0eed80 x1871643350922752/t0(0) o38->lustre-MDT0001-lwp-OST0001@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 1 dl 1784938494 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938494.056588:0:16388:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f238e0eed80 x1871643350922752/t0(0) o38->lustre-MDT0001-lwp-OST0001@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 1 dl 1784938494 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784938494.056614:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b4115000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784938494.056678:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.154@tcp failed (-110) 00000100:00100000:2.0:1784938494.056684:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:16388:1871643350922624:192.168.202.154@tcp:38:kworker.0 00000100:00080000:2.0:1784938494.056691:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f238ce54800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784938494.056772:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938494.056777:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938494.056780:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938494.056784:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1784938494.056787:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f24b4115000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784938494.056794:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 192.168.202.154@tcp last attempt 750 00000100:00080000:1.0:1784938494.056805:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784938494.056813:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9f24b4115000 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:1.0:1784938494.056840:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f238e0ee680 x1871643350930176/t0(0) o38->lustre-MDT0001-lwp-OST0000@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784938494.056850:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938494.056853:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938494.056868:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938494.056872:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1784938494.056874:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f238ce54800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784938494.056878:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 192.168.202.154@tcp last attempt 750 00000100:00080000:1.0:1784938494.056882:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784938494.056886:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9f238ce54800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:1.0:1784938494.056901:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f238e0edc00 x1871643350930304/t0(0) o38->lustre-MDT0001-lwp-OST0001@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784938494.056909:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1784938494.056927:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1784938494.056929:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f2387dd9800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784938494.056933:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 192.168.202.154@tcp last attempt 758 00000100:00080000:1.0:1784938494.056937:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784938494.056942:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f2387dd9800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:1.0:1784938494.056956:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f238e0ed180 x1871643350930432/t0(0) o38->lustre-MDT0001-osp-MDT0000@192.168.202.154@tcp:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784938494.057064:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.154@tcp failed (-110) 00000100:00100000:2.0:1784938494.057069:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:16388:1871643350922752:192.168.202.154@tcp:38:kworker.0 00000100:00100000:2.0:1784938494.057104:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:16388:1871643350930176:192.168.202.154@tcp:38:kworker.0 00000100:00100000:2.0:1784938494.057231:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:16388:1871643350930304:192.168.202.154@tcp:38:kworker.0 00000100:00100000:2.0:1784938494.057265:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350930432:192.168.202.154@tcp:38:kworker.0 00000100:00100000:2.0:1784938494.057309:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e07296-2a01-411c-abf2-6d190cb69ef0:16390:1871643350930048:0@lo:400:kworker.0 00000100:00100000:2.0:1784938494.057366:0:16390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938494.057509:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350930688:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938494.057541:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784938494.057547:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350930560:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938494.057804:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938494.057848:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938494.057905:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938494.057948:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938494.057974:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938494.058021:0:26609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350930176 00000100:00100000:2.0:1784938494.058030:0:26609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350930176 00000100:00100000:2.0:1784938494.058068:0:26609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350930304 00000100:00100000:2.0:1784938494.058071:0:26609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350930304 00000100:00100000:2.0:1784938494.058086:0:26609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 1 00000100:00100000:2.0:1784938494.058094:0:26609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:16388:x1871643350930176:12345-192.168.202.154@tcp:38:kworker.0 00010000:00020000:2.0:1784938494.058121:0:26609:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.154@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784938494.058205:0:26609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:16388:x1871643350930176:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 108us (399us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784938494.058213:0:26609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 1 00000100:00100000:2.0:1784938494.058240:0:26609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 2 00000100:00100000:2.0:1784938494.058246:0:26609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:16388:x1871643350930304:12345-192.168.202.154@tcp:38:kworker.0 00010000:00020000:2.0:1784938494.058258:0:26609:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.154@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784938494.058294:0:26609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:16388:x1871643350930304:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 45us (444us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784938494.058302:0:26609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 2 00000100:00100000:2.0:1784938494.058349:0:25714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350930432 00000100:00100000:2.0:1784938494.058354:0:25714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350930432 00000100:00100000:2.0:1784938494.059582:0:25714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 94 00000100:00100000:2.0:1784938494.059600:0:25714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:16388:x1871643350930432:12345-192.168.202.154@tcp:38:kworker.0 00010000:00020000:2.0:1784938494.059624:0:25714:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.154@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784938494.059688:0:25714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:16388:x1871643350930432:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 91us (1782us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784938494.059695:0:25714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 94 00000100:00100000:2.0:1784938494.059743:0:25725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350930688 00000100:00100000:2.0:1784938494.059750:0:25725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350930688 00000100:00100000:2.0:1784938494.059808:0:25725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350930560 00000100:00100000:2.0:1784938494.059811:0:25725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350930560 00000100:00100000:2.0:1784938494.059837:0:25725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 93 00000100:00100000:2.0:1784938494.059844:0:25725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:16392:x1871643350930688:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938494.060266:0:25725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:16392:x1871643350930688:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 421us (2316us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938494.060275:0:25725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 93 00000100:00100000:2.0:1784938494.060291:0:25725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 94 00000100:00100000:2.0:1784938494.060298:0:25725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:16392:x1871643350930560:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938494.060328:0:25725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:16392:x1871643350930560:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 30us (2352us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938494.060335:0:25725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 94 00000100:00080000:2.0:1784938494.060373:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784938494.060377:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784938494.060823:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1784938494.060829:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784938494.060834:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f238d120800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784938494.060846:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9f238d120800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:1.0:1784938494.060902:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f238e0ee300 x1871643350930816/t0(0) o38->lustre-MDT0000-lwp-MDT0000@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784938494.060953:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938494.060957:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938494.060960:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938494.060963:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784938494.063133:0:26598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350930048 00000100:00100000:0.0:1784938494.063170:0:26598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350930048 00000100:00100000:3.0:1784938494.063231:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350930560:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938494.063251:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350930688:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938494.063455:0:26598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784938494.063467:0:26598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238c301450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+19:16390:x1871643350930048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938494.063482:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:16388:1871643350930816:192.168.202.154@tcp:38:kworker.0 00000100:00080000:2.0:1784938494.065353:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b4115000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784938494.065370:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.154@tcp failed (-19) 00000100:00100000:2.0:1784938494.065375:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:16388:1871643350930176:192.168.202.154@tcp:38:kworker.0 00000100:00080000:2.0:1784938494.065478:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f238ce54800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784938494.065484:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.154@tcp failed (-19) 00000100:00100000:2.0:1784938494.065488:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:16388:1871643350930304:192.168.202.154@tcp:38:kworker.0 00000100:00080000:2.0:1784938494.065502:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f2387dd9800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784938494.065506:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.154@tcp failed (-19) 00000100:00100000:2.0:1784938494.065510:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350930432:192.168.202.154@tcp:38:kworker.0 00000100:00100000:0.0:1784938494.067620:0:26598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238c301450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+19:16390:x1871643350930048:12345-0@lo:400:kworker.0 Request processed in 4142us (10240us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938494.067640:0:26598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784938494.068008:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938494.068443:0:26609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350930816 00000100:00100000:0.0:1784938494.068454:0:26609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350930816 00000100:00100000:0.0:1784938494.068511:0:26609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 3 00000100:00100000:0.0:1784938494.068519:0:26609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:16388:x1871643350930816:12345-192.168.202.154@tcp:38:kworker.0 00010000:00080000:0.0:1784938494.068555:0:26609:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@192.168.202.154@tcp recovering/t0 exp 0000000000000000 cur 760 last 0 00000020:00000080:0.0:1784938494.068601:0:26609:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x7b044d4128f9f020 00000004:00100000:0.0:1784938494.068619:0:26609:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784938494.068782:0:26609:0:(import.c:65:import_set_state_nolock()) ffff9f238dba1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784938494.068868:0:26609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:16388:x1871643350930816:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 347us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938494.068876:0:26609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 3 00010000:00080000:0.0:1784938494.069133:0:16388:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f238e0ee300 x1871643350930816/t0(0) o38->lustre-MDT0000-lwp-MDT0000@192.168.202.154@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938504 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784938494.069187:0:16388:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1784938494.069197:0:16388:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1784938494.069204:0:16388:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784938494.069207:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f238d120800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784938494.069217:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:16388:1871643350930816:192.168.202.154@tcp:38:kworker.0 00000100:00100000:3.0:1784938494.076602:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e07296-2a01-411c-abf2-6d190cb69ef0:16390:1871643350930048:0@lo:400:kworker.0 00000100:00100000:3.0:1784938494.120364:0:26643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34e40 going to sleep for 0 seconds 00010000:00010000:0.0:1784938494.891486:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938495.145399:0:26643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34e40 going to sleep for 0 seconds 00010000:00010000:0.0:1784938495.912302:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938496.168302:0:26643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34e40 going to sleep for 0 seconds 00010000:00010000:0.0:1784938496.937166:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1784938497.128240:0:16390:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938481/real 1784938481] req@ffff9f2388244700 x1871643350921856/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938497 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938497.128275:0:16390:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9f2388244700 x1871643350921856/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938497 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000400:1.0:1784938497.128285:0:16390:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938481/real 1784938481] req@ffff9f2388246300 x1871643350921984/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938497 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938497.128296:0:16390:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9f2388246300 x1871643350921984/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938497 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938497.128310:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:16390:1871643350921856:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938497.128315:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:16390:1871643350921984:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938497.192363:0:26643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34e40 going to sleep for 0 seconds 00000001:00100000:2.0:1784938497.710172:0:22178:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1784938497.710394:0:21144:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:02000400:3.0:1784938497.971291:0:26892:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1784938497.977509:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938498.216675:0:26643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34e40 going to sleep for 0 seconds 00010000:00010000:0.0:1784938498.991037:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1784938499.135337:0:26944:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784938499.135557:0:26944:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00000400:3.0:1784938499.176334:0:16392:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938483/real 1784938483] req@ffff9f2386362300 x1871643350922496/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938499 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938499.176367:0:16392:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9f2386362300 x1871643350922496/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938499 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938499.176388:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386362300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:16392:1871643350922496:192.168.202.154@tcp:400:kworker.0 00000100:00000400:3.0:1784938499.176703:0:16391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938483/real 1784938483] req@ffff9f2386363800 x1871643350922240/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938499 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938499.176722:0:16391:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9f2386363800 x1871643350922240/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938499 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938499.176735:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386363800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:16391:1871643350922240:192.168.202.154@tcp:400:kworker.0 00000100:00080000:3.0:1784938499.249587:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784938499.249597:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784938499.249599:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784938499.249603:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1784938499.249607:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f24b4115000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938499.249619:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 192.168.202.154@tcp last attempt 760 00000100:00080000:3.0:1784938499.249630:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784938499.249639:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9f24b4115000 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:3.0:1784938499.249665:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b6b8ea00 x1871643350931072/t0(0) o38->lustre-MDT0001-lwp-OST0000@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784938499.249688:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784938499.249691:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784938499.249695:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784938499.249697:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1784938499.249699:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f238ce54800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938499.249703:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 192.168.202.154@tcp last attempt 760 00000100:00080000:3.0:1784938499.249707:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784938499.249711:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9f238ce54800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:3.0:1784938499.249961:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b6b8f800 x1871643350931200/t0(0) o38->lustre-MDT0001-lwp-OST0001@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784938499.249974:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784938499.249977:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1784938499.249979:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f2387dd9800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938499.249983:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 192.168.202.154@tcp last attempt 760 00000100:00080000:3.0:1784938499.249987:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784938499.249991:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f2387dd9800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:3.0:1784938499.250004:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b6b8e300 x1871643350931328/t0(0) o38->lustre-MDT0001-osp-MDT0000@192.168.202.154@tcp:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784938499.250356:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350931584:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938499.250458:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938499.250465:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:16391:1871643350931712:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938499.250612:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e07296-2a01-411c-abf2-6d190cb69ef0:16389:1871643350930944:0@lo:400:kworker.0 00000100:00100000:2.0:1784938499.250666:0:16389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938499.250707:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350930944 00000100:00100000:2.0:1784938499.250714:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350930944 00000100:00100000:2.0:1784938499.250773:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784938499.250781:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238c300050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+19:16389:x1871643350930944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938499.250834:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238c300050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+19:16389:x1871643350930944:12345-0@lo:400:kworker.0 Request processed in 54us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938499.250842:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784938499.252604:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938499.252670:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938499.252708:0:25730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350931584 00000100:00100000:3.0:1784938499.252716:0:25730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350931584 00000100:00100000:3.0:1784938499.253295:0:25730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 95 00000100:00100000:3.0:1784938499.253307:0:25730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:16391:x1871643350931584:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938499.253375:0:25730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:16391:x1871643350931584:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 70us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938499.253382:0:25730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 95 00000100:00100000:3.0:1784938499.253424:0:26608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350931712 00000100:00100000:3.0:1784938499.253428:0:26608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350931712 00000100:00100000:3.0:1784938499.253455:0:26608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 0 00000100:00100000:3.0:1784938499.253462:0:26608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:16391:x1871643350931712:12345-192.168.202.154@tcp:400:kworker.0 00010000:00080000:3.0:1784938499.253473:0:26608:0:(ldlm_lib.c:3234:target_queue_recovery_request()) @@@ not queueing req@ffff9f24b6b8df80 x1871643350931712/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@192.168.202.154@tcp:730/0 lens 224/0 e 0 to 0 dl 1784938510 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938499.253514:0:26608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:16391:x1871643350931712:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 52us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938499.253521:0:26608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 0 00010000:00080000:3.0:1784938499.253674:0:16391:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f24b6b8c000 x1871643350931712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938499.253689:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:16391:1871643350931712:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938499.253703:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350931584:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938499.253768:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e07296-2a01-411c-abf2-6d190cb69ef0:16389:1871643350930944:0@lo:400:kworker.0 00000100:00100000:3.0:1784938499.253780:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784938499.253790:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350931456:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938499.253900:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938499.254225:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:16388:1871643350931072:192.168.202.154@tcp:38:kworker.0 00000100:00100000:0.0:1784938499.254271:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:16388:1871643350931200:192.168.202.154@tcp:38:kworker.0 00000100:00100000:0.0:1784938499.254295:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350931328:192.168.202.154@tcp:38:kworker.0 00000100:00100000:3.0:1784938499.254776:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938499.254799:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938499.254818:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938499.254847:0:26607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350931072 00000100:00100000:3.0:1784938499.254853:0:26607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350931072 00000100:00100000:3.0:1784938499.254886:0:26607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350931200 00000100:00100000:3.0:1784938499.254888:0:26607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350931200 00000100:00100000:3.0:1784938499.254902:0:26607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 4 00000100:00100000:0.0:1784938499.255373:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350931456 00000100:00100000:0.0:1784938499.255380:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350931456 00000100:00100000:3.0:1784938499.255433:0:26607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16388:x1871643350931072:12345-192.168.202.154@tcp:38:kworker.0 00010000:00020000:3.0:1784938499.255455:0:26607:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.154@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784938499.255511:0:26607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16388:x1871643350931072:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 78us (736us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784938499.255518:0:26607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 4 00000100:00100000:3.0:1784938499.255536:0:26607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 5 00000100:00100000:3.0:1784938499.255541:0:26607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16388:x1871643350931200:12345-192.168.202.154@tcp:38:kworker.0 00010000:00020000:3.0:1784938499.255550:0:26607:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.154@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784938499.255571:0:26607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16388:x1871643350931200:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 28us (771us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784938499.255577:0:26607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 5 00000100:00080000:3.0:1784938499.255717:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b4115000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784938499.255723:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.154@tcp failed (-19) 00000100:00100000:3.0:1784938499.255740:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:16388:1871643350931072:192.168.202.154@tcp:38:kworker.0 00000100:00080000:3.0:1784938499.255750:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f238ce54800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784938499.255754:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.154@tcp failed (-19) 00000100:00100000:3.0:1784938499.255757:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:16388:1871643350931200:192.168.202.154@tcp:38:kworker.0 00000100:00100000:1.0:1784938499.259186:0:26643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34e40 going to sleep for 0 seconds 00000100:00100000:1.0:1784938499.259225:0:21161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350931328 00000100:00100000:1.0:1784938499.259234:0:21161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350931328 00000100:00100000:1.0:1784938499.259288:0:21161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 95 00000100:00100000:1.0:1784938499.259294:0:21161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:16388:x1871643350931328:12345-192.168.202.154@tcp:38:kworker.0 00010000:00020000:1.0:1784938499.259317:0:21161:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.154@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784938499.259384:0:21161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:16388:x1871643350931328:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 87us (4563us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784938499.259390:0:21161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 95 00000100:00080000:1.0:1784938499.259610:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f2387dd9800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784938499.259616:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.154@tcp failed (-19) 00000100:00100000:1.0:1784938499.259620:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350931328:192.168.202.154@tcp:38:kworker.0 00000100:00080000:2.0:1784938499.260431:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784938499.260441:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784938499.269339:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 96 00000100:00100000:2.0:1784938499.269356:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:16389:x1871643350931456:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938499.269441:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:16389:x1871643350931456:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 89us (15540us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938499.269448:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 96 00000100:00100000:2.0:1784938499.274344:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350931456:192.168.202.154@tcp:400:kworker.0 00010000:00010000:0.0:1784938500.016450:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938500.271051:0:26643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34e40 going to sleep for 0 seconds 00000020:00000004:3.0:1784938500.412346:0:26994:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784938500.412786:0:26994:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784938501.032376:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938501.291523:0:26643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34e40 going to sleep for 0 seconds 00010000:00010000:0.0:1784938502.057440:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938502.320347:0:26643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34e40 going to sleep for 0 seconds 00010000:00010000:1.0:1784938503.081920:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938503.337990:0:26643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34e40 going to sleep for 0 seconds 00000100:00100000:2.0:1784938503.400354:0:16388:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938483/real 1784938483] req@ffff9f2386361f80 x1871643350922112/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 1 dl 1784938503 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938503.400394:0:16388:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f2386361f80 x1871643350922112/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 1 dl 1784938503 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938503.400413:0:16388:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938483/real 1784938483] req@ffff9f2386363b80 x1871643350922368/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 1 dl 1784938503 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938503.400425:0:16388:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f2386363b80 x1871643350922368/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 1 dl 1784938503 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784938503.400443:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b4116800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784938503.400466:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.154@tcp failed (-110) 00000100:00100000:2.0:1784938503.400470:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386361f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:16388:1871643350922112:192.168.202.154@tcp:38:kworker.0 00000100:00080000:2.0:1784938503.400476:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f2383aea800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784938503.400481:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.154@tcp failed (-110) 00000100:00100000:2.0:1784938503.400484:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386363b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:16388:1871643350922368:192.168.202.154@tcp:38:kworker.0 00000100:00080000:3.0:1784938503.400600:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784938503.400605:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784938503.400607:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f24b4116800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938503.400613:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 192.168.202.154@tcp last attempt 749 00000100:00080000:3.0:1784938503.400622:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1784938503.400628:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f24b4116800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:3.0:1784938503.400648:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b6b8ea00 x1871643350931968/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784938503.400661:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784938503.400664:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1784938503.400665:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f24b4115000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938503.400669:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 192.168.202.154@tcp last attempt 765 00000100:00080000:3.0:1784938503.400672:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1784938503.400675:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9f24b4115000 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:3.0:1784938503.400687:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b6b8d180 x1871643350932096/t0(0) o38->lustre-MDT0001-lwp-OST0000@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784938503.400695:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784938503.400698:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784938503.400699:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f2383aea800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938503.400702:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 192.168.202.154@tcp last attempt 749 00000100:00080000:3.0:1784938503.400705:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1784938503.400709:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f2383aea800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:3.0:1784938503.400719:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b6b8c380 x1871643350932224/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784938503.400728:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784938503.400731:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1784938503.400733:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f238ce54800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938503.400735:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 192.168.202.154@tcp last attempt 765 00000100:00080000:3.0:1784938503.400738:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1784938503.400741:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9f238ce54800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:3.0:1784938503.400751:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b6b8ed80 x1871643350932352/t0(0) o38->lustre-MDT0001-lwp-OST0001@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784938503.400759:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784938503.400762:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1784938503.400764:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f2387dd9800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938503.400767:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 192.168.202.154@tcp last attempt 765 00000100:00080000:3.0:1784938503.400770:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1784938503.400774:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f2387dd9800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:3.0:1784938503.400785:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b6b8d500 x1871643350932480/t0(0) o38->lustre-MDT0001-osp-MDT0000@192.168.202.154@tcp:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784938503.400845:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e07296-2a01-411c-abf2-6d190cb69ef0:16389:1871643350931840:0@lo:400:kworker.0 00000100:00100000:3.0:1784938503.400905:0:16389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938503.400949:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784938503.400956:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350932608:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938503.401015:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350932736:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938503.401046:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938503.401051:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:16391:1871643350932864:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938503.401263:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938503.401312:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938503.401333:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938503.401359:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350932736 00000100:00100000:3.0:1784938503.401366:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350932736 00000100:00100000:3.0:1784938503.401411:0:25720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350932608 00000100:00100000:3.0:1784938503.401414:0:25720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350932608 00000100:00100000:3.0:1784938503.401436:0:25720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 97 00000100:00100000:3.0:1784938503.401443:0:25720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:16391:x1871643350932736:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938503.401486:0:25720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:16391:x1871643350932736:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 43us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938503.401493:0:25720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 97 00000100:00100000:3.0:1784938503.401508:0:25720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 98 00000100:00100000:3.0:1784938503.401514:0:25720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:16389:x1871643350932608:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938503.401536:0:25720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:16389:x1871643350932608:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 22us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938503.401541:0:25720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 98 00000100:00100000:3.0:1784938503.401562:0:26607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350932864 00000100:00100000:3.0:1784938503.401566:0:26607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350932864 00000100:00100000:3.0:1784938503.401593:0:26607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 1 00000100:00100000:3.0:1784938503.401600:0:26607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:16391:x1871643350932864:12345-192.168.202.154@tcp:400:kworker.0 00010000:00080000:3.0:1784938503.401611:0:26607:0:(ldlm_lib.c:3234:target_queue_recovery_request()) @@@ not queueing req@ffff9f24b68a9880 x1871643350932864/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@192.168.202.154@tcp:734/0 lens 224/0 e 0 to 0 dl 1784938514 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938503.401642:0:26607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:16391:x1871643350932864:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 43us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938503.401648:0:26607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 1 00000100:00080000:3.0:1784938503.401662:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784938503.401666:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784938503.401678:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:16388:1871643350931968:192.168.202.154@tcp:38:kworker.0 00000100:00100000:3.0:1784938503.401707:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:16388:1871643350932096:192.168.202.154@tcp:38:kworker.0 00000100:00100000:3.0:1784938503.401729:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:16388:1871643350932224:192.168.202.154@tcp:38:kworker.0 00000100:00100000:3.0:1784938503.401759:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:16388:1871643350932352:192.168.202.154@tcp:38:kworker.0 00000100:00100000:3.0:1784938503.401779:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350932480:192.168.202.154@tcp:38:kworker.0 00000100:00100000:3.0:1784938503.401910:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938503.401966:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938503.402054:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938503.402074:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938503.402089:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938503.402102:0:26609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350932224 00000100:00100000:3.0:1784938503.402105:0:26609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350932224 00000100:00100000:3.0:1784938503.402118:0:26609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350931968 00000100:00100000:3.0:1784938503.402120:0:26609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350931968 00000100:00100000:3.0:1784938503.402126:0:26609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350932096 00000100:00100000:3.0:1784938503.402128:0:26609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350932096 00000100:00100000:3.0:1784938503.402135:0:26609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350932352 00000100:00100000:3.0:1784938503.402136:0:26609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350932352 00000100:00100000:3.0:1784938503.402166:0:26609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 6 00000100:00100000:3.0:1784938503.402170:0:26609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:16388:x1871643350932224:12345-192.168.202.154@tcp:38:kworker.0 00010000:00080000:3.0:1784938503.402193:0:26609:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@192.168.202.154@tcp recovering/t0 exp 0000000000000000 cur 769 last 0 00000020:00000080:3.0:1784938503.402226:0:26609:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x7b044d4128f9f027 00000004:00100000:3.0:1784938503.402238:0:26609:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784938503.402275:0:26609:0:(import.c:65:import_set_state_nolock()) ffff9f238d125000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784938503.402307:0:26609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:16388:x1871643350932224:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 135us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938503.402314:0:26609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 6 00000100:00100000:3.0:1784938503.402327:0:26609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 7 00000100:00100000:3.0:1784938503.402331:0:26609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:16388:x1871643350931968:12345-192.168.202.154@tcp:38:kworker.0 00010000:00080000:3.0:1784938503.402342:0:26609:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@192.168.202.154@tcp recovering/t0 exp 0000000000000000 cur 769 last 0 00000020:00000080:3.0:1784938503.402361:0:26609:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x7b044d4128f9f02e 00000004:00100000:3.0:1784938503.402367:0:26609:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784938503.402383:0:26609:0:(import.c:65:import_set_state_nolock()) ffff9f238d124000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784938503.402403:0:26609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:16388:x1871643350931968:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 71us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938503.402410:0:26609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 7 00000100:00100000:3.0:1784938503.402421:0:26609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 8 00000100:00100000:3.0:1784938503.402425:0:26609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:16388:x1871643350932096:12345-192.168.202.154@tcp:38:kworker.0 00010000:00020000:3.0:1784938503.402437:0:26609:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.154@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784938503.402457:0:26609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:16388:x1871643350932096:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 30us (382us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784938503.402462:0:26609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 8 00000100:00100000:3.0:1784938503.402473:0:26609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 9 00000100:00100000:3.0:1784938503.402477:0:26609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:16388:x1871643350932352:12345-192.168.202.154@tcp:38:kworker.0 00010000:00020000:3.0:1784938503.402486:0:26609:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.154@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784938503.402501:0:26609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:16388:x1871643350932352:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 23us (411us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784938503.402506:0:26609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 9 00000100:00100000:3.0:1784938503.402534:0:21160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350932480 00000100:00100000:3.0:1784938503.402538:0:21160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350932480 00000100:00100000:3.0:1784938503.402556:0:21160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 96 00000100:00100000:3.0:1784938503.402560:0:21160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:16388:x1871643350932480:12345-192.168.202.154@tcp:38:kworker.0 00010000:00020000:3.0:1784938503.402570:0:21160:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.154@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784938503.402589:0:21160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:16388:x1871643350932480:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 27us (623us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784938503.402595:0:21160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 96 00010000:00080000:3.0:1784938503.402630:0:16391:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f24b68ab800 x1871643350932864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938503.402644:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:16391:1871643350932864:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938503.402656:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350932736:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938503.402697:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350932608:192.168.202.154@tcp:400:kworker.0 00010000:00080000:3.0:1784938503.402869:0:16388:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f24b6b8ea00 x1871643350931968/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.202.154@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784938503.402880:0:16388:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1784938503.403754:0:16388:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9f24b6b8ea00 x1871643350931968/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.202.154@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938528 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784938503.403770:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b4116800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1784938503.403774:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b4116800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1784938503.403778:0:16388:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 192.168.202.154@tcp (at 192.168.202.154@tcp) 00000100:00100000:0.0:1784938503.404349:0:26598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350931840 00000100:00100000:0.0:1784938503.404356:0:26598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350931840 00000100:00100000:0.0:1784938503.404412:0:26598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784938503.404421:0:26598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3720450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+19:16389:x1871643350931840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938503.404488:0:26598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3720450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+19:16389:x1871643350931840:12345-0@lo:400:kworker.0 Request processed in 68us (3582us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938503.404495:0:26598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784938503.404556:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e07296-2a01-411c-abf2-6d190cb69ef0:16389:1871643350931840:0@lo:400:kworker.0 00000100:00100000:3.0:1784938503.413237:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:16388:1871643350931968:192.168.202.154@tcp:38:kworker.0 00000100:00080000:3.0:1784938503.413279:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b4115000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784938503.413284:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.154@tcp failed (-19) 00000100:00100000:3.0:1784938503.413288:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:16388:1871643350932096:192.168.202.154@tcp:38:kworker.0 00010000:00080000:3.0:1784938503.413305:0:16388:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f24b6b8c380 x1871643350932224/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.202.154@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784938503.413320:0:16388:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1784938503.418928:0:16388:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9f24b6b8c380 x1871643350932224/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.202.154@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938528 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784938503.418944:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f2383aea800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1784938503.418949:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f2383aea800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1784938503.418955:0:16388:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 192.168.202.154@tcp (at 192.168.202.154@tcp) 00000100:00100000:3.0:1784938503.418962:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:16388:1871643350932224:192.168.202.154@tcp:38:kworker.0 00000100:00080000:3.0:1784938503.419001:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f238ce54800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784938503.419007:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.154@tcp failed (-19) 00000100:00100000:3.0:1784938503.419011:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:16388:1871643350932352:192.168.202.154@tcp:38:kworker.0 00000100:00080000:3.0:1784938503.419024:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f2387dd9800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784938503.419028:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.154@tcp failed (-19) 00000100:00100000:3.0:1784938503.419032:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350932480:192.168.202.154@tcp:38:kworker.0 00010000:00010000:0.0:1784938504.106476:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938504.366391:0:26643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34e40 going to sleep for 0 seconds 00010000:00010000:2.0:1784938505.130748:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938505.389044:0:26643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34e40 going to sleep for 0 seconds 00010000:00010000:0.0:1784938506.156860:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938506.411021:0:26643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34e40 going to sleep for 0 seconds 00010000:00010000:0.0:1784938507.176662:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938507.438673:0:26643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34e40 going to sleep for 0 seconds 00010000:00010000:1.0:1784938508.200606:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784938508.458447:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784938508.458457:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1784938508.458461:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f24b4115000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938508.458474:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 192.168.202.154@tcp last attempt 769 00000100:00080000:3.0:1784938508.458485:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784938508.458495:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9f24b4115000 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:1.0:1784938508.458747:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e07296-2a01-411c-abf2-6d190cb69ef0:16389:1871643350932992:0@lo:400:kworker.0 00000100:00100000:1.0:1784938508.458874:0:16389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938508.458947:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938508.458954:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:16389:1871643350933120:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938508.459038:0:26600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350932992 00000100:00100000:1.0:1784938508.459048:0:26600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350932992 00000100:00100000:1.0:1784938508.459107:0:26600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784938508.459118:0:26600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2383a12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+19:16389:x1871643350932992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784938508.459319:0:26600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2383a12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+19:16389:x1871643350932992:12345-0@lo:400:kworker.0 Request processed in 202us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938508.459328:0:26600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784938508.459731:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938508.459777:0:26609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350933120 00000100:00100000:1.0:1784938508.459782:0:26609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350933120 00000100:00100000:3.0:1784938508.459928:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b68abb80 x1871643350933248/t0(0) o38->lustre-MDT0001-lwp-OST0000@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784938508.459974:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784938508.459978:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1784938508.459981:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f238ce54800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938508.459986:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 192.168.202.154@tcp last attempt 769 00000100:00080000:3.0:1784938508.459992:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784938508.459997:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9f238ce54800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:3.0:1784938508.460011:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b68aa300 x1871643350933504/t0(0) o38->lustre-MDT0001-lwp-OST0001@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784938508.460019:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784938508.460023:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1784938508.460025:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f2387dd9800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938508.460029:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 192.168.202.154@tcp last attempt 769 00000100:00080000:3.0:1784938508.460032:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784938508.460036:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f2387dd9800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:3.0:1784938508.460050:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b6b8d500 x1871643350933632/t0(0) o38->lustre-MDT0001-osp-MDT0000@192.168.202.154@tcp:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784938508.460102:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:16388:1871643350933248:192.168.202.154@tcp:38:kworker.0 00000100:00100000:3.0:1784938508.460182:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:16388:1871643350933504:192.168.202.154@tcp:38:kworker.0 00000100:00100000:3.0:1784938508.460217:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350933632:192.168.202.154@tcp:38:kworker.0 00000100:00100000:3.0:1784938508.460259:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:16391:1871643350933376:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938508.460288:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938508.460295:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350933760:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938508.460455:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938508.460531:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938508.460564:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938508.460589:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938508.460631:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938508.460655:0:26608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350933504 00000100:00100000:3.0:1784938508.460660:0:26608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350933504 00000100:00100000:3.0:1784938508.460684:0:26608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350933248 00000100:00100000:3.0:1784938508.460687:0:26608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350933248 00000100:00100000:3.0:1784938508.460696:0:26608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350933376 00000100:00100000:3.0:1784938508.460698:0:26608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350933376 00000100:00100000:3.0:1784938508.460720:0:26608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 2 00000100:00100000:3.0:1784938508.460727:0:26608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:16391:x1871643350933376:12345-192.168.202.154@tcp:400:kworker.0 00010000:00080000:3.0:1784938508.460742:0:26608:0:(ldlm_lib.c:3234:target_queue_recovery_request()) @@@ not queueing req@ffff9f24b6b8e300 x1871643350933376/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@192.168.202.154@tcp:739/0 lens 224/0 e 0 to 0 dl 1784938519 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938508.460780:0:26608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:16391:x1871643350933376:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 53us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938508.460787:0:26608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 2 00000100:00100000:1.0:1784938508.461464:0:26609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 3 00000100:00100000:1.0:1784938508.461475:0:26609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:16389:x1871643350933120:12345-192.168.202.154@tcp:400:kworker.0 00010000:00080000:1.0:1784938508.461487:0:26609:0:(ldlm_lib.c:3234:target_queue_recovery_request()) @@@ not queueing req@ffff9f238e0eea00 x1871643350933120/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@192.168.202.154@tcp:739/0 lens 224/0 e 0 to 0 dl 1784938519 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938508.461910:0:26609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:16389:x1871643350933120:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 434us (2179us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938508.461919:0:26609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 3 00000100:00100000:1.0:1784938508.461941:0:26609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 10 00000100:00100000:1.0:1784938508.461946:0:26609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:16388:x1871643350933504:12345-192.168.202.154@tcp:38:kworker.0 00010000:00020000:1.0:1784938508.461972:0:26609:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.154@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784938508.462381:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:16390:1871643350934016:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938508.462447:0:16390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784938508.462454:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350933888:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938508.466758:0:25721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350933760 00000100:00100000:3.0:1784938508.466780:0:25721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350933760 00000100:00100000:2.0:1784938508.467556:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e07296-2a01-411c-abf2-6d190cb69ef0:16389:1871643350932992:0@lo:400:kworker.0 00000100:00100000:0.0:1784938508.467945:0:26643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34e40 going to sleep for 0 seconds 00000100:00100000:3.0:1784938508.468974:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 99 00000100:00100000:3.0:1784938508.469000:0:25721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:16391:x1871643350933760:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938508.469131:0:25721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:16391:x1871643350933760:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 143us (8499us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938508.469141:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 99 00000100:00080000:2.0:1784938508.470056:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938508.475355:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938508.475428:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938508.475508:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350933760:192.168.202.154@tcp:400:kworker.0 00010000:00080000:3.0:1784938508.475530:0:16391:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f24b68aa680 x1871643350933376/t0(0) o400->lustre-MDT0000-lwp-OST0001@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938508.475543:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:16391:1871643350933376:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938508.475594:0:26608:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1784938508.475604:0:26608:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:2.0:1784938508.490881:0:16389:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f24b68a8a80 x1871643350933120/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938508.490908:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:16389:1871643350933120:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938508.493138:0:26608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350934016 00000100:00100000:0.0:1784938508.493171:0:26608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350934016 00000100:00100000:0.0:1784938508.493252:0:26608:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1784938508.493274:0:26608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 4 00000100:00100000:0.0:1784938508.493288:0:26608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:16390:x1871643350934016:12345-192.168.202.154@tcp:400:kworker.0 00010000:00080000:0.0:1784938508.493312:0:26608:0:(ldlm_lib.c:3234:target_queue_recovery_request()) @@@ not queueing req@ffff9f238f22ea00 x1871643350934016/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@192.168.202.154@tcp:739/0 lens 224/0 e 0 to 0 dl 1784938519 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938508.493490:0:26608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:16390:x1871643350934016:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 205us (18060us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938508.493654:0:26608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 4 00010000:00080000:2.0:1784938508.494941:0:16390:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f24b6b8d180 x1871643350934016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938508.494965:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:16390:1871643350934016:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938508.495687:0:25714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350933632 00000100:00100000:0.0:1784938508.495697:0:25714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350933632 00000100:00100000:0.0:1784938508.495750:0:25714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 97 00000100:00100000:0.0:1784938508.495760:0:25714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:16388:x1871643350933632:12345-192.168.202.154@tcp:38:kworker.0 00010000:00020000:0.0:1784938508.498445:0:25714:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.154@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784938508.498602:0:25714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:16388:x1871643350933632:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 2836us (38031us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784938508.498619:0:25714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 97 00000100:00100000:0.0:1784938508.499237:0:25723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350933888 00000100:00100000:0.0:1784938508.499250:0:25723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350933888 00000100:00100000:0.0:1784938508.499335:0:25723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 100 00000100:00100000:0.0:1784938508.499347:0:25723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:16390:x1871643350933888:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938508.499413:0:25723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:16390:x1871643350933888:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 68us (24075us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938508.499420:0:25723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 100 00000100:00080000:2.0:1784938508.499567:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784938508.504721:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f2387dd9800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784938508.504745:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.154@tcp failed (-19) 00000100:00100000:3.0:1784938508.504751:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350933632:192.168.202.154@tcp:38:kworker.0 00000100:00100000:2.0:1784938508.504970:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350933888:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938508.505049:0:27313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 11 00000100:00100000:3.0:1784938508.505061:0:27313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:16388:x1871643350933248:12345-192.168.202.154@tcp:38:kworker.0 00010000:00020000:3.0:1784938508.505091:0:27313:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.154@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784938508.505202:0:27313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:16388:x1871643350933248:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 140us (44670us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784938508.505211:0:27313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 11 00000100:00080000:3.0:1784938508.505390:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b4115000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784938508.505395:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.154@tcp failed (-19) 00000100:00100000:3.0:1784938508.505399:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:16388:1871643350933248:192.168.202.154@tcp:38:kworker.0 00000100:00100000:1.0:1784938508.516902:0:26609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:16388:x1871643350933504:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 54936us (56430us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784938508.516924:0:26609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 10 00000100:00080000:1.0:1784938508.517271:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f238ce54800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784938508.517278:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.154@tcp failed (-19) 00000100:00100000:1.0:1784938508.517283:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:16388:1871643350933504:192.168.202.154@tcp:38:kworker.0 00010000:00010000:2.0:1784938509.231710:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784938509.282939:0:27340:0:(obd_mount.c:919:lmd_print()) mount data: 00000020:01000004:3.0:1784938509.282945:0:27340:0:(obd_mount.c:922:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1784938509.282947:0:27340:0:(obd_mount.c:925:lmd_print()) options: user_xattr,errors=remount-ro,user_xattr 00000080:01200004:3.0:1784938509.283086:0:27340:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9f2489215800 00000020:01000004:3.0:1784938509.283114:0:27340:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1784938509.283134:0:27340:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1784938509.283200:0:27340:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9f238c830000) 00000020:00000080:3.0:1784938509.283229:0:27340:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1784938509.432867:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1784938509.434355:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1784938509.443631:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1784938509.443896:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1784938509.444203:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1784938509.444608:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1784938509.445621:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1784938509.449596:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1784938509.451644:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1784938509.452398:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1784938509.453142:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1784938509.453930:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1784938509.454957:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1784938509.455360:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1784938509.456417:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1784938509.462200:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1784938509.463377:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1784938509.463972:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1784938509.464837:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1784938509.465236:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1784938509.465844:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1784938509.466399:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1784938509.469714:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1784938509.470738:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1784938509.473075:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1784938509.474878:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1784938509.476043:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1784938509.476891:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1784938509.478706:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00000100:00100000:0.0:1784938509.480416:0:26643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34e40 going to sleep for 0 seconds 00100000:10000000:2.0:1784938509.481569:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1784938509.483571:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1784938509.485129:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1784938509.486086:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1784938509.486686:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1784938509.487944:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1784938509.488493:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1784938509.489474:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1784938509.490311:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1784938509.490834:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1784938509.491739:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1784938509.492325:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1784938509.492711:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1784938509.492900:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1784938509.493325:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1784938509.493689:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1784938509.493891:0:27340:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00080000:01000000:2.0:1784938509.502102:0:27340:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1784938509.502619:0:27340:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1784938509.502635:0:27340:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784938509.502653:0:27340:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7b044d4128f9f03c 00000020:01000004:2.0:1784938509.502662:0:27340:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1784938509.502701:0:27340:0:(obd_mount.c:406:lustre_start_mgc()) MGC192.168.202.154@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784938509.502705:0:27340:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784938509.502712:0:27340:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1784938509.502752:0:27340:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1784938509.502758:0:27340:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.154@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1784938509.530986:0:27340:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.154@tcp ctxt 0 is initialized 00000020:01000004:1.0:1784938509.531079:0:27340:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.154@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1784938509.531086:0:27340:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1784938509.531088:0:27340:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1784938509.531090:0:27340:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938509.531091:0:27340:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938509.531093:0:27340:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938509.531095:0:27340:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938509.531097:0:27340:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784938509.531099:0:27340:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938509.531102:0:27340:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784938509.531107:0:27340:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1784938509.531110:0:27340:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784938509.531112:0:27340:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1784938509.531113:0:27340:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938509.531114:0:27340:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938509.531115:0:27340:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938509.531116:0:27340:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938509.531118:0:27340:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784938509.531119:0:27340:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938509.531120:0:27340:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784938509.531197:0:27340:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1784938509.531226:0:27340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350934144:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784938509.531332:0:27340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938509.531403:0:27340:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828ce0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938509.531843:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350934144 00000100:00100000:0.0:1784938509.531853:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350934144 00000100:00100000:0.0:1784938509.531933:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784938509.531946:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2383a10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+19:27340:x1871643350934144:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784938509.531991:0:26601:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1784938509.531995:0:26601:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1784938509.532009:0:26601:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1784938509.532763:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2383a10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+19:27340:x1871643350934144:12345-0@lo:253:mount.lustre.0 Request processed in 815us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938509.532777:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784938509.533053:0:27340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350934144:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784938509.533069:0:27340:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1784938509.533072:0:27340:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784938509.533074:0:27340:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1784938509.533075:0:27340:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938509.533076:0:27340:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938509.533078:0:27340:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938509.533079:0:27340:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938509.533081:0:27340:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784938509.533083:0:27340:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938509.533084:0:27340:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1784938509.533115:0:27340:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f2489215800 from lustre-MDT0001 10000000:01000000:1.0:1784938509.533185:0:27340:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1784938509.533189:0:27340:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1784938509.533201:0:27340:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f24b17699c0 local copy 00010000:00010000:1.0:1784938509.533215:0:27340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24827c6200/0x7b044d4128f9f012 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f019 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938509.533624:0:27340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350934272:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938509.533676:0:27340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938509.533731:0:27340:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828cec00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938509.533879:0:26598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350934272 00000100:00100000:0.0:1784938509.533888:0:26598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350934272 00000100:00100000:0.0:1784938509.533948:0:26598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784938509.533960:0:26598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24892f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+19:27340:x1871643350934272:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784938509.534073:0:26598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24892f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+19:27340:x1871643350934272:12345-0@lo:501:mount.lustre.0 Request processed in 115us (396us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784938509.534081:0:26598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784938509.534400:0:27340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350934272:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1784938509.534418:0:27340:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1784938509.534438:0:27340:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1784938509.534447:0:27340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24827c6200/0x7b044d4128f9f012 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f019 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938509.534457:0:27340:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f24827c6200/0x7b044d4128f9f012 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f019 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938509.534491:0:27340:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f2489215800 10000000:01000000:1.0:1784938509.534497:0:27340:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784938509.536046:0:27340:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9f2489215800 10000000:01000000:1.0:1784938509.536059:0:27340:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1784938509.536065:0:27340:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9f2489215800 from 1 10000000:01000000:1.0:1784938509.536068:0:27340:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1784938509.536121:0:27340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24827c6600/0x7b044d4128f9f043 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938509.536135:0:27340:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f24827c6600/0x7b044d4128f9f043 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938509.536172:0:27340:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f24827c6600/0x7b044d4128f9f043 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938509.536204:0:27340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350934400:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784938509.536480:0:27340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938509.536598:0:27340:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828cec00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938509.538599:0:26600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350934400 00000100:00100000:3.0:1784938509.538623:0:26600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350934400 00000100:00100000:3.0:1784938509.538758:0:26600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784938509.538771:0:26600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b1497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+19:27340:x1871643350934400:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938509.538803:0:26600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938509.538830:0:26600:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f238217d400/0x7b044d4128f9f04a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9f043 expref: -99 pid: 26600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.538871:0:26600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f238217d400/0x7b044d4128f9f04a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9f043 expref: 20 pid: 26600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.538887:0:26600:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f238217d400/0x7b044d4128f9f04a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9f043 expref: 20 pid: 26600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.538899:0:26600:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217d400, rc 0) 00000100:00100000:3.0:1784938509.539116:0:26600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b1497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+20:27340:x1871643350934400:12345-0@lo:101:mount.lustre.0 Request processed in 346us (2635us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938509.539125:0:26600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784938509.539609:0:27340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350934400:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938509.539638:0:27340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f24827c6600/0x7b044d4128f9f043 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f04a expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938509.539649:0:27340:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f24827c6600/0x7b044d4128f9f043 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9f04a expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938509.539673:0:27340:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1784938509.539684:0:27340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24827c6600/0x7b044d4128f9f043 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f04a expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938509.539692:0:27340:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f24827c6600/0x7b044d4128f9f043 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f04a expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938509.539702:0:27340:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1784938509.539709:0:27340:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784938509.539716:0:27340:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9f2489215800 10000000:01000000:1.0:1784938509.539719:0:27340:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1784938509.539723:0:27340:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1784938509.539726:0:27340:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1784938509.539760:0:27340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24827c6a00/0x7b044d4128f9f051 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938509.539769:0:27340:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f24827c6a00/0x7b044d4128f9f051 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938509.539779:0:27340:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f24827c6a00/0x7b044d4128f9f051 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938509.539839:0:27340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350934528:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784938509.539884:0:27340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938509.540018:0:27340:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828cec00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938509.540470:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350934528 00000100:00100000:2.0:1784938509.540479:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350934528 00000100:00100000:3.0:1784938509.540718:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784938509.540729:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b1495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+20:27340:x1871643350934528:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938509.540743:0:26601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938509.540760:0:26601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f238217c600/0x7b044d4128f9f058 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9f051 expref: -99 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.540793:0:26601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f238217c600/0x7b044d4128f9f058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9f051 expref: 21 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.540811:0:26601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f238217c600/0x7b044d4128f9f058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9f051 expref: 21 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.540821:0:26601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217c600, rc 0) 00000100:00100000:3.0:1784938509.540881:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b1495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+21:27340:x1871643350934528:12345-0@lo:101:mount.lustre.0 Request processed in 153us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938509.540888:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784938509.540966:0:27340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350934528:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938509.540980:0:27340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f24827c6a00/0x7b044d4128f9f051 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f058 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938509.540990:0:27340:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f24827c6a00/0x7b044d4128f9f051 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9f058 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784938509.543123:0:27340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:0.0:1784938509.545130:0:27340:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784938509.546875:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1784938509.546929:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:0.0:1784938509.546946:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:0.0:1784938509.546960:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:0.0:1784938509.546976:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:0.0:1784938509.546989:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:0.0:1784938509.547003:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:0.0:1784938509.547018:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:0.0:1784938509.547033:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:0.0:1784938509.547047:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:0.0:1784938509.547061:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:0.0:1784938509.547075:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:0.0:1784938509.547088:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:0.0:1784938509.547101:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:0.0:1784938509.547113:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:0.0:1784938509.547125:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:0.0:1784938509.547139:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:0.0:1784938509.547192:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:0.0:1784938509.547209:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:0.0:1784938509.547292:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:0.0:1784938509.547312:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:0.0:1784938509.547329:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:0.0:1784938509.547342:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:0.0:1784938509.547366:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:0.0:1784938509.547381:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:0.0:1784938509.547393:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:0.0:1784938509.547406:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:0.0:1784938509.547419:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:0.0:1784938509.547432:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:0.0:1784938509.547446:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:0.0:1784938509.547460:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:0.0:1784938509.547472:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:0.0:1784938509.547487:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:0.0:1784938509.547507:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:0.0:1784938509.547526:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:0.0:1784938509.547542:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:0.0:1784938509.547557:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:0.0:1784938509.547587:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:0.0:1784938509.547602:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:0.0:1784938509.547617:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:0.0:1784938509.547632:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:0.0:1784938509.547647:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:0.0:1784938509.547661:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:0.0:1784938509.547676:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:0.0:1784938509.547704:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:0.0:1784938509.547710:0:27340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:0.0:1784938509.547882:0:27340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350934656:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784938509.547986:0:27340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938509.548053:0:27340:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238cd3f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938509.548446:0:26600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350934656 00000100:00100000:3.0:1784938509.548456:0:26600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350934656 00000100:00100000:3.0:1784938509.548532:0:26600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784938509.548543:0:26600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b1496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+21:27340:x1871643350934656:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938509.548748:0:26600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b1496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+21:27340:x1871643350934656:12345-0@lo:501:mount.lustre.0 Request processed in 206us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938509.548758:0:26600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784938509.548965:0:27340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350934656:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938509.549019:0:27340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350934784:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784938509.549083:0:27340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938509.549107:0:27340:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828ce600 going to sleep for 11 seconds 00000100:00100000:3.0:1784938509.549174:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350934784 00000100:00100000:3.0:1784938509.549178:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350934784 00000100:00100000:3.0:1784938509.549209:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784938509.549217:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b1497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+21:27340:x1871643350934784:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784938509.552917:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b1497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+21:27340:x1871643350934784:12345-0@lo:503:mount.lustre.0 Request processed in 3682us (3816us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938509.552939:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784938509.553099:0:27340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350934784:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784938509.553931:0:27340:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784938509.554054:0:27340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350934912:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938509.554131:0:27340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938509.554211:0:27340:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24831dd540 going to sleep for 11 seconds 00000100:00100000:3.0:1784938509.554360:0:26600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350934912 00000100:00100000:3.0:1784938509.554368:0:26600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350934912 00000100:00100000:3.0:1784938509.554423:0:26600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784938509.554434:0:26600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2498336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+21:27340:x1871643350934912:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784938509.555609:0:26600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2498336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+21:27340:x1871643350934912:12345-0@lo:502:mount.lustre.0 Request processed in 1170us (1472us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938509.555623:0:26600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784938509.555838:0:27340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350934912:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784938509.556178:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1784938509.556854:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:1.0:1784938509.556888:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:1.0:1784938509.556906:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:1.0:1784938509.556929:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:1.0:1784938509.556946:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:1.0:1784938509.556961:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:1.0:1784938509.556976:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:1.0:1784938509.556990:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:1.0:1784938509.557003:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:1.0:1784938509.557015:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:1.0:1784938509.557028:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:1.0:1784938509.557043:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:1.0:1784938509.557060:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:1.0:1784938509.557076:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:1.0:1784938509.557088:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:1.0:1784938509.557098:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:1.0:1784938509.557109:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:1.0:1784938509.557122:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:1.0:1784938509.557134:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:1.0:1784938509.557178:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:1.0:1784938509.557194:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:1.0:1784938509.557205:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:1.0:1784938509.557229:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:1.0:1784938509.557248:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:1.0:1784938509.557261:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:1.0:1784938509.557275:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:1.0:1784938509.557289:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:1.0:1784938509.557306:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:1.0:1784938509.557322:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:1.0:1784938509.557338:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:1.0:1784938509.557362:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:1.0:1784938509.557377:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:1.0:1784938509.557390:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:1.0:1784938509.557405:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:1.0:1784938509.557420:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:1.0:1784938509.557434:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:1.0:1784938509.557450:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:1.0:1784938509.557464:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:1.0:1784938509.557479:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:1.0:1784938509.557492:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:1.0:1784938509.557699:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:1.0:1784938509.557722:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:1.0:1784938509.557737:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:1.0:1784938509.557805:0:27340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350935040:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938509.557910:0:27340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938509.557975:0:27340:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24831dd540 going to sleep for 11 seconds 00000100:00100000:3.0:1784938509.558479:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350935040 00000100:00100000:3.0:1784938509.558491:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350935040 00000100:00100000:3.0:1784938509.558641:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784938509.558653:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2498334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+21:27340:x1871643350935040:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784938509.558837:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2498334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+21:27340:x1871643350935040:12345-0@lo:502:mount.lustre.0 Request processed in 184us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938509.558846:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784938509.559054:0:27340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350935040:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784938509.559132:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:1.0:1784938509.559338:0:27340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1784938509.560730:0:27344:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938509.560747:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938509.560751:0:27344:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1784938509.560758:0:27344:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1784938509.560761:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784938509.560780:0:27344:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9f238c833380) 00000020:00000080:3.0:1784938509.560825:0:27344:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1784938509.560833:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1784938509.560938:0:27344:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784938509.560946:0:27344:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7b044d4128f9f066 00000020:00000080:3.0:1784938509.561857:0:27344:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1784938509.561864:0:27344:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938509.561869:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938509.561871:0:27344:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1784938509.561874:0:27344:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938509.561878:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938509.561879:0:27344:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1784938509.561883:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784938509.561911:0:27344:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9f2389c619c0) 00000020:00000080:3.0:1784938509.561932:0:27344:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1784938509.561937:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1784938509.561939:0:27344:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1784938509.561945:0:27344:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1784938509.561953:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784938509.563344:0:27344:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f2489215800 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1784938509.563436:0:27344:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9f2389c63380) 00000020:00000080:3.0:1784938509.563459:0:27344:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1784938509.564260:0:27344:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1784938509.564274:0:27344:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7b044d4128f9f07b 00000020:00000080:3.0:1784938509.564494:0:27344:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1784938509.564634:0:27344:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1784938509.564642:0:27344:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x7b044d4128f9f082 00080000:01000000:3.0:1784938509.564653:0:27344:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:3.0:1784938509.564658:0:27344:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7b044d4128f9f089 00010000:00010000:0.0:1784938509.712960:0:27344:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-4 is initialized 00000001:00000004:0.0:1784938509.713853:0:27344:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934850 00000001:00080000:0.0:1784938509.714426:0:27344:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1784938509.715947:0:27344:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1784938509.715968:0:27344:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938509.715978:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938509.715980:0:27344:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1784938509.715984:0:27344:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938509.715991:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938509.715992:0:27344:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1784938509.715996:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784938509.716004:0:27344:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.154@tcp to nid 0x20000c0a8ca9a (192.168.202.154@tcp) 00000020:00000080:0.0:1784938509.716051:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784938509.716074:0:27344:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9f24b1768000) 00000020:00000080:0.0:1784938509.716110:0:27344:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1784938509.716116:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784938509.716338:0:27344:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1784938509.716355:0:27344:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:0.0:1784938509.716365:0:27344:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7b044d4128f9f097 00010000:00080000:0.0:1784938509.716411:0:27344:0:(ldlm_lib.c:125:import_set_conn()) imp ffff9f24b4113800@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.154@tcp at head 00010000:00010000:2.0:1784938509.728655:0:27344:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-9 is initialized 00000020:00000080:0.0:1784938509.731018:0:27344:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784938509.731458:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1784938509.731592:0:27344:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1784938509.731634:0:27344:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7b044d4128f9f09e 00000100:00080000:0.0:1784938509.731652:0:27344:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 192.168.202.154@tcp last attempt 0 00000100:00080000:0.0:1784938509.731665:0:27344:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9f24b4113800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:0.0:1784938509.731714:0:27344:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f2386361880 x1871643350935168/t0(0) o38->lustre-MDT0000-osp-MDT0001@192.168.202.154@tcp:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784938509.731802:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:16388:1871643350935168:192.168.202.154@tcp:38:llog_process_th.0 00000100:00080000:0.0:1784938509.732970:0:27344:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1784938509.733076:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784938509.733082:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1784938509.733085:0:38:0:(import.c:65:import_set_state_nolock()) ffff9f24b4115000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784938509.733094:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 192.168.202.154@tcp last attempt 774 00000100:00080000:0.0:1784938509.733103:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784938509.733110:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9f24b4115000 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:0.0:1784938509.733130:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f2386361f80 x1871643350935424/t0(0) o38->lustre-MDT0001-lwp-OST0000@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784938509.735597:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784938509.735638:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386363b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:16392:1871643350935296:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938509.738570:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938509.738685:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938509.738743:0:21161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350935168 00000100:00100000:3.0:1784938509.738755:0:21161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350935168 00000100:00100000:3.0:1784938509.738828:0:21161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 98 00000100:00100000:3.0:1784938509.738838:0:21161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:16388:x1871643350935168:12345-192.168.202.154@tcp:38:llog_process_th.0 00010000:00080000:3.0:1784938509.738883:0:21161:0:(ldlm_lib.c:961:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9f238f34d000, cookie 0x7b044d4128f9eefa 00000100:00100000:3.0:1784938509.738960:0:21161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:16388:x1871643350935168:12345-192.168.202.154@tcp:38:llog_process_th.0 Request processed in 119us (405us total) trans 0 rc -114/-114 00000100:00100000:3.0:1784938509.738969:0:21161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 98 00000100:00100000:3.0:1784938509.738999:0:26608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350935296 00000100:00100000:3.0:1784938509.739003:0:26608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350935296 00000100:00100000:3.0:1784938509.739053:0:26608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 5 00000100:00100000:3.0:1784938509.739061:0:26608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:16392:x1871643350935296:12345-192.168.202.154@tcp:400:kworker.0 00010000:00080000:3.0:1784938509.739081:0:26608:0:(ldlm_lib.c:3234:target_queue_recovery_request()) @@@ not queueing req@ffff9f238f22df80 x1871643350935296/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@192.168.202.154@tcp:740/0 lens 224/0 e 0 to 0 dl 1784938520 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938509.739122:0:26608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:16392:x1871643350935296:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 61us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938509.739129:0:26608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 5 00000100:00100000:1.0:1784938509.739580:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386361f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:16388:1871643350935424:192.168.202.154@tcp:38:kworker.0 00000100:00100000:2.0:1784938509.740003:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00080000:0.0:1784938509.740196:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784938509.740202:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1784938509.740206:0:38:0:(import.c:65:import_set_state_nolock()) ffff9f238ce54800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784938509.740213:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 192.168.202.154@tcp last attempt 774 00000100:00080000:0.0:1784938509.740232:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784938509.740239:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9f238ce54800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:0.0:1784938509.740265:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f2386362300 x1871643350935680/t0(0) o38->lustre-MDT0001-lwp-OST0001@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784938509.740278:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1784938509.740282:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1784938509.740284:0:38:0:(import.c:65:import_set_state_nolock()) ffff9f2387dd9800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784938509.740288:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 192.168.202.154@tcp last attempt 774 00000100:00080000:0.0:1784938509.740291:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784938509.740295:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f2387dd9800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:0.0:1784938509.740311:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b68c2680 x1871643350935808/t0(0) o38->lustre-MDT0001-osp-MDT0000@192.168.202.154@tcp:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:01000000:0.0:1784938509.740494:0:27344:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938509.740512:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938509.740515:0:27344:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1784938509.740519:0:27344:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784938509.740522:0:27344:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1784938509.740524:0:27344:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784938509.740525:0:27344:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784938509.740527:0:27344:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784938509.740531:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938509.740532:0:27344:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784938509.740535:0:27344:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938509.740543:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938509.740544:0:27344:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1784938509.740549:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1784938509.740627:0:27344:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1784938509.740642:0:27344:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938509.740646:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938509.740647:0:27344:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1784938509.740650:0:27344:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784938509.740653:0:27344:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1784938509.740654:0:27344:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784938509.740655:0:27344:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784938509.740657:0:27344:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784938509.740659:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938509.740661:0:27344:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784938509.740663:0:27344:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784938509.740667:0:27344:0:(obd_mount.c:957:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1784938509.740671:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938509.740672:0:27344:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1784938509.740675:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784938509.740680:0:27344:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.154@tcp to nid 0x20000c0a8ca9a (192.168.202.154@tcp) 00000020:01000000:0.0:1784938509.740702:0:27344:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1784938509.740706:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784938509.740727:0:27344:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9f24b176b380) 00000020:00000080:0.0:1784938509.740758:0:27344:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1784938509.740765:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784938509.740888:0:27344:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1784938509.740896:0:27344:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:0.0:1784938509.740904:0:27344:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7b044d4128f9f0ac 00010000:00080000:0.0:1784938509.740943:0:27344:0:(ldlm_lib.c:125:import_set_conn()) imp ffff9f24b36a1800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.154@tcp at head 00010000:00010000:0.0:1784938509.741697:0:27344:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-10 is initialized 00000100:00100000:2.0:1784938509.742479:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350935936:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938509.742607:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784938509.742616:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350936064:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938509.742669:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:16391:1871643350936192:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938509.742701:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938509.742710:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386363800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:16391:1871643350935552:192.168.202.154@tcp:400:kworker.0 00010000:00080000:3.0:1784938509.746315:0:16392:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f2386363b80 x1871643350935296/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938509.746343:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386363b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:16392:1871643350935296:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938509.748802:0:27313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350935424 00000100:00100000:3.0:1784938509.748816:0:27313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350935424 00000100:00100000:3.0:1784938509.748903:0:27313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 12 00000100:00100000:3.0:1784938509.748915:0:27313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:16388:x1871643350935424:12345-192.168.202.154@tcp:38:kworker.0 00000100:00100000:3.0:1784938509.749207:0:27313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:16388:x1871643350935424:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 290us (9202us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784938509.749218:0:27313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 12 00000100:00100000:3.0:1784938509.749314:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938509.750951:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938509.751002:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000040:01000000:0.0:1784938509.751305:0:27344:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1784938509.752321:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938509.752577:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350935936 00000100:00100000:3.0:1784938509.752592:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350935936 00000100:00100000:3.0:1784938509.752668:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350936064 00000100:00100000:3.0:1784938509.752671:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350936064 00000100:00100000:3.0:1784938509.752705:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 101 00000100:00100000:3.0:1784938509.752716:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:16389:x1871643350935936:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938509.752832:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:16389:x1871643350935936:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 116us (3517us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938509.752840:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 101 00000100:00100000:3.0:1784938509.752863:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 102 00000100:00100000:3.0:1784938509.752871:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:16389:x1871643350936064:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938509.752900:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:16389:x1871643350936064:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 29us (1959us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938509.752906:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 102 00000040:01000000:0.0:1784938509.753609:0:27344:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:02020000:1.0:1784938509.754419:0:16388:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_connect to node 192.168.202.154@tcp failed: rc = -114 00000100:00100000:3.0:1784938509.758752:0:26608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350936192 00000100:00100000:3.0:1784938509.758772:0:26608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350936192 00000100:00100000:3.0:1784938509.758856:0:26608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350935552 00000100:00100000:3.0:1784938509.758860:0:26608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350935552 00000100:00100000:3.0:1784938509.758895:0:26608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 6 00000100:00100000:3.0:1784938509.758907:0:26608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:16391:x1871643350936192:12345-192.168.202.154@tcp:400:kworker.0 00010000:00080000:3.0:1784938509.758932:0:26608:0:(ldlm_lib.c:3234:target_queue_recovery_request()) @@@ not queueing req@ffff9f238f22d880 x1871643350936192/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@192.168.202.154@tcp:740/0 lens 224/0 e 0 to 0 dl 1784938520 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938509.759691:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350936064:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938509.759713:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350935936:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938509.759775:0:26607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 7 00000100:00100000:0.0:1784938509.759797:0:26607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:16391:x1871643350935552:12345-192.168.202.154@tcp:400:kworker.0 00010000:00080000:0.0:1784938509.759812:0:26607:0:(ldlm_lib.c:3234:target_queue_recovery_request()) @@@ not queueing req@ffff9f238f22f480 x1871643350935552/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@192.168.202.154@tcp:740/0 lens 224/0 e 0 to 0 dl 1784938520 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938509.759856:0:26607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:16391:x1871643350935552:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 73us (7541us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938509.759864:0:26607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 7 00000100:00100000:3.0:1784938509.762670:0:26608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:16391:x1871643350936192:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 118us (8019us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938509.762706:0:26608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 6 00010000:00080000:3.0:1784938509.768042:0:16391:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f2386363800 x1871643350935552/t0(0) o400->lustre-MDT0000-lwp-OST0001@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938509.768072:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386363800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:16391:1871643350935552:192.168.202.154@tcp:400:kworker.0 00010000:00080000:3.0:1784938509.768091:0:16391:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f24b68c0380 x1871643350936192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938509.768101:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:16391:1871643350936192:192.168.202.154@tcp:400:kworker.0 00000040:00080000:0.0:1784938509.773778:0:27344:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784938509.774525:0:27344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1784938509.774697:0:27344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1784938509.777694:0:27349:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1784938509.777711:0:27349:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1784938509.781995:0:27344:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1784938509.782018:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000100:00100000:1.0:1784938509.782654:0:16388:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784938509.782670:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b4113800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784938509.782683:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.154@tcp failed (-114) 00000100:00100000:1.0:1784938509.782690:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:16388:1871643350935168:192.168.202.154@tcp:38:llog_process_th.0 00000100:00100000:1.0:1784938509.782735:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386362300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:16388:1871643350935680:192.168.202.154@tcp:38:kworker.0 00000100:00100000:1.0:1784938509.782874:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350935808:192.168.202.154@tcp:38:kworker.0 00000100:00080000:1.0:1784938509.782930:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b4115000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784938509.782935:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.154@tcp failed (-11) 00000100:00100000:1.0:1784938509.782940:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386361f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:16388:1871643350935424:192.168.202.154@tcp:38:kworker.0 00000004:01000000:3.0:1784938509.783067:0:27344:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1784938509.783103:0:27344:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7b044d4128f9f0b3 00000100:00080000:3.0:1784938509.783113:0:27344:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 192.168.202.154@tcp last attempt 0 00000100:00080000:3.0:1784938509.783122:0:27344:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9f24b36a1800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:3.0:1784938509.783199:0:27344:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f238f22ed80 x1871643350936320/t0(0) o8->lustre-OST0000-osc-MDT0001@192.168.202.154@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784938509.784061:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938509.784101:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938509.784232:0:21160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350935808 00000100:00100000:0.0:1784938509.784242:0:21160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350935808 00000100:00100000:0.0:1784938509.784306:0:21160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 99 00000100:00100000:0.0:1784938509.784316:0:21160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:16388:x1871643350935808:12345-192.168.202.154@tcp:38:kworker.0 00000100:00100000:0.0:1784938509.784668:0:21160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:16388:x1871643350935808:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 350us (563us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784938509.784678:0:21160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 99 00000100:00080000:3.0:1784938509.784893:0:27344:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1784938509.785028:0:27344:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938509.785036:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938509.785039:0:27344:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1784938509.785042:0:27344:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784938509.785045:0:27344:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1784938509.785047:0:27344:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784938509.785049:0:27344:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784938509.785051:0:27344:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784938509.785053:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938509.785055:0:27344:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784938509.785057:0:27344:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784938509.785064:0:27344:0:(obd_mount.c:957:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1784938509.785068:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938509.785069:0:27344:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1784938509.785073:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784938509.785077:0:27344:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.154@tcp to nid 0x20000c0a8ca9a (192.168.202.154@tcp) 00000020:01000000:3.0:1784938509.785100:0:27344:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1784938509.785102:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784938509.785122:0:27344:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9f2389c60000) 00000020:00000080:3.0:1784938509.785169:0:27344:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1784938509.785177:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1784938509.786074:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:16388:1871643350936320:192.168.202.154@tcp:8:llog_process_th.0 00000100:00100000:2.0:1784938509.786511:0:16388:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784938509.786522:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f2387dd9800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784938509.786528:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.154@tcp failed (-11) 00000100:00100000:2.0:1784938509.786532:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350935808:192.168.202.154@tcp:38:kworker.0 00000100:00100000:1.0:1784938509.786692:0:26607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350935680 00000100:00100000:1.0:1784938509.786700:0:26607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350935680 00000100:00100000:1.0:1784938509.786752:0:26607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 13 00000100:00100000:1.0:1784938509.786760:0:26607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16388:x1871643350935680:12345-192.168.202.154@tcp:38:kworker.0 00000100:00100000:1.0:1784938509.786833:0:26607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16388:x1871643350935680:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 71us (2774us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784938509.786840:0:26607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 13 00000100:00100000:0.0:1784938509.787132:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938509.787206:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350936320 00000100:00100000:0.0:1784938509.787211:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350936320 00000100:00100000:0.0:1784938509.787247:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 988 00000100:00100000:0.0:1784938509.787253:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:16388:x1871643350936320:12345-192.168.202.154@tcp:8:llog_process_th.0 00010000:00080000:0.0:1784938509.787281:0:21629:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@192.168.202.154@tcp t0 exp 0000000000000000 cur 775 last 0 00000020:00000080:0.0:1784938509.787328:0:21629:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7b044d4128f9f0c1 00000004:00080000:3.0:1784938509.788694:0:27344:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1784938509.788707:0:27344:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:3.0:1784938509.788720:0:27344:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7b044d4128f9f0c8 00010000:00080000:3.0:1784938509.788795:0:27344:0:(ldlm_lib.c:125:import_set_conn()) imp ffff9f24906aa800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.154@tcp at head 00010000:00010000:3.0:1784938509.789130:0:27344:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1784938509.789268:0:27344:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1784938509.789305:0:27344:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00002000:00100000:0.0:1784938509.791513:0:21629:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9f2486cc2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cb ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1784938509.791529:0:21629:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1784938509.791533:0:21629:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784938509.791674:0:21629:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1784938509.791732:0:21629:0:(import.c:65:import_set_state_nolock()) ffff9f2486cc4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784938509.791851:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:16388:x1871643350936320:12345-192.168.202.154@tcp:8:llog_process_th.0 Request processed in 4592us (4716us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938509.791866:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 988 00000100:00080000:0.0:1784938509.791973:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f238ce54800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784938509.791979:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.154@tcp failed (-11) 00000100:00100000:0.0:1784938509.791985:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386362300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:16388:1871643350935680:192.168.202.154@tcp:38:kworker.0 00000100:00100000:0.0:1784938509.793717:0:16388:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784938509.793736:0:16388:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1784938509.793747:0:16388:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784938509.793755:0:16388:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1784938509.793760:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b36a1800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784938509.793793:0:16388:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784938509.793806:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:16388:1871643350936320:192.168.202.154@tcp:8:llog_process_th.0 00000100:00100000:1.0:1784938509.794664:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784938509.794686:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23823bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350936448:192.168.202.154@tcp:13:osp-pre-0-1.0 00000004:00080000:3.0:1784938509.794903:0:27349:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1784938509.795006:0:27349:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 775961859689ns, next at 0ns, rc = 0 00080000:00080000:3.0:1784938509.795013:0:27349:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1784938509.796611:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938509.797456:0:21154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350936448 00000100:00100000:2.0:1784938509.797469:0:21154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350936448 00000100:00100000:2.0:1784938509.797551:0:21154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 90 00000100:00100000:2.0:1784938509.797562:0:21154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:16391:x1871643350936448:12345-192.168.202.154@tcp:13:osp-pre-0-1.0 00002000:00000024:2.0:1784938509.797603:0:21154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 272832 pending 0 free 313057280 avail 285245440 00000100:00100000:2.0:1784938509.797674:0:21154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:16391:x1871643350936448:12345-192.168.202.154@tcp:13:osp-pre-0-1.0 Request processed in 114us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938509.797682:0:21154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 90 00000100:00080000:3.0:1784938509.798538:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1784938509.802199:0:27341:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1784938509.806038:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23823bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350936448:192.168.202.154@tcp:13:osp-pre-0-1.0 00000040:00080000:0.0:1784938509.807968:0:27344:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784938509.808647:0:27344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1784938509.808813:0:27344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:0.0:1784938509.809628:0:27351:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1784938509.809635:0:27351:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1784938509.811890:0:27344:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784938509.811913:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784938509.811986:0:27344:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1784938509.812560:0:27344:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7b044d4128f9f0cf 00000100:00080000:0.0:1784938509.812583:0:27344:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 192.168.202.154@tcp last attempt 0 00000100:00080000:0.0:1784938509.812602:0:27344:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f24906aa800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:0.0:1784938509.812671:0:27344:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b68c3100 x1871643350936576/t0(0) o8->lustre-OST0001-osc-MDT0001@192.168.202.154@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784938509.812710:0:27344:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1784938509.812960:0:27344:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938509.812967:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938509.812969:0:27344:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1784938509.812972:0:27344:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938509.812978:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938509.812979:0:27344:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784938509.812982:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784938509.812984:0:27344:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784938509.812986:0:27344:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938509.812989:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938509.812990:0:27344:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1784938509.812992:0:27344:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938509.812994:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938509.812996:0:27344:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784938509.812999:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1784938509.813057:0:27344:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938509.813061:0:27344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938509.813062:0:27344:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784938509.813066:0:27344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:1.0:1784938509.813328:0:27340:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1784938509.813390:0:27340:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1784938509.813411:0:27340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24827c6a00/0x7b044d4128f9f051 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f058 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938509.813423:0:27340:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f24827c6a00/0x7b044d4128f9f051 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f058 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938509.813444:0:27340:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9f2489215800 from 1 10000000:01000000:1.0:1784938509.813448:0:27340:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784938509.813487:0:27340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24827c7400/0x7b044d4128f9f0d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938509.813496:0:27340:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f24827c7400/0x7b044d4128f9f0d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938509.813515:0:27340:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f24827c7400/0x7b044d4128f9f0d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938509.813544:0:27340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350936704:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784938509.813638:0:27340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938509.813697:0:27340:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24831dd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938509.813888:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:16388:1871643350936576:192.168.202.154@tcp:8:llog_process_th.0 00000100:00100000:2.0:1784938509.814726:0:26600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350936704 00000100:00100000:2.0:1784938509.814738:0:26600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350936704 00000100:00100000:2.0:1784938509.814822:0:26600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784938509.814835:0:26600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+21:27340:x1871643350936704:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784938509.814855:0:26600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938509.814877:0:26600:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2386e00e00/0x7b044d4128f9f0dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9f0d6 expref: -99 pid: 26600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938509.814943:0:26600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2386e00e00/0x7b044d4128f9f0dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9f0d6 expref: 22 pid: 26600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938509.814959:0:26600:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2386e00e00/0x7b044d4128f9f0dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9f0d6 expref: 22 pid: 26600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938509.814975:0:26600:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2386e00e00, rc 0) 00000100:00100000:2.0:1784938509.815062:0:26600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+22:27340:x1871643350936704:12345-0@lo:101:mount.lustre.0 Request processed in 229us (1424us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938509.815070:0:26600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784938509.815139:0:27340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350936704:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784938509.815186:0:27340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f24827c7400/0x7b044d4128f9f0d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f0dd expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938509.815196:0:27340:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f24827c7400/0x7b044d4128f9f0d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9f0dd expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938509.816226:0:27340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23823b9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350936832:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1784938509.816592:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938509.817130:0:27340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938509.817210:0:27340:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238ec680c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938509.818173:0:25718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350936576 00000100:00100000:2.0:1784938509.818187:0:25718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350936576 00000100:00100000:0.0:1784938509.818349:0:26598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350936832 00000100:00100000:0.0:1784938509.818355:0:26598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350936832 00000100:00100000:0.0:1784938509.818406:0:26598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784938509.818416:0:26598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+22:27340:x1871643350936832:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1784938509.818669:0:26598:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1784938509.818702:0:26598:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1784938509.818706:0:26598:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1784938509.818709:0:26598:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1784938509.818712:0:26598:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 13 00000100:00100000:0.0:1784938509.818864:0:26598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+22:27340:x1871643350936832:12345-0@lo:256:mount.lustre.0 Request processed in 448us (1733us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938509.818873:0:26598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784938509.819665:0:25718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 989 00000100:00100000:2.0:1784938509.819674:0:25718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:16388:x1871643350936576:12345-192.168.202.154@tcp:8:llog_process_th.0 00010000:00080000:2.0:1784938509.819713:0:25718:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@192.168.202.154@tcp t0 exp 0000000000000000 cur 775 last 0 00000020:00000080:2.0:1784938509.819755:0:25718:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7b044d4128f9f0e4 00002000:00100000:2.0:1784938509.819772:0:25718:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9f2490614800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cb ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1784938509.819777:0:25718:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1784938509.819780:0:25718:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1784938509.819891:0:25718:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1784938509.819926:0:25718:0:(import.c:65:import_set_state_nolock()) ffff9f2490617800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938509.819997:0:25718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:16388:x1871643350936576:12345-192.168.202.154@tcp:8:llog_process_th.0 Request processed in 322us (3408us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938509.820005:0:25718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 989 00000100:00100000:0.0:1784938509.823127:0:27340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23823b9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350936832:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1784938509.824417:0:27340:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784938509.824555:0:27340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24827c7400/0x7b044d4128f9f0d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f0dd expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938509.824570:0:27340:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f24827c7400/0x7b044d4128f9f0d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f0dd expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938509.824581:0:27340:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9f2489215800 from 1 10000000:01000000:0.0:1784938509.824584:0:27340:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784938509.824633:0:27340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24b379d200/0x7b044d4128f9f0eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938509.824645:0:27340:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f24b379d200/0x7b044d4128f9f0eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938509.824655:0:27340:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f24b379d200/0x7b044d4128f9f0eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938509.824682:0:27340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350936960:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784938509.824764:0:27340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938509.824833:0:27340:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248529f240 going to sleep for 11 seconds 00000100:00100000:3.0:1784938509.825229:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350936960 00000100:00100000:3.0:1784938509.825239:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350936960 00000100:00100000:3.0:1784938509.825318:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784938509.825330:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+22:27340:x1871643350936960:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938509.825359:0:26601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938509.825380:0:26601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f238217c000/0x7b044d4128f9f0f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9f0eb expref: -99 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.825412:0:26601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f238217c000/0x7b044d4128f9f0f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9f0eb expref: 23 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.825425:0:26601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f238217c000/0x7b044d4128f9f0f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9f0eb expref: 23 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.825664:0:26601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238217c000, rc 0) 00000100:00100000:3.0:1784938509.825737:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+23:27340:x1871643350936960:12345-0@lo:101:mount.lustre.0 Request processed in 409us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938509.825746:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784938509.825823:0:27340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350936960:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938509.825841:0:27340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f24b379d200/0x7b044d4128f9f0eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f0f2 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.825854:0:27340:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f24b379d200/0x7b044d4128f9f0eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9f0f2 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938509.827717:0:16388:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784938509.827735:0:16388:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1784938509.827746:0:16388:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784938509.827754:0:16388:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1784938509.827760:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24906aa800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1784938509.827777:0:16388:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784938509.827797:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:16388:1871643350936576:192.168.202.154@tcp:8:llog_process_th.0 00000004:00080000:0.0:1784938509.831454:0:27351:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1784938509.831573:0:27351:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 775998426335ns, next at 0ns, rc = 0 00080000:00080000:0.0:1784938509.831584:0:27351:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000040:00080000:3.0:1784938509.835790:0:27340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 7 00000040:00080000:3.0:1784938509.836305:0:27340:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784938509.838733:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350937088:192.168.202.154@tcp:13:osp-pre-1-1.0 00000040:00080000:3.0:1784938509.839857:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1784938509.839935:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:3.0:1784938509.839953:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:3.0:1784938509.839969:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:3.0:1784938509.839983:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:3.0:1784938509.840016:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000100:00100000:2.0:1784938509.841953:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938509.842010:0:21154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350937088 00000100:00100000:2.0:1784938509.842072:0:21154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350937088 00000100:00100000:2.0:1784938509.842194:0:21154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 91 00000100:00100000:2.0:1784938509.842207:0:21154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:16389:x1871643350937088:12345-192.168.202.154@tcp:13:osp-pre-1-1.0 00002000:00000024:2.0:1784938509.844014:0:21154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 272832 pending 0 free 313057280 avail 285245440 00000100:00080000:1.0:1784938509.844276:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1784938509.844775:0:27341:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1784938509.845009:0:21154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:16389:x1871643350937088:12345-192.168.202.154@tcp:13:osp-pre-1-1.0 Request processed in 2797us (3067us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938509.845022:0:21154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 91 00000040:00080000:3.0:1784938509.845175:0:27340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 6 count 7 00000100:00100000:3.0:1784938509.845364:0:27340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350937216:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938509.845753:0:27340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938509.845826:0:27340:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b6906000 going to sleep for 11 seconds 00000100:00100000:3.0:1784938509.845864:0:26600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350937216 00000100:00100000:3.0:1784938509.845873:0:26600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350937216 00000100:00100000:3.0:1784938509.845931:0:26600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784938509.845941:0:26600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f267850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+23:27340:x1871643350937216:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938509.847807:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350937088:192.168.202.154@tcp:13:osp-pre-1-1.0 00000100:00100000:3.0:1784938509.849803:0:26600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f267850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+23:27340:x1871643350937216:12345-0@lo:501:mount.lustre.0 Request processed in 3842us (4031us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938509.849821:0:26600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784938509.850118:0:27340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350937216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784938509.850225:0:27340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350937344:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784938509.850307:0:27340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938509.850358:0:27340:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248529fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938509.850959:0:26598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350937344 00000100:00100000:1.0:1784938509.850970:0:26598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350937344 00000100:00100000:1.0:1784938509.851049:0:26598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1784938509.851061:0:26598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+23:27340:x1871643350937344:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784938509.851256:0:26598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+23:27340:x1871643350937344:12345-0@lo:503:mount.lustre.0 Request processed in 198us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938509.851265:0:26598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784938509.851649:0:27340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350937344:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1784938509.852308:0:27340:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784938509.852446:0:27340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350937472:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784938509.852514:0:27340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938509.852566:0:27340:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248529fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938509.852659:0:26600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350937472 00000100:00100000:3.0:1784938509.852666:0:26600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350937472 00000100:00100000:3.0:1784938509.852717:0:26600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784938509.852726:0:26600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248323b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+23:27340:x1871643350937472:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784938509.852849:0:26600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248323b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+23:27340:x1871643350937472:12345-0@lo:502:mount.lustre.0 Request processed in 122us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938509.852858:0:26600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784938509.852915:0:27340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350937472:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784938509.853174:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1784938509.853206:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:3.0:1784938509.853222:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:3.0:1784938509.853236:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:3.0:1784938509.853251:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000100:00100000:3.0:1784938509.853277:0:27340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350937600:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784938509.853316:0:27340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938509.853345:0:27340:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b6906480 going to sleep for 11 seconds 00000100:00100000:1.0:1784938509.853510:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350937600 00000100:00100000:1.0:1784938509.853517:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350937600 00000100:00100000:1.0:1784938509.853544:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784938509.853551:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248323b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+23:27340:x1871643350937600:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938509.853643:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248323b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+23:27340:x1871643350937600:12345-0@lo:502:mount.lustre.0 Request processed in 91us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938509.853650:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784938509.854985:0:27340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350937600:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784938509.855180:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:3.0:1784938509.855197:0:27340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:1.0:1784938509.857935:0:27353:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784938509.857955:0:27353:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938509.857959:0:27353:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1784938509.857968:0:27353:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f2489215800 00000020:00000080:1.0:1784938509.857972:0:27353:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784938509.857984:0:27353:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938509.857987:0:27353:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938509.857988:0:27353:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1784938509.857991:0:27353:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784938509.857994:0:27353:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938509.857995:0:27353:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1784938509.857999:0:27353:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f2489215800 00000020:00000080:1.0:1784938509.858001:0:27353:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784938509.858137:0:27353:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938509.858141:0:27353:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938509.858170:0:27353:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1784938509.858174:0:27353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 7 count 7 00000020:01000000:3.0:1784938509.858744:0:27340:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1784938509.858801:0:27340:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784938509.858833:0:27340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24b379d200/0x7b044d4128f9f0eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f0f2 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.858848:0:27340:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f24b379d200/0x7b044d4128f9f0eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f0f2 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938509.858920:0:27340:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784938509.858925:0:27340:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f2489215800 10000000:01000000:3.0:1784938509.858929:0:27340:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f2489215800 10000000:01000000:3.0:1784938509.858935:0:27340:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784938509.858945:0:27340:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9f2489215800 from 1 10000000:01000000:3.0:1784938509.858948:0:27340:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784938509.859010:0:27340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238217c400/0x7b044d4128f9f0f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.859021:0:27340:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f238217c400/0x7b044d4128f9f0f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.859037:0:27340:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f238217c400/0x7b044d4128f9f0f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938509.859068:0:27340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350937728:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784938509.859195:0:27340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938509.859266:0:27340:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b6906300 going to sleep for 11 seconds 00000100:00100000:0.0:1784938509.859681:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350937728 00000100:00100000:0.0:1784938509.859691:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350937728 00000100:00100000:0.0:1784938509.859766:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784938509.859779:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483239050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+23:27340:x1871643350937728:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938509.859808:0:26601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938509.859830:0:26601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f24b379d000/0x7b044d4128f9f100 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9f0f9 expref: -99 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938509.859861:0:26601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f24b379d000/0x7b044d4128f9f100 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9f0f9 expref: 24 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938509.859875:0:26601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f24b379d000/0x7b044d4128f9f100 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9f0f9 expref: 24 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938509.859885:0:26601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b379d000, rc 0) 00000100:00100000:0.0:1784938509.859943:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483239050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+24:27340:x1871643350937728:12345-0@lo:101:mount.lustre.0 Request processed in 166us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938509.859952:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784938509.860120:0:27340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350937728:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938509.860141:0:27340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f238217c400/0x7b044d4128f9f0f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f100 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.860183:0:27340:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f238217c400/0x7b044d4128f9f0f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9f100 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784938509.864828:0:27340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:3.0:1784938509.865384:0:27340:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784938509.865648:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1784938509.865676:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:3.0:1784938509.865692:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:3.0:1784938509.865705:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:3.0:1784938509.865718:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:3.0:1784938509.865732:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:3.0:1784938509.865745:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:3.0:1784938509.865760:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:3.0:1784938509.865775:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1784938509.865802:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:3.0:1784938509.865817:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:3.0:1784938509.865828:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:3.0:1784938509.865838:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:3.0:1784938509.865848:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:3.0:1784938509.865859:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:3.0:1784938509.865872:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:3.0:1784938509.865884:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:3.0:1784938509.865897:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:3.0:1784938509.865909:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:3.0:1784938509.865920:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:3.0:1784938509.865931:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:3.0:1784938509.865944:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:3.0:1784938509.865958:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:3.0:1784938509.865973:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:3.0:1784938509.865987:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:3.0:1784938509.865999:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:3.0:1784938509.866012:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:3.0:1784938509.866026:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:3.0:1784938509.866040:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:3.0:1784938509.866054:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:3.0:1784938509.866071:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:3.0:1784938509.866086:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:3.0:1784938509.866099:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:3.0:1784938509.866112:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:3.0:1784938509.866127:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:3.0:1784938509.866141:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:3.0:1784938509.866184:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:3.0:1784938509.866199:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:3.0:1784938509.866214:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:3.0:1784938509.866227:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:3.0:1784938509.866242:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:3.0:1784938509.866255:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:3.0:1784938509.866270:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:3.0:1784938509.866284:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:3.0:1784938509.866299:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:3.0:1784938509.866315:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:3.0:1784938509.866331:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:3.0:1784938509.866346:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:3.0:1784938509.866467:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:3.0:1784938509.866486:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:3.0:1784938509.866501:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:3.0:1784938509.866508:0:27340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:3.0:1784938509.866634:0:27340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350937856:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938509.866731:0:27340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938509.866808:0:27340:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b6906000 going to sleep for 11 seconds 00000100:00100000:1.0:1784938509.867079:0:26598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350937856 00000100:00100000:1.0:1784938509.867090:0:26598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350937856 00000100:00100000:1.0:1784938509.867183:0:26598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784938509.867195:0:26598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483238450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+24:27340:x1871643350937856:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938509.867383:0:26598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483238450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+24:27340:x1871643350937856:12345-0@lo:501:mount.lustre.0 Request processed in 189us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938509.867392:0:26598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784938509.868825:0:27340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350937856:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938509.868927:0:27340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350937984:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784938509.869047:0:27340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938509.869090:0:27340:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b6906000 going to sleep for 11 seconds 00000100:00100000:1.0:1784938509.869731:0:26600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350937984 00000100:00100000:1.0:1784938509.869742:0:26600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350937984 00000100:00100000:1.0:1784938509.869816:0:26600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784938509.869829:0:26600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483239850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+24:27340:x1871643350937984:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784938509.869995:0:26600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483239850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+24:27340:x1871643350937984:12345-0@lo:503:mount.lustre.0 Request processed in 168us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938509.870004:0:26600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784938509.870228:0:27340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350937984:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784938509.871239:0:27340:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784938509.871694:0:27340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350938112:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784938509.871801:0:27340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938509.871849:0:27340:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2386c92900 going to sleep for 11 seconds 00000100:00100000:2.0:1784938509.871989:0:26598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350938112 00000100:00100000:2.0:1784938509.871998:0:26598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350938112 00000100:00100000:2.0:1784938509.872067:0:26598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784938509.872079:0:26598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483238850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+24:27340:x1871643350938112:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784938509.872265:0:26598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483238850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+24:27340:x1871643350938112:12345-0@lo:502:mount.lustre.0 Request processed in 186us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938509.872277:0:26598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784938509.872859:0:27340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350938112:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784938509.873762:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1784938509.873815:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:3.0:1784938509.873834:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:3.0:1784938509.873846:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:3.0:1784938509.873858:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:3.0:1784938509.873868:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:3.0:1784938509.873879:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:3.0:1784938509.873890:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:3.0:1784938509.873900:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:3.0:1784938509.873911:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:3.0:1784938509.873922:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:3.0:1784938509.873933:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:3.0:1784938509.873947:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:3.0:1784938509.873961:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:3.0:1784938509.873976:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:3.0:1784938509.873994:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:3.0:1784938509.874008:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:3.0:1784938509.874599:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:3.0:1784938509.874634:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:3.0:1784938509.874649:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:3.0:1784938509.874663:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:3.0:1784938509.874676:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:3.0:1784938509.874691:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:3.0:1784938509.874706:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:3.0:1784938509.874721:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:3.0:1784938509.874736:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:3.0:1784938509.874752:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:3.0:1784938509.874765:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:3.0:1784938509.874778:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:3.0:1784938509.876629:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:3.0:1784938509.876676:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:3.0:1784938509.876694:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:3.0:1784938509.876710:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:3.0:1784938509.876724:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:3.0:1784938509.876740:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:3.0:1784938509.876757:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:3.0:1784938509.876773:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:3.0:1784938509.876804:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:3.0:1784938509.876821:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:3.0:1784938509.876836:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:3.0:1784938509.876853:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:3.0:1784938509.876866:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:3.0:1784938509.876877:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:3.0:1784938509.876889:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:3.0:1784938509.876900:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:3.0:1784938509.876911:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:3.0:1784938509.876922:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:3.0:1784938509.876936:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:3.0:1784938509.880179:0:27340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350938240:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784938509.883482:0:27340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938509.883615:0:27340:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b6906300 going to sleep for 11 seconds 00000100:00100000:2.0:1784938509.884352:0:26598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350938240 00000100:00100000:2.0:1784938509.884367:0:26598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350938240 00000100:00100000:2.0:1784938509.884452:0:26598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784938509.884463:0:26598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248323b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+24:27340:x1871643350938240:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784938509.884719:0:26598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248323b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+24:27340:x1871643350938240:12345-0@lo:502:mount.lustre.0 Request processed in 257us (3226us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938509.884728:0:26598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784938509.885588:0:27340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350938240:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784938509.885903:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:1.0:1784938509.885938:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:1.0:1784938509.885992:0:27340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ec700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350938368:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938509.886071:0:27340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938509.886126:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350938368 00000100:00100000:1.0:1784938509.886135:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350938368 00000100:00100000:1.0:1784938509.886234:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784938509.886244:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483239c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+24:27340:x1871643350938368:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938509.887860:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483239c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+24:27340:x1871643350938368:12345-0@lo:502:mount.lustre.0 Request processed in 1609us (1781us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938509.887877:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784938509.887961:0:27340:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828ce0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938509.887988:0:27340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ec700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350938368:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784938509.888087:0:27340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:1.0:1784938509.888104:0:27340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1784938509.899018:0:27355:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1784938509.899067:0:27355:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9f2389e78000) 00000020:00000080:0.0:1784938509.899109:0:27355:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1784938509.899663:0:27355:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f2489215800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1784938509.899669:0:27355:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f2489215800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1784938509.899673:0:27355:0:(obd_mount.c:706:lustre_put_lsi()) put ffff9f2489215800 3 00010000:00080000:0.0:1784938509.899716:0:27355:0:(ldlm_lib.c:125:import_set_conn()) imp ffff9f24b36a7000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.154@tcp at head 00010000:00010000:0.0:1784938509.906059:0:27355:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-12 is initialized 00000020:00000080:0.0:1784938509.906241:0:27355:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1784938509.908069:0:27355:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1784938509.908100:0:27355:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x7b044d4128f9f10e 00000100:00080000:0.0:1784938509.908120:0:27355:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 192.168.202.154@tcp last attempt 0 00000100:00080000:0.0:1784938509.908136:0:27355:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9f24b36a7000 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:0.0:1784938509.908206:0:27355:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b68c1500 x1871643350938496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784938509.908275:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:16388:1871643350938496:192.168.202.154@tcp:38:llog_process_th.0 00000100:00100000:0.0:1784938509.908664:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00080000:0.0:1784938509.908704:0:27355:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1784938509.915225:0:27313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350938496 00000100:00100000:3.0:1784938509.915249:0:27313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350938496 00000100:00100000:3.0:1784938509.915327:0:27313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 14 00000100:00100000:3.0:1784938509.915337:0:27313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:16388:x1871643350938496:12345-192.168.202.154@tcp:38:llog_process_th.0 00010000:00080000:3.0:1784938509.915391:0:27313:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@192.168.202.154@tcp recovering/t0 exp 0000000000000000 cur 776 last 0 00000020:00000080:3.0:1784938509.915452:0:27313:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x7b044d4128f9f115 00000004:00100000:3.0:1784938509.915469:0:27313:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784938509.915530:0:27313:0:(import.c:65:import_set_state_nolock()) ffff9f238ce50800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784938509.915642:0:27313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:16388:x1871643350938496:12345-192.168.202.154@tcp:38:llog_process_th.0 Request processed in 305us (6979us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938509.915652:0:27313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 14 00000100:00080000:3.0:1784938509.915736:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784938509.915741:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1784938509.915744:0:38:0:(import.c:65:import_set_state_nolock()) ffff9f24b4115000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938509.915754:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9f24b4115000 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:3.0:1784938509.915779:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f238f22dc00 x1871643350938752/t0(0) o38->lustre-MDT0001-lwp-OST0000@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784938509.915828:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784938509.915832:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1784938509.915833:0:38:0:(import.c:65:import_set_state_nolock()) ffff9f238ce54800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938509.915839:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9f238ce54800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:3.0:1784938509.915854:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f238f22d500 x1871643350939008/t0(0) o38->lustre-MDT0001-lwp-OST0001@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784938509.915864:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784938509.915868:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1784938509.915869:0:38:0:(import.c:65:import_set_state_nolock()) ffff9f2387dd9800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938509.915874:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f2387dd9800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:3.0:1784938509.915887:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f238f22ca80 x1871643350939136/t0(0) o38->lustre-MDT0001-osp-MDT0000@192.168.202.154@tcp:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784938509.915917:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784938509.915920:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784938509.915922:0:38:0:(import.c:65:import_set_state_nolock()) ffff9f24b4113800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938509.915926:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 192.168.202.154@tcp last attempt 775 00000100:00080000:3.0:1784938509.915932:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784938509.915936:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9f24b4113800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:3.0:1784938509.915947:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f238f22ed80 x1871643350939648/t0(0) o38->lustre-MDT0000-osp-MDT0001@192.168.202.154@tcp:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784938509.915997:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:16390:1871643350938624:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938509.916065:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:16390:1871643350939520:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938509.916104:0:16390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784938509.916110:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350939392:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938509.916189:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:16388:1871643350938752:192.168.202.154@tcp:38:kworker.0 00000100:00100000:3.0:1784938509.916223:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:16388:1871643350939008:192.168.202.154@tcp:38:kworker.0 00000100:00100000:3.0:1784938509.916256:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350939136:192.168.202.154@tcp:38:kworker.0 00000100:00100000:3.0:1784938509.916281:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:16388:1871643350939648:192.168.202.154@tcp:38:kworker.0 00000100:00100000:3.0:1784938509.916324:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:16391:1871643350938880:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938509.916347:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386362300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350939776:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938509.916371:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938509.916377:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350939264:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938509.916745:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938509.916833:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938509.916862:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938509.916894:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938509.916951:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938509.916971:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938509.916992:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938509.917003:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938509.917025:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938509.917050:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938509.917084:0:26607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350939008 00000100:00100000:3.0:1784938509.917093:0:26607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350939008 00000100:00100000:3.0:1784938509.917124:0:26607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350938624 00000100:00100000:3.0:1784938509.917127:0:26607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350938624 00000100:00100000:3.0:1784938509.917193:0:26607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350938880 00000100:00100000:3.0:1784938509.917196:0:26607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350938880 00000100:00100000:3.0:1784938509.917211:0:26607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350939520 00000100:00100000:3.0:1784938509.917214:0:26607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350939520 00000100:00100000:3.0:1784938509.917228:0:26607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350938752 00000100:00100000:3.0:1784938509.917230:0:26607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350938752 00000100:00100000:3.0:1784938509.917244:0:26607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 8 00000100:00100000:3.0:1784938509.917254:0:26607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386363800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:16390:x1871643350938624:12345-192.168.202.154@tcp:400:kworker.0 00010000:00080000:3.0:1784938509.917271:0:26607:0:(ldlm_lib.c:3234:target_queue_recovery_request()) @@@ not queueing req@ffff9f2386363800 x1871643350938624/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@192.168.202.154@tcp:740/0 lens 224/0 e 0 to 0 dl 1784938520 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938509.917324:0:26607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386363800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:16390:x1871643350938624:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 71us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938509.917331:0:26607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 8 00000100:00100000:3.0:1784938509.917349:0:26607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 9 00000100:00100000:3.0:1784938509.917355:0:26607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386363b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:16391:x1871643350938880:12345-192.168.202.154@tcp:400:kworker.0 00010000:00080000:3.0:1784938509.917362:0:26607:0:(ldlm_lib.c:3234:target_queue_recovery_request()) @@@ not queueing req@ffff9f2386363b80 x1871643350938880/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@192.168.202.154@tcp:740/0 lens 224/0 e 0 to 0 dl 1784938520 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938509.917390:0:26607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386363b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:16391:x1871643350938880:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 35us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938509.917396:0:26607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 9 00000100:00100000:3.0:1784938509.917408:0:26607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 10 00000100:00100000:3.0:1784938509.917415:0:26607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:16390:x1871643350939520:12345-192.168.202.154@tcp:400:kworker.0 00010000:00080000:3.0:1784938509.917423:0:26607:0:(ldlm_lib.c:3234:target_queue_recovery_request()) @@@ not queueing req@ffff9f24b6b8c380 x1871643350939520/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@192.168.202.154@tcp:740/0 lens 224/0 e 0 to 0 dl 1784938520 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938509.917447:0:26607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:16390:x1871643350939520:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 32us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938509.917454:0:26607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 10 00000100:00100000:3.0:1784938509.917466:0:26607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 15 00000100:00100000:3.0:1784938509.917470:0:26607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386361f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16388:x1871643350939008:12345-192.168.202.154@tcp:38:kworker.0 00000100:00100000:3.0:1784938509.917521:0:26607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386361f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16388:x1871643350939008:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 49us (777us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784938509.917529:0:26607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 15 00000100:00100000:3.0:1784938509.917541:0:26607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 16 00000100:00100000:3.0:1784938509.917545:0:26607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16388:x1871643350938752:12345-192.168.202.154@tcp:38:kworker.0 00000100:00100000:3.0:1784938509.917569:0:26607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16388:x1871643350938752:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 23us (577us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784938509.917575:0:26607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 16 00010000:00080000:3.0:1784938509.917628:0:16388:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f24b68c1500 x1871643350938496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@192.168.202.154@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938509.917640:0:16388:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784938509.917651:0:16388:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1784938509.917661:0:16388:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1784938509.917666:0:16388:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784938509.917670:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b36a7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784938509.917678:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:16388:1871643350938496:192.168.202.154@tcp:38:llog_process_th.0 00000100:00100000:3.0:1784938509.917712:0:25714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350939648 00000100:00100000:3.0:1784938509.917716:0:25714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350939648 00000100:00100000:3.0:1784938509.917740:0:25714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350939136 00000100:00100000:3.0:1784938509.917742:0:25714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350939136 00000100:00100000:3.0:1784938509.917753:0:25714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 100 00000100:00100000:3.0:1784938509.917757:0:25714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386361880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:16388:x1871643350939648:12345-192.168.202.154@tcp:38:kworker.0 00010000:00080000:3.0:1784938509.917773:0:25714:0:(ldlm_lib.c:961:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9f238f34d000, cookie 0x7b044d4128f9eefa 00010000:00080000:3.0:1784938509.917778:0:25714:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@192.168.202.154@tcp recovering/t0 exp ffff9f238f34d000 cur 776 last 1784938491 00010000:02000400:3.0:1784938509.917801:0:25714:0:(ldlm_lib.c:2059:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 1 client reconnects 00000100:00100000:2.0:1784938509.920367:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350939392 00000100:00100000:2.0:1784938509.920382:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350939392 00000100:00100000:2.0:1784938509.920636:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350939776 00000100:00100000:2.0:1784938509.920641:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350939776 00000100:00100000:2.0:1784938509.920671:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350939264 00000100:00100000:2.0:1784938509.920674:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350939264 00000100:00100000:2.0:1784938509.920711:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 103 00000100:00100000:2.0:1784938509.920722:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238125d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:16390:x1871643350939392:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938509.920819:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238125d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:16390:x1871643350939392:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 98us (3845us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938509.920827:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 103 00000100:00100000:2.0:1784938509.921023:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 104 00000100:00100000:2.0:1784938509.921030:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:16391:x1871643350939776:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938509.921057:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:16391:x1871643350939776:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 27us (4030us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938509.921063:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 104 00000100:00100000:2.0:1784938509.921075:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 105 00000100:00100000:2.0:1784938509.921081:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f228e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:16391:x1871643350939264:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938509.921106:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f228e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:16391:x1871643350939264:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 25us (4055us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938509.921113:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 105 00000100:00100000:2.0:1784938509.921169:0:21160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 101 00000100:00100000:2.0:1784938509.921176:0:21160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:16388:x1871643350939136:12345-192.168.202.154@tcp:38:kworker.0 00000100:00100000:2.0:1784938509.921510:0:21160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:16388:x1871643350939136:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 330us (4502us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784938509.921517:0:21160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 101 00000040:00080000:1.0:1784938509.924010:0:27355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:1.0:1784938509.924092:0:27340:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1784938509.925610:0:27340:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784938509.925643:0:27340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238217c400/0x7b044d4128f9f0f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f100 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938509.925659:0:27340:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f238217c400/0x7b044d4128f9f0f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f100 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784938509.925742:0:27340:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1784938509.925745:0:27340:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1784938509.925747:0:27340:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938509.925748:0:27340:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938509.925751:0:27340:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938509.925753:0:27340:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938509.925755:0:27340:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784938509.925757:0:27340:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938509.925758:0:27340:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784938509.925764:0:27340:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1784938509.925767:0:27340:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784938509.925769:0:27340:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1784938509.925770:0:27340:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938509.925771:0:27340:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938509.925772:0:27340:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938509.925774:0:27340:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938509.925775:0:27340:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784938509.925776:0:27340:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938509.925777:0:27340:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1784938509.926268:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350939264:192.168.202.154@tcp:400:kworker.0 10000000:01000000:1.0:1784938509.926619:0:27340:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1784938509.926647:0:27340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ec700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350939904:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784938509.926740:0:27340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938509.926809:0:27340:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24906db0c0 going to sleep for 11 seconds 00010000:00080000:2.0:1784938509.926979:0:16391:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f238f22e300 x1871643350938880/t0(0) o400->lustre-MDT0000-lwp-OST0001@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938509.926994:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:16391:1871643350938880:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938509.927013:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386362300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350939776:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938509.931865:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350939392:192.168.202.154@tcp:400:kworker.0 00010000:00080000:2.0:1784938509.931926:0:16390:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f238f22f100 x1871643350938624/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938509.931939:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:16390:1871643350938624:192.168.202.154@tcp:400:kworker.0 00010000:00080000:2.0:1784938509.931955:0:16390:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f238f22c380 x1871643350939520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938509.931965:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:16390:1871643350939520:192.168.202.154@tcp:400:kworker.0 00000100:00080000:2.0:1784938509.932040:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b4115000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784938509.932047:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.154@tcp failed (-11) 00000100:00100000:2.0:1784938509.932051:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:16388:1871643350938752:192.168.202.154@tcp:38:kworker.0 00000100:00080000:2.0:1784938509.932065:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f238ce54800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784938509.932069:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.154@tcp failed (-11) 00000100:00100000:2.0:1784938509.932072:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:16388:1871643350939008:192.168.202.154@tcp:38:kworker.0 00000100:00080000:2.0:1784938509.932085:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f2387dd9800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784938509.932089:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.154@tcp failed (-11) 00000100:00100000:2.0:1784938509.932092:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350939136:192.168.202.154@tcp:38:kworker.0 00010000:00080000:3.0:1784938509.953258:0:25714:0:(ldlm_lib.c:2123:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000100:00100000:3.0:1784938509.953331:0:26600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350939904 00000100:00100000:3.0:1784938509.953357:0:26600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350939904 00000100:00100000:3.0:1784938509.954004:0:26600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784938509.954022:0:26600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248323ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+24:27340:x1871643350939904:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784938509.954083:0:26600:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1784938509.954105:0:26600:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000004:00100000:3.0:1784938509.954919:0:25714:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784938509.955001:0:25714:0:(import.c:65:import_set_state_nolock()) ffff9f238ce53800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784938509.955225:0:25714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386361880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:16388:x1871643350939648:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 37381us (38307us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938509.955241:0:25714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 100 00010000:00080000:0.0:1784938509.957637:0:26644:0:(ldlm_lib.c:2568:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 1 abort 0 expired 0 00010000:00080000:0.0:1784938509.957651:0:26644:0:(ldlm_lib.c:2123:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00010000:00080000:0.0:1784938509.957655:0:26644:0:(ldlm_lib.c:2586:check_for_recovery_ready()) lustre-MDT0000 update recovery is not ready, extend recovery 70 00000100:00100000:0.0:1784938509.961603:0:16388:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 8589934866 gen 2 00000100:00080000:0.0:1784938509.961626:0:16388:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1784938509.961638:0:16388:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1784938509.961646:0:16388:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784938509.961648:0:16388:0:(import.c:1233:ptlrpc_connect_interpret()) connect to lustre-MDT0000_UUID during recovery 00000100:00080000:0.0:1784938509.961652:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b4113800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY_LOCKS 00000100:00080000:0.0:1784938509.961658:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b4113800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1784938509.961705:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:16388:1871643350939648:192.168.202.154@tcp:38:kworker.0 00000100:00100000:0.0:1784938509.963922:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:16388:1871643350940032:192.168.202.154@tcp:400:ptlrpcd_rcv.0 00000100:00100000:3.0:1784938509.966249:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938509.966858:0:21160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350940032 00000100:00100000:3.0:1784938509.966871:0:21160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350940032 00000100:00100000:3.0:1784938509.966945:0:21160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 102 00000100:00100000:3.0:1784938509.966958:0:21160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:16388:x1871643350940032:12345-192.168.202.154@tcp:400:ptlrpcd_rcv.0 00010000:00080000:3.0:1784938509.966996:0:21160:0:(ldlm_lib.c:3160:target_queue_recovery_request()) @@@ queue final req req@ffff9f238f22b480 x1871643350940032/t0(0) o400->lustre-MDT0001-mdtlov_UUID@192.168.202.154@tcp:740/0 lens 224/0 e 0 to 0 dl 1784938520 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938509.967021:0:21160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:16388:x1871643350940032:12345-192.168.202.154@tcp:400:ptlrpcd_rcv.0 Request processed in 65us (789us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784938509.967029:0:21160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 102 00010000:00080000:3.0:1784938509.967111:0:26644:0:(ldlm_lib.c:2568:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 1 abort 0 expired 0 00010000:00080000:3.0:1784938509.967118:0:26644:0:(ldlm_lib.c:2123:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00010000:00080000:3.0:1784938509.967121:0:26644:0:(ldlm_lib.c:2586:check_for_recovery_ready()) lustre-MDT0000 update recovery is not ready, extend recovery 70 20000000:01000000:0.0:1784938509.972772:0:26600:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784938509.972807:0:26600:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1784938509.973200:0:26604:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784938509.973208:0:26604:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784938509.973252:0:26604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f238db38000/0x7b044d4128f9f11c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938509.973278:0:26604:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f2386e00c00/0x7b044d4128f9efa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9efa2 expref: 24 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938509.973297:0:26604:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f2386e00e00/0x7b044d4128f9f0dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9f0d6 expref: 24 pid: 26600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938509.973308:0:26604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f238db38000/0x7b044d4128f9f11c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938509.973382:0:26604:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f2386e00e00/0x7b044d4128f9f0dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b044d4128f9f0d6 expref: 24 pid: 26600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938509.973405:0:26604:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f2386e00e00/0x7b044d4128f9f0dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b044d4128f9f0d6 expref: 24 pid: 26600 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938509.973426:0:26604:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ece00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:26604:1871643350940160:0@lo:104: 00000100:00100000:1.0:1784938509.973797:0:26604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784938509.973866:0:26604:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f2386e00c00/0x7b044d4128f9efa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b044d4128f9efa2 expref: 24 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938509.973875:0:26604:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f2386e00c00/0x7b044d4128f9efa9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b044d4128f9efa2 expref: 24 pid: 26601 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938509.973885:0:26604:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0edf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:26604:1871643350940288:0@lo:104: 00000100:00100000:1.0:1784938509.973907:0:26604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938509.973927:0:26604:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24870c36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938509.975391:0:19217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350940160 00000100:00100000:3.0:1784938509.975412:0:19217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350940160 00000100:00100000:3.0:1784938509.975759:0:19217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350940288 00000100:00100000:3.0:1784938509.975765:0:19217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350940288 00000100:00100000:3.0:1784938509.975797:0:19217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784938509.975809:0:19217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e07296-2a01-411c-abf2-6d190cb69ef0+4:26604:x1871643350940160:12345-0@lo:104: 00010000:00010000:3.0:1784938509.975830:0:19217:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9f24827c7400/0x7b044d4128f9f0d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b044d4128f9f0dd expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.975951:0:19217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784938509.975958:0:19217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e07296-2a01-411c-abf2-6d190cb69ef0+4:26604:x1871643350940160:12345-0@lo:104: Request processed in 152us (2162us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938509.975966:0:19217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784938509.975988:0:19217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784938509.975995:0:19217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e07296-2a01-411c-abf2-6d190cb69ef0+3:26604:x1871643350940288:12345-0@lo:104: 00010000:00010000:3.0:1784938509.976005:0:19217:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9f24b379ce00/0x7b044d4128f9efa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b044d4128f9efa9 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.976047:0:19217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784938509.976053:0:19217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e07296-2a01-411c-abf2-6d190cb69ef0+3:26604:x1871643350940288:12345-0@lo:104: Request processed in 58us (2145us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938509.976058:0:19217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:3.0:1784938509.976080:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938509.976088:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9f24827c7400/0x7b044d4128f9f0d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b044d4128f9f0dd expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.976096:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c7400 already unused, calling callback (ffffffffc1390c20) 10000000:00010000:3.0:1784938509.976101:0:25733:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9f24827c7400/0x7b044d4128f9f0d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b044d4128f9f0dd expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.976111:0:25733:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f24827c7400/0x7b044d4128f9f0d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b044d4128f9f0dd expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938509.976119:0:25733:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f24827c7400/0x7b044d4128f9f0d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b044d4128f9f0dd expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938509.976126:0:25733:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938509.976195:0:25733:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9f24827c7400/0x7b044d4128f9f0d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b044d4128f9f0dd expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.976203:0:25733:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938509.976241:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9f24827c7400/0x7b044d4128f9f0d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b044d4128f9f0dd expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.976249:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f24827c7400/0x7b044d4128f9f0d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b044d4128f9f0dd expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.976266:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938509.976269:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9f24b379ce00/0x7b044d4128f9efa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b044d4128f9efa9 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.976290:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b379ce00 already unused, calling callback (ffffffffc1390c20) 10000000:00010000:3.0:1784938509.976294:0:25733:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9f24b379ce00/0x7b044d4128f9efa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b044d4128f9efa9 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.976301:0:25733:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f24b379ce00/0x7b044d4128f9efa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b044d4128f9efa9 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938509.976307:0:25733:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f24b379ce00/0x7b044d4128f9efa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b044d4128f9efa9 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938509.976312:0:25733:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938509.976325:0:25733:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9f24b379ce00/0x7b044d4128f9efa2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b044d4128f9efa9 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.976331:0:25733:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938509.976361:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9f24b379ce00/0x7b044d4128f9efa2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b044d4128f9efa9 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.976368:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f24b379ce00/0x7b044d4128f9efa2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b044d4128f9efa9 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.976386:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938509.976388:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938509.976390:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938509.976398:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938509.977202:0:26600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248323ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+24:27340:x1871643350939904:12345-0@lo:253:mount.lustre.0 Request processed in 23180us (50456us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938509.977228:0:26600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784938509.977587:0:27340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ec700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:27340:1871643350939904:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784938509.977606:0:27340:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1784938509.977610:0:27340:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784938509.977612:0:27340:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784938509.977614:0:27340:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938509.977615:0:27340:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784938509.977617:0:27340:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938509.977618:0:27340:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938509.977620:0:27340:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784938509.977621:0:27340:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938509.977623:0:27340:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784938509.977644:0:27340:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1784938509.979712:0:26604:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ece00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:26604:1871643350940160:0@lo:104: 00000100:00100000:2.0:1784938509.979728:0:26604:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0edf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:26604:1871643350940288:0@lo:104: 00010000:00010000:2.0:1784938509.979775:0:26604:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f238db38000/0x7b044d4128f9f11c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938509.980064:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e07296-2a01-411c-abf2-6d190cb69ef0:16392:1871643350940416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938509.981003:0:16392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938509.981104:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e07296-2a01-411c-abf2-6d190cb69ef0:16389:1871643350940544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938509.981162:0:16389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938509.984016:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350940416 00000100:00100000:3.0:1784938509.984035:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350940416 00010000:00010000:3.0:1784938509.984090:0:25731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f2386e00e00/0x7b044d4128f9f0dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b044d4128f9f0d6 expref: 24 pid: 26600 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938509.984159:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350940544 00000100:00100000:3.0:1784938509.984163:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350940544 00010000:00010000:3.0:1784938509.984177:0:25731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f2386e00c00/0x7b044d4128f9efa9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b044d4128f9efa2 expref: 25 pid: 26601 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938509.984203:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:3.0:1784938509.984212:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:73e07296-2a01-411c-abf2-6d190cb69ef0+25:16392:x1871643350940416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938509.984230:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938509.984235:0:25731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f2386e00e00/0x7b044d4128f9f0dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b044d4128f9f0d6 expref: 25 pid: 26600 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.984251:0:25731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f2386e00e00/0x7b044d4128f9f0dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b044d4128f9f0d6 expref: 25 pid: 26600 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.984273:0:25731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2386e00e00/0x7b044d4128f9f0dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b044d4128f9f0d6 expref: 25 pid: 26600 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.984292:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938509.984412:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:73e07296-2a01-411c-abf2-6d190cb69ef0+24:16392:x1871643350940416:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (3412us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938509.984421:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:3.0:1784938509.984442:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:3.0:1784938509.984449:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:73e07296-2a01-411c-abf2-6d190cb69ef0+23:16389:x1871643350940544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938509.984460:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938509.984464:0:25731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f2386e00c00/0x7b044d4128f9efa9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b044d4128f9efa2 expref: 23 pid: 26601 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.984473:0:25731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f2386e00c00/0x7b044d4128f9efa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b044d4128f9efa2 expref: 23 pid: 26601 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.984482:0:25731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2386e00c00/0x7b044d4128f9efa9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b044d4128f9efa2 expref: 23 pid: 26601 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.984494:0:25731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f238db38000/0x7b044d4128f9f11c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.987667:0:25731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f238db38000/0x7b044d4128f9f11c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784938509.987707:0:25731:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014499668s 00010000:00010000:3.0:1784938509.987715:0:25731:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f238db38000/0x7b044d4128f9f11c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.987722:0:25731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f238db38000/0x7b044d4128f9f11c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.987730:0:25731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f238db38000/0x7b044d4128f9f11c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.987737:0:25731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f238db38000/0x7b044d4128f9f11c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.987754:0:25731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db38000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938509.987759:0:25731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f238db38000/0x7b044d4128f9f11c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.987768:0:25731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f238db38000/0x7b044d4128f9f11c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.988899:0:25731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f238db38000/0x7b044d4128f9f11c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.989116:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938509.989297:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:73e07296-2a01-411c-abf2-6d190cb69ef0+22:16389:x1871643350940544:12345-0@lo:103:ldlm_bl.0 Request processed in 4830us (8133us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938509.989312:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1784938509.991216:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e07296-2a01-411c-abf2-6d190cb69ef0:16389:1871643350940544:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938509.991899:0:26604:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f238db38000/0x7b044d4128f9f11c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.991916:0:26604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f238db38000/0x7b044d4128f9f11c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938509.991926:0:26604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f238db38000/0x7b044d4128f9f11c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938509.992026:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e07296-2a01-411c-abf2-6d190cb69ef0:16392:1871643350940416:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1784938510.003922:0:27340:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0001: committed batchid 4294967465 00000040:01000000:1.0:1784938510.004953:0:27340:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1784938510.005050:0:27361:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 4294967465 00000020:00080000:3.0:1784938510.005055:0:27361:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294967465 00000040:01000000:3.0:1784938510.005555:0:27362:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1784938510.005883:0:27340:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00080000:3.0:1784938510.006853:0:27363:0:(client.c:1417:ptlrpc_import_delay_req()) @@@ allow during recovery req@ffff9f238f22b800 x1871643350940672/t0(0) o1000->lustre-MDT0000-osp-MDT0001@192.168.202.154@tcp:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938510.006869:0:27363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22b800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:27363:1871643350940672:192.168.202.154@tcp:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784938510.006980:0:27363:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238ee37c00 going to sleep for 11 seconds 00000040:01000000:1.0:1784938510.007260:0:27340:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1784938510.007323:0:27340:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1784938510.007973:0:27340:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1784938510.007982:0:27340:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1784938510.008025:0:27340:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784938510.010756:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938510.010863:0:25714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350940672 00000100:00100000:0.0:1784938510.010876:0:25714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350940672 00000100:00100000:0.0:1784938510.010950:0:25714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 103 00000100:00100000:0.0:1784938510.010962:0:25714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:27363:x1871643350940672:12345-192.168.202.154@tcp:1000:lod0001_rec0000.0 00010000:00080000:0.0:1784938510.010989:0:25714:0:(ldlm_lib.c:3234:target_queue_recovery_request()) @@@ not queueing req@ffff9f23823b8000 x1871643350940672/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@192.168.202.154@tcp:741/0 lens 304/0 e 0 to 0 dl 1784938521 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938510.011120:0:25714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:27363:x1871643350940672:12345-192.168.202.154@tcp:1000:lod0001_rec0000.0 Request processed in 160us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938510.011128:0:25714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 103 00000100:00100000:0.0:1784938510.014061:0:27363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22b800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:27363:1871643350940672:192.168.202.154@tcp:1000:lod0001_rec0000.0 00000040:01000000:0.0:1784938510.014129:0:27363:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00080000:0.0:1784938510.014220:0:27363:0:(client.c:1417:ptlrpc_import_delay_req()) @@@ allow during recovery req@ffff9f24b68c2a00 x1871643350940800/t0(0) o1000->lustre-MDT0000-osp-MDT0001@192.168.202.154@tcp:24/4 lens 336/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938510.014236:0:27363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c2a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:27363:1871643350940800:192.168.202.154@tcp:1000:lod0001_rec0000.0 00000100:00100000:0.0:1784938510.014605:0:27363:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d3a4600 going to sleep for 11 seconds 00000100:00100000:3.0:1784938510.014889:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938510.014928:0:21161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350940800 00000100:00100000:3.0:1784938510.014937:0:21161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350940800 00000100:00100000:3.0:1784938510.014994:0:21161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 104 00000100:00100000:3.0:1784938510.015003:0:21161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f228700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:27363:x1871643350940800:12345-192.168.202.154@tcp:1000:lod0001_rec0000.0 00010000:00080000:3.0:1784938510.015026:0:21161:0:(ldlm_lib.c:3234:target_queue_recovery_request()) @@@ not queueing req@ffff9f238f228700 x1871643350940800/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@192.168.202.154@tcp:741/0 lens 336/0 e 0 to 0 dl 1784938521 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938510.016119:0:21161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f228700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:27363:x1871643350940800:12345-192.168.202.154@tcp:1000:lod0001_rec0000.0 Request processed in 1108us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938510.016133:0:21161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 104 00000040:00080000:1.0:1784938510.017201:0:27340:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:3.0:1784938510.018693:0:27363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c2a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:27363:1871643350940800:192.168.202.154@tcp:1000:lod0001_rec0000.0 00000040:00080000:1.0:1784938510.019449:0:27340:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1784938510.019572:0:27340:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:3.0:1784938510.019988:0:27363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f229180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:27363:1871643350940928:192.168.202.154@tcp:900:lod0001_rec0000.0 00000100:00100000:3.0:1784938510.020085:0:27363:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238ee37900 going to sleep for 11 seconds 00000040:00080000:1.0:1784938510.020682:0:27340:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784938510.020983:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00080000:10000000:1.0:1784938510.021885:0:27340:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000100:00100000:2.0:1784938510.023509:0:26618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350940928 00000100:00100000:2.0:1784938510.023528:0:26618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350940928 00000100:00100000:2.0:1784938510.023602:0:26618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 0 00000100:00100000:3.0:1784938510.023616:0:26619:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 2 min 2 max 256 00000100:00100000:2.0:1784938510.023617:0:26618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:27363:x1871643350940928:12345-192.168.202.154@tcp:900:lod0001_rec0000.0 00000100:00100000:3.0:1784938510.023631:0:26619:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0002' 00010000:00080000:2.0:1784938510.023647:0:26618:0:(ldlm_lib.c:3234:target_queue_recovery_request()) @@@ not queueing req@ffff9f238f229f80 x1871643350940928/t0(0) o900->lustre-MDT0000-lwp-MDT0001_UUID@192.168.202.154@tcp:741/0 lens 264/0 e 0 to 0 dl 1784938521 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938510.023757:0:26618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:27363:x1871643350940928:12345-192.168.202.154@tcp:900:lod0001_rec0000.0 Request processed in 143us (2776us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938510.023767:0:26618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 0 00010000:00080000:3.0:1784938510.024078:0:27363:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f238f229180 x1871643350940928/t0(0) o900->lustre-MDT0000-lwp-MDT0001@192.168.202.154@tcp:29/10 lens 264/248 e 0 to 0 dl 1784938526 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938510.024097:0:27363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f229180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:27363:1871643350940928:192.168.202.154@tcp:900:lod0001_rec0000.0 00000100:00080000:3.0:1784938510.024215:0:27363:0:(client.c:1417:ptlrpc_import_delay_req()) @@@ allow during recovery req@ffff9f238f229180 x1871643350941056/t0(0) o1000->lustre-MDT0000-osp-MDT0001@192.168.202.154@tcp:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938510.024229:0:27363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f229180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:27363:1871643350941056:192.168.202.154@tcp:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784938510.024417:0:27363:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238ee37c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938510.024823:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938510.025312:0:21160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350941056 00000100:00100000:2.0:1784938510.025323:0:21160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350941056 00000100:00100000:2.0:1784938510.026131:0:21160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 105 00000100:00100000:2.0:1784938510.026166:0:21160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:27363:x1871643350941056:12345-192.168.202.154@tcp:1000:lod0001_rec0000.0 00010000:00080000:2.0:1784938510.026191:0:21160:0:(ldlm_lib.c:3234:target_queue_recovery_request()) @@@ not queueing req@ffff9f238f22b100 x1871643350941056/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@192.168.202.154@tcp:741/0 lens 304/0 e 0 to 0 dl 1784938521 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000001:00000004:1.0:1784938510.028135:0:27340:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000040:00080000:0.0:1784938510.030013:0:27362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1784938510.030127:0:27362:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1784938510.030812:0:21160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:27363:x1871643350941056:12345-192.168.202.154@tcp:1000:lod0001_rec0000.0 Request processed in 4660us (5980us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938510.030828:0:21160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 105 00000100:00100000:1.0:1784938510.031303:0:27363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f229180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:27363:1871643350941056:192.168.202.154@tcp:1000:lod0001_rec0000.0 00000100:00080000:1.0:1784938510.031492:0:27363:0:(client.c:1417:ptlrpc_import_delay_req()) @@@ allow during recovery req@ffff9f238e0ed180 x1871643350941184/t0(0) o1000->lustre-MDT0000-osp-MDT0001@192.168.202.154@tcp:24/4 lens 336/33016 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938510.031517:0:27363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ed180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:27363:1871643350941184:192.168.202.154@tcp:1000:lod0001_rec0000.0 00000100:00100000:1.0:1784938510.031628:0:27363:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24831b4540 going to sleep for 11 seconds 00000100:00100000:3.0:1784938510.031731:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938510.031763:0:21161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350941184 00000100:00100000:3.0:1784938510.031769:0:21161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350941184 00000100:00100000:3.0:1784938510.031835:0:21161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 106 00000100:00100000:3.0:1784938510.031845:0:21161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f228000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:27363:x1871643350941184:12345-192.168.202.154@tcp:1000:lod0001_rec0000.0 00010000:00080000:3.0:1784938510.031865:0:21161:0:(ldlm_lib.c:3234:target_queue_recovery_request()) @@@ not queueing req@ffff9f238f228000 x1871643350941184/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@192.168.202.154@tcp:741/0 lens 336/0 e 0 to 0 dl 1784938521 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938510.043101:0:21161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f228000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:27363:x1871643350941184:12345-192.168.202.154@tcp:1000:lod0001_rec0000.0 Request processed in 11238us (11352us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938510.043122:0:21161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 106 00000100:00100000:3.0:1784938510.045899:0:27363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ed180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:27363:1871643350941184:192.168.202.154@tcp:1000:lod0001_rec0000.0 00000040:00080000:3.0:1784938510.045973:0:27363:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000401:0x1:0x0] first idx 2, last_idx 4 00000100:00080000:3.0:1784938510.046207:0:27363:0:(client.c:1417:ptlrpc_import_delay_req()) @@@ allow during recovery req@ffff9f238f228a80 x1871643350941312/t0(0) o1000->lustre-MDT0000-osp-MDT0001@192.168.202.154@tcp:24/4 lens 336/33016 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938510.046223:0:27363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f228a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:27363:1871643350941312:192.168.202.154@tcp:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784938510.046370:0:27363:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238ee37c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938510.046947:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938510.048047:0:21160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350941312 00000100:00100000:2.0:1784938510.048064:0:21160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350941312 00000100:00100000:2.0:1784938510.048172:0:21160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 107 00000100:00100000:2.0:1784938510.048185:0:21160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:27363:x1871643350941312:12345-192.168.202.154@tcp:1000:lod0001_rec0000.0 00010000:00080000:2.0:1784938510.048210:0:21160:0:(ldlm_lib.c:3234:target_queue_recovery_request()) @@@ not queueing req@ffff9f24b68c0a80 x1871643350941312/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@192.168.202.154@tcp:741/0 lens 336/0 e 0 to 0 dl 1784938521 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000001:00080000:2.0:1784938510.050669:0:27340:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1784938510.050724:0:27340:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbfdb4cbdb988 00100000:10000000:2.0:1784938510.050736:0:27340:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1784938510.051565:0:27340:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784938510.051612:0:27340:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.154@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784938510.051648:0:27340:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1784938510.051687:0:27340:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000004:00080000:1.0:1784938510.056253:0:27350:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x68:0x0] 00000100:00100000:1.0:1784938510.056348:0:27350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0edc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:27350:1871643350941440:192.168.202.154@tcp:5:osp-pre-0-1.0 00000020:00000004:2.0:1784938510.058193:0:27340:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784938510.058541:0:27340:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1784938510.062717:0:27350:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24831b4000 going to sleep for 11 seconds 00000004:00080000:1.0:1784938510.062770:0:27352:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x69:0x0] 00000100:00100000:1.0:1784938510.062845:0:27352:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ee680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:27352:1871643350941568:192.168.202.154@tcp:5:osp-pre-1-1.0 00000100:00100000:0.0:1784938510.064574:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938510.064646:0:25726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350941440 00000100:00100000:0.0:1784938510.064657:0:25726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350941440 00000100:00100000:0.0:1784938510.064727:0:25726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 990 00000100:00100000:0.0:1784938510.064740:0:25726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+6:27350:x1871643350941440:12345-192.168.202.154@tcp:5:osp-pre-0-1.0 00002000:00080000:0.0:1784938510.065097:0:25726:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 129 -> diff = -25 00002000:02000040:0.0:1784938510.065103:0:25726:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:105 to 0x280000400:129) 00000100:00100000:2.0:1784938510.066020:0:21160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:27363:x1871643350941312:12345-192.168.202.154@tcp:1000:lod0001_rec0000.0 Request processed in 17831us (19070us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938510.066036:0:21160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 107 00000100:00100000:1.0:1784938510.073322:0:27352:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24831b4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938510.075043:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938510.078592:0:21152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350941568 00000100:00100000:3.0:1784938510.078611:0:21152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350941568 00000100:00100000:3.0:1784938510.078694:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 991 00000100:00100000:3.0:1784938510.078707:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:27352:x1871643350941568:12345-192.168.202.154@tcp:5:osp-pre-1-1.0 00002000:00080000:3.0:1784938510.084857:0:21152:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 129 -> diff = -24 00002000:02000040:3.0:1784938510.084880:0:21152:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:106 to 0x2c0000400:129) 00002000:00010000:0.0:1784938510.105172:0:25726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x81:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938510.105193:0:25726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f169e32/0x7b044d4128f9f123 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.107432:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x81:0x0].0x0 since=776s v=(0 0) 00010000:00010000:0.0:1784938510.107448:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x81:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938510.107461:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f169e32/0x7b044d4128f9f123 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.107491:0:25726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f169e32/0x7b044d4128f9f123 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938510.111282:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x81:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938510.111302:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006dad1d34/0x7b044d4128f9f12a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.111326:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x81:0x0].0x0 since=776s v=(0 0) 00010000:00010000:3.0:1784938510.111332:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x81:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938510.111341:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006dad1d34/0x7b044d4128f9f12a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.111361:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006dad1d34/0x7b044d4128f9f12a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.111374:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006dad1d34/0x7b044d4128f9f12a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.111384:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006dad1d34/0x7b044d4128f9f12a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.111422:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784938510.111568:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x80:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938510.111574:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ac78920/0x7b044d4128f9f131 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.111582:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x80:0x0].0x0 since=776s v=(0 0) 00010000:00010000:3.0:1784938510.111585:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x80:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938510.111589:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ac78920/0x7b044d4128f9f131 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.111599:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ac78920/0x7b044d4128f9f131 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.111612:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ac78920/0x7b044d4128f9f131 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.111619:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ac78920/0x7b044d4128f9f131 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.111641:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784938510.111685:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938510.111691:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080def834/0x7b044d4128f9f138 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.111699:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7f:0x0].0x0 since=776s v=(0 0) 00010000:00010000:3.0:1784938510.111701:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938510.111705:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080def834/0x7b044d4128f9f138 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.111715:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080def834/0x7b044d4128f9f138 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.111722:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080def834/0x7b044d4128f9f138 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.111730:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080def834/0x7b044d4128f9f138 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.111754:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1784938510.113430:0:25726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f169e32/0x7b044d4128f9f123 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.113453:0:25726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f169e32/0x7b044d4128f9f123 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.113479:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784938510.113487:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006dad1d34/0x7b044d4128f9f12a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.113496:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217de00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938510.113502:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006dad1d34/0x7b044d4128f9f12a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.113515:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006dad1d34/0x7b044d4128f9f12a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.113540:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006dad1d34/0x7b044d4128f9f12a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.113549:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006dad1d34/0x7b044d4128f9f12a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.113582:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938510.113586:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ac78920/0x7b044d4128f9f131 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.113592:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217ce00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938510.113596:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ac78920/0x7b044d4128f9f131 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.113603:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ac78920/0x7b044d4128f9f131 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.113618:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ac78920/0x7b044d4128f9f131 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.113626:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ac78920/0x7b044d4128f9f131 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.113639:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938510.113643:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080def834/0x7b044d4128f9f138 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.113649:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217c200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938510.113652:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080def834/0x7b044d4128f9f138 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.113660:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080def834/0x7b044d4128f9f138 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.113669:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080def834/0x7b044d4128f9f138 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.113676:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080def834/0x7b044d4128f9f138 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.113688:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.113690:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.113692:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.113727:0:25726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938510.113740:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938510.113827:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f169e32/0x7b044d4128f9f123 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.113835:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b379cc00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938510.113839:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f169e32/0x7b044d4128f9f123 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.113848:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f169e32/0x7b044d4128f9f123 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.113863:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f169e32/0x7b044d4128f9f123 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.113870:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f169e32/0x7b044d4128f9f123 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.113889:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.113890:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.113892:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938510.114035:0:25726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x80:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938510.114043:0:25726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc23643d/0x7b044d4128f9f13f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114057:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x80:0x0].0x0 since=776s v=(0 0) 00010000:00010000:0.0:1784938510.114061:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x80:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938510.114069:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc23643d/0x7b044d4128f9f13f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114083:0:25726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc23643d/0x7b044d4128f9f13f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114093:0:25726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc23643d/0x7b044d4128f9f13f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114101:0:25726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc23643d/0x7b044d4128f9f13f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114116:0:25726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938510.114123:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938510.114127:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc23643d/0x7b044d4128f9f13f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114134:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b379c000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938510.114137:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc23643d/0x7b044d4128f9f13f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114166:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc23643d/0x7b044d4128f9f13f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114176:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc23643d/0x7b044d4128f9f13f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114190:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc23643d/0x7b044d4128f9f13f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114202:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.114204:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.114205:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938510.114242:0:25726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938510.114247:0:25726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b403a808/0x7b044d4128f9f146 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114255:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7f:0x0].0x0 since=776s v=(0 0) 00010000:00010000:0.0:1784938510.114259:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938510.114263:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b403a808/0x7b044d4128f9f146 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114271:0:25726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b403a808/0x7b044d4128f9f146 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114279:0:25726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b403a808/0x7b044d4128f9f146 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114287:0:25726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b403a808/0x7b044d4128f9f146 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114298:0:25726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938510.114303:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938510.114308:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b403a808/0x7b044d4128f9f146 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114315:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b379c600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938510.114318:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b403a808/0x7b044d4128f9f146 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114326:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b403a808/0x7b044d4128f9f146 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114336:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b403a808/0x7b044d4128f9f146 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114343:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b403a808/0x7b044d4128f9f146 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114355:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.114356:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.114358:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938510.114390:0:25726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938510.114396:0:25726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000553e8c3f/0x7b044d4128f9f14d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114404:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7e:0x0].0x0 since=776s v=(0 0) 00010000:00010000:0.0:1784938510.114406:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938510.114410:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000553e8c3f/0x7b044d4128f9f14d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114425:0:25726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000553e8c3f/0x7b044d4128f9f14d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114433:0:25726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000553e8c3f/0x7b044d4128f9f14d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114440:0:25726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000553e8c3f/0x7b044d4128f9f14d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114451:0:25726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938510.114456:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938510.114459:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000553e8c3f/0x7b044d4128f9f14d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114467:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b379c400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938510.114470:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000553e8c3f/0x7b044d4128f9f14d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114477:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000553e8c3f/0x7b044d4128f9f14d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114485:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000553e8c3f/0x7b044d4128f9f14d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114492:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000553e8c3f/0x7b044d4128f9f14d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114505:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.114506:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.114508:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938510.114541:0:25726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938510.114546:0:25726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e8ea1de/0x7b044d4128f9f154 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114554:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7d:0x0].0x0 since=776s v=(0 0) 00010000:00010000:0.0:1784938510.114557:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938510.114562:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e8ea1de/0x7b044d4128f9f154 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114570:0:25726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e8ea1de/0x7b044d4128f9f154 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114578:0:25726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e8ea1de/0x7b044d4128f9f154 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114586:0:25726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e8ea1de/0x7b044d4128f9f154 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114595:0:25726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938510.114600:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938510.114603:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e8ea1de/0x7b044d4128f9f154 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114615:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b379ce00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938510.114619:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e8ea1de/0x7b044d4128f9f154 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114626:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e8ea1de/0x7b044d4128f9f154 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114635:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e8ea1de/0x7b044d4128f9f154 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114642:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e8ea1de/0x7b044d4128f9f154 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114654:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.114655:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.114657:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938510.114690:0:25726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938510.114696:0:25726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000993f7fed/0x7b044d4128f9f15b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114704:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7c:0x0].0x0 since=776s v=(0 0) 00010000:00010000:0.0:1784938510.114707:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938510.114711:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000993f7fed/0x7b044d4128f9f15b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114719:0:25726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000993f7fed/0x7b044d4128f9f15b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114728:0:25726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000993f7fed/0x7b044d4128f9f15b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114735:0:25726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000993f7fed/0x7b044d4128f9f15b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114758:0:25726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938510.114763:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938510.114767:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000993f7fed/0x7b044d4128f9f15b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114773:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b379dc00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938510.114776:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000993f7fed/0x7b044d4128f9f15b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114796:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000993f7fed/0x7b044d4128f9f15b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114807:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000993f7fed/0x7b044d4128f9f15b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114815:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000993f7fed/0x7b044d4128f9f15b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114828:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.114830:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.114832:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938510.114868:0:25726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938510.114873:0:25726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a837456f/0x7b044d4128f9f162 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114880:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7b:0x0].0x0 since=776s v=(0 0) 00010000:00010000:0.0:1784938510.114883:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938510.114888:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a837456f/0x7b044d4128f9f162 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114896:0:25726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a837456f/0x7b044d4128f9f162 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114904:0:25726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a837456f/0x7b044d4128f9f162 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114911:0:25726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a837456f/0x7b044d4128f9f162 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114921:0:25726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938510.114925:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938510.114929:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a837456f/0x7b044d4128f9f162 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114934:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b379de00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938510.114937:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a837456f/0x7b044d4128f9f162 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114950:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a837456f/0x7b044d4128f9f162 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114960:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a837456f/0x7b044d4128f9f162 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114968:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a837456f/0x7b044d4128f9f162 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.114981:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.114982:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.114984:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938510.115021:0:25726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938510.115026:0:25726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034c21370/0x7b044d4128f9f169 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115034:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7a:0x0].0x0 since=776s v=(0 0) 00010000:00010000:0.0:1784938510.115037:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938510.115041:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034c21370/0x7b044d4128f9f169 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115049:0:25726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034c21370/0x7b044d4128f9f169 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115057:0:25726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034c21370/0x7b044d4128f9f169 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115065:0:25726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034c21370/0x7b044d4128f9f169 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115075:0:25726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938510.115080:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938510.115083:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034c21370/0x7b044d4128f9f169 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115090:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2480030400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938510.115093:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034c21370/0x7b044d4128f9f169 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115101:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034c21370/0x7b044d4128f9f169 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115111:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034c21370/0x7b044d4128f9f169 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115117:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034c21370/0x7b044d4128f9f169 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115130:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.115131:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.115133:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938510.115192:0:25726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x79:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938510.115199:0:25726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000644dbc6b/0x7b044d4128f9f170 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115207:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x79:0x0].0x0 since=776s v=(0 0) 00010000:00010000:0.0:1784938510.115210:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x79:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938510.115214:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000644dbc6b/0x7b044d4128f9f170 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115222:0:25726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000644dbc6b/0x7b044d4128f9f170 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115229:0:25726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000644dbc6b/0x7b044d4128f9f170 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115237:0:25726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000644dbc6b/0x7b044d4128f9f170 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115247:0:25726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938510.115252:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938510.115255:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000644dbc6b/0x7b044d4128f9f170 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115261:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2480031200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938510.115265:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000644dbc6b/0x7b044d4128f9f170 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115273:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000644dbc6b/0x7b044d4128f9f170 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115283:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000644dbc6b/0x7b044d4128f9f170 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115292:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000644dbc6b/0x7b044d4128f9f170 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115305:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.115306:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.115307:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938510.115340:0:25726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x78:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938510.115344:0:25726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce195e5a/0x7b044d4128f9f177 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115352:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x78:0x0].0x0 since=776s v=(0 0) 00010000:00010000:0.0:1784938510.115355:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x78:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938510.115359:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce195e5a/0x7b044d4128f9f177 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115367:0:25726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce195e5a/0x7b044d4128f9f177 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115375:0:25726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce195e5a/0x7b044d4128f9f177 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115383:0:25726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce195e5a/0x7b044d4128f9f177 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115399:0:25726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938510.115404:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938510.115408:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce195e5a/0x7b044d4128f9f177 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115414:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2480030000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938510.115417:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce195e5a/0x7b044d4128f9f177 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115425:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce195e5a/0x7b044d4128f9f177 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115434:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce195e5a/0x7b044d4128f9f177 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115441:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce195e5a/0x7b044d4128f9f177 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115453:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.115454:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.115456:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938510.115488:0:25726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x77:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938510.115493:0:25726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb88e185/0x7b044d4128f9f17e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115501:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x77:0x0].0x0 since=776s v=(0 0) 00010000:00010000:0.0:1784938510.115505:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x77:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938510.115509:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb88e185/0x7b044d4128f9f17e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115517:0:25726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb88e185/0x7b044d4128f9f17e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115524:0:25726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb88e185/0x7b044d4128f9f17e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115533:0:25726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb88e185/0x7b044d4128f9f17e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115542:0:25726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938510.115547:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938510.115550:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb88e185/0x7b044d4128f9f17e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115557:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2480030200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938510.115560:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb88e185/0x7b044d4128f9f17e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115568:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb88e185/0x7b044d4128f9f17e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115577:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb88e185/0x7b044d4128f9f17e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115590:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb88e185/0x7b044d4128f9f17e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115601:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.115603:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.115604:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938510.115637:0:25726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x76:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938510.115641:0:25726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000268e9728/0x7b044d4128f9f185 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115649:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x76:0x0].0x0 since=776s v=(0 0) 00010000:00010000:0.0:1784938510.115652:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x76:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938510.115656:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000268e9728/0x7b044d4128f9f185 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115665:0:25726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000268e9728/0x7b044d4128f9f185 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115673:0:25726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000268e9728/0x7b044d4128f9f185 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115681:0:25726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000268e9728/0x7b044d4128f9f185 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115690:0:25726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938510.115695:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938510.115699:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000268e9728/0x7b044d4128f9f185 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115706:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2480031000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938510.115709:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000268e9728/0x7b044d4128f9f185 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115716:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000268e9728/0x7b044d4128f9f185 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115724:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000268e9728/0x7b044d4128f9f185 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115731:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000268e9728/0x7b044d4128f9f185 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.115743:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.115745:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.115746:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938510.115778:0:25726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x75:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938510.121242:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938510.121256:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938510.121492:0:27363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f228a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:27363:1871643350941312:192.168.202.154@tcp:1000:lod0001_rec0000.0 00000040:00080000:1.0:1784938510.121573:0:27363:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 4 synced_idx: 0 lgh_last_idx: 4 00000040:00080000:1.0:1784938510.121580:0:27363:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x200000bd1:0x1:0x0] at index 3 of catalog [0x200000401:0x1:0x0] 00000100:00080000:1.0:1784938510.121710:0:27363:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != REPLAY_WAIT) req@ffff9f238e0eca80 x1871643350941696/t0(0) o1000->lustre-MDT0000-osp-MDT0001@192.168.202.154@tcp:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938510.121729:0:27363:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24831b40c0 going to sleep for 0 seconds 00010000:00010000:0.0:1784938510.125084:0:25726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032c0299a/0x7b044d4128f9f18c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.125113:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x75:0x0].0x0 since=776s v=(0 0) 00010000:00010000:0.0:1784938510.125119:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x75:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938510.125129:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032c0299a/0x7b044d4128f9f18c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.125168:0:25726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032c0299a/0x7b044d4128f9f18c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.125184:0:25726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032c0299a/0x7b044d4128f9f18c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.125193:0:25726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032c0299a/0x7b044d4128f9f18c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.125247:0:25726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938510.125275:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938510.125283:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032c0299a/0x7b044d4128f9f18c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.125291:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2480030800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938510.125297:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032c0299a/0x7b044d4128f9f18c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.125309:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032c0299a/0x7b044d4128f9f18c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.125331:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032c0299a/0x7b044d4128f9f18c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.125339:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032c0299a/0x7b044d4128f9f18c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.125373:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.125375:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.125378:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938510.125548:0:25726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x74:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938510.125555:0:25726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001fa763f/0x7b044d4128f9f193 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.125565:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x74:0x0].0x0 since=776s v=(0 0) 00010000:00010000:0.0:1784938510.125568:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x74:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938510.125573:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001fa763f/0x7b044d4128f9f193 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.125582:0:25726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001fa763f/0x7b044d4128f9f193 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.125590:0:25726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001fa763f/0x7b044d4128f9f193 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.125598:0:25726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001fa763f/0x7b044d4128f9f193 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.125615:0:25726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938510.125624:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938510.125629:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001fa763f/0x7b044d4128f9f193 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.125641:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2480031400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938510.125644:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001fa763f/0x7b044d4128f9f193 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.125651:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001fa763f/0x7b044d4128f9f193 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.125662:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001fa763f/0x7b044d4128f9f193 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.125669:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001fa763f/0x7b044d4128f9f193 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.125687:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.125689:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.125690:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938510.125737:0:25726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x73:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938510.129496:0:25726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000684fc97c/0x7b044d4128f9f19a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.129591:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x73:0x0].0x0 since=776s v=(0 0) 00010000:00010000:0.0:1784938510.129597:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x73:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938510.129605:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000684fc97c/0x7b044d4128f9f19a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.129625:0:25726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000684fc97c/0x7b044d4128f9f19a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.129640:0:25726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000684fc97c/0x7b044d4128f9f19a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.129648:0:25726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000684fc97c/0x7b044d4128f9f19a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.129724:0:25726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938510.130986:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938510.131003:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000684fc97c/0x7b044d4128f9f19a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.131017:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2480030e00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938510.131023:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000684fc97c/0x7b044d4128f9f19a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.131037:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000684fc97c/0x7b044d4128f9f19a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.131062:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000684fc97c/0x7b044d4128f9f19a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.131072:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000684fc97c/0x7b044d4128f9f19a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.131099:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.131103:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.131105:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938510.131494:0:25726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x72:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938510.131516:0:25726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db15c6a5/0x7b044d4128f9f1a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.131530:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x72:0x0].0x0 since=776s v=(0 0) 00010000:00010000:0.0:1784938510.131534:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x72:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938510.131540:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db15c6a5/0x7b044d4128f9f1a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.131553:0:25726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db15c6a5/0x7b044d4128f9f1a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.131562:0:25726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db15c6a5/0x7b044d4128f9f1a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.131570:0:25726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db15c6a5/0x7b044d4128f9f1a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.131592:0:25726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938510.131602:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938510.131607:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db15c6a5/0x7b044d4128f9f1a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.131615:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057e00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938510.131618:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db15c6a5/0x7b044d4128f9f1a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.131631:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db15c6a5/0x7b044d4128f9f1a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.131645:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db15c6a5/0x7b044d4128f9f1a1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.131652:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db15c6a5/0x7b044d4128f9f1a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.131665:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.131667:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.131668:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938510.131719:0:25726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x71:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938510.131726:0:25726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004766fa96/0x7b044d4128f9f1a8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.131734:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71:0x0].0x0 since=776s v=(0 0) 00010000:00010000:0.0:1784938510.131738:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938510.131742:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004766fa96/0x7b044d4128f9f1a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.131751:0:25726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004766fa96/0x7b044d4128f9f1a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.131758:0:25726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004766fa96/0x7b044d4128f9f1a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.131766:0:25726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004766fa96/0x7b044d4128f9f1a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.131793:0:25726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784938510.131835:0:25726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x70:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938510.131841:0:25726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f10ec8f1/0x7b044d4128f9f1af lrc: 3/0,1 mode: --/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.131849:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x70:0x0].0x0 since=776s v=(0 0) 00010000:00010000:0.0:1784938510.131852:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x70:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938510.131856:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f10ec8f1/0x7b044d4128f9f1af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.131865:0:25726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f10ec8f1/0x7b044d4128f9f1af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.131873:0:25726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f10ec8f1/0x7b044d4128f9f1af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.131879:0:25726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f10ec8f1/0x7b044d4128f9f1af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.131893:0:25726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784938510.131902:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938510.131906:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004766fa96/0x7b044d4128f9f1a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.131914:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4056600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938510.131917:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004766fa96/0x7b044d4128f9f1a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.131925:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004766fa96/0x7b044d4128f9f1a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.131936:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004766fa96/0x7b044d4128f9f1a8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.131944:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004766fa96/0x7b044d4128f9f1a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.131955:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938510.131958:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f10ec8f1/0x7b044d4128f9f1af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.131965:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4056800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938510.131968:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f10ec8f1/0x7b044d4128f9f1af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.131975:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f10ec8f1/0x7b044d4128f9f1af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.131984:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f10ec8f1/0x7b044d4128f9f1af lrc: 1/0,0 mode: --/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.131992:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f10ec8f1/0x7b044d4128f9f1af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132001:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.132003:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.132005:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938510.132051:0:25726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938510.132057:0:25726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000331fa39b/0x7b044d4128f9f1b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132065:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6f:0x0].0x0 since=776s v=(0 0) 00010000:00010000:0.0:1784938510.132068:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938510.132072:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000331fa39b/0x7b044d4128f9f1b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132081:0:25726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000331fa39b/0x7b044d4128f9f1b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132088:0:25726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000331fa39b/0x7b044d4128f9f1b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132095:0:25726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000331fa39b/0x7b044d4128f9f1b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132110:0:25726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938510.132118:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938510.132123:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000331fa39b/0x7b044d4128f9f1b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132131:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4056c00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938510.132134:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000331fa39b/0x7b044d4128f9f1b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132142:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000331fa39b/0x7b044d4128f9f1b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132182:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000331fa39b/0x7b044d4128f9f1b6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132189:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000331fa39b/0x7b044d4128f9f1b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132201:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.132202:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.132204:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938510.132249:0:25726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938510.132254:0:25726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b01e28b4/0x7b044d4128f9f1bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132261:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6e:0x0].0x0 since=776s v=(0 0) 00010000:00010000:0.0:1784938510.132264:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938510.132268:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b01e28b4/0x7b044d4128f9f1bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132282:0:25726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b01e28b4/0x7b044d4128f9f1bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132291:0:25726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b01e28b4/0x7b044d4128f9f1bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132297:0:25726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b01e28b4/0x7b044d4128f9f1bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132310:0:25726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938510.132316:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938510.132319:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b01e28b4/0x7b044d4128f9f1bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132327:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938510.132330:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b01e28b4/0x7b044d4128f9f1bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132338:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b01e28b4/0x7b044d4128f9f1bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132348:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b01e28b4/0x7b044d4128f9f1bd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132357:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b01e28b4/0x7b044d4128f9f1bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132371:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.132373:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.132374:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938510.132424:0:25726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938510.132430:0:25726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d815b0aa/0x7b044d4128f9f1c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132438:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6d:0x0].0x0 since=776s v=(0 0) 00010000:00010000:0.0:1784938510.132441:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938510.132445:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d815b0aa/0x7b044d4128f9f1c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132455:0:25726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d815b0aa/0x7b044d4128f9f1c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132464:0:25726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d815b0aa/0x7b044d4128f9f1c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132471:0:25726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d815b0aa/0x7b044d4128f9f1c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132484:0:25726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938510.132491:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938510.132494:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d815b0aa/0x7b044d4128f9f1c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132508:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938510.132511:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d815b0aa/0x7b044d4128f9f1c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132519:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d815b0aa/0x7b044d4128f9f1c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132529:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d815b0aa/0x7b044d4128f9f1c4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132537:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d815b0aa/0x7b044d4128f9f1c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132550:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.132553:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.132554:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938510.132600:0:25726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938510.132606:0:25726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d69cb8e1/0x7b044d4128f9f1cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132614:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6c:0x0].0x0 since=776s v=(0 0) 00010000:00010000:0.0:1784938510.132617:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938510.132621:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d69cb8e1/0x7b044d4128f9f1cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132630:0:25726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d69cb8e1/0x7b044d4128f9f1cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132639:0:25726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d69cb8e1/0x7b044d4128f9f1cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132647:0:25726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d69cb8e1/0x7b044d4128f9f1cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132660:0:25726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938510.132667:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938510.132671:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d69cb8e1/0x7b044d4128f9f1cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132678:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4056200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938510.132681:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d69cb8e1/0x7b044d4128f9f1cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132689:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d69cb8e1/0x7b044d4128f9f1cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132700:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d69cb8e1/0x7b044d4128f9f1cb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132707:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d69cb8e1/0x7b044d4128f9f1cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.132720:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.132722:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.132724:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938510.132768:0:25726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938510.132774:0:25726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3bd6645/0x7b044d4128f9f1d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.143465:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6b:0x0].0x0 since=776s v=(0 0) 00010000:00010000:0.0:1784938510.143473:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938510.143484:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3bd6645/0x7b044d4128f9f1d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.143606:0:25726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3bd6645/0x7b044d4128f9f1d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.143622:0:25726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3bd6645/0x7b044d4128f9f1d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.143630:0:25726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3bd6645/0x7b044d4128f9f1d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.143678:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.143696:0:25726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938510.143711:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938510.143719:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3bd6645/0x7b044d4128f9f1d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.143728:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4056400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938510.143733:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3bd6645/0x7b044d4128f9f1d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.143821:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3bd6645/0x7b044d4128f9f1d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.143847:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3bd6645/0x7b044d4128f9f1d2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.143855:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3bd6645/0x7b044d4128f9f1d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.143892:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.143894:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.143896:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938510.144053:0:25726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938510.144060:0:25726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec965129/0x7b044d4128f9f1d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.144070:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6a:0x0].0x0 since=776s v=(0 0) 00010000:00010000:0.0:1784938510.144073:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938510.144077:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec965129/0x7b044d4128f9f1d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.144086:0:25726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec965129/0x7b044d4128f9f1d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.144094:0:25726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec965129/0x7b044d4128f9f1d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.144103:0:25726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec965129/0x7b044d4128f9f1d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.144118:0:25726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938510.144127:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938510.144132:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec965129/0x7b044d4128f9f1d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.144139:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4056a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938510.147020:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec965129/0x7b044d4128f9f1d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.147054:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec965129/0x7b044d4128f9f1d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.147082:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec965129/0x7b044d4128f9f1d9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.147090:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec965129/0x7b044d4128f9f1d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.147120:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.147123:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938510.147126:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938510.149260:0:25726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x69:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938510.149276:0:25726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcd3e12b/0x7b044d4128f9f1e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.149297:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x69:0x0].0x0 since=776s v=(0 0) 00010000:00010000:0.0:1784938510.149302:0:25726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x69:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938510.149310:0:25726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcd3e12b/0x7b044d4128f9f1e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.149327:0:25726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcd3e12b/0x7b044d4128f9f1e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.149340:0:25726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcd3e12b/0x7b044d4128f9f1e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.149350:0:25726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcd3e12b/0x7b044d4128f9f1e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938510.149383:0:25726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1784938510.149423:0:25726:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000400:104 00010000:00010000:1.0:1784938510.149915:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938510.149926:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcd3e12b/0x7b044d4128f9f1e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938510.149937:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938510.149943:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcd3e12b/0x7b044d4128f9f1e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938510.149955:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcd3e12b/0x7b044d4128f9f1e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938510.149977:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcd3e12b/0x7b044d4128f9f1e0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938510.149986:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcd3e12b/0x7b044d4128f9f1e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938510.150013:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938510.150015:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938510.150017:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938510.152419:0:25726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+6:27350:x1871643350941440:12345-192.168.202.154@tcp:5:osp-pre-0-1.0 Request processed in 87662us (87836us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938510.152441:0:25726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 990 00000100:00100000:1.0:1784938510.154987:0:27350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0edc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:27350:1871643350941440:192.168.202.154@tcp:5:osp-pre-0-1.0 00000004:00080000:1.0:1784938510.155016:0:27350:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x81:0x0] from OST, last_created [0x280000400:0x81:0x0]last_used is [0x280000400:0x68:0x0] 00000100:00100000:1.0:1784938510.155090:0:27350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0edc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:27350:1871643350941824:192.168.202.154@tcp:5:osp-pre-0-1.0 00000100:00100000:1.0:1784938510.155232:0:27350:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24831b4000 going to sleep for 11 seconds 00000100:00100000:0.0:1784938510.156558:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938510.156608:0:25729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350941824 00000100:00100000:0.0:1784938510.156618:0:25729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350941824 00000100:00100000:0.0:1784938510.156679:0:25729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 992 00000100:00100000:0.0:1784938510.156690:0:25729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+6:27350:x1871643350941824:12345-192.168.202.154@tcp:5:osp-pre-0-1.0 00002000:00080000:0.0:1784938510.156773:0:25729:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x280000400 at 130 00000001:00080000:0.0:1784938510.172459:0:21144:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967567 is committed 00000001:00100000:0.0:1784938510.172520:0:21144:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00002000:00080000:0.0:1784938510.172575:0:25729:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x280000400 at 138 00002000:00010000:2.0:1784938510.177493:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938510.177528:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093f69a35/0x7b044d4128f9f1e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.177553:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7e:0x0].0x0 since=776s v=(0 0) 00010000:00010000:2.0:1784938510.177559:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938510.177568:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093f69a35/0x7b044d4128f9f1e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.177586:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093f69a35/0x7b044d4128f9f1e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.177600:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093f69a35/0x7b044d4128f9f1e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.177609:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093f69a35/0x7b044d4128f9f1e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.177635:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938510.177649:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938510.177656:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093f69a35/0x7b044d4128f9f1e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.177665:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e01600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938510.177670:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093f69a35/0x7b044d4128f9f1e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.177681:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093f69a35/0x7b044d4128f9f1e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.177700:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093f69a35/0x7b044d4128f9f1e7 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.177708:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093f69a35/0x7b044d4128f9f1e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.177727:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938510.177729:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938510.177731:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938510.177884:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938510.177890:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026765547/0x7b044d4128f9f1ee lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.177899:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7d:0x0].0x0 since=776s v=(0 0) 00010000:00010000:2.0:1784938510.177902:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938510.177907:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026765547/0x7b044d4128f9f1ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.177918:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026765547/0x7b044d4128f9f1ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.177926:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026765547/0x7b044d4128f9f1ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.177933:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026765547/0x7b044d4128f9f1ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.177951:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938510.177960:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938510.177965:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026765547/0x7b044d4128f9f1ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.177980:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938510.177983:0:25732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026765547/0x7b044d4128f9f1ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.177991:0:25732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026765547/0x7b044d4128f9f1ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.178003:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026765547/0x7b044d4128f9f1ee lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.178009:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026765547/0x7b044d4128f9f1ee lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.178021:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938510.178023:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938510.178024:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938510.178072:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938510.178078:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000308168bd/0x7b044d4128f9f1f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.178086:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7c:0x0].0x0 since=776s v=(0 0) 00010000:00010000:2.0:1784938510.178088:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938510.178093:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000308168bd/0x7b044d4128f9f1f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.178102:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000308168bd/0x7b044d4128f9f1f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.178109:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000308168bd/0x7b044d4128f9f1f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.178116:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000308168bd/0x7b044d4128f9f1f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.178131:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938510.178139:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938510.178175:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000308168bd/0x7b044d4128f9f1f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.178183:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938510.178186:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000308168bd/0x7b044d4128f9f1f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.178195:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000308168bd/0x7b044d4128f9f1f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.178205:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000308168bd/0x7b044d4128f9f1f5 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.178811:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000308168bd/0x7b044d4128f9f1f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.178836:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938510.178839:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938510.178841:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938510.178942:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938510.178949:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9f1fc lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.178959:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7b:0x0].0x0 since=776s v=(0 0) 00010000:00010000:2.0:1784938510.178963:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938510.178968:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9f1fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.178978:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9f1fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.178987:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9f1fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.178994:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9f1fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.179015:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938510.179023:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938510.179028:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9f1fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.179035:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e01200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938510.179039:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9f1fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.179051:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9f1fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.179062:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9f1fc lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.179070:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e4a76a9/0x7b044d4128f9f1fc lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.179082:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938510.179083:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938510.179084:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938510.179129:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938510.179134:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d2fa755/0x7b044d4128f9f203 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.179142:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7a:0x0].0x0 since=776s v=(0 0) 00010000:00010000:2.0:1784938510.179452:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938510.179457:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d2fa755/0x7b044d4128f9f203 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.179469:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d2fa755/0x7b044d4128f9f203 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.179477:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d2fa755/0x7b044d4128f9f203 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.179485:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d2fa755/0x7b044d4128f9f203 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.180184:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938510.180198:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938510.180205:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d2fa755/0x7b044d4128f9f203 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.180227:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e01a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938510.180231:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d2fa755/0x7b044d4128f9f203 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.180240:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d2fa755/0x7b044d4128f9f203 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.180254:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d2fa755/0x7b044d4128f9f203 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.180262:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d2fa755/0x7b044d4128f9f203 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.180278:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938510.180280:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938510.180282:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938510.180372:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x79:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938510.180381:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fcea42e/0x7b044d4128f9f20a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.180391:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x79:0x0].0x0 since=776s v=(0 0) 00010000:00010000:2.0:1784938510.180394:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x79:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938510.180399:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fcea42e/0x7b044d4128f9f20a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.180410:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fcea42e/0x7b044d4128f9f20a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.180418:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fcea42e/0x7b044d4128f9f20a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.180426:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fcea42e/0x7b044d4128f9f20a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.180442:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938510.180450:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938510.180455:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fcea42e/0x7b044d4128f9f20a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.180462:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e01e00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938510.180466:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fcea42e/0x7b044d4128f9f20a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.180474:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fcea42e/0x7b044d4128f9f20a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.180486:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fcea42e/0x7b044d4128f9f20a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.180495:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fcea42e/0x7b044d4128f9f20a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.181700:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938510.181703:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938510.181705:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938510.181886:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x78:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938510.181894:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ff6aa56/0x7b044d4128f9f211 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.181907:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x78:0x0].0x0 since=776s v=(0 0) 00010000:00010000:2.0:1784938510.181911:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x78:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938510.181917:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ff6aa56/0x7b044d4128f9f211 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.181930:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ff6aa56/0x7b044d4128f9f211 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.181941:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ff6aa56/0x7b044d4128f9f211 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.181949:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ff6aa56/0x7b044d4128f9f211 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.181978:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938510.181987:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938510.181993:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ff6aa56/0x7b044d4128f9f211 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.182001:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938510.182006:0:25732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ff6aa56/0x7b044d4128f9f211 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.182014:0:25732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ff6aa56/0x7b044d4128f9f211 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.182028:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ff6aa56/0x7b044d4128f9f211 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.182035:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ff6aa56/0x7b044d4128f9f211 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.182048:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938510.182051:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938510.182052:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938510.182106:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x77:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938510.182112:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015193dfb/0x7b044d4128f9f218 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.182121:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x77:0x0].0x0 since=776s v=(0 0) 00010000:00010000:2.0:1784938510.182125:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x77:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938510.182130:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015193dfb/0x7b044d4128f9f218 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.182139:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015193dfb/0x7b044d4128f9f218 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.182169:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015193dfb/0x7b044d4128f9f218 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.182178:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015193dfb/0x7b044d4128f9f218 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.182191:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938510.182199:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938510.182204:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015193dfb/0x7b044d4128f9f218 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.182211:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e01400 already unused, calling callback (ffffffffc0d954a0) 00000001:00080000:0.0:1784938510.182850:0:25729:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967567 00002000:00080000:0.0:1784938510.182912:0:25729:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x280000400 at 146 00000001:00080000:0.0:1784938510.184036:0:25729:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967568 00002000:00080000:0.0:1784938510.184062:0:25729:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x280000400 at 154 00010000:00010000:2.0:1784938510.184320:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015193dfb/0x7b044d4128f9f218 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.184336:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015193dfb/0x7b044d4128f9f218 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.184357:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015193dfb/0x7b044d4128f9f218 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.184371:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015193dfb/0x7b044d4128f9f218 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.184396:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938510.184399:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938510.184402:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784938510.184908:0:25729:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967569 00000100:00100000:0.0:1784938510.185065:0:25729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+8:27350:x1871643350941824:12345-192.168.202.154@tcp:5:osp-pre-0-1.0 Request processed in 28369us (28507us total) trans 4294967570 rc 0/0 00000100:00100000:0.0:1784938510.185077:0:25729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 992 00000020:00080000:0.0:1784938510.185084:0:25729:0:(tgt_main.c:784:tgt_ses_key_exit()) total 4 transactions per RPC 00002000:00010000:2.0:1784938510.187883:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x76:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938510.187909:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000507b298e/0x7b044d4128f9f21f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.187932:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x76:0x0].0x0 since=776s v=(0 0) 00010000:00010000:2.0:1784938510.187938:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x76:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938510.187947:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000507b298e/0x7b044d4128f9f21f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.187968:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000507b298e/0x7b044d4128f9f21f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.187984:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000507b298e/0x7b044d4128f9f21f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.187994:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000507b298e/0x7b044d4128f9f21f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.188174:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938510.188190:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938510.188198:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000507b298e/0x7b044d4128f9f21f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.188207:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00c00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938510.188224:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000507b298e/0x7b044d4128f9f21f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.188236:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000507b298e/0x7b044d4128f9f21f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.188258:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000507b298e/0x7b044d4128f9f21f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.188266:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000507b298e/0x7b044d4128f9f21f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.188292:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938510.188294:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938510.188296:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938510.189091:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x75:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938510.189101:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a5e02e4/0x7b044d4128f9f226 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.189113:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x75:0x0].0x0 since=776s v=(0 0) 00010000:00010000:2.0:1784938510.189117:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x75:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938510.189123:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a5e02e4/0x7b044d4128f9f226 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.189139:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a5e02e4/0x7b044d4128f9f226 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.189176:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a5e02e4/0x7b044d4128f9f226 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.189184:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a5e02e4/0x7b044d4128f9f226 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.189210:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784938510.189269:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x74:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938510.189275:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cac31b6d/0x7b044d4128f9f22d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.189283:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x74:0x0].0x0 since=776s v=(0 0) 00010000:00010000:2.0:1784938510.189286:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x74:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938510.189290:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cac31b6d/0x7b044d4128f9f22d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.189299:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cac31b6d/0x7b044d4128f9f22d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.189307:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cac31b6d/0x7b044d4128f9f22d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.189320:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cac31b6d/0x7b044d4128f9f22d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.189338:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784938510.189470:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938510.189475:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a5e02e4/0x7b044d4128f9f226 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.189484:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00e00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938510.189488:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a5e02e4/0x7b044d4128f9f226 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.189853:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938510.189862:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cac31b6d/0x7b044d4128f9f22d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.189870:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17ba00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938510.189873:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cac31b6d/0x7b044d4128f9f22d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.189882:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cac31b6d/0x7b044d4128f9f22d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.189899:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cac31b6d/0x7b044d4128f9f22d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.189906:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cac31b6d/0x7b044d4128f9f22d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.189928:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938510.189930:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938510.189932:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938510.189958:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a5e02e4/0x7b044d4128f9f226 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.189973:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a5e02e4/0x7b044d4128f9f226 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.189981:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a5e02e4/0x7b044d4128f9f226 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.189996:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938510.189998:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938510.190000:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938510.190056:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x73:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938510.190064:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006472ffd4/0x7b044d4128f9f234 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.190073:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x73:0x0].0x0 since=776s v=(0 0) 00010000:00010000:2.0:1784938510.190076:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x73:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938510.190081:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006472ffd4/0x7b044d4128f9f234 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.190091:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006472ffd4/0x7b044d4128f9f234 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.190099:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006472ffd4/0x7b044d4128f9f234 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.190107:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006472ffd4/0x7b044d4128f9f234 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.190129:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784938510.190196:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x72:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938510.190202:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090273ca6/0x7b044d4128f9f23b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.190211:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x72:0x0].0x0 since=776s v=(0 0) 00010000:00010000:2.0:1784938510.190281:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x72:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938510.190285:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090273ca6/0x7b044d4128f9f23b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.190295:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090273ca6/0x7b044d4128f9f23b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.190304:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090273ca6/0x7b044d4128f9f23b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.190310:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090273ca6/0x7b044d4128f9f23b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.190323:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784938510.190331:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938510.190335:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006472ffd4/0x7b044d4128f9f234 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.190602:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938510.190609:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090273ca6/0x7b044d4128f9f23b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.190616:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17bc00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938510.190620:0:25732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090273ca6/0x7b044d4128f9f23b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.190628:0:25732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090273ca6/0x7b044d4128f9f23b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.190640:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090273ca6/0x7b044d4128f9f23b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.190646:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090273ca6/0x7b044d4128f9f23b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.190661:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938510.190663:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938510.190665:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938510.190690:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17a000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938510.190696:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006472ffd4/0x7b044d4128f9f234 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.190707:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006472ffd4/0x7b044d4128f9f234 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.190718:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006472ffd4/0x7b044d4128f9f234 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.190724:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006472ffd4/0x7b044d4128f9f234 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.190740:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938510.190818:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938510.190820:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938510.190888:0:27350:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967567 gen 2 00002000:00010000:2.0:1784938510.190889:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x71:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938510.190894:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003adfbbe2/0x7b044d4128f9f242 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.190902:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x71:0x0].0x0 since=776s v=(0 0) 00010000:00010000:2.0:1784938510.190905:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x71:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1784938510.190907:0:27350:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9f238e0edc00 x1871643350941824/t4294967570(4294967570) o5->lustre-OST0000-osc-MDT0001@192.168.202.154@tcp:28/4 lens 432/432 e 0 to 0 dl 1784938526 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1784938510.190910:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003adfbbe2/0x7b044d4128f9f242 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.190919:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003adfbbe2/0x7b044d4128f9f242 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938510.190925:0:27350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0edc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:27350:1871643350941824:192.168.202.154@tcp:5:osp-pre-0-1.0 00010000:00010000:2.0:1784938510.190926:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003adfbbe2/0x7b044d4128f9f242 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.190934:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003adfbbe2/0x7b044d4128f9f242 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938510.190949:0:27350:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x81:0x0]-[0x280000400:0xa1:0x0] 00010000:00010000:2.0:1784938510.190992:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938510.191019:0:27350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0eed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:27350:1871643350941952:192.168.202.154@tcp:900:osp-pre-0-1.0 00002000:00010000:2.0:1784938510.191035:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x70:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938510.191040:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091814461/0x7b044d4128f9f249 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.191048:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x70:0x0].0x0 since=776s v=(0 0) 00010000:00010000:2.0:1784938510.191051:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x70:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938510.191055:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091814461/0x7b044d4128f9f249 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.191063:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091814461/0x7b044d4128f9f249 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.191071:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091814461/0x7b044d4128f9f249 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.191077:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091814461/0x7b044d4128f9f249 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.191109:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938510.191115:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003adfbbe2/0x7b044d4128f9f242 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.191122:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17aa00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938510.191125:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003adfbbe2/0x7b044d4128f9f242 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.191133:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003adfbbe2/0x7b044d4128f9f242 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.191166:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003adfbbe2/0x7b044d4128f9f242 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.191176:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003adfbbe2/0x7b044d4128f9f242 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.191192:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938510.191195:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091814461/0x7b044d4128f9f249 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.191202:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17a800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938510.191206:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091814461/0x7b044d4128f9f249 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.191287:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091814461/0x7b044d4128f9f249 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938510.191292:0:27350:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24831b4000 going to sleep for 11 seconds 00010000:00010000:3.0:1784938510.191307:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091814461/0x7b044d4128f9f249 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.191320:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938510.191321:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938510.191323:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938510.191448:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784938510.191459:0:21152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091814461/0x7b044d4128f9f249 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.191586:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938510.191688:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938510.191694:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b9ed1c8/0x7b044d4128f9f250 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.191704:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6f:0x0].0x0 since=776s v=(0 0) 00010000:00010000:2.0:1784938510.191707:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938510.191712:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b9ed1c8/0x7b044d4128f9f250 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.191722:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b9ed1c8/0x7b044d4128f9f250 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.191736:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b9ed1c8/0x7b044d4128f9f250 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.192316:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b9ed1c8/0x7b044d4128f9f250 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.192402:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784938510.192470:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938510.192476:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fe810d2/0x7b044d4128f9f257 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.192484:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6e:0x0].0x0 since=776s v=(0 0) 00010000:00010000:2.0:1784938510.192486:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938510.192491:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fe810d2/0x7b044d4128f9f257 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.192571:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fe810d2/0x7b044d4128f9f257 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.192579:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fe810d2/0x7b044d4128f9f257 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.192587:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fe810d2/0x7b044d4128f9f257 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.192607:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1784938510.192651:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938510.192655:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e788d2b/0x7b044d4128f9f25e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.192663:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6d:0x0].0x0 since=776s v=(0 0) 00010000:00010000:2.0:1784938510.192665:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938510.192669:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e788d2b/0x7b044d4128f9f25e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.192677:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e788d2b/0x7b044d4128f9f25e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.192684:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e788d2b/0x7b044d4128f9f25e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.192691:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e788d2b/0x7b044d4128f9f25e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.192705:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1784938510.192713:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784938510.192719:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b9ed1c8/0x7b044d4128f9f250 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.192726:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17b600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938510.192732:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b9ed1c8/0x7b044d4128f9f250 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.192826:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938510.192833:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fe810d2/0x7b044d4128f9f257 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.192841:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17a600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938510.192846:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fe810d2/0x7b044d4128f9f257 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.192855:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fe810d2/0x7b044d4128f9f257 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.192870:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fe810d2/0x7b044d4128f9f257 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.192879:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fe810d2/0x7b044d4128f9f257 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.192894:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938510.192897:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e788d2b/0x7b044d4128f9f25e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.192904:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17a400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938510.192907:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e788d2b/0x7b044d4128f9f25e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.192914:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e788d2b/0x7b044d4128f9f25e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.192923:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e788d2b/0x7b044d4128f9f25e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.192930:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e788d2b/0x7b044d4128f9f25e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.192940:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938510.192942:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938510.192944:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938510.192951:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938510.192975:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b9ed1c8/0x7b044d4128f9f250 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.192988:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b9ed1c8/0x7b044d4128f9f250 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.192996:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b9ed1c8/0x7b044d4128f9f250 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.193011:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938510.193013:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938510.193014:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938510.193059:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938510.193065:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfc96367/0x7b044d4128f9f265 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.193074:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6c:0x0].0x0 since=776s v=(0 0) 00010000:00010000:2.0:1784938510.193077:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938510.193082:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfc96367/0x7b044d4128f9f265 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.193092:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfc96367/0x7b044d4128f9f265 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.193101:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfc96367/0x7b044d4128f9f265 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.193109:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cfc96367/0x7b044d4128f9f265 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.193209:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784938510.193269:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938510.193275:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9f26c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.193283:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6b:0x0].0x0 since=776s v=(0 0) 00010000:00010000:2.0:1784938510.193286:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938510.193291:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9f26c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.193301:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9f26c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.193310:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9f26c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.193318:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9f26c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.193471:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938510.193478:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cfc96367/0x7b044d4128f9f265 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.193486:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17be00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938510.193490:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfc96367/0x7b044d4128f9f265 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.193509:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfc96367/0x7b044d4128f9f265 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.193527:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cfc96367/0x7b044d4128f9f265 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.193535:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfc96367/0x7b044d4128f9f265 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.193551:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938510.193554:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9f26c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.193560:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17b000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938510.193564:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9f26c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.193571:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9f26c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.193582:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9f26c lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.193590:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938510.193592:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938510.193594:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938510.193717:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784938510.193722:0:21152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd7865b4/0x7b044d4128f9f26c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938510.193817:0:21152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938510.193822:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004078d00f/0x7b044d4128f9f273 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.193831:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6a:0x0].0x0 since=776s v=(0 0) 00010000:00010000:2.0:1784938510.193834:0:21152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938510.193839:0:21152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004078d00f/0x7b044d4128f9f273 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.193848:0:21152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004078d00f/0x7b044d4128f9f273 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.193856:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004078d00f/0x7b044d4128f9f273 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938510.193863:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004078d00f/0x7b044d4128f9f273 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.193950:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938510.193956:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004078d00f/0x7b044d4128f9f273 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.193963:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17ac00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938510.193967:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004078d00f/0x7b044d4128f9f273 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.193975:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004078d00f/0x7b044d4128f9f273 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.193986:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004078d00f/0x7b044d4128f9f273 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938510.193994:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938510.193997:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938510.193999:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938510.194060:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784938510.194065:0:21152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004078d00f/0x7b044d4128f9f273 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1784938510.194116:0:21152:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000400:105 00000100:00100000:2.0:1784938510.194254:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:27352:x1871643350941568:12345-192.168.202.154@tcp:5:osp-pre-1-1.0 Request processed in 115543us (119219us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938510.194271:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 991 00000100:00100000:1.0:1784938510.195680:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938510.195731:0:26618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350941952 00000100:00100000:1.0:1784938510.195762:0:27352:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ee680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:27352:1871643350941568:192.168.202.154@tcp:5:osp-pre-1-1.0 00000004:00080000:1.0:1784938510.195776:0:27352:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x81:0x0] from OST, last_created [0x2c0000400:0x81:0x0]last_used is [0x2c0000400:0x69:0x0] 00000100:00100000:2.0:1784938510.195821:0:26618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350941952 00000100:00100000:2.0:1784938510.195890:0:26618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 1 00000100:00100000:2.0:1784938510.195900:0:26618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:27350:x1871643350941952:12345-192.168.202.154@tcp:900:osp-pre-0-1.0 00010000:00080000:2.0:1784938510.195922:0:26618:0:(ldlm_lib.c:3234:target_queue_recovery_request()) @@@ not queueing req@ffff9f238e0efb80 x1871643350941952/t0(0) o900->lustre-MDT0000-lwp-MDT0001_UUID@192.168.202.154@tcp:741/0 lens 264/0 e 0 to 0 dl 1784938521 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938510.196002:0:26618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:27350:x1871643350941952:12345-192.168.202.154@tcp:900:osp-pre-0-1.0 Request processed in 103us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938510.196010:0:26618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 1 00000100:00100000:1.0:1784938510.196049:0:27352:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ee680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:27352:1871643350942080:192.168.202.154@tcp:5:osp-pre-1-1.0 00000100:00100000:1.0:1784938510.196120:0:27352:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24831b4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938510.196290:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00010000:00080000:1.0:1784938510.196333:0:27350:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f238e0eed80 x1871643350941952/t0(0) o900->lustre-MDT0000-lwp-MDT0001@192.168.202.154@tcp:29/10 lens 264/248 e 0 to 0 dl 1784938526 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938510.196346:0:27350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0eed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:27350:1871643350941952:192.168.202.154@tcp:900:osp-pre-0-1.0 00010000:00010000:3.0:1784938510.196902:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938510.197728:0:25724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350942080 00000100:00100000:2.0:1784938510.197814:0:25724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350942080 00000100:00100000:2.0:1784938510.197883:0:25724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 993 00000100:00100000:2.0:1784938510.197893:0:25724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+6:27352:x1871643350942080:12345-192.168.202.154@tcp:5:osp-pre-1-1.0 00002000:00080000:2.0:1784938510.197949:0:25724:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x2c0000400 at 130 00000001:00080000:2.0:1784938510.211283:0:22178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967567 is committed 00000001:00100000:2.0:1784938510.211352:0:22178:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00002000:00080000:2.0:1784938510.211406:0:25724:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x2c0000400 at 138 00000001:00080000:2.0:1784938510.212230:0:25724:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967567 00002000:00080000:2.0:1784938510.212265:0:25724:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x2c0000400 at 146 00000001:00080000:2.0:1784938510.212858:0:25724:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967568 00002000:00080000:2.0:1784938510.212879:0:25724:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x2c0000400 at 154 00000001:00080000:2.0:1784938510.213660:0:25724:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967569 00000100:00100000:2.0:1784938510.214114:0:25724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+8:27352:x1871643350942080:12345-192.168.202.154@tcp:5:osp-pre-1-1.0 Request processed in 16214us (17820us total) trans 4294967570 rc 0/0 00000100:00100000:2.0:1784938510.214128:0:25724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 993 00000020:00080000:2.0:1784938510.214136:0:25724:0:(tgt_main.c:784:tgt_ses_key_exit()) total 4 transactions per RPC 00000100:00100000:2.0:1784938510.215017:0:27352:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967567 gen 2 00000100:00100000:2.0:1784938510.215034:0:27352:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9f238e0ee680 x1871643350942080/t4294967570(4294967570) o5->lustre-OST0001-osc-MDT0001@192.168.202.154@tcp:28/4 lens 432/432 e 0 to 0 dl 1784938526 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938510.215050:0:27352:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ee680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:27352:1871643350942080:192.168.202.154@tcp:5:osp-pre-1-1.0 00000004:00080000:2.0:1784938510.215071:0:27352:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x81:0x0]-[0x2c0000400:0xa1:0x0] 00000100:00100000:2.0:1784938510.215134:0:27352:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23823ba680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:27352:1871643350942208:192.168.202.154@tcp:900:osp-pre-1-1.0 00000100:00100000:2.0:1784938510.215251:0:27352:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b6a64840 going to sleep for 11 seconds 00000100:00100000:0.0:1784938510.215517:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938510.218976:0:27364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350942208 00000100:00100000:2.0:1784938510.218998:0:27364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350942208 00000100:00100000:2.0:1784938510.219093:0:26618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 2 00000100:00100000:2.0:1784938510.219106:0:26618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:27352:x1871643350942208:12345-192.168.202.154@tcp:900:osp-pre-1-1.0 00010000:00080000:2.0:1784938510.219131:0:26618:0:(ldlm_lib.c:3234:target_queue_recovery_request()) @@@ not queueing req@ffff9f24b68c1880 x1871643350942208/t0(0) o900->lustre-MDT0000-lwp-MDT0001_UUID@192.168.202.154@tcp:741/0 lens 264/0 e 0 to 0 dl 1784938521 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938510.219880:0:26618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:27352:x1871643350942208:12345-192.168.202.154@tcp:900:osp-pre-1-1.0 Request processed in 771us (4359us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938510.219894:0:26618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 2 00010000:00080000:3.0:1784938510.223183:0:27352:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f23823ba680 x1871643350942208/t0(0) o900->lustre-MDT0000-lwp-MDT0001@192.168.202.154@tcp:29/10 lens 264/248 e 0 to 0 dl 1784938526 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938510.223222:0:27352:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23823ba680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:27352:1871643350942208:192.168.202.154@tcp:900:osp-pre-1-1.0 00010000:00010000:3.0:1784938510.250399:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938510.510132:0:26643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34e40 going to sleep for 0 seconds 00000100:00100000:3.0:1784938511.144644:0:27363:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24831b40c0 going to sleep for 0 seconds 00010000:00010000:0.0:1784938511.272956:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938511.528241:0:26643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34e40 going to sleep for 0 seconds 10000000:01000000:1.0:1784938511.592677:0:19231:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784938511.592693:0:19231:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9f2489215800 from 14 10000000:01000000:1.0:1784938511.592704:0:19231:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784938511.592797:0:19231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238db39c00/0x7b044d4128f9f27a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938511.592814:0:19231:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f238db39c00/0x7b044d4128f9f27a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938511.592830:0:19231:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f238db39c00/0x7b044d4128f9f27a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938511.592876:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350942336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784938511.592990:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938511.593074:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24831b4000 going to sleep for 11 seconds 00000100:00100000:2.0:1784938511.593185:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350942336 00000100:00100000:2.0:1784938511.593198:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350942336 00000100:00100000:2.0:1784938511.593278:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784938511.593290:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+22:19231:x1871643350942336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938511.593312:0:26601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938511.593345:0:26601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f238d17a000/0x7b044d4128f9f281 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9f27a expref: -99 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938511.593382:0:26601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f238d17a000/0x7b044d4128f9f281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9f27a expref: 23 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938511.593401:0:26601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f238d17a000/0x7b044d4128f9f281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9f27a expref: 23 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938511.593411:0:26601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17a000, rc 0) 00000100:00100000:2.0:1784938511.593484:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+23:19231:x1871643350942336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938511.593491:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784938511.593825:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350942336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938511.593848:0:19231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f238db39c00/0x7b044d4128f9f27a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f281 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938511.593859:0:19231:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f238db39c00/0x7b044d4128f9f27a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9f281 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938511.593938:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350942464:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784938511.593980:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938511.594015:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24831b4000 going to sleep for 11 seconds 00000100:00100000:0.0:1784938511.594126:0:26598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350942464 00000100:00100000:0.0:1784938511.594132:0:26598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350942464 00000100:00100000:0.0:1784938511.594198:0:26598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784938511.594206:0:26598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+23:19231:x1871643350942464:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784938511.594223:0:26598:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784938511.594243:0:26598:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784938511.594247:0:26598:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1784938511.594353:0:26598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+23:19231:x1871643350942464:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 148us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938511.594362:0:26598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784938511.595662:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350942464:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784938511.595752:0:19231:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784938511.595765:0:19231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238db39c00/0x7b044d4128f9f27a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f281 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938511.595790:0:19231:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f238db39c00/0x7b044d4128f9f27a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f281 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938511.595810:0:19231:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784938511.595813:0:19231:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9f238e2b0800 from 14 10000000:01000000:1.0:1784938511.595817:0:19231:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784938511.595860:0:19231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238db39a00/0x7b044d4128f9f288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938511.595870:0:19231:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f238db39a00/0x7b044d4128f9f288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938511.595881:0:19231:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f238db39a00/0x7b044d4128f9f288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938511.595905:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350942592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784938511.595971:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938511.596022:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24831b4000 going to sleep for 11 seconds 00000100:00100000:1.0:1784938511.596062:0:26598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350942592 00000100:00100000:1.0:1784938511.596070:0:26598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350942592 00000100:00100000:1.0:1784938511.596124:0:26598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784938511.596135:0:26598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+23:19231:x1871643350942592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938511.596175:0:26598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938511.596192:0:26598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f238db38a00/0x7b044d4128f9f28f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9f288 expref: -99 pid: 26598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938511.596220:0:26598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f238db38a00/0x7b044d4128f9f28f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9f288 expref: 24 pid: 26598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938511.597186:0:26598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f238db38a00/0x7b044d4128f9f28f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9f288 expref: 24 pid: 26598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938511.597208:0:26598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238db38a00, rc 0) 00000100:00100000:1.0:1784938511.597287:0:26598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+24:19231:x1871643350942592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1152us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938511.597297:0:26598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784938511.597748:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350942592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938511.597787:0:19231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f238db39a00/0x7b044d4128f9f288 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f28f expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938511.597800:0:19231:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f238db39a00/0x7b044d4128f9f288 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9f28f expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938511.597894:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350942720:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784938511.597950:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938511.597995:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2485023a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938511.598106:0:26600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350942720 00000100:00100000:2.0:1784938511.598114:0:26600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350942720 00000100:00100000:2.0:1784938511.598184:0:26600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784938511.598196:0:26600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+24:19231:x1871643350942720:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784938511.598224:0:26600:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784938511.598246:0:26600:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784938511.598250:0:26600:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1784938511.598371:0:26600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+24:19231:x1871643350942720:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 177us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938511.598380:0:26600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1784938511.598796:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350942720:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1784938511.598861:0:19231:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784938511.598872:0:19231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238db39a00/0x7b044d4128f9f288 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f28f expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938511.598883:0:19231:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f238db39a00/0x7b044d4128f9f288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f28f expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938512.168317:0:27363:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24831b40c0 going to sleep for 0 seconds 00010000:00010000:3.0:1784938512.296410:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938512.561730:0:26643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34e40 going to sleep for 0 seconds 00000100:00100000:3.0:1784938513.192274:0:27363:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24831b40c0 going to sleep for 0 seconds 00010000:00010000:0.0:1784938513.323404:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938513.583264:0:26643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34e40 going to sleep for 0 seconds 00000100:00100000:3.0:1784938514.216732:0:27363:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24831b40c0 going to sleep for 0 seconds 00010000:00010000:0.0:1784938514.345330:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938514.600383:0:26643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34e40 going to sleep for 0 seconds 00000100:00080000:0.0:1784938515.113112:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784938515.113122:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1784938515.113126:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f24b4115000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784938515.113166:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9f24b4115000 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:0.0:1784938515.113193:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b68c0e00 x1871643350943104/t0(0) o38->lustre-MDT0001-lwp-OST0000@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784938515.113234:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784938515.113238:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1784938515.113240:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f238ce54800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784938515.113246:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9f238ce54800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:0.0:1784938515.113258:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b68c1f80 x1871643350943360/t0(0) o38->lustre-MDT0001-lwp-OST0001@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784938515.113268:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1784938515.113271:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1784938515.113272:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f2387dd9800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784938515.113277:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f2387dd9800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:0.0:1784938515.113288:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b68c1180 x1871643350943488/t0(0) o38->lustre-MDT0001-osp-MDT0000@192.168.202.154@tcp:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784938515.113314:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784938515.113317:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:0.0:1784938515.113360:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350943616:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938515.113477:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350944128:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938515.113549:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1784938515.113557:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e07296-2a01-411c-abf2-6d190cb69ef0:16389:1871643350942848:0@lo:400:kworker.0 00000100:00100000:0.0:1784938515.113615:0:16389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938515.113646:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350943744:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938515.113668:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:16389:1871643350944256:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938515.113697:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:16391:1871643350942976:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938515.113717:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:16391:1871643350943872:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938515.113737:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784938515.113754:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:16391:1871643350943232:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938515.113776:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350944000:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938515.113807:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:16388:1871643350943104:192.168.202.154@tcp:38:kworker.0 00000100:00100000:0.0:1784938515.113845:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:16388:1871643350943360:192.168.202.154@tcp:38:kworker.0 00000100:00100000:0.0:1784938515.113863:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350943488:192.168.202.154@tcp:38:kworker.0 00000100:00100000:0.0:1784938515.114334:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938515.114400:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938515.114425:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938515.114446:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938515.114463:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938515.114482:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938515.114498:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938515.114514:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938515.114706:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350942848 00000100:00100000:1.0:1784938515.114714:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350942848 00000100:00100000:1.0:1784938515.114774:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784938515.114783:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+24:16389:x1871643350942848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784938515.114843:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+24:16389:x1871643350942848:12345-0@lo:400:kworker.0 Request processed in 61us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938515.114850:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784938515.114885:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784938515.114895:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350944384:192.168.202.154@tcp:13:osp-pre-0-1.0 00000100:00100000:1.0:1784938515.114969:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e07296-2a01-411c-abf2-6d190cb69ef0:16389:1871643350942848:0@lo:400:kworker.0 00000100:00100000:1.0:1784938515.115011:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350944128 00000100:00100000:1.0:1784938515.115014:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350944128 00000100:00100000:1.0:1784938515.115051:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350943616 00000100:00100000:1.0:1784938515.115054:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350943616 00000100:00100000:1.0:1784938515.115074:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350943744 00000100:00100000:1.0:1784938515.115076:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350943744 00000100:00100000:1.0:1784938515.115093:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350944000 00000100:00100000:1.0:1784938515.115096:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350944000 00000100:00100000:1.0:1784938515.115117:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 106 00000100:00100000:1.0:1784938515.115123:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+8:16389:x1871643350944128:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938515.115173:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+8:16389:x1871643350944128:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 50us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938515.115181:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 106 00000100:00100000:1.0:1784938515.115194:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 107 00000100:00100000:1.0:1784938515.115201:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:16389:x1871643350943616:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938515.115224:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:16389:x1871643350943616:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 24us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938515.115230:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 107 00000100:00100000:1.0:1784938515.115241:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 108 00000100:00100000:1.0:1784938515.115247:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:16389:x1871643350943744:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938515.115274:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:16389:x1871643350943744:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 27us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938515.115279:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 108 00000100:00100000:1.0:1784938515.115289:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 109 00000100:00100000:1.0:1784938515.115295:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+8:16391:x1871643350944000:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938515.115317:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+8:16391:x1871643350944000:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 22us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938515.115322:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 109 00000100:00100000:2.0:1784938515.115483:0:26609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350944256 00000100:00100000:2.0:1784938515.115487:0:26609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350944256 00000100:00100000:2.0:1784938515.115512:0:26609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350943872 00000100:00100000:2.0:1784938515.115515:0:26609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350943872 00000100:00100000:2.0:1784938515.115524:0:26609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350942976 00000100:00100000:2.0:1784938515.115526:0:26609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350942976 00000100:00100000:2.0:1784938515.115550:0:26609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350943232 00000100:00100000:2.0:1784938515.115552:0:26609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350943232 00000100:00100000:2.0:1784938515.115567:0:26609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 11 00000100:00100000:2.0:1784938515.115573:0:26609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:16389:x1871643350944256:12345-192.168.202.154@tcp:400:kworker.0 00010000:00080000:2.0:1784938515.115585:0:26609:0:(ldlm_lib.c:3234:target_queue_recovery_request()) @@@ not queueing req@ffff9f24bd257100 x1871643350944256/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@192.168.202.154@tcp:746/0 lens 224/0 e 0 to 0 dl 1784938526 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938515.115615:0:26609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:16389:x1871643350944256:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 42us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938515.115621:0:26609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 11 00000100:00100000:2.0:1784938515.115634:0:26609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 12 00000100:00100000:2.0:1784938515.115639:0:26609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:16391:x1871643350943872:12345-192.168.202.154@tcp:400:kworker.0 00010000:00080000:2.0:1784938515.115646:0:26609:0:(ldlm_lib.c:3234:target_queue_recovery_request()) @@@ not queueing req@ffff9f24bd257480 x1871643350943872/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@192.168.202.154@tcp:746/0 lens 224/0 e 0 to 0 dl 1784938526 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938515.115669:0:26609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:16391:x1871643350943872:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 30us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938515.115675:0:26609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 12 00000100:00100000:2.0:1784938515.115685:0:26609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 13 00000100:00100000:2.0:1784938515.115691:0:26609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:16391:x1871643350942976:12345-192.168.202.154@tcp:400:kworker.0 00010000:00080000:2.0:1784938515.115698:0:26609:0:(ldlm_lib.c:3234:target_queue_recovery_request()) @@@ not queueing req@ffff9f24bd255f80 x1871643350942976/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@192.168.202.154@tcp:746/0 lens 224/0 e 0 to 0 dl 1784938526 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938515.115723:0:26609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:16391:x1871643350942976:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 32us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938515.115729:0:26609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 13 00000100:00100000:2.0:1784938515.115751:0:26609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 14 00000100:00100000:2.0:1784938515.115758:0:26609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:16391:x1871643350943232:12345-192.168.202.154@tcp:400:kworker.0 00010000:00080000:2.0:1784938515.115768:0:26609:0:(ldlm_lib.c:3234:target_queue_recovery_request()) @@@ not queueing req@ffff9f24bd257800 x1871643350943232/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@192.168.202.154@tcp:746/0 lens 224/0 e 0 to 0 dl 1784938526 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938515.115789:0:26609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:16391:x1871643350943232:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 32us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938515.115795:0:26609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 14 00000100:00100000:0.0:1784938515.116090:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938515.116120:0:26607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350943104 00000100:00100000:0.0:1784938515.116124:0:26607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350943104 00000100:00100000:0.0:1784938515.116161:0:26607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 17 00000100:00100000:0.0:1784938515.116167:0:26607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16388:x1871643350943104:12345-192.168.202.154@tcp:38:kworker.0 00010000:00080000:0.0:1784938515.116195:0:26607:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@192.168.202.154@tcp t0 exp 0000000000000000 cur 781 last 0 00000020:00000080:0.0:1784938515.116249:0:26607:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x7b044d4128f9f296 00000004:00100000:0.0:1784938515.116264:0:26607:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784938515.116393:0:26607:0:(import.c:65:import_set_state_nolock()) ffff9f24b2ce5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784938515.116422:0:26607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:16388:x1871643350943104:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 254us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938515.116428:0:26607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 17 00000100:00080000:0.0:1784938515.116589:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784938515.116594:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784938515.119770:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938515.119799:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350944512:192.168.202.154@tcp:13:osp-pre-1-1.0 00000100:00100000:0.0:1784938515.126659:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938515.126723:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938515.126758:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938515.126784:0:21154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350944384 00000100:00100000:0.0:1784938515.126793:0:21154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350944384 00000100:00100000:0.0:1784938515.126842:0:21154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 92 00000100:00100000:0.0:1784938515.126851:0:21154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+8:16392:x1871643350944384:12345-192.168.202.154@tcp:13:osp-pre-0-1.0 00002000:00000024:0.0:1784938515.126883:0:21154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 271936 pending 0 free 313057280 avail 285245440 00000100:00100000:0.0:1784938515.126946:0:21154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+8:16392:x1871643350944384:12345-192.168.202.154@tcp:13:osp-pre-0-1.0 Request processed in 96us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938515.126953:0:21154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 92 00000100:00100000:1.0:1784938515.127172:0:21161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350943488 00000100:00100000:1.0:1784938515.127177:0:21161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350943488 00000100:00100000:1.0:1784938515.127212:0:21161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 108 00000100:00100000:1.0:1784938515.127218:0:21161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:16388:x1871643350943488:12345-192.168.202.154@tcp:38:kworker.0 00010000:00080000:1.0:1784938515.127244:0:21161:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@192.168.202.154@tcp t0 exp 0000000000000000 cur 781 last 0 00000020:00000080:1.0:1784938515.127285:0:21161:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b044d4128f9f29d 00000004:00100000:1.0:1784938515.127299:0:21161:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1784938515.127306:0:21161:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1784938515.127423:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350943616:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938515.127710:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938515.127770:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350943744:192.168.202.154@tcp:400:kworker.0 00010000:00080000:1.0:1784938515.127786:0:16389:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f24b68c0380 x1871643350944256/t0(0) o400->lustre-MDT0000-lwp-MDT0001@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938515.127797:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:16389:1871643350944256:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938515.127811:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350944128:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938515.127852:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350944384:192.168.202.154@tcp:13:osp-pre-0-1.0 00010000:00080000:1.0:1784938515.127880:0:16388:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f24b68c0e00 x1871643350943104/t0(0) o38->lustre-MDT0001-lwp-OST0000@192.168.202.154@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784938515.127893:0:16388:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00010000:00080000:3.0:1784938515.128655:0:16391:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f24b68c2d80 x1871643350943232/t0(0) o400->lustre-MDT0000-lwp-OST0001@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938515.128669:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:16391:1871643350943232:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938515.128681:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350944000:192.168.202.154@tcp:400:kworker.0 00010000:00080000:3.0:1784938515.128692:0:16391:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f24b68c2300 x1871643350942976/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938515.128700:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:16391:1871643350942976:192.168.202.154@tcp:400:kworker.0 00010000:00080000:3.0:1784938515.128709:0:16391:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f24b68c3100 x1871643350943872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938515.128716:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:16391:1871643350943872:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938515.129270:0:26608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350943360 00000100:00100000:2.0:1784938515.129280:0:26608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350943360 00000100:00100000:2.0:1784938515.129331:0:26608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 18 00000100:00100000:2.0:1784938515.129339:0:26608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:16388:x1871643350943360:12345-192.168.202.154@tcp:38:kworker.0 00010000:00080000:2.0:1784938515.129374:0:26608:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@192.168.202.154@tcp t0 exp 0000000000000000 cur 781 last 0 00000020:00000080:2.0:1784938515.129412:0:26608:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x7b044d4128f9f2a4 00000004:00100000:2.0:1784938515.129425:0:26608:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784938515.129463:0:26608:0:(import.c:65:import_set_state_nolock()) ffff9f24b2d33800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938515.129527:0:26608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:16388:x1871643350943360:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 187us (2878us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938515.129657:0:21154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350944512 00000100:00100000:0.0:1784938515.129662:0:21154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350944512 00000100:00100000:0.0:1784938515.129696:0:21154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 93 00000100:00100000:0.0:1784938515.129704:0:21154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+8:16391:x1871643350944512:12345-192.168.202.154@tcp:13:osp-pre-1-1.0 00002000:00000024:0.0:1784938515.129726:0:21154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 271936 pending 0 free 313057280 avail 285245440 00000100:00100000:0.0:1784938515.129769:0:21154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+8:16391:x1871643350944512:12345-192.168.202.154@tcp:13:osp-pre-1-1.0 Request processed in 66us (2060us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938515.129776:0:21154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 93 00000100:00080000:1.0:1784938515.130514:0:16388:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0001-lwp-OST0000: lwp recover req@ffff9f24b68c0e00 x1871643350943104/t0(0) o38->lustre-MDT0001-lwp-OST0000@192.168.202.154@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938540 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784938515.130525:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b4115000 lustre-MDT0001_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1784938515.130530:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b4115000 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938515.130892:0:26608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 18 00000100:02000000:1.0:1784938515.131582:0:16388:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-lwp-OST0000: Connection restored to 192.168.202.154@tcp (at 192.168.202.154@tcp) 00000100:00100000:3.0:1784938515.132228:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350944512:192.168.202.154@tcp:13:osp-pre-1-1.0 00000100:00100000:1.0:1784938515.162526:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:16388:1871643350943104:192.168.202.154@tcp:38:kworker.0 00010000:00080000:0.0:1784938515.162728:0:16388:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f24b68c1f80 x1871643350943360/t0(0) o38->lustre-MDT0001-lwp-OST0001@192.168.202.154@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784938515.162763:0:16388:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1784938515.165860:0:16388:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0001-lwp-OST0001: lwp recover req@ffff9f24b68c1f80 x1871643350943360/t0(0) o38->lustre-MDT0001-lwp-OST0001@192.168.202.154@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938540 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784938515.165878:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f238ce54800 lustre-MDT0001_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1784938515.165884:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f238ce54800 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1784938515.165889:0:16388:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-lwp-OST0001: Connection restored to 192.168.202.154@tcp (at 192.168.202.154@tcp) 00000100:00100000:0.0:1784938515.165895:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:16388:1871643350943360:192.168.202.154@tcp:38:kworker.0 00000100:00080000:1.0:1784938515.173039:0:21161:0:(import.c:65:import_set_state_nolock()) ffff9f2383aea000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938515.173136:0:21161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:16388:x1871643350943488:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 45914us (46409us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938515.173174:0:21161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 108 00000100:00080000:0.0:1784938515.173604:0:16388:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1784938515.173615:0:16388:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1784938515.173621:0:16388:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1784938515.173623:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f2387dd9800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1784938515.173648:0:16388:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000008f88336f): req@ffff9f24b6b8c700 x1871643350926976/t0(0) o1000->lustre-MDT0001-osp-MDT0000@192.168.202.154@tcp:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938515.173665:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350943488:192.168.202.154@tcp:38:kworker.0 00000100:00100000:3.0:1784938515.177759:0:26643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938515.177935:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938515.178005:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350944640:192.168.202.154@tcp:41:osp-pre-1-0.0 00000100:00100000:1.0:1784938515.178125:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938515.178487:0:25714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350926976 00000100:00100000:0.0:1784938515.178496:0:25714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350926976 00000100:00100000:0.0:1784938515.178549:0:25714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350944640 00000100:00100000:0.0:1784938515.178552:0:25714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350944640 00000100:00100000:0.0:1784938515.178566:0:25714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 109 00000100:00100000:0.0:1784938515.178575:0:25714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:26643:x1871643350926976:12345-192.168.202.154@tcp:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784938515.178648:0:25714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:26643:x1871643350926976:12345-192.168.202.154@tcp:1000:lod0000_rec0001.0 Request processed in 73us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938515.178655:0:25714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 109 00000100:00100000:0.0:1784938515.178671:0:25714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 110 00000100:00100000:0.0:1784938515.178677:0:25714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:16389:x1871643350944640:12345-192.168.202.154@tcp:41:osp-pre-1-0.0 00000004:00000024:0.0:1784938515.178697:0:25714:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 218472448 avail 191447040 00000100:00100000:0.0:1784938515.178723:0:25714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:16389:x1871643350944640:12345-192.168.202.154@tcp:41:osp-pre-1-0.0 Request processed in 46us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938515.178729:0:25714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 110 00000100:00100000:1.0:1784938515.178974:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350944640:192.168.202.154@tcp:41:osp-pre-1-0.0 00000100:00100000:0.0:1784938515.179167:0:26643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8c700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:26643:1871643350926976:192.168.202.154@tcp:1000:lod0000_rec0001.0 00000040:01000000:0.0:1784938515.179197:0:26643:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1784938515.179230:0:26643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd254380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:26643:1871643350944768:192.168.202.154@tcp:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784938515.179275:0:26643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d3a4900 going to sleep for 11 seconds 00000100:00100000:1.0:1784938515.179389:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938515.179486:0:25714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350944768 00000100:00100000:0.0:1784938515.179490:0:25714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350944768 00000100:00100000:0.0:1784938515.179519:0:25714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 111 00000100:00100000:0.0:1784938515.179525:0:25714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:26643:x1871643350944768:12345-192.168.202.154@tcp:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784938515.180492:0:25714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:26643:x1871643350944768:12345-192.168.202.154@tcp:1000:lod0000_rec0001.0 Request processed in 962us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938515.180501:0:25714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 111 00000100:00100000:3.0:1784938515.180864:0:26643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd254380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:26643:1871643350944768:192.168.202.154@tcp:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784938515.180946:0:26643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f228380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:26643:1871643350944896:192.168.202.154@tcp:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784938515.180992:0:26643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f249d7ba480 going to sleep for 11 seconds 00000100:00100000:0.0:1784938515.181095:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938515.181174:0:21161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350944896 00000100:00100000:3.0:1784938515.181179:0:21161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350944896 00000100:00100000:3.0:1784938515.181219:0:21161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 112 00000100:00100000:3.0:1784938515.181226:0:21161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:26643:x1871643350944896:12345-192.168.202.154@tcp:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784938515.181278:0:21161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:26643:x1871643350944896:12345-192.168.202.154@tcp:1000:lod0000_rec0001.0 Request processed in 52us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938515.181284:0:21161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 112 00000100:00100000:3.0:1784938515.181811:0:26643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f228380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:26643:1871643350944896:192.168.202.154@tcp:1000:lod0000_rec0001.0 00000040:00080000:3.0:1784938515.181871:0:26643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784938515.190173:0:26643:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784938515.195769:0:26643:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 23, retries 0 00000004:00080000:3.0:1784938515.195782:0:26643:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:0.0:1784938515.195960:0:26644:0:(ldlm_lib.c:2568:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 1 abort 0 expired 0 00010000:00080000:0.0:1784938515.195967:0:26644:0:(ldlm_lib.c:2706:replay_request_or_update()) Waiting for transno 8589934867 00000020:00080000:0.0:1784938515.195973:0:26644:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784938515.195977:0:26644:0:(ldlm_lib.c:2251:check_for_next_transno()) max: 1, connected: 1, completed: 1, queue_len: 0, req_transno: 0, next_transno: 8589934867 00010000:00080000:0.0:1784938515.195980:0:26644:0:(ldlm_lib.c:2285:check_for_next_transno()) waking for completed recovery 00000020:00080000:0.0:1784938515.195982:0:26644:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784938515.195992:0:26644:0:(ldlm_lib.c:2475:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1784938515.195995:0:26644:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1784938515.196108:0:26644:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00100000:1.0:1784938515.204702:0:26594:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:0.0:1784938515.204849:0:26644:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:0.0:1784938515.204891:0:26644:0:(ldlm_lib.c:2019:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:0.0:1784938515.204954:0:26644:0:(ldlm_lib.c:2963:target_recovery_thread()) @@@ processing final ping from 192.168.202.154@tcp: req@ffff9f238f22b480 x1871643350940032/t0(0) o400->lustre-MDT0001-mdtlov_UUID@192.168.202.154@tcp:740/0 lens 224/0 e 0 to 0 dl 1784938520 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1784938515.205074:0:26644:0:(ldlm_lib.c:1891:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 1 clients 1 recovered and 0 were evicted. 00000100:00080000:1.0:1784938515.210893:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b4113800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1784938515.210914:0:16388:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff9f24b68c0700 x1871643350940032/t0(0) o400->lustre-MDT0000-osp-MDT0001@192.168.202.154@tcp:24/4 lens 224/224 e 0 to 0 dl 1784938525 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784938515.210925:0:16388:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9f24b68c0700 x1871643350940032/t0(0) o400->lustre-MDT0000-osp-MDT0001@192.168.202.154@tcp:24/4 lens 224/224 e 0 to 0 dl 1784938525 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784938515.210932:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b4113800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1784938515.210958:0:16388:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 192.168.202.154@tcp (at 192.168.202.154@tcp) 00000100:00080000:1.0:1784938515.210966:0:16388:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000000f9fd469): req@ffff9f238e0eca80 x1871643350941696/t0(0) o1000->lustre-MDT0000-osp-MDT0001@192.168.202.154@tcp:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938515.210981:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:16388:1871643350940032:192.168.202.154@tcp:400:ptlrpcd_rcv.0 00000100:00100000:3.0:1784938515.211415:0:27363:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24831b40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938515.216317:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938515.216780:0:21161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350941696 00000100:00100000:3.0:1784938515.216792:0:21161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350941696 00000100:00100000:3.0:1784938515.216861:0:21161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 113 00000100:00100000:3.0:1784938515.216873:0:21161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:27363:x1871643350941696:12345-192.168.202.154@tcp:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784938515.216986:0:21161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:27363:x1871643350941696:12345-192.168.202.154@tcp:1000:lod0001_rec0000.0 Request processed in 114us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938515.216995:0:21161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 113 00000100:00100000:3.0:1784938515.217182:0:27363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0eca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:27363:1871643350941696:192.168.202.154@tcp:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784938515.217328:0:27363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f228380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:27363:1871643350945024:192.168.202.154@tcp:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784938515.217409:0:27363:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f249d7bac00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938515.217491:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938515.217514:0:21160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350945024 00000100:00100000:3.0:1784938515.217519:0:21160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350945024 00000100:00100000:3.0:1784938515.217557:0:21160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 114 00000100:00100000:3.0:1784938515.217565:0:21160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f229500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:27363:x1871643350945024:12345-192.168.202.154@tcp:1000:lod0001_rec0000.0 00000100:00100000:1.0:1784938515.224092:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938515.224121:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350945152:192.168.202.154@tcp:41:osp-pre-0-1.0 00000100:00100000:3.0:1784938515.225320:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938515.225480:0:21161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350945152 00000100:00100000:3.0:1784938515.225488:0:21161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350945152 00000100:00100000:3.0:1784938515.225542:0:21161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 115 00000100:00100000:3.0:1784938515.225553:0:21161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:16389:x1871643350945152:12345-192.168.202.154@tcp:41:osp-pre-0-1.0 00000004:00000024:3.0:1784938515.225590:0:21161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 218308608 avail 191283200 00000100:00100000:3.0:1784938515.225645:0:21161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:16389:x1871643350945152:12345-192.168.202.154@tcp:41:osp-pre-0-1.0 Request processed in 93us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938515.225652:0:21161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 115 00000100:00100000:3.0:1784938515.225810:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350945152:192.168.202.154@tcp:41:osp-pre-0-1.0 00000100:00100000:1.0:1784938515.237044:0:21160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f229500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:27363:x1871643350945024:12345-192.168.202.154@tcp:1000:lod0001_rec0000.0 Request processed in 19467us (19540us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938515.237061:0:21160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 114 00000100:00100000:3.0:1784938515.237657:0:27363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f228380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:27363:1871643350945024:192.168.202.154@tcp:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784938515.237805:0:27363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f228380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:27363:1871643350945280:192.168.202.154@tcp:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784938515.237859:0:27363:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f249d7baf00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938515.237942:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938515.237967:0:21161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350945280 00000100:00100000:3.0:1784938515.237973:0:21161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350945280 00000100:00100000:3.0:1784938515.238018:0:21161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 116 00000100:00100000:3.0:1784938515.238027:0:21161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:27363:x1871643350945280:12345-192.168.202.154@tcp:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784938515.238092:0:21161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:27363:x1871643350945280:12345-192.168.202.154@tcp:1000:lod0001_rec0000.0 Request processed in 66us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938515.238099:0:21161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 116 00000100:00100000:3.0:1784938515.238213:0:27363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f228380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:27363:1871643350945280:192.168.202.154@tcp:1000:lod0001_rec0000.0 00000004:00080000:3.0:1784938515.238256:0:27363:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9f249d7bae40 with version 1 00000040:00080000:3.0:1784938515.238279:0:27363:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000401:0x1:0x0] first idx 3, last_idx 4 00000004:00080000:3.0:1784938515.238291:0:27363:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9f24831b4540 with version 2 00000040:00080000:3.0:1784938515.243171:0:27363:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x200000bd1:0x1:0x0] at index 3 of catalog [0x200000401:0x1:0x0] 00000004:00080000:2.0:1784938515.243350:0:27346:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9f24829c33c0 version 1 rpc_version 1 00000020:00100000:2.0:1784938515.243393:0:27346:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1784938515.243408:0:27346:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9f23823bb800 x1871643350945536/t0(0) o1000->lustre-MDT0000-osp-MDT0001@192.168.202.154@tcp:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784938515.243435:0:27346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23823bb800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:27346:1871643350945536:192.168.202.154@tcp:1000:osp_up0-1.0 00000100:00100000:2.0:1784938515.243532:0:27346:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b6a64e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938515.243851:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938515.243885:0:21160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350945536 00000100:00100000:1.0:1784938515.243893:0:21160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350945536 00000100:00100000:1.0:1784938515.243938:0:21160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 117 00000100:00100000:1.0:1784938515.243947:0:21160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:27346:x1871643350945536:12345-192.168.202.154@tcp:1000:osp_up0-1.0 00000100:00100000:1.0:1784938515.244210:0:21160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:27346:x1871643350945536:12345-192.168.202.154@tcp:1000:osp_up0-1.0 Request processed in 263us (359us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1784938515.244219:0:21160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 117 00000100:00100000:2.0:1784938515.246000:0:27346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23823bb800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:27346:1871643350945536:192.168.202.154@tcp:1000:osp_up0-1.0 00000004:00080000:2.0:1784938515.246021:0:27346:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9f24829c33c0 version 2 rpc_version 2 00000020:00100000:2.0:1784938515.246047:0:27346:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1784938515.246054:0:27346:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9f23823ba680 x1871643350945792/t0(0) o1000->lustre-MDT0000-osp-MDT0001@192.168.202.154@tcp:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784938515.246073:0:27346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23823ba680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:27346:1871643350945792:192.168.202.154@tcp:1000:osp_up0-1.0 00000100:00100000:2.0:1784938515.246167:0:27346:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b6a64e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938515.246336:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938515.246363:0:25714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350945792 00000100:00100000:2.0:1784938515.246369:0:25714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350945792 00000100:00100000:2.0:1784938515.246414:0:25714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 118 00000100:00100000:2.0:1784938515.246423:0:25714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:27346:x1871643350945792:12345-192.168.202.154@tcp:1000:osp_up0-1.0 00000100:00100000:2.0:1784938515.246593:0:25714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:27346:x1871643350945792:12345-192.168.202.154@tcp:1000:osp_up0-1.0 Request processed in 170us (256us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1784938515.246601:0:25714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 118 00000100:00100000:2.0:1784938515.246711:0:27346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23823ba680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:27346:1871643350945792:192.168.202.154@tcp:1000:osp_up0-1.0 00000100:00100000:2.0:1784938515.246766:0:27363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23823bad80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:27363:1871643350945920:192.168.202.154@tcp:1000:lod0001_rec0000.0 00000100:00100000:2.0:1784938515.246835:0:27363:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b6a64180 going to sleep for 11 seconds 00000100:00100000:2.0:1784938515.246901:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938515.246919:0:21160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350945920 00000100:00100000:2.0:1784938515.246922:0:21160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350945920 00000100:00100000:2.0:1784938515.246942:0:21160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 119 00000100:00100000:2.0:1784938515.246948:0:21160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386362300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:27363:x1871643350945920:12345-192.168.202.154@tcp:1000:lod0001_rec0000.0 00000100:00100000:2.0:1784938515.247203:0:21160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386362300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:27363:x1871643350945920:12345-192.168.202.154@tcp:1000:lod0001_rec0000.0 Request processed in 253us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938515.247210:0:21160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 119 00000100:00100000:2.0:1784938515.247330:0:27363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23823bad80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:27363:1871643350945920:192.168.202.154@tcp:1000:lod0001_rec0000.0 00000040:00080000:2.0:1784938515.247383:0:27363:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1784938515.247387:0:27363:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x200000bd1:0x2:0x0] at index 4 of catalog [0x200000401:0x1:0x0] 00000100:00100000:2.0:1784938515.247441:0:27363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386363480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:27363:1871643350946048:192.168.202.154@tcp:1000:lod0001_rec0000.0 00000100:00100000:2.0:1784938515.247469:0:27363:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24852ca780 going to sleep for 11 seconds 00000100:00100000:2.0:1784938515.247531:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938515.247546:0:25714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350946048 00000100:00100000:2.0:1784938515.247550:0:25714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350946048 00000100:00100000:2.0:1784938515.247569:0:25714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 120 00000100:00100000:2.0:1784938515.247575:0:25714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386362a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:27363:x1871643350946048:12345-192.168.202.154@tcp:1000:lod0001_rec0000.0 00000100:00100000:2.0:1784938515.247615:0:25714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386362a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:27363:x1871643350946048:12345-192.168.202.154@tcp:1000:lod0001_rec0000.0 Request processed in 39us (84us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938515.247622:0:25714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 120 00000100:00100000:2.0:1784938515.247692:0:27363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386363480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:27363:1871643350946048:192.168.202.154@tcp:1000:lod0001_rec0000.0 00000040:00080000:2.0:1784938515.247729:0:27363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1784938515.247778:0:27363:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9f24852cab40 with version 3 00000004:00080000:2.0:1784938515.247812:0:27363:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9f24852ca600 with version 4 00000040:00080000:2.0:1784938515.247816:0:27363:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x200000bd1:0x2:0x0] at index 4 of catalog [0x200000401:0x1:0x0] 00000040:00080000:2.0:1784938515.247829:0:27363:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 4 count 1 00000004:00080000:2.0:1784938515.247890:0:27363:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 5, retries 0 00000004:00080000:2.0:1784938515.247894:0:27363:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000004:00080000:2.0:1784938515.247983:0:27346:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9f24829c33c0 version 3 rpc_version 3 00000020:00100000:2.0:1784938515.247997:0:27346:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1784938515.248004:0:27346:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9f2386363480 x1871643350946304/t0(0) o1000->lustre-MDT0000-osp-MDT0001@192.168.202.154@tcp:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784938515.248025:0:27346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386363480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:27346:1871643350946304:192.168.202.154@tcp:1000:osp_up0-1.0 00000100:00100000:2.0:1784938515.248053:0:27346:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24852cacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938515.248127:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938515.248163:0:25714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350946304 00000100:00100000:2.0:1784938515.248168:0:25714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350946304 00000100:00100000:2.0:1784938515.248190:0:25714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 121 00000100:00100000:2.0:1784938515.248197:0:25714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386360e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:27346:x1871643350946304:12345-192.168.202.154@tcp:1000:osp_up0-1.0 00000100:00100000:2.0:1784938515.248356:0:25714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386360e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:27346:x1871643350946304:12345-192.168.202.154@tcp:1000:osp_up0-1.0 Request processed in 159us (229us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1784938515.248363:0:25714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 121 00000100:00100000:2.0:1784938515.248471:0:27346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386363480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:27346:1871643350946304:192.168.202.154@tcp:1000:osp_up0-1.0 00000004:00080000:2.0:1784938515.248480:0:27346:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9f24829c33c0 version 4 rpc_version 4 00000020:00100000:2.0:1784938515.248493:0:27346:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1784938515.248498:0:27346:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9f2386360700 x1871643350946560/t0(0) o1000->lustre-MDT0000-osp-MDT0001@192.168.202.154@tcp:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784938515.248512:0:27346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386360700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:27346:1871643350946560:192.168.202.154@tcp:1000:osp_up0-1.0 00000100:00100000:2.0:1784938515.248541:0:27346:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b6a64e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938515.248613:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938515.248629:0:25714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350946560 00000100:00100000:2.0:1784938515.248633:0:25714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350946560 00000100:00100000:2.0:1784938515.248651:0:25714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 122 00000100:00100000:2.0:1784938515.248657:0:25714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:27346:x1871643350946560:12345-192.168.202.154@tcp:1000:osp_up0-1.0 00000100:00100000:2.0:1784938515.260974:0:25714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:27346:x1871643350946560:12345-192.168.202.154@tcp:1000:osp_up0-1.0 Request processed in 12300us (12345us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1784938515.260993:0:25714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 122 00000100:00100000:2.0:1784938515.265260:0:27346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386360700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:27346:1871643350946560:192.168.202.154@tcp:1000:osp_up0-1.0 00000004:00000080:1.0:1784938515.294913:0:26644:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbfdb4ca57e10 00100000:10000000:1.0:1784938515.294928:0:26644:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:1.0:1784938515.305195:0:26632:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x68:0x0] 00000100:00100000:1.0:1784938515.305270:0:26632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ec700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:26632:1871643350946688:192.168.202.154@tcp:5:osp-pre-1-0.0 00000100:00100000:1.0:1784938515.305381:0:26632:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2489295780 going to sleep for 11 seconds 00000004:00080000:2.0:1784938515.310810:0:26630:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x69:0x0] 00000100:00100000:2.0:1784938515.310867:0:26630:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:26630:1871643350946816:192.168.202.154@tcp:5:osp-pre-0-0.0 00000100:00100000:2.0:1784938515.310960:0:26630:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b6906d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938515.311182:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938515.311248:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938515.312358:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350946688 00000100:00100000:3.0:1784938515.312369:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350946688 00000100:00100000:3.0:1784938515.312424:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350946816 00000100:00100000:3.0:1784938515.312428:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350946816 00000100:00100000:3.0:1784938515.312456:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 994 00000100:00100000:3.0:1784938515.312467:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:26632:x1871643350946688:12345-192.168.202.154@tcp:5:osp-pre-1-0.0 00002000:00080000:3.0:1784938515.312504:0:21151:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 129 -> diff = -25 00002000:02000040:3.0:1784938515.312509:0:21151:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:105 to 0x2c0000401:129) 00000100:00100000:0.0:1784938515.315949:0:25727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 995 00000100:00100000:0.0:1784938515.315975:0:25727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:26630:x1871643350946816:12345-192.168.202.154@tcp:5:osp-pre-0-0.0 00002000:00080000:0.0:1784938515.316014:0:25727:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 129 -> diff = -24 00002000:02000040:0.0:1784938515.316020:0:25727:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:106 to 0x280000401:129) 00002000:00010000:3.0:1784938515.335673:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x81:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938515.335689:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8714fdb/0x7b044d4128f9f2ab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.335708:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x81:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1784938515.335713:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x81:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938515.335719:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8714fdb/0x7b044d4128f9f2ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.335735:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8714fdb/0x7b044d4128f9f2ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.335761:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8714fdb/0x7b044d4128f9f2ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.335769:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8714fdb/0x7b044d4128f9f2ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.335799:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784938515.335926:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x80:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938515.335931:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0ff6b1e/0x7b044d4128f9f2b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x80:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.335939:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x80:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1784938515.335942:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x80:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938515.335946:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0ff6b1e/0x7b044d4128f9f2b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.335954:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0ff6b1e/0x7b044d4128f9f2b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.335962:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0ff6b1e/0x7b044d4128f9f2b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.335969:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0ff6b1e/0x7b044d4128f9f2b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.335991:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784938515.336029:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938515.336034:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6d2a71d/0x7b044d4128f9f2b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.336042:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7f:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1784938515.336045:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938515.336048:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6d2a71d/0x7b044d4128f9f2b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.336057:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6d2a71d/0x7b044d4128f9f2b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.336066:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6d2a71d/0x7b044d4128f9f2b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.336074:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6d2a71d/0x7b044d4128f9f2b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.336091:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1784938515.336102:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784938515.336108:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8714fdb/0x7b044d4128f9f2ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.336117:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217da00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938515.336122:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8714fdb/0x7b044d4128f9f2ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.336131:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8714fdb/0x7b044d4128f9f2ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.336164:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8714fdb/0x7b044d4128f9f2ab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.336172:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8714fdb/0x7b044d4128f9f2ab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.336195:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938515.336198:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0ff6b1e/0x7b044d4128f9f2b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.336206:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217d200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938515.336209:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0ff6b1e/0x7b044d4128f9f2b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.336216:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0ff6b1e/0x7b044d4128f9f2b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.336227:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0ff6b1e/0x7b044d4128f9f2b2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.336235:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0ff6b1e/0x7b044d4128f9f2b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.336247:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938515.336250:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6d2a71d/0x7b044d4128f9f2b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.336257:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217ca00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938515.336260:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6d2a71d/0x7b044d4128f9f2b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.336268:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6d2a71d/0x7b044d4128f9f2b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.336277:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6d2a71d/0x7b044d4128f9f2b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.336283:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6d2a71d/0x7b044d4128f9f2b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.336296:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938515.336298:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938515.338153:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784938515.338280:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938515.338289:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000337df334/0x7b044d4128f9f2c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.338621:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7e:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1784938515.338627:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938515.338634:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000337df334/0x7b044d4128f9f2c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.338648:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000337df334/0x7b044d4128f9f2c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.338659:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000337df334/0x7b044d4128f9f2c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.338668:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000337df334/0x7b044d4128f9f2c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.338694:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784938515.338750:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938515.338756:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080def834/0x7b044d4128f9f2c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.338765:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7d:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1784938515.338768:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938515.338773:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080def834/0x7b044d4128f9f2c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.338783:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080def834/0x7b044d4128f9f2c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.338792:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080def834/0x7b044d4128f9f2c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.338801:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080def834/0x7b044d4128f9f2c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.338816:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784938515.338854:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938515.338860:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ac78920/0x7b044d4128f9f2ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.338868:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7c:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1784938515.338871:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938515.338875:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ac78920/0x7b044d4128f9f2ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.338885:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ac78920/0x7b044d4128f9f2ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.338893:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ac78920/0x7b044d4128f9f2ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.338901:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ac78920/0x7b044d4128f9f2ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.338915:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1784938515.338925:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784938515.338931:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000337df334/0x7b044d4128f9f2c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.338940:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217d600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938515.338944:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000337df334/0x7b044d4128f9f2c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.338955:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000337df334/0x7b044d4128f9f2c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.338970:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000337df334/0x7b044d4128f9f2c0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.338979:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000337df334/0x7b044d4128f9f2c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.339007:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938515.339010:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080def834/0x7b044d4128f9f2c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.339017:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217c200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938515.339020:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080def834/0x7b044d4128f9f2c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.339027:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080def834/0x7b044d4128f9f2c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.339037:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080def834/0x7b044d4128f9f2c7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.339044:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080def834/0x7b044d4128f9f2c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.339056:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938515.339059:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ac78920/0x7b044d4128f9f2ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.339065:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217ce00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938515.339068:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ac78920/0x7b044d4128f9f2ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.339074:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ac78920/0x7b044d4128f9f2ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.339083:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ac78920/0x7b044d4128f9f2ce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.339089:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ac78920/0x7b044d4128f9f2ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.339100:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938515.339102:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938515.339103:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784938515.339170:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938515.339176:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006dad1d34/0x7b044d4128f9f2d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.339186:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7b:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1784938515.339189:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938515.339194:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006dad1d34/0x7b044d4128f9f2d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.339205:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006dad1d34/0x7b044d4128f9f2d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.339214:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006dad1d34/0x7b044d4128f9f2d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.339222:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006dad1d34/0x7b044d4128f9f2d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.339236:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938515.339243:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938515.339246:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006dad1d34/0x7b044d4128f9f2d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.339254:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238217de00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938515.339257:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006dad1d34/0x7b044d4128f9f2d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.339264:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006dad1d34/0x7b044d4128f9f2d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.339279:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006dad1d34/0x7b044d4128f9f2d5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.339286:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006dad1d34/0x7b044d4128f9f2d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.339446:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938515.342441:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938515.342444:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938515.342448:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784938515.342561:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938515.342571:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087008cea/0x7b044d4128f9f2dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.342590:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7a:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1784938515.342594:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938515.342601:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087008cea/0x7b044d4128f9f2dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.342616:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087008cea/0x7b044d4128f9f2dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.342626:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087008cea/0x7b044d4128f9f2dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.342635:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087008cea/0x7b044d4128f9f2dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.342703:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784938515.342763:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x79:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938515.342769:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ea8d30f/0x7b044d4128f9f2e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.342779:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x79:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1784938515.342782:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x79:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938515.342787:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ea8d30f/0x7b044d4128f9f2e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.342796:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ea8d30f/0x7b044d4128f9f2e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.342804:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ea8d30f/0x7b044d4128f9f2e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.342811:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ea8d30f/0x7b044d4128f9f2e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.345750:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784938515.345764:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087008cea/0x7b044d4128f9f2dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.345777:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61a200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938515.345783:0:25732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087008cea/0x7b044d4128f9f2dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.345795:0:25732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087008cea/0x7b044d4128f9f2dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.345818:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087008cea/0x7b044d4128f9f2dc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.345826:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087008cea/0x7b044d4128f9f2dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.345862:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938515.345866:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ea8d30f/0x7b044d4128f9f2e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.345873:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61b600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938515.345876:0:25732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ea8d30f/0x7b044d4128f9f2e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.345885:0:25732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ea8d30f/0x7b044d4128f9f2e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.345896:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ea8d30f/0x7b044d4128f9f2e3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.345905:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.345907:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.345909:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.346239:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.346246:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938515.346290:0:25727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x81:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938515.346438:0:25727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d109a39b/0x7b044d4128f9f2ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.346460:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x81:0x0].0x0 since=781s v=(0 0) 00010000:00010000:1.0:1784938515.346464:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x81:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938515.346470:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d109a39b/0x7b044d4128f9f2ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.346487:0:25727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d109a39b/0x7b044d4128f9f2ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.346498:0:25727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d109a39b/0x7b044d4128f9f2ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.346506:0:25727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d109a39b/0x7b044d4128f9f2ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.346527:0:25727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938515.346538:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938515.346542:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d109a39b/0x7b044d4128f9f2ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.346550:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938515.346554:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d109a39b/0x7b044d4128f9f2ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.346562:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d109a39b/0x7b044d4128f9f2ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.346581:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d109a39b/0x7b044d4128f9f2ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.346589:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d109a39b/0x7b044d4128f9f2ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.346605:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.346607:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.346609:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938515.347900:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784938515.347912:0:21151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ea8d30f/0x7b044d4128f9f2e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938515.348022:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938515.348029:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026699c1b/0x7b044d4128f9f2f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.348041:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x78:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1784938515.348045:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x78:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938515.348050:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026699c1b/0x7b044d4128f9f2f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.348063:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026699c1b/0x7b044d4128f9f2f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.348073:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026699c1b/0x7b044d4128f9f2f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.348082:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026699c1b/0x7b044d4128f9f2f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.348098:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938515.349024:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938515.349033:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026699c1b/0x7b044d4128f9f2f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349042:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61bc00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938515.349047:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026699c1b/0x7b044d4128f9f2f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349056:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026699c1b/0x7b044d4128f9f2f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349072:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026699c1b/0x7b044d4128f9f2f1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349080:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026699c1b/0x7b044d4128f9f2f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349107:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.349109:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.349111:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.349118:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938515.349164:0:25727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x80:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938515.349169:0:25727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b5f9794/0x7b044d4128f9f2f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x80:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349180:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x80:0x0].0x0 since=781s v=(0 0) 00010000:00010000:1.0:1784938515.349183:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x80:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938515.349188:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b5f9794/0x7b044d4128f9f2f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349199:0:25727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b5f9794/0x7b044d4128f9f2f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349208:0:25727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b5f9794/0x7b044d4128f9f2f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349216:0:25727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b5f9794/0x7b044d4128f9f2f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349235:0:25727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938515.349245:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938515.349249:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b5f9794/0x7b044d4128f9f2f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349261:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db38c00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938515.349264:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b5f9794/0x7b044d4128f9f2f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349270:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b5f9794/0x7b044d4128f9f2f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349281:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b5f9794/0x7b044d4128f9f2f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349288:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b5f9794/0x7b044d4128f9f2f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349313:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.349315:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.349317:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938515.349387:0:25727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938515.349392:0:25727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b20eee20/0x7b044d4128f9f2ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349400:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7f:0x0].0x0 since=781s v=(0 0) 00010000:00010000:1.0:1784938515.349403:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938515.349407:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b20eee20/0x7b044d4128f9f2ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349416:0:25727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b20eee20/0x7b044d4128f9f2ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349425:0:25727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b20eee20/0x7b044d4128f9f2ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349433:0:25727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b20eee20/0x7b044d4128f9f2ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349449:0:25727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938515.349456:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938515.349461:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b20eee20/0x7b044d4128f9f2ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349469:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39e00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938515.349473:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b20eee20/0x7b044d4128f9f2ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349481:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b20eee20/0x7b044d4128f9f2ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349492:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b20eee20/0x7b044d4128f9f2ff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349499:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b20eee20/0x7b044d4128f9f2ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349512:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.349514:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.349516:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938515.349556:0:25727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938515.349561:0:25727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097541b4a/0x7b044d4128f9f306 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349570:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7e:0x0].0x0 since=781s v=(0 0) 00010000:00010000:1.0:1784938515.349572:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938515.349576:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097541b4a/0x7b044d4128f9f306 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349585:0:25727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097541b4a/0x7b044d4128f9f306 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349594:0:25727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097541b4a/0x7b044d4128f9f306 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349602:0:25727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097541b4a/0x7b044d4128f9f306 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349615:0:25727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938515.349621:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938515.349625:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097541b4a/0x7b044d4128f9f306 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349633:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938515.349636:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097541b4a/0x7b044d4128f9f306 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349651:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097541b4a/0x7b044d4128f9f306 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349661:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097541b4a/0x7b044d4128f9f306 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349669:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097541b4a/0x7b044d4128f9f306 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349681:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.349682:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.349684:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938515.349722:0:25727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938515.349728:0:25727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1d7f9cb/0x7b044d4128f9f30d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349736:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7d:0x0].0x0 since=781s v=(0 0) 00010000:00010000:1.0:1784938515.349752:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938515.349756:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d7f9cb/0x7b044d4128f9f30d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349765:0:25727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1d7f9cb/0x7b044d4128f9f30d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349774:0:25727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1d7f9cb/0x7b044d4128f9f30d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349783:0:25727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d7f9cb/0x7b044d4128f9f30d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349797:0:25727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938515.349804:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938515.349808:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1d7f9cb/0x7b044d4128f9f30d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349815:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db38600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938515.349819:0:25732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1d7f9cb/0x7b044d4128f9f30d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349827:0:25732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1d7f9cb/0x7b044d4128f9f30d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349838:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1d7f9cb/0x7b044d4128f9f30d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349846:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1d7f9cb/0x7b044d4128f9f30d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349859:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.349860:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.349862:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938515.349899:0:25727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938515.349907:0:25727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bd830c1/0x7b044d4128f9f314 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349916:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7c:0x0].0x0 since=781s v=(0 0) 00010000:00010000:1.0:1784938515.349920:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938515.349923:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bd830c1/0x7b044d4128f9f314 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349932:0:25727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bd830c1/0x7b044d4128f9f314 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349941:0:25727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bd830c1/0x7b044d4128f9f314 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349949:0:25727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bd830c1/0x7b044d4128f9f314 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349962:0:25727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938515.349969:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938515.349973:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bd830c1/0x7b044d4128f9f314 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349980:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938515.349983:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bd830c1/0x7b044d4128f9f314 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.349992:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bd830c1/0x7b044d4128f9f314 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350002:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bd830c1/0x7b044d4128f9f314 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350009:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bd830c1/0x7b044d4128f9f314 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350021:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.350023:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.350025:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938515.350063:0:25727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938515.350069:0:25727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060b77135/0x7b044d4128f9f31b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350077:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7b:0x0].0x0 since=781s v=(0 0) 00010000:00010000:1.0:1784938515.350080:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938515.350085:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060b77135/0x7b044d4128f9f31b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350093:0:25727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060b77135/0x7b044d4128f9f31b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350101:0:25727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060b77135/0x7b044d4128f9f31b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350109:0:25727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060b77135/0x7b044d4128f9f31b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350127:0:25727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938515.350134:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938515.350138:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060b77135/0x7b044d4128f9f31b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350166:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db38e00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938515.350169:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060b77135/0x7b044d4128f9f31b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350178:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060b77135/0x7b044d4128f9f31b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350189:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060b77135/0x7b044d4128f9f31b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350196:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060b77135/0x7b044d4128f9f31b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350210:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.350212:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.350214:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938515.350253:0:25727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938515.350258:0:25727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c154b833/0x7b044d4128f9f322 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350266:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7a:0x0].0x0 since=781s v=(0 0) 00010000:00010000:1.0:1784938515.350269:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938515.350273:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c154b833/0x7b044d4128f9f322 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350281:0:25727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c154b833/0x7b044d4128f9f322 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350288:0:25727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c154b833/0x7b044d4128f9f322 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350295:0:25727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c154b833/0x7b044d4128f9f322 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350308:0:25727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938515.350315:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938515.350318:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c154b833/0x7b044d4128f9f322 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350325:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938515.350327:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c154b833/0x7b044d4128f9f322 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350335:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c154b833/0x7b044d4128f9f322 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350344:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c154b833/0x7b044d4128f9f322 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350357:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c154b833/0x7b044d4128f9f322 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350369:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.350371:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.350373:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938515.350412:0:25727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x79:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938515.350418:0:25727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9bb6f8e/0x7b044d4128f9f329 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350426:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x79:0x0].0x0 since=781s v=(0 0) 00010000:00010000:1.0:1784938515.350429:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x79:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938515.350432:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9bb6f8e/0x7b044d4128f9f329 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350440:0:25727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9bb6f8e/0x7b044d4128f9f329 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350448:0:25727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9bb6f8e/0x7b044d4128f9f329 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350456:0:25727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9bb6f8e/0x7b044d4128f9f329 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350469:0:25727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938515.350475:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938515.350479:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9bb6f8e/0x7b044d4128f9f329 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350487:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938515.350490:0:25732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9bb6f8e/0x7b044d4128f9f329 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350499:0:25732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9bb6f8e/0x7b044d4128f9f329 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350509:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9bb6f8e/0x7b044d4128f9f329 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350517:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9bb6f8e/0x7b044d4128f9f329 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350530:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.350532:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.350534:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938515.350572:0:25727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x78:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938515.350577:0:25727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f832e683/0x7b044d4128f9f330 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350586:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78:0x0].0x0 since=781s v=(0 0) 00010000:00010000:1.0:1784938515.350590:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938515.350594:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f832e683/0x7b044d4128f9f330 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350608:0:25727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f832e683/0x7b044d4128f9f330 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350617:0:25727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f832e683/0x7b044d4128f9f330 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350625:0:25727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f832e683/0x7b044d4128f9f330 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350638:0:25727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938515.350646:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938515.350650:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f832e683/0x7b044d4128f9f330 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350657:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db38400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938515.350660:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f832e683/0x7b044d4128f9f330 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350669:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f832e683/0x7b044d4128f9f330 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350679:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f832e683/0x7b044d4128f9f330 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350687:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f832e683/0x7b044d4128f9f330 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.350700:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.350702:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.350704:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938515.351174:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784938515.351351:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x77:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938515.351358:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088ff705f/0x7b044d4128f9f33e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.351370:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1784938515.351373:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938515.351378:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088ff705f/0x7b044d4128f9f33e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.351387:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088ff705f/0x7b044d4128f9f33e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.351400:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088ff705f/0x7b044d4128f9f33e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.351407:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088ff705f/0x7b044d4128f9f33e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.351425:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784938515.351473:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x76:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938515.351479:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9585a08/0x7b044d4128f9f345 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.351486:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1784938515.351490:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938515.351494:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9585a08/0x7b044d4128f9f345 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.351503:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9585a08/0x7b044d4128f9f345 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.351512:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9585a08/0x7b044d4128f9f345 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.351519:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9585a08/0x7b044d4128f9f345 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.351539:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784938515.351574:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938515.351578:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000128c8131/0x7b044d4128f9f34c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.351586:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1784938515.351588:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938515.351592:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000128c8131/0x7b044d4128f9f34c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.351600:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000128c8131/0x7b044d4128f9f34c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.351609:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000128c8131/0x7b044d4128f9f34c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.351617:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000128c8131/0x7b044d4128f9f34c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.351630:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1784938515.351665:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938515.351671:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea2da067/0x7b044d4128f9f353 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.351679:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1784938515.351683:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938515.351687:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea2da067/0x7b044d4128f9f353 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.351696:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea2da067/0x7b044d4128f9f353 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.351704:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea2da067/0x7b044d4128f9f353 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.351711:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea2da067/0x7b044d4128f9f353 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.351724:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1784938515.351772:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938515.351777:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea074bdc/0x7b044d4128f9f35a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.351786:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1784938515.351789:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938515.351793:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea074bdc/0x7b044d4128f9f35a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.351803:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea074bdc/0x7b044d4128f9f35a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.351812:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea074bdc/0x7b044d4128f9f35a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.351819:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea074bdc/0x7b044d4128f9f35a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.351833:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1784938515.351868:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938515.351873:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e45c1791/0x7b044d4128f9f361 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.351882:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1784938515.351885:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938515.351889:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e45c1791/0x7b044d4128f9f361 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.351897:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e45c1791/0x7b044d4128f9f361 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.351906:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e45c1791/0x7b044d4128f9f361 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.351913:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e45c1791/0x7b044d4128f9f361 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.351921:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1784938515.351951:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938515.351957:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000164ff879/0x7b044d4128f9f368 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.351965:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1784938515.351969:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938515.351973:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000164ff879/0x7b044d4128f9f368 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.351982:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000164ff879/0x7b044d4128f9f368 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.351990:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000164ff879/0x7b044d4128f9f368 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.351998:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000164ff879/0x7b044d4128f9f368 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352006:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1784938515.352042:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938515.352047:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005777c505/0x7b044d4128f9f36f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352055:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1784938515.352058:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938515.352062:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005777c505/0x7b044d4128f9f36f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352071:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005777c505/0x7b044d4128f9f36f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352085:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005777c505/0x7b044d4128f9f36f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352094:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005777c505/0x7b044d4128f9f36f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352104:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:3.0:1784938515.352136:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938515.352141:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fcd2670/0x7b044d4128f9f376 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352171:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1784938515.352174:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938515.352179:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fcd2670/0x7b044d4128f9f376 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352189:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fcd2670/0x7b044d4128f9f376 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352199:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fcd2670/0x7b044d4128f9f376 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352208:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fcd2670/0x7b044d4128f9f376 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352223:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:3.0:1784938515.352260:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938515.352265:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c010a79b/0x7b044d4128f9f37d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352273:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1784938515.352275:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938515.352279:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c010a79b/0x7b044d4128f9f37d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352287:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c010a79b/0x7b044d4128f9f37d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352295:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c010a79b/0x7b044d4128f9f37d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352302:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c010a79b/0x7b044d4128f9f37d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352311:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:3.0:1784938515.352346:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938515.352352:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc245ddc/0x7b044d4128f9f384 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352359:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1784938515.352363:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938515.352367:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc245ddc/0x7b044d4128f9f384 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352376:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc245ddc/0x7b044d4128f9f384 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352383:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc245ddc/0x7b044d4128f9f384 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352389:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc245ddc/0x7b044d4128f9f384 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352397:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:3.0:1784938515.352432:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938515.352438:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a481461f/0x7b044d4128f9f38b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352445:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1784938515.352448:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938515.352453:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a481461f/0x7b044d4128f9f38b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352462:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a481461f/0x7b044d4128f9f38b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352470:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a481461f/0x7b044d4128f9f38b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352478:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a481461f/0x7b044d4128f9f38b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352488:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:3.0:1784938515.352519:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938515.352525:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b04cfea/0x7b044d4128f9f392 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352533:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1784938515.352536:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938515.352540:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b04cfea/0x7b044d4128f9f392 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352549:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b04cfea/0x7b044d4128f9f392 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352557:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b04cfea/0x7b044d4128f9f392 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352564:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b04cfea/0x7b044d4128f9f392 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352573:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:3.0:1784938515.352610:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938515.352615:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003d010a8/0x7b044d4128f9f399 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352624:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1784938515.352627:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938515.352632:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003d010a8/0x7b044d4128f9f399 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352640:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003d010a8/0x7b044d4128f9f399 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352648:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003d010a8/0x7b044d4128f9f399 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352656:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003d010a8/0x7b044d4128f9f399 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352665:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:3.0:1784938515.352699:0:21151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x69:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938515.352704:0:21151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000866e2be0/0x7b044d4128f9f3a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352712:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1784938515.352715:0:21151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938515.352720:0:21151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000866e2be0/0x7b044d4128f9f3a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352729:0:21151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000866e2be0/0x7b044d4128f9f3a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352758:0:21151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000866e2be0/0x7b044d4128f9f3a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352766:0:21151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000866e2be0/0x7b044d4128f9f3a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938515.352775:0:21151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00080000:3.0:1784938515.352804:0:21151:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:104 00000100:00100000:3.0:1784938515.352892:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:26632:x1871643350946688:12345-192.168.202.154@tcp:5:osp-pre-1-0.0 Request processed in 40422us (41707us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938515.352902:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 994 00000100:00100000:2.0:1784938515.353837:0:26632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ec700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:26632:1871643350946688:192.168.202.154@tcp:5:osp-pre-1-0.0 00000004:00080000:2.0:1784938515.353854:0:26632:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x81:0x0] from OST, last_created [0x2c0000401:0x81:0x0]last_used is [0x2c0000401:0x68:0x0] 00000100:00100000:2.0:1784938515.353922:0:26632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:26632:1871643350947072:192.168.202.154@tcp:5:osp-pre-1-0.0 00000100:00100000:2.0:1784938515.353979:0:26632:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2489295780 going to sleep for 11 seconds 00000100:00100000:2.0:1784938515.353996:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350946944:192.168.202.154@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938515.354261:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938515.354313:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00010000:00010000:2.0:1784938515.354351:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:2.0:1784938515.354358:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088ff705f/0x7b044d4128f9f33e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354369:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61a400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938515.354373:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088ff705f/0x7b044d4128f9f33e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354388:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088ff705f/0x7b044d4128f9f33e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354407:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088ff705f/0x7b044d4128f9f33e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354416:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088ff705f/0x7b044d4128f9f33e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354445:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:2.0:1784938515.354450:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9585a08/0x7b044d4128f9f345 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354457:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61b000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938515.354460:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9585a08/0x7b044d4128f9f345 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354468:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9585a08/0x7b044d4128f9f345 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354478:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9585a08/0x7b044d4128f9f345 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354486:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9585a08/0x7b044d4128f9f345 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354507:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:2.0:1784938515.354511:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000128c8131/0x7b044d4128f9f34c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354519:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61a600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938515.354522:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000128c8131/0x7b044d4128f9f34c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354530:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000128c8131/0x7b044d4128f9f34c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354539:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000128c8131/0x7b044d4128f9f34c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354546:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000128c8131/0x7b044d4128f9f34c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354560:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:2.0:1784938515.354564:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea2da067/0x7b044d4128f9f353 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354571:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61ba00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938515.354575:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea2da067/0x7b044d4128f9f353 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354588:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea2da067/0x7b044d4128f9f353 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354598:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea2da067/0x7b044d4128f9f353 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354607:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea2da067/0x7b044d4128f9f353 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354618:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:2.0:1784938515.354622:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea074bdc/0x7b044d4128f9f35a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354629:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61ae00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938515.354632:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea074bdc/0x7b044d4128f9f35a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354641:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea074bdc/0x7b044d4128f9f35a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354650:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea074bdc/0x7b044d4128f9f35a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354658:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea074bdc/0x7b044d4128f9f35a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354676:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:2.0:1784938515.354680:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e45c1791/0x7b044d4128f9f361 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354687:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61ac00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938515.354690:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e45c1791/0x7b044d4128f9f361 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354698:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e45c1791/0x7b044d4128f9f361 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354708:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e45c1791/0x7b044d4128f9f361 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354715:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e45c1791/0x7b044d4128f9f361 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354728:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1784938515.354732:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000164ff879/0x7b044d4128f9f368 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354751:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61be00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938515.354755:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000164ff879/0x7b044d4128f9f368 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354767:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000164ff879/0x7b044d4128f9f368 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354780:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000164ff879/0x7b044d4128f9f368 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354787:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000164ff879/0x7b044d4128f9f368 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354798:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1784938515.354802:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005777c505/0x7b044d4128f9f36f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354808:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61a800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938515.354811:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005777c505/0x7b044d4128f9f36f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354819:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005777c505/0x7b044d4128f9f36f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354827:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005777c505/0x7b044d4128f9f36f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354833:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005777c505/0x7b044d4128f9f36f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354848:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1784938515.354852:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fcd2670/0x7b044d4128f9f376 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354858:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61b400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938515.354861:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fcd2670/0x7b044d4128f9f376 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354868:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fcd2670/0x7b044d4128f9f376 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354877:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fcd2670/0x7b044d4128f9f376 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354883:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fcd2670/0x7b044d4128f9f376 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354892:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1784938515.354896:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c010a79b/0x7b044d4128f9f37d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354901:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61a000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938515.354904:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c010a79b/0x7b044d4128f9f37d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354914:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c010a79b/0x7b044d4128f9f37d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354922:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c010a79b/0x7b044d4128f9f37d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354927:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c010a79b/0x7b044d4128f9f37d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354936:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1784938515.354939:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc245ddc/0x7b044d4128f9f384 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354945:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61aa00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938515.354948:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc245ddc/0x7b044d4128f9f384 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354954:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc245ddc/0x7b044d4128f9f384 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354963:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc245ddc/0x7b044d4128f9f384 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354969:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc245ddc/0x7b044d4128f9f384 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938515.354977:0:25723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350947072 00010000:00010000:2.0:1784938515.354984:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:1.0:1784938515.354985:0:25723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350947072 00010000:00010000:2.0:1784938515.354987:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a481461f/0x7b044d4128f9f38b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.354993:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61b800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938515.354996:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a481461f/0x7b044d4128f9f38b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.355002:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a481461f/0x7b044d4128f9f38b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.355010:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a481461f/0x7b044d4128f9f38b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.355016:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a481461f/0x7b044d4128f9f38b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.355026:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784938515.355029:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b04cfea/0x7b044d4128f9f392 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.355035:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d61b200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938515.355038:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b04cfea/0x7b044d4128f9f392 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.355049:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b04cfea/0x7b044d4128f9f392 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.355057:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b04cfea/0x7b044d4128f9f392 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.355064:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b04cfea/0x7b044d4128f9f392 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.355073:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938515.355076:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003d010a8/0x7b044d4128f9f399 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.355081:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a7600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938515.355084:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003d010a8/0x7b044d4128f9f399 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.355091:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003d010a8/0x7b044d4128f9f399 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938515.355094:0:25723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 996 00010000:00010000:2.0:1784938515.355100:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003d010a8/0x7b044d4128f9f399 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938515.355103:0:25723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd5a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:26632:x1871643350947072:12345-192.168.202.154@tcp:5:osp-pre-1-0.0 00010000:00010000:2.0:1784938515.355107:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003d010a8/0x7b044d4128f9f399 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.355121:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938515.355124:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000866e2be0/0x7b044d4128f9f3a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.355130:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a7400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938515.355132:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000866e2be0/0x7b044d4128f9f3a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.355138:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000866e2be0/0x7b044d4128f9f3a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1784938515.355158:0:25723:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x2c0000401 at 130 00010000:00010000:2.0:1784938515.355166:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000866e2be0/0x7b044d4128f9f3a0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.355173:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000866e2be0/0x7b044d4128f9f3a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.355183:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938515.355185:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938515.355187:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938515.355193:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938515.355198:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938515.355203:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938515.355235:0:21154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350946944 00000100:00100000:2.0:1784938515.355239:0:21154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350946944 00000100:00100000:2.0:1784938515.355266:0:21154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 94 00000100:00100000:2.0:1784938515.355273:0:21154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:16391:x1871643350946944:12345-192.168.202.154@tcp:13:osp-pre-1-0.0 00002000:00000024:2.0:1784938515.355286:0:21154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 271936 pending 896 free 313057280 avail 285245440 00000100:00100000:2.0:1784938515.355328:0:21154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:16391:x1871643350946944:12345-192.168.202.154@tcp:13:osp-pre-1-0.0 Request processed in 54us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938515.355334:0:21154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 94 00000100:00100000:2.0:1784938515.355462:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350946944:192.168.202.154@tcp:13:osp-pre-1-0.0 00010000:00010000:2.0:1784938515.355483:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1784938515.355658:0:25723:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x2c0000401 at 138 00000001:00080000:1.0:1784938515.356334:0:25723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967571 00002000:00080000:1.0:1784938515.356353:0:25723:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x2c0000401 at 146 00000001:00080000:1.0:1784938515.356666:0:25723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967572 00002000:00080000:1.0:1784938515.356682:0:25723:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x2c0000401 at 154 00000001:00080000:1.0:1784938515.357004:0:25723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967573 00000100:00100000:1.0:1784938515.357127:0:25723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd5a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:26632:x1871643350947072:12345-192.168.202.154@tcp:5:osp-pre-1-0.0 Request processed in 2020us (2863us total) trans 4294967574 rc 0/0 00000100:00100000:1.0:1784938515.357137:0:25723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 996 00000020:00080000:1.0:1784938515.357142:0:25723:0:(tgt_main.c:784:tgt_ses_key_exit()) total 4 transactions per RPC 00002000:00010000:1.0:1784938515.357273:0:25727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x77:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938515.357282:0:25727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec2e81e1/0x7b044d4128f9f337 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357297:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77:0x0].0x0 since=781s v=(0 0) 00010000:00010000:1.0:1784938515.357301:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938515.357307:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec2e81e1/0x7b044d4128f9f337 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357327:0:25727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec2e81e1/0x7b044d4128f9f337 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357338:0:25727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec2e81e1/0x7b044d4128f9f337 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357347:0:25727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec2e81e1/0x7b044d4128f9f337 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357364:0:25727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938515.357374:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938515.357378:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec2e81e1/0x7b044d4128f9f337 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357387:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db38000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938515.357392:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec2e81e1/0x7b044d4128f9f337 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357401:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec2e81e1/0x7b044d4128f9f337 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357418:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec2e81e1/0x7b044d4128f9f337 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357425:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec2e81e1/0x7b044d4128f9f337 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357445:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.357447:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.357449:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938515.357518:0:25727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938515.357524:0:25727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ddc35db/0x7b044d4128f9f3a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357533:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76:0x0].0x0 since=781s v=(0 0) 00010000:00010000:1.0:1784938515.357536:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938515.357541:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ddc35db/0x7b044d4128f9f3a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357551:0:25727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ddc35db/0x7b044d4128f9f3a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357559:0:25727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ddc35db/0x7b044d4128f9f3a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357568:0:25727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ddc35db/0x7b044d4128f9f3a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357581:0:25727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938515.357588:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938515.357593:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ddc35db/0x7b044d4128f9f3a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357607:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db38800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938515.357610:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ddc35db/0x7b044d4128f9f3a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357618:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ddc35db/0x7b044d4128f9f3a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357629:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ddc35db/0x7b044d4128f9f3a7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357637:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ddc35db/0x7b044d4128f9f3a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357650:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.357652:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.357654:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938515.357694:0:25727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938515.357700:0:25727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000420af1ca/0x7b044d4128f9f3ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357708:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75:0x0].0x0 since=781s v=(0 0) 00010000:00010000:1.0:1784938515.357711:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938515.357716:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000420af1ca/0x7b044d4128f9f3ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357726:0:25727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000420af1ca/0x7b044d4128f9f3ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357734:0:25727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000420af1ca/0x7b044d4128f9f3ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357755:0:25727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000420af1ca/0x7b044d4128f9f3ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357769:0:25727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784938515.357808:0:25727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938515.357814:0:25727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f9f3b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357822:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74:0x0].0x0 since=781s v=(0 0) 00010000:00010000:1.0:1784938515.357825:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938515.357828:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f9f3b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357838:0:25727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f9f3b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357847:0:25727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f9f3b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357854:0:25727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f9f3b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357874:0:25727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1784938515.357910:0:25727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938515.357915:0:25727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a075a0f7/0x7b044d4128f9f3bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357923:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73:0x0].0x0 since=781s v=(0 0) 00010000:00010000:1.0:1784938515.357926:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938515.357930:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a075a0f7/0x7b044d4128f9f3bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357939:0:25727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a075a0f7/0x7b044d4128f9f3bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357947:0:25727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a075a0f7/0x7b044d4128f9f3bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357954:0:25727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a075a0f7/0x7b044d4128f9f3bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357969:0:25727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1784938515.357977:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784938515.357981:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000420af1ca/0x7b044d4128f9f3ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.357989:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db38200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938515.357993:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000420af1ca/0x7b044d4128f9f3ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358000:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000420af1ca/0x7b044d4128f9f3ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358010:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000420af1ca/0x7b044d4128f9f3ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358017:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000420af1ca/0x7b044d4128f9f3ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358030:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784938515.358033:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f9f3b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358040:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c7400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938515.358043:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f9f3b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358052:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f9f3b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358062:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f9f3b5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358069:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d953704/0x7b044d4128f9f3b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358081:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938515.358084:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a075a0f7/0x7b044d4128f9f3bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358091:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c6400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938515.358094:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a075a0f7/0x7b044d4128f9f3bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358101:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a075a0f7/0x7b044d4128f9f3bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358110:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a075a0f7/0x7b044d4128f9f3bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358118:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a075a0f7/0x7b044d4128f9f3bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358131:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.358133:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.358135:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938515.358193:0:25727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938515.358200:0:25727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f873e89f/0x7b044d4128f9f3c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358208:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72:0x0].0x0 since=781s v=(0 0) 00010000:00010000:1.0:1784938515.358212:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938515.358217:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f873e89f/0x7b044d4128f9f3c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358226:0:25727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f873e89f/0x7b044d4128f9f3c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358234:0:25727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f873e89f/0x7b044d4128f9f3c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358241:0:25727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f873e89f/0x7b044d4128f9f3c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358254:0:25727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938515.358261:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938515.358265:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f873e89f/0x7b044d4128f9f3c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358271:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c559e00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938515.358274:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f873e89f/0x7b044d4128f9f3c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358282:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f873e89f/0x7b044d4128f9f3c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358293:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f873e89f/0x7b044d4128f9f3c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358307:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f873e89f/0x7b044d4128f9f3c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358321:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.358323:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.358324:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938515.358363:0:25727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938515.358369:0:25727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9acc545/0x7b044d4128f9f3ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358377:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71:0x0].0x0 since=781s v=(0 0) 00010000:00010000:1.0:1784938515.358380:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938515.358384:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9acc545/0x7b044d4128f9f3ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358393:0:25727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9acc545/0x7b044d4128f9f3ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358402:0:25727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9acc545/0x7b044d4128f9f3ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358410:0:25727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9acc545/0x7b044d4128f9f3ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358422:0:25727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938515.358428:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938515.358432:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9acc545/0x7b044d4128f9f3ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358439:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c558a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938515.358442:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9acc545/0x7b044d4128f9f3ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358450:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9acc545/0x7b044d4128f9f3ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358460:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9acc545/0x7b044d4128f9f3ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358468:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9acc545/0x7b044d4128f9f3ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358482:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.358483:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.358485:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938515.358520:0:25727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938515.358526:0:25727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae12b8fe/0x7b044d4128f9f3d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358534:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70:0x0].0x0 since=781s v=(0 0) 00010000:00010000:1.0:1784938515.358538:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938515.358542:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae12b8fe/0x7b044d4128f9f3d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358557:0:25727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae12b8fe/0x7b044d4128f9f3d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358566:0:25727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae12b8fe/0x7b044d4128f9f3d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358573:0:25727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae12b8fe/0x7b044d4128f9f3d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358585:0:25727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938515.358591:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938515.358595:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae12b8fe/0x7b044d4128f9f3d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358602:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c558400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938515.358604:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae12b8fe/0x7b044d4128f9f3d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358612:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae12b8fe/0x7b044d4128f9f3d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358623:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae12b8fe/0x7b044d4128f9f3d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358631:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae12b8fe/0x7b044d4128f9f3d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358645:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.358647:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.358649:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938515.358686:0:25727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938515.358692:0:25727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049f52d48/0x7b044d4128f9f3d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358700:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f:0x0].0x0 since=781s v=(0 0) 00010000:00010000:1.0:1784938515.358703:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938515.358708:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049f52d48/0x7b044d4128f9f3d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358717:0:25727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049f52d48/0x7b044d4128f9f3d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358725:0:25727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049f52d48/0x7b044d4128f9f3d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.358734:0:25727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049f52d48/0x7b044d4128f9f3d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784938515.359541:0:22178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967570 is committed 00010000:00010000:2.0:1784938515.359565:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938515.359593:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.363531:0:25727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938515.363596:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938515.363605:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049f52d48/0x7b044d4128f9f3d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.363615:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c558800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938515.363619:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049f52d48/0x7b044d4128f9f3d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.363630:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049f52d48/0x7b044d4128f9f3d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.363647:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049f52d48/0x7b044d4128f9f3d8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.363653:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049f52d48/0x7b044d4128f9f3d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784938515.363658:0:21144:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967570 is committed 00010000:00010000:2.0:1784938515.363678:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938515.363679:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938515.363681:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938515.363779:0:25727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938515.363787:0:25727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005979dcbb/0x7b044d4128f9f3df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.363805:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e:0x0].0x0 since=781s v=(0 0) 00010000:00010000:1.0:1784938515.363810:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938515.363817:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005979dcbb/0x7b044d4128f9f3df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.363829:0:25727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005979dcbb/0x7b044d4128f9f3df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.363839:0:25727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005979dcbb/0x7b044d4128f9f3df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.363847:0:25727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005979dcbb/0x7b044d4128f9f3df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.363880:0:25727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784938515.363919:0:25727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938515.363925:0:25727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098b26aa7/0x7b044d4128f9f3e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.363933:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d:0x0].0x0 since=781s v=(0 0) 00010000:00010000:1.0:1784938515.363937:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938515.363941:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098b26aa7/0x7b044d4128f9f3e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.363951:0:25727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098b26aa7/0x7b044d4128f9f3e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.363964:0:25727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098b26aa7/0x7b044d4128f9f3e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.363970:0:25727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098b26aa7/0x7b044d4128f9f3e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.363983:0:25727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784938515.363991:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784938515.363994:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005979dcbb/0x7b044d4128f9f3df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.364001:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c559000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938515.364004:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005979dcbb/0x7b044d4128f9f3df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.364011:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005979dcbb/0x7b044d4128f9f3df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.364021:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005979dcbb/0x7b044d4128f9f3df lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.364027:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005979dcbb/0x7b044d4128f9f3df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.364039:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938515.364042:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098b26aa7/0x7b044d4128f9f3e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.364048:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c559200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938515.364051:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098b26aa7/0x7b044d4128f9f3e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.364058:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098b26aa7/0x7b044d4128f9f3e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.364066:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098b26aa7/0x7b044d4128f9f3e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.364073:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098b26aa7/0x7b044d4128f9f3e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.364082:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.364084:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.364086:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938515.364124:0:25727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938515.364130:0:25727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000007385ab/0x7b044d4128f9f3ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.364138:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c:0x0].0x0 since=781s v=(0 0) 00010000:00010000:1.0:1784938515.364141:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938515.364161:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000007385ab/0x7b044d4128f9f3ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.364176:0:25727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000007385ab/0x7b044d4128f9f3ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.364184:0:25727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000007385ab/0x7b044d4128f9f3ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.364186:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.364192:0:25727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000007385ab/0x7b044d4128f9f3ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.364211:0:25727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938515.364229:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938515.364235:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000007385ab/0x7b044d4128f9f3ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.364242:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c559a00 already unused, calling callback (ffffffffc0d954a0) 00002000:00010000:1.0:1784938515.364249:0:25727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784938515.364254:0:25727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7a2d07f/0x7b044d4128f9f3f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.364256:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000007385ab/0x7b044d4128f9f3ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.364262:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b:0x0].0x0 since=781s v=(0 0) 00010000:00010000:2.0:1784938515.364265:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000007385ab/0x7b044d4128f9f3ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.364265:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938515.364269:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7a2d07f/0x7b044d4128f9f3f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.364276:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000007385ab/0x7b044d4128f9f3ed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.364277:0:25727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7a2d07f/0x7b044d4128f9f3f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.364284:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000007385ab/0x7b044d4128f9f3ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.364286:0:25727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7a2d07f/0x7b044d4128f9f3f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.364298:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.364299:0:25727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7a2d07f/0x7b044d4128f9f3f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.364307:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.364312:0:25727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938515.364315:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938515.364318:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7a2d07f/0x7b044d4128f9f3f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.364330:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c559c00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938515.364332:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7a2d07f/0x7b044d4128f9f3f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.364340:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7a2d07f/0x7b044d4128f9f3f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938515.364346:0:25727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938515.364350:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7a2d07f/0x7b044d4128f9f3f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.364350:0:25727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9f3fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.364358:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7a2d07f/0x7b044d4128f9f3f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.364359:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a:0x0].0x0 since=781s v=(0 0) 00010000:00010000:1.0:1784938515.364362:0:25727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938515.364366:0:25727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9f3fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.364370:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938515.364372:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938515.364373:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.364374:0:25727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9f3fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.364379:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938515.364382:0:25727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9f3fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.364389:0:25727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9f3fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938515.365109:0:25727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1784938515.365172:0:25727:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:105 00000100:00100000:1.0:1784938515.365246:0:25727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:26630:x1871643350946816:12345-192.168.202.154@tcp:5:osp-pre-0-0.0 Request processed in 49279us (53993us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938515.365257:0:25727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 995 00000100:00100000:0.0:1784938515.365663:0:26630:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:26630:1871643350946816:192.168.202.154@tcp:5:osp-pre-0-0.0 00000004:00080000:0.0:1784938515.365683:0:26630:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x81:0x0] from OST, last_created [0x280000401:0x81:0x0]last_used is [0x280000401:0x69:0x0] 00000100:00100000:0.0:1784938515.365765:0:26630:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd256a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:26630:1871643350947328:192.168.202.154@tcp:5:osp-pre-0-0.0 00000100:00100000:0.0:1784938515.365816:0:26630:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d3a4300 going to sleep for 11 seconds 00000100:00100000:0.0:1784938515.365832:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350947200:192.168.202.154@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938515.366001:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938515.366024:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938515.366079:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350947328 00000100:00100000:0.0:1784938515.366085:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350947328 00000100:00100000:0.0:1784938515.366134:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 997 00000100:00100000:0.0:1784938515.366171:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:26630:x1871643350947328:12345-192.168.202.154@tcp:5:osp-pre-0-0.0 00002000:00080000:0.0:1784938515.366210:0:25715:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x280000401 at 130 00002000:00080000:0.0:1784938515.366699:0:25715:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x280000401 at 138 00000001:00080000:0.0:1784938515.367254:0:25715:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967571 00002000:00080000:0.0:1784938515.367273:0:25715:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x280000401 at 146 00010000:00010000:2.0:1784938515.367466:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938515.367475:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9f3fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.367487:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c558e00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938515.367492:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9f3fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.367508:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9f3fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.367526:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9f3fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.367534:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001457c98/0x7b044d4128f9f3fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938515.367557:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938515.367560:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938515.367561:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938515.367599:0:26632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:26632:1871643350947072:192.168.202.154@tcp:5:osp-pre-1-0.0 00000004:00080000:2.0:1784938515.367612:0:26632:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x81:0x0]-[0x2c0000401:0xa1:0x0] 00000100:00100000:2.0:1784938515.367639:0:21154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350947200 00000100:00100000:2.0:1784938515.367645:0:21154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350947200 00000100:00100000:2.0:1784938515.367682:0:21154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 95 00000100:00100000:2.0:1784938515.367690:0:21154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:16392:x1871643350947200:12345-192.168.202.154@tcp:13:osp-pre-0-0.0 00002000:00000024:2.0:1784938515.367708:0:21154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 271936 pending 896 free 313057280 avail 285245440 00000001:00080000:0.0:1784938515.367766:0:25715:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967572 00000100:00100000:2.0:1784938515.367771:0:21154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:16392:x1871643350947200:12345-192.168.202.154@tcp:13:osp-pre-0-0.0 Request processed in 81us (1745us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938515.367778:0:21154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 95 00002000:00080000:0.0:1784938515.367781:0:25715:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x280000401 at 154 00000001:00080000:0.0:1784938515.368139:0:25715:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967573 00000100:00100000:0.0:1784938515.368204:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:26630:x1871643350947328:12345-192.168.202.154@tcp:5:osp-pre-0-0.0 Request processed in 2061us (2203us total) trans 4294967574 rc 0/0 00000100:00100000:0.0:1784938515.368211:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 997 00000020:00080000:0.0:1784938515.368214:0:25715:0:(tgt_main.c:784:tgt_ses_key_exit()) total 4 transactions per RPC 00010000:00010000:1.0:1784938515.371873:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938515.372230:0:26630:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd256a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:26630:1871643350947328:192.168.202.154@tcp:5:osp-pre-0-0.0 00000004:00080000:1.0:1784938515.372248:0:26630:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x81:0x0]-[0x280000401:0xa1:0x0] 00000100:00100000:3.0:1784938515.373832:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350947200:192.168.202.154@tcp:13:osp-pre-0-0.0 00000001:02000400:2.0:1784938516.094257:0:27608:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784938516.393043:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784938517.421933:0:27660:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784938517.430050:0:27660:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784938517.436216:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938518.446813:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784938519.060088:0:27711:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784938519.060366:0:27711:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784938519.469072:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938520.233931:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f228380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350947456:192.168.202.154@tcp:41:osp-pre-0-1.0 00000100:00100000:2.0:1784938520.234262:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784938520.234273:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350947584:192.168.202.154@tcp:13:osp-pre-1-1.0 00000100:00100000:2.0:1784938520.234450:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938520.234535:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938520.234560:0:21161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350947456 00000100:00100000:2.0:1784938520.234567:0:21161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350947456 00000100:00100000:2.0:1784938520.234609:0:21161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 123 00000100:00100000:2.0:1784938520.234617:0:21161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:16389:x1871643350947456:12345-192.168.202.154@tcp:41:osp-pre-0-1.0 00000004:00000024:2.0:1784938520.235811:0:21161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 218345472 avail 191320064 00000100:00100000:2.0:1784938520.235884:0:21161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:16389:x1871643350947456:12345-192.168.202.154@tcp:41:osp-pre-0-1.0 Request processed in 1264us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938520.235894:0:21161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 123 00000100:00100000:2.0:1784938520.235927:0:21154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350947584 00000100:00100000:2.0:1784938520.235933:0:21154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350947584 00000100:00100000:2.0:1784938520.235973:0:21154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 96 00000100:00100000:2.0:1784938520.235981:0:21154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16389:x1871643350947584:12345-192.168.202.154@tcp:13:osp-pre-1-1.0 00002000:00000024:2.0:1784938520.236004:0:21154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 271040 pending 0 free 313057280 avail 285245440 00000100:00100000:2.0:1784938520.236035:0:21154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16389:x1871643350947584:12345-192.168.202.154@tcp:13:osp-pre-1-1.0 Request processed in 55us (1499us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938520.236040:0:21154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 96 00000100:00080000:2.0:1784938520.236243:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784938520.236281:0:16389:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967570 gen 2 00000100:00100000:2.0:1784938520.236305:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350947584:192.168.202.154@tcp:13:osp-pre-1-1.0 00000100:00100000:2.0:1784938520.236322:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f228380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350947456:192.168.202.154@tcp:41:osp-pre-0-1.0 00000100:00100000:3.0:1784938520.236649:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f228380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350947840:192.168.202.154@tcp:41:osp-pre-1-0.0 00000100:00100000:3.0:1784938520.236737:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784938520.236745:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350947712:192.168.202.154@tcp:13:osp-pre-0-1.0 00000100:00100000:2.0:1784938520.236977:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938520.236999:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938520.237018:0:21154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350947712 00000100:00100000:2.0:1784938520.237023:0:21154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350947712 00000100:00100000:2.0:1784938520.237056:0:21154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 97 00000100:00100000:2.0:1784938520.237065:0:21154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16392:x1871643350947712:12345-192.168.202.154@tcp:13:osp-pre-0-1.0 00002000:00000024:2.0:1784938520.237089:0:21154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 271040 pending 0 free 313057280 avail 285245440 00000100:00100000:2.0:1784938520.237122:0:21154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16392:x1871643350947712:12345-192.168.202.154@tcp:13:osp-pre-0-1.0 Request processed in 58us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938520.237129:0:21154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 97 00000100:00080000:2.0:1784938520.237172:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938520.237373:0:21160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350947840 00000100:00100000:3.0:1784938520.237377:0:21160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350947840 00000100:00100000:3.0:1784938520.237407:0:21160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 124 00000100:00100000:3.0:1784938520.237412:0:21160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:16392:x1871643350947840:12345-192.168.202.154@tcp:41:osp-pre-1-0.0 00000004:00000024:3.0:1784938520.237435:0:21160:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 218472448 avail 191447040 00000100:00100000:3.0:1784938520.237468:0:21160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:16392:x1871643350947840:12345-192.168.202.154@tcp:41:osp-pre-1-0.0 Request processed in 55us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938520.237475:0:21160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 124 00000100:00100000:0.0:1784938520.237780:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:16391:1871643350948224:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938520.240646:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d4e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350948736:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938520.240743:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784938520.240752:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d4e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:16391:1871643350948352:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938520.240781:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d4e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:16391:1871643350948864:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938520.241810:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938520.241845:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938520.241866:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938520.241882:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938520.241907:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:16390:1871643350948096:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938520.241951:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d4e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350948608:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938520.241982:0:16390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1784938520.241990:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24bd255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e07296-2a01-411c-abf2-6d190cb69ef0:16390:1871643350947968:0@lo:400:kworker.0 00000100:00100000:3.0:1784938520.242025:0:16390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938520.242058:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:16390:1871643350948480:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938520.242082:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d4e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:16390:1871643350948992:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938520.242119:0:26598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350947968 00000100:00100000:3.0:1784938520.242128:0:26598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350947968 00000100:00100000:3.0:1784938520.242190:0:26598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784938520.242199:0:26598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+24:16390:x1871643350947968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784938520.242266:0:26598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+24:16390:x1871643350947968:12345-0@lo:400:kworker.0 Request processed in 68us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938520.242274:0:26598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784938520.242322:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e07296-2a01-411c-abf2-6d190cb69ef0:16390:1871643350947968:0@lo:400:kworker.0 00000100:00100000:3.0:1784938520.242358:0:16392:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967570 gen 2 00000100:00100000:3.0:1784938520.242375:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350947712:192.168.202.154@tcp:13:osp-pre-0-1.0 00000100:00100000:3.0:1784938520.242392:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f228380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350947840:192.168.202.154@tcp:41:osp-pre-1-0.0 00000100:00100000:1.0:1784938520.242618:0:27313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350948224 00000100:00100000:1.0:1784938520.242623:0:27313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350948224 00000100:00100000:1.0:1784938520.242737:0:27313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350948352 00000100:00100000:1.0:1784938520.242741:0:27313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350948352 00000100:00100000:1.0:1784938520.242756:0:27313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350948864 00000100:00100000:1.0:1784938520.242759:0:27313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350948864 00000100:00100000:1.0:1784938520.242773:0:27313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 15 00000100:00100000:1.0:1784938520.242779:0:27313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:16391:x1871643350948224:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938520.242820:0:27313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:16391:x1871643350948224:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 40us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938520.242826:0:27313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 15 00000100:00100000:1.0:1784938520.242839:0:27313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 16 00000100:00100000:1.0:1784938520.242845:0:27313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:16391:x1871643350948352:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938520.242870:0:27313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:16391:x1871643350948352:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 25us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938520.242877:0:27313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 16 00000100:00100000:1.0:1784938520.242888:0:27313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 17 00000100:00100000:1.0:1784938520.242894:0:27313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:16391:x1871643350948864:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938520.242918:0:27313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:16391:x1871643350948864:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 24us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938520.242924:0:27313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 17 00000100:00100000:2.0:1784938520.243326:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938520.243347:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938520.243366:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938520.243382:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938520.243439:0:21152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350948736 00000100:00100000:2.0:1784938520.243445:0:21152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350948736 00000100:00100000:2.0:1784938520.243477:0:21152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350948608 00000100:00100000:2.0:1784938520.243480:0:21152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350948608 00000100:00100000:2.0:1784938520.243506:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 110 00000100:00100000:2.0:1784938520.243513:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:16391:x1871643350948736:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938520.243548:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:16391:x1871643350948736:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 35us (1702us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938520.243554:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 110 00000100:00100000:2.0:1784938520.243568:0:21152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 111 00000100:00100000:2.0:1784938520.243574:0:21152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:16390:x1871643350948608:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938520.243599:0:21152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:16390:x1871643350948608:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 25us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938520.243604:0:21152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 111 00000100:00100000:2.0:1784938520.243621:0:26609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350948096 00000100:00100000:2.0:1784938520.243636:0:26609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350948096 00000100:00100000:2.0:1784938520.243653:0:26609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350948480 00000100:00100000:2.0:1784938520.243656:0:26609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350948480 00000100:00100000:2.0:1784938520.243679:0:26609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350948992 00000100:00100000:2.0:1784938520.243682:0:26609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350948992 00000100:00100000:2.0:1784938520.243695:0:26609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 18 00000100:00100000:2.0:1784938520.243712:0:26609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:16390:x1871643350948096:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938520.243737:0:26609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:16390:x1871643350948096:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 26us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938520.243744:0:26609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 18 00000100:00100000:2.0:1784938520.243755:0:26609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 19 00000100:00100000:2.0:1784938520.243761:0:26609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:16390:x1871643350948480:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938520.243783:0:26609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:16390:x1871643350948480:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 23us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938520.243789:0:26609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 19 00000100:00100000:2.0:1784938520.243800:0:26609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 20 00000100:00100000:2.0:1784938520.243806:0:26609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:16390:x1871643350948992:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938520.243829:0:26609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:16390:x1871643350948992:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 23us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938520.243835:0:26609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 20 00010000:00080000:2.0:1784938520.244016:0:16390:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f238d4e1f80 x1871643350948480/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938520.244032:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:16390:1871643350948480:192.168.202.154@tcp:400:kworker.0 00010000:00080000:2.0:1784938520.244044:0:16390:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f238d4e1c00 x1871643350948992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938520.244052:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d4e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:16390:1871643350948992:192.168.202.154@tcp:400:kworker.0 00010000:00080000:2.0:1784938520.244062:0:16390:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f24bd254e00 x1871643350948096/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938520.244071:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:16390:1871643350948096:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938520.244083:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d4e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350948608:192.168.202.154@tcp:400:kworker.0 00000100:00080000:3.0:1784938520.244502:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784938520.244508:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784938520.244511:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784938520.244514:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1784938520.244930:0:16391:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f238d4e3800 x1871643350948352/t0(0) o400->lustre-MDT0000-lwp-OST0001@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938520.244944:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d4e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:16391:1871643350948352:192.168.202.154@tcp:400:kworker.0 00010000:00080000:0.0:1784938520.244960:0:16391:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f238d4e2680 x1871643350948864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938520.244968:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d4e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:16391:1871643350948864:192.168.202.154@tcp:400:kworker.0 00010000:00080000:0.0:1784938520.244980:0:16391:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f24bd254380 x1871643350948224/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938520.244989:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24bd254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:16391:1871643350948224:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938520.245001:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d4e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350948736:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938520.301358:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938520.307387:0:26600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337637120 00000100:00100000:1.0:1784938520.307404:0:26600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337637120 00000100:00100000:1.0:1784938520.311393:0:26600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 79 00000100:00100000:1.0:1784938520.311406:0:26600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:10956:x1871643337637120:12345-192.168.202.54@tcp:250:mount.lustre.0 00010000:00080000:1.0:1784938520.311442:0:26600:0:(ldlm_lib.c:1468:target_handle_connect()) MGS: connection from 8ccc7f77-7c1a-4025-b77c-8021722e21dc@192.168.202.54@tcp t0 exp 0000000000000000 cur 786 last 0 00000020:00000080:1.0:1784938520.311473:0:26600:0:(genops.c:1406:class_connect()) connect: client 8ccc7f77-7c1a-4025-b77c-8021722e21dc, cookie 0x7b044d4128f9f402 00000100:00080000:1.0:1784938520.311606:0:26600:0:(import.c:65:import_set_state_nolock()) ffff9f24bd50d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938520.311711:0:26600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ccc7f77-7c1a-4025-b77c-8021722e21dc+5:10956:x1871643337637120:12345-192.168.202.54@tcp:250:mount.lustre.0 Request processed in 304us (10361us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938520.311720:0:26600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 79 00000100:00100000:2.0:1784938520.323035:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938520.323139:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337637248 00000100:00100000:1.0:1784938520.323180:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337637248 00000100:00100000:1.0:1784938520.323248:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 80 00000100:00100000:1.0:1784938520.323258:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ccc7f77-7c1a-4025-b77c-8021722e21dc+5:17690:x1871643337637248:12345-192.168.202.54@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784938520.323276:0:26601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938520.323294:0:26601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f238c558c00/0x7b044d4128f9f409 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x571025e947664dd2 expref: -99 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938520.323324:0:26601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f238c558c00/0x7b044d4128f9f409 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664dd2 expref: 6 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938520.323334:0:26601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f238c558c00/0x7b044d4128f9f409 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664dd2 expref: 6 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938520.323344:0:26601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c558c00, rc 0) 00000100:00100000:1.0:1784938520.323395:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ccc7f77-7c1a-4025-b77c-8021722e21dc+6:17690:x1871643337637248:12345-192.168.202.54@tcp:101:mount.lustre.0 Request processed in 138us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938520.323401:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 80 00000100:00100000:1.0:1784938520.337300:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938520.341474:0:26600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337637376 00000100:00100000:3.0:1784938520.341489:0:26600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337637376 00000100:00100000:3.0:1784938520.341544:0:26600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 81 00000100:00100000:3.0:1784938520.341554:0:26600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ccc7f77-7c1a-4025-b77c-8021722e21dc+6:17690:x1871643337637376:12345-192.168.202.54@tcp:501:mount.lustre.0 00000100:00100000:3.0:1784938520.341734:0:26600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ccc7f77-7c1a-4025-b77c-8021722e21dc+6:17690:x1871643337637376:12345-192.168.202.54@tcp:501:mount.lustre.0 Request processed in 146us (4412us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784938520.341743:0:26600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 81 00000100:00100000:2.0:1784938520.343958:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938520.344411:0:26598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337637504 00000100:00100000:3.0:1784938520.344424:0:26598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337637504 00000100:00100000:3.0:1784938520.344489:0:26598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 82 00000100:00100000:3.0:1784938520.344500:0:26598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ccc7f77-7c1a-4025-b77c-8021722e21dc+6:17690:x1871643337637504:12345-192.168.202.54@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784938520.344517:0:26598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938520.344535:0:26598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f238d3a6800/0x7b044d4128f9f410 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x571025e947664dd9 expref: -99 pid: 26598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938520.344567:0:26598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f238d3a6800/0x7b044d4128f9f410 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664dd9 expref: 7 pid: 26598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938520.344579:0:26598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f238d3a6800/0x7b044d4128f9f410 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664dd9 expref: 7 pid: 26598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938520.344589:0:26598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a6800, rc 0) 00000100:00100000:3.0:1784938520.344906:0:26598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ccc7f77-7c1a-4025-b77c-8021722e21dc+7:17690:x1871643337637504:12345-192.168.202.54@tcp:101:mount.lustre.0 Request processed in 406us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938520.344915:0:26598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 82 00000100:00100000:3.0:1784938520.355381:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938520.355476:0:26600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337637632 00000100:00100000:0.0:1784938520.355486:0:26600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337637632 00000100:00100000:0.0:1784938520.355544:0:26600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 83 00000100:00100000:0.0:1784938520.355555:0:26600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ccc7f77-7c1a-4025-b77c-8021722e21dc+7:17690:x1871643337637632:12345-192.168.202.54@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784938520.355742:0:26600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ccc7f77-7c1a-4025-b77c-8021722e21dc+8:17690:x1871643337637632:12345-192.168.202.54@tcp:501:mount.lustre.0 Request processed in 188us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938520.355750:0:26600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 83 00000100:00100000:2.0:1784938520.362124:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938520.362454:0:26598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337637760 00000100:00100000:3.0:1784938520.362465:0:26598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337637760 00000100:00100000:3.0:1784938520.362510:0:26598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 84 00000100:00100000:3.0:1784938520.362519:0:26598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ccc7f77-7c1a-4025-b77c-8021722e21dc+8:17690:x1871643337637760:12345-192.168.202.54@tcp:503:mount.lustre.0 00000100:00100000:3.0:1784938520.362916:0:26598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ccc7f77-7c1a-4025-b77c-8021722e21dc+8:17690:x1871643337637760:12345-192.168.202.54@tcp:503:mount.lustre.0 Request processed in 396us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938520.362926:0:26598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 84 00000100:00100000:2.0:1784938520.366902:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938520.366961:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337637888 00000100:00100000:3.0:1784938520.366972:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337637888 00000100:00100000:3.0:1784938520.367076:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 85 00000100:00100000:3.0:1784938520.367089:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ccc7f77-7c1a-4025-b77c-8021722e21dc+8:17704:x1871643337637888:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784938520.367316:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ccc7f77-7c1a-4025-b77c-8021722e21dc+8:17704:x1871643337637888:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 229us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938520.367324:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 85 00000100:00100000:2.0:1784938520.394530:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938520.394637:0:26598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337638016 00000100:00100000:3.0:1784938520.394648:0:26598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337638016 00000100:00100000:3.0:1784938520.394723:0:26598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 86 00000100:00100000:3.0:1784938520.394734:0:26598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ccc7f77-7c1a-4025-b77c-8021722e21dc+8:17704:x1871643337638016:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784938520.394929:0:26598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ccc7f77-7c1a-4025-b77c-8021722e21dc+8:17704:x1871643337638016:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 195us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938520.394938:0:26598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 86 00000100:00100000:2.0:1784938520.397683:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938520.397744:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337638144 00000100:00100000:3.0:1784938520.397755:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337638144 00000100:00100000:2.0:1784938520.397851:0:26598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 87 00000100:00100000:2.0:1784938520.397864:0:26598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ccc7f77-7c1a-4025-b77c-8021722e21dc+8:17704:x1871643337638144:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784938520.398014:0:26598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ccc7f77-7c1a-4025-b77c-8021722e21dc+8:17704:x1871643337638144:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 154us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938520.398023:0:26598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 87 00000100:00100000:2.0:1784938520.406709:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938520.407177:0:26600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337638272 00000100:00100000:1.0:1784938520.407188:0:26600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337638272 00000100:00100000:1.0:1784938520.407250:0:26600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 88 00000100:00100000:1.0:1784938520.407260:0:26600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ccc7f77-7c1a-4025-b77c-8021722e21dc+8:17690:x1871643337638272:12345-192.168.202.54@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784938520.407280:0:26600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938520.407302:0:26600:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f238c559400/0x7b044d4128f9f417 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x571025e947664e0a expref: -99 pid: 26600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938520.407339:0:26600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f238c559400/0x7b044d4128f9f417 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664e0a expref: 9 pid: 26600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938520.407350:0:26600:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f238c559400/0x7b044d4128f9f417 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664e0a expref: 9 pid: 26600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938520.407360:0:26600:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c559400, rc 0) 00000100:00100000:1.0:1784938520.407434:0:26600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ccc7f77-7c1a-4025-b77c-8021722e21dc+9:17690:x1871643337638272:12345-192.168.202.54@tcp:101:mount.lustre.0 Request processed in 175us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938520.407443:0:26600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 88 00000100:00100000:3.0:1784938520.418271:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938520.419943:0:26598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337638400 00000100:00100000:2.0:1784938520.419961:0:26598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337638400 00000100:00100000:2.0:1784938520.420036:0:26598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 89 00000100:00100000:2.0:1784938520.420046:0:26598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ccc7f77-7c1a-4025-b77c-8021722e21dc+9:17690:x1871643337638400:12345-192.168.202.54@tcp:256:mount.lustre.0 20000000:01000000:2.0:1784938520.420077:0:26598:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1784938520.420106:0:26598:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784938520.420111:0:26598:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1784938520.420114:0:26598:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1784938520.420117:0:26598:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1784938520.420120:0:26598:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1784938520.423015:0:26598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ccc7f77-7c1a-4025-b77c-8021722e21dc+9:17690:x1871643337638400:12345-192.168.202.54@tcp:256:mount.lustre.0 Request processed in 2960us (4753us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938520.423031:0:26598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 89 00000100:00100000:0.0:1784938520.434397:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938520.435465:0:26600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337638528 00000100:00100000:1.0:1784938520.435479:0:26600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337638528 00000100:00100000:1.0:1784938520.435541:0:26600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 90 00000100:00100000:1.0:1784938520.435553:0:26600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ccc7f77-7c1a-4025-b77c-8021722e21dc+9:17690:x1871643337638528:12345-192.168.202.54@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784938520.435570:0:26600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938520.435590:0:26600:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f238c558000/0x7b044d4128f9f41e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x571025e947664e11 expref: -99 pid: 26600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938520.435617:0:26600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f238c558000/0x7b044d4128f9f41e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664e11 expref: 10 pid: 26600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938520.435629:0:26600:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f238c558000/0x7b044d4128f9f41e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664e11 expref: 10 pid: 26600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938520.435640:0:26600:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c558000, rc 0) 00000100:00100000:1.0:1784938520.435715:0:26600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ccc7f77-7c1a-4025-b77c-8021722e21dc+10:17690:x1871643337638528:12345-192.168.202.54@tcp:101:mount.lustre.0 Request processed in 163us (1328us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938520.435722:0:26600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 90 00000100:00100000:2.0:1784938520.439980:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938520.440102:0:26598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337638656 00000100:00100000:3.0:1784938520.440114:0:26598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337638656 00000100:00100000:2.0:1784938520.440924:0:26598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 91 00000100:00100000:2.0:1784938520.440940:0:26598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2381fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ccc7f77-7c1a-4025-b77c-8021722e21dc+10:17690:x1871643337638656:12345-192.168.202.54@tcp:501:mount.lustre.0 00000100:00100000:2.0:1784938520.441100:0:26598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2381fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ccc7f77-7c1a-4025-b77c-8021722e21dc+10:17690:x1871643337638656:12345-192.168.202.54@tcp:501:mount.lustre.0 Request processed in 165us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938520.441109:0:26598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 91 00000100:00100000:2.0:1784938520.443338:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938520.443889:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337638784 00000100:00100000:3.0:1784938520.443899:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337638784 00000100:00100000:3.0:1784938520.444013:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 92 00000100:00100000:3.0:1784938520.444024:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b2ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ccc7f77-7c1a-4025-b77c-8021722e21dc+10:17690:x1871643337638784:12345-192.168.202.54@tcp:503:mount.lustre.0 00000100:00100000:3.0:1784938520.444211:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b2ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ccc7f77-7c1a-4025-b77c-8021722e21dc+10:17690:x1871643337638784:12345-192.168.202.54@tcp:503:mount.lustre.0 Request processed in 187us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938520.444220:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 92 00000100:00100000:0.0:1784938520.454887:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938520.455004:0:26598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337638912 00000100:00100000:2.0:1784938520.455015:0:26598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337638912 00000100:00100000:2.0:1784938520.455076:0:26598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 93 00000100:00100000:2.0:1784938520.455085:0:26598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b2ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ccc7f77-7c1a-4025-b77c-8021722e21dc+10:17709:x1871643337638912:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784938520.455298:0:26598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b2ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ccc7f77-7c1a-4025-b77c-8021722e21dc+10:17709:x1871643337638912:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 212us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938520.455307:0:26598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 93 00000100:00100000:2.0:1784938520.462127:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938520.462876:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337639040 00000100:00100000:3.0:1784938520.462889:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337639040 00000100:00100000:2.0:1784938520.463085:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 94 00000100:00100000:2.0:1784938520.463096:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b2ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ccc7f77-7c1a-4025-b77c-8021722e21dc+10:17709:x1871643337639040:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784938520.463511:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b2ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ccc7f77-7c1a-4025-b77c-8021722e21dc+10:17709:x1871643337639040:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 415us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938520.463521:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 94 00000100:00100000:2.0:1784938520.470874:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938520.470912:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938520.471017:0:26609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337639168 00000100:00100000:0.0:1784938520.471027:0:26609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337639168 00000100:00100000:0.0:1784938520.471072:0:26609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337639424 00000100:00100000:0.0:1784938520.471075:0:26609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337639424 00000100:00100000:0.0:1784938520.471102:0:26609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:0.0:1784938520.471110:0:26609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:10956:x1871643337639168:12345-192.168.202.54@tcp:38:mount.lustre.0 00010000:00080000:0.0:1784938520.471163:0:26609:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from 8ac2e24a-3d40-4d85-8f00-33cba44b76c9@192.168.202.54@tcp t0 exp 0000000000000000 cur 786 last 0 00000020:00000080:0.0:1784938520.471219:0:26609:0:(genops.c:1406:class_connect()) connect: client 8ac2e24a-3d40-4d85-8f00-33cba44b76c9, cookie 0x7b044d4128f9f425 00000004:00100000:0.0:1784938520.471243:0:26609:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1784938520.471453:0:26609:0:(import.c:65:import_set_state_nolock()) ffff9f24b2ce2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784938520.471516:0:26609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+6:10956:x1871643337639168:12345-192.168.202.54@tcp:38:mount.lustre.0 Request processed in 405us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938520.471524:0:26609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:0.0:1784938520.471540:0:26609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:0.0:1784938520.471545:0:26609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:10956:x1871643337639424:12345-192.168.202.54@tcp:38:mount.lustre.0 00010000:00080000:0.0:1784938520.471562:0:26609:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0001: connection from 8ac2e24a-3d40-4d85-8f00-33cba44b76c9@192.168.202.54@tcp t0 exp 0000000000000000 cur 786 last 0 00000020:00000080:0.0:1784938520.471609:0:26609:0:(genops.c:1406:class_connect()) connect: client 8ac2e24a-3d40-4d85-8f00-33cba44b76c9, cookie 0x7b044d4128f9f42c 00000004:00100000:0.0:1784938520.471620:0:26609:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1784938520.474074:0:26609:0:(import.c:65:import_set_state_nolock()) ffff9f24b2ce7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784938520.474136:0:26609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+6:10956:x1871643337639424:12345-192.168.202.54@tcp:38:mount.lustre.0 Request processed in 2588us (3221us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938520.474164:0:26609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 20 00000001:00100000:0.0:1784938520.477950:0:26594:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8ac2e24a-3d40-4d85-8f00-33cba44b76c9 00000001:00080000:0.0:1784938520.477966:0:26594:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901892 is committed 00000001:00100000:0.0:1784938520.478217:0:27341:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8ac2e24a-3d40-4d85-8f00-33cba44b76c9 00000001:00100000:0.0:1784938520.478223:0:27341:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1784938520.480987:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938520.481075:0:27313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337639296 00000100:00100000:1.0:1784938520.481086:0:27313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337639296 00000100:00080000:3.0:1784938520.481242:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938520.481307:0:26608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:2.0:1784938520.481320:0:26608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+5:0:x1871643337639296:12345-192.168.202.54@tcp:41:mount.lustre.0 00000004:00000024:2.0:1784938520.481354:0:26608:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 218345472 avail 191320064 00000100:00100000:2.0:1784938520.481494:0:26608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+5:0:x1871643337639296:12345-192.168.202.54@tcp:41:mount.lustre.0 Request processed in 177us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938520.481503:0:26608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:2.0:1784938520.482789:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938520.483105:0:26609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337639552 00000100:00100000:0.0:1784938520.483113:0:26609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337639552 00000100:00100000:0.0:1784938520.483216:0:26609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00100000:0.0:1784938520.483225:0:26609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+5:0:x1871643337639552:12345-192.168.202.54@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784938520.483255:0:26609:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 218472448 avail 191447040 00000100:00100000:0.0:1784938520.483562:0:26609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+5:0:x1871643337639552:12345-192.168.202.54@tcp:41:mount.lustre.0 Request processed in 337us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938520.483571:0:26609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00080000:2.0:1784938520.483860:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784938520.484059:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938520.484573:0:26608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337639680 00000100:00100000:0.0:1784938520.484579:0:26608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337639680 00000100:00100000:0.0:1784938520.484629:0:26608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:0.0:1784938520.484637:0:26608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+5:17690:x1871643337639680:12345-192.168.202.54@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784938520.484667:0:26608:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 218345472 avail 191320064 00000100:00100000:0.0:1784938520.484724:0:26608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+5:17690:x1871643337639680:12345-192.168.202.54@tcp:41:mount.lustre.0 Request processed in 88us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938520.484732:0:26608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:2.0:1784938520.486979:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938520.487065:0:26609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337639808 00000100:00100000:0.0:1784938520.487075:0:26609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337639808 00000100:00100000:2.0:1784938520.487232:0:26607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 24 00000100:00100000:2.0:1784938520.487244:0:26607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+5:17690:x1871643337639808:12345-192.168.202.54@tcp:40:mount.lustre.0 00000100:00100000:2.0:1784938520.487335:0:26607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+5:17690:x1871643337639808:12345-192.168.202.54@tcp:40:mount.lustre.0 Request processed in 93us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938520.487343:0:26607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 24 00010000:00010000:1.0:1784938520.488618:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938520.490786:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938520.490827:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938520.490919:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938520.490972:0:26618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337640192 00000100:00100000:2.0:1784938520.490982:0:26618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337640192 00000100:00100000:2.0:1784938520.491044:0:26618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 3 00000100:00100000:2.0:1784938520.491054:0:26618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+5:17690:x1871643337640192:12345-192.168.202.54@tcp:900:mount.lustre.0 00000100:00100000:2.0:1784938520.491173:0:26618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+5:17690:x1871643337640192:12345-192.168.202.54@tcp:900:mount.lustre.0 Request processed in 93us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938520.491183:0:26618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 3 00000100:00100000:0.0:1784938520.492502:0:25719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337639936 00000100:00100000:0.0:1784938520.492513:0:25719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337639936 00000100:00100000:0.0:1784938520.492585:0:25719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337640064 00000100:00100000:0.0:1784938520.492589:0:25719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337640064 00000100:00100000:2.0:1784938520.492626:0:25728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 998 00000100:00100000:2.0:1784938520.492633:0:25728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:10956:x1871643337639936:12345-192.168.202.54@tcp:8:mount.lustre.0 00010000:00080000:2.0:1784938520.492675:0:25728:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0000: connection from 8ac2e24a-3d40-4d85-8f00-33cba44b76c9@192.168.202.54@tcp t0 exp 0000000000000000 cur 786 last 0 00000020:00000080:2.0:1784938520.492719:0:25728:0:(genops.c:1406:class_connect()) connect: client 8ac2e24a-3d40-4d85-8f00-33cba44b76c9, cookie 0x7b044d4128f9f433 00002000:00100000:2.0:1784938520.492733:0:25728:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8ac2e24a-3d40-4d85-8f00-33cba44b76c9/ffff9f24b2d32000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cb ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784938520.492744:0:25728:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784938520.492830:0:25728:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784938520.492858:0:25728:0:(import.c:65:import_set_state_nolock()) ffff9f24b2d34800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938520.492908:0:25728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+6:10956:x1871643337639936:12345-192.168.202.54@tcp:8:mount.lustre.0 Request processed in 273us (2079us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938520.492915:0:25728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 998 00000100:00100000:2.0:1784938520.492932:0:25728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 999 00000100:00100000:2.0:1784938520.492936:0:25728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238e0ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:10956:x1871643337640064:12345-192.168.202.54@tcp:8:mount.lustre.0 00010000:00080000:2.0:1784938520.492953:0:25728:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0001: connection from 8ac2e24a-3d40-4d85-8f00-33cba44b76c9@192.168.202.54@tcp t0 exp 0000000000000000 cur 786 last 0 00000020:00000080:2.0:1784938520.492971:0:25728:0:(genops.c:1406:class_connect()) connect: client 8ac2e24a-3d40-4d85-8f00-33cba44b76c9, cookie 0x7b044d4128f9f43a 00002000:00100000:2.0:1784938520.492976:0:25728:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8ac2e24a-3d40-4d85-8f00-33cba44b76c9/ffff9f24b2d33000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cb ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784938520.492982:0:25728:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784938520.493022:0:25728:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784938520.493037:0:25728:0:(import.c:65:import_set_state_nolock()) ffff9f24b2d35800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938520.493062:0:25728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238e0ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+6:10956:x1871643337640064:12345-192.168.202.54@tcp:8:mount.lustre.0 Request processed in 123us (2142us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938520.493069:0:25728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 999 00000001:00100000:3.0:1784938520.496714:0:21144:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8ac2e24a-3d40-4d85-8f00-33cba44b76c9 00000001:00080000:3.0:1784938520.496732:0:21144:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967574 is committed 00000100:00100000:3.0:1784938520.498725:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938520.498881:0:26610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337640320 00000100:00100000:0.0:1784938520.498892:0:26610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337640320 00000100:00100000:0.0:1784938520.498951:0:26610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:0.0:1784938520.498961:0:26610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+5:17690:x1871643337640320:12345-192.168.202.54@tcp:33:mount.lustre.0 00000004:00080000:0.0:1784938520.500318:0:26610:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1272us 00000001:00100000:2.0:1784938520.501710:0:22178:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8ac2e24a-3d40-4d85-8f00-33cba44b76c9 00000001:00080000:2.0:1784938520.501725:0:22178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967574 is committed 00000004:00200000:2.0:1784938520.514006:0:26610:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1784938520.514134:0:26610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+5:17690:x1871643337640320:12345-192.168.202.54@tcp:33:mount.lustre.0 Request processed in 15168us (15411us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938520.514178:0:26610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:2.0:1784938520.744856:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784938520.744881:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350949120:192.168.202.154@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938520.748789:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d4e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350949248:192.168.202.154@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938520.749035:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938520.749090:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938520.749131:0:21154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350949120 00000100:00100000:0.0:1784938520.749140:0:21154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350949120 00000100:00100000:0.0:1784938520.749198:0:21154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350949248 00000100:00100000:0.0:1784938520.749202:0:21154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350949248 00000100:00100000:0.0:1784938520.749218:0:21154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 98 00000100:00100000:0.0:1784938520.749227:0:21154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:16389:x1871643350949120:12345-192.168.202.154@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1784938520.749250:0:21154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8708800 pending 0 free 313057280 avail 285245440 00000100:00100000:0.0:1784938520.749308:0:21154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:16389:x1871643350949120:12345-192.168.202.154@tcp:13:osp-pre-1-0.0 Request processed in 81us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938520.749316:0:21154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 98 00000100:00100000:0.0:1784938520.749336:0:21154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 99 00000100:00100000:0.0:1784938520.749342:0:21154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:16391:x1871643350949248:12345-192.168.202.154@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1784938520.749352:0:21154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8708800 pending 0 free 313057280 avail 285245440 00000100:00100000:0.0:1784938520.749373:0:21154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:16391:x1871643350949248:12345-192.168.202.154@tcp:13:osp-pre-0-0.0 Request processed in 31us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938520.749380:0:21154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 99 00000100:00100000:0.0:1784938520.749689:0:16391:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967574 gen 2 00000100:00100000:0.0:1784938520.749726:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d4e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350949248:192.168.202.154@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938520.749769:0:16389:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967574 gen 2 00000100:00100000:0.0:1784938520.749783:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350949120:192.168.202.154@tcp:13:osp-pre-1-0.0 00010000:00010000:3.0:1784938521.516946:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938521.683644:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938521.684290:0:26608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337640448 00000100:00100000:2.0:1784938521.684301:0:26608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337640448 00000100:00100000:2.0:1784938521.684366:0:26608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 25 00000100:00100000:2.0:1784938521.684377:0:26608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+5:17734:x1871643337640448:12345-192.168.202.54@tcp:101:touch.0 00010000:00010000:2.0:1784938521.684409:0:26608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938521.684437:0:26608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17be00/0x7b044d4128f9f441 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664e42 expref: -99 pid: 26608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.684507:0:26608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b000/0x7b044d4128f9f448 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 26608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.684523:0:26608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b000/0x7b044d4128f9f448 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.684539:0:26608:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b000/0x7b044d4128f9f448 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26608 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938521.684594:0:26608:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784938521.684598:0:26608:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784938521.684633:0:26608:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b000/0x7b044d4128f9f448 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.684663:0:26608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17be00/0x7b044d4128f9f441 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664e42 expref: 7 pid: 26608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.684681:0:26608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b000/0x7b044d4128f9f448 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664e42 expref: 6 pid: 26608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.684700:0:26608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:2.0:1784938521.684703:0:26608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784938521.684706:0:26608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17b000, rc 0) 00000100:00100000:2.0:1784938521.684774:0:26608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+6:17734:x1871643337640448:12345-192.168.202.54@tcp:101:touch.0 Request processed in 399us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938521.684781:0:26608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 25 00000100:00100000:1.0:1784938521.698075:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938521.698199:0:26616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337640576 00000100:00100000:2.0:1784938521.698210:0:26616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337640576 00000100:00100000:2.0:1784938521.698268:0:26616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:2.0:1784938521.698280:0:26616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+6:17734:x1871643337640576:12345-192.168.202.54@tcp:700:touch.0 00000100:00100000:2.0:1784938521.698367:0:26616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+6:17734:x1871643337640576:12345-192.168.202.54@tcp:700:touch.0 Request processed in 89us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938521.698375:0:26616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:1.0:1784938521.713438:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938521.714477:0:26607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337640832 00000100:00100000:3.0:1784938521.714491:0:26607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337640832 00000100:00100000:3.0:1784938521.714551:0:26607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 26 00000100:00100000:3.0:1784938521.714562:0:26607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+6:17734:x1871643337640832:12345-192.168.202.54@tcp:101:touch.0 00010000:00010000:3.0:1784938521.714586:0:26607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938521.714590:0:26607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784938521.714619:0:26607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b000/0x7b044d4128f9f448 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664e42 expref: 6 pid: 26608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938521.714635:0:26607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f24898e0100) 00010000:00010000:3.0:1784938521.714647:0:26607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938521.714662:0:26607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7800/0x7b044d4128f9f44f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664e49 expref: -99 pid: 26607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938521.714811:0:26607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6e00/0x7b044d4128f9f456 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938521.714825:0:26607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6e00/0x7b044d4128f9f456 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938521.714836:0:26607:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6e00/0x7b044d4128f9f456 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938521.714848:0:26607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7e00/0x7b044d4128f9f45d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938521.714855:0:26607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7e00/0x7b044d4128f9f45d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938521.714862:0:26607:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7e00/0x7b044d4128f9f45d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938521.714918:0:26607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9f464 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938521.714931:0:26607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9f464 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938521.714938:0:26607:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9f464 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938521.714949:0:26607:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1784938521.714966:0:26607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9f464 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938521.714973:0:26607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9f464 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938521.714980:0:26607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9f464 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938521.714986:0:26607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a7a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938521.714991:0:26607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9f464 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938521.715000:0:26607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9f464 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938521.715008:0:26607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f23861e5000) 00010000:00010000:3.0:1784938521.715011:0:26607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938521.715015:0:26607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9f464 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938521.715022:0:26607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7a00/0x7b044d4128f9f464 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938521.715035:0:26607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6e00/0x7b044d4128f9f456 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938521.715042:0:26607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6e00/0x7b044d4128f9f456 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938521.715047:0:26607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6e00/0x7b044d4128f9f456 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938521.715052:0:26607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a6e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938521.715055:0:26607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6e00/0x7b044d4128f9f456 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938521.715060:0:26607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6e00/0x7b044d4128f9f456 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938521.715068:0:26607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f23861e5f00) 00010000:00010000:3.0:1784938521.715070:0:26607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938521.715073:0:26607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6e00/0x7b044d4128f9f456 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938521.715079:0:26607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a6e00/0x7b044d4128f9f456 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938521.715088:0:26607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7e00/0x7b044d4128f9f45d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938521.715094:0:26607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7e00/0x7b044d4128f9f45d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938521.715100:0:26607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7e00/0x7b044d4128f9f45d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938521.715105:0:26607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a7e00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:3.0:1784938521.715108:0:26607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7e00/0x7b044d4128f9f45d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938521.715114:0:26607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7e00/0x7b044d4128f9f45d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938521.715121:0:26607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9f23861e5b00) 00010000:00010000:3.0:1784938521.715123:0:26607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938521.715125:0:26607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7e00/0x7b044d4128f9f45d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938521.715131:0:26607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7e00/0x7b044d4128f9f45d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938521.715179:0:26607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7800/0x7b044d4128f9f44f lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664e49 expref: 6 pid: 26607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938521.715188:0:26607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f23861e5f00) 00010000:00010000:3.0:1784938521.715190:0:26607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938521.715193:0:26607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d3a7800/0x7b044d4128f9f44f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664e49 expref: 6 pid: 26607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938521.715204:0:26607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a7800, rc 0) 00000100:00100000:3.0:1784938521.715279:0:26607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+5:17734:x1871643337640832:12345-192.168.202.54@tcp:101:touch.0 Request processed in 719us (1853us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938521.715287:0:26607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 26 00000100:00100000:3.0:1784938521.719518:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938521.719855:0:26608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337640960 00000100:00100000:2.0:1784938521.719866:0:26608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337640960 00000100:00100000:2.0:1784938521.719933:0:26608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 27 00000100:00100000:2.0:1784938521.719944:0:26608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+5:17734:x1871643337640960:12345-192.168.202.54@tcp:101:touch.0 00010000:00010000:2.0:1784938521.719966:0:26608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938521.719990:0:26608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17be00/0x7b044d4128f9f46b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664e50 expref: -99 pid: 26608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.720057:0:26608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b600/0x7b044d4128f9f472 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 26608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.720072:0:26608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b600/0x7b044d4128f9f472 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.720084:0:26608:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b600/0x7b044d4128f9f472 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26608 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938521.720161:0:26608:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784938521.720165:0:26608:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784938521.720186:0:26608:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b600/0x7b044d4128f9f472 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.720210:0:26608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17be00/0x7b044d4128f9f46b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664e50 expref: 7 pid: 26608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.720229:0:26608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b600/0x7b044d4128f9f472 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664e50 expref: 6 pid: 26608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.720238:0:26608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f24898e0600) 00010000:00010000:2.0:1784938521.720242:0:26608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784938521.720246:0:26608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17b600, rc 0) 00000100:00100000:2.0:1784938521.720545:0:26608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+6:17734:x1871643337640960:12345-192.168.202.54@tcp:101:touch.0 Request processed in 600us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938521.720552:0:26608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 27 00000100:00100000:3.0:1784938521.723264:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938521.723524:0:26607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337641088 00000100:00100000:2.0:1784938521.723534:0:26607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337641088 00000100:00100000:2.0:1784938521.723595:0:26607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 28 00000100:00100000:2.0:1784938521.723605:0:26607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+6:17734:x1871643337641088:12345-192.168.202.54@tcp:101:touch.0 00010000:00010000:2.0:1784938521.723628:0:26607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938521.723650:0:26607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a800/0x7b044d4128f9f479 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x571025e947664e57 expref: -99 pid: 26607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.723731:0:26607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a200/0x7b044d4128f9f480 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.723746:0:26607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a200/0x7b044d4128f9f480 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.723757:0:26607:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a200/0x7b044d4128f9f480 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.723772:0:26607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9f487 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.723779:0:26607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9f487 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.723787:0:26607:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9f487 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.723846:0:26607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9f48e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.723854:0:26607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9f48e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.723861:0:26607:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9f48e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938521.723904:0:26607:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784938521.723908:0:26607:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784938521.723926:0:26607:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9f48e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.723937:0:26607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a200/0x7b044d4128f9f480 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.723944:0:26607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a200/0x7b044d4128f9f480 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.723952:0:26607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a200/0x7b044d4128f9f480 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.723958:0:26607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17a200 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938521.723962:0:26607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a200/0x7b044d4128f9f480 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.723971:0:26607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a200/0x7b044d4128f9f480 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.723984:0:26607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f24898e0600) 00010000:00010000:2.0:1784938521.723987:0:26607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938521.723992:0:26607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a200/0x7b044d4128f9f480 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.723999:0:26607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a200/0x7b044d4128f9f480 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.724013:0:26607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9f487 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.724024:0:26607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9f487 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.724031:0:26607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9f487 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.724036:0:26607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17ae00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:2.0:1784938521.724039:0:26607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9f487 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.724045:0:26607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9f487 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.724053:0:26607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9f24898e0c00) 00010000:00010000:2.0:1784938521.724055:0:26607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938521.724058:0:26607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9f487 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.724064:0:26607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17ae00/0x7b044d4128f9f487 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26607 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.724094:0:26607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17a800/0x7b044d4128f9f479 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664e57 expref: 8 pid: 26607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.724108:0:26607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9f48e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664e57 expref: 7 pid: 26607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938521.724116:0:26607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f24898e0500) 00010000:00010000:2.0:1784938521.724118:0:26607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784938521.724120:0:26607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17b400, rc 0) 00000100:00100000:2.0:1784938521.724214:0:26607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+7:17734:x1871643337641088:12345-192.168.202.54@tcp:101:touch.0 Request processed in 610us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938521.724221:0:26607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 28 00000100:00100000:0.0:1784938521.727684:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938521.728077:0:26619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337641216 00000100:00100000:3.0:1784938521.728087:0:26619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337641216 00000100:00100000:3.0:1784938521.728181:0:26619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:3.0:1784938521.728192:0:26619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+7:17734:x1871643337641216:12345-192.168.202.54@tcp:900:touch.0 00000100:00100000:3.0:1784938521.728291:0:26619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+7:17734:x1871643337641216:12345-192.168.202.54@tcp:900:touch.0 Request processed in 99us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938521.728299:0:26619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:3.0:1784938521.738616:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938521.738706:0:26608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337641472 00000100:00100000:0.0:1784938521.738717:0:26608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337641472 00000100:00100000:0.0:1784938521.738785:0:26608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 29 00000100:00100000:0.0:1784938521.738796:0:26608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24bd256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+7:17734:x1871643337641472:12345-192.168.202.54@tcp:36:touch.0 00010000:00010000:0.0:1784938521.738856:0:26608:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938521.738888:0:26608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b400/0x7b044d4128f9f48e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664e57 expref: 7 pid: 26607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938521.738910:0:26608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f24898e0500) 00010000:00010000:0.0:1784938521.738924:0:26608:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784938521.738952:0:26608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057a00/0x7b044d4128f9f495 lrc: 3/0,1 mode: --/PW res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 26608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938521.738964:0:26608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057a00/0x7b044d4128f9f495 lrc: 3/0,1 mode: PW/PW res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938521.738974:0:26608:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057a00/0x7b044d4128f9f495 lrc: 3/0,1 mode: PW/PW res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 26608 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:02000000:0.0:1784938521.739060:0:26608:0:(osd_handler.c:3453:osd_attr_set()) *** cfs_fail_loc=193, val=0*** 00000004:00010000:0.0:1784938521.743622:0:26608:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a39905d8 reply state 00000000f4c2c1fd transno 12884901893 ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057a00/0x7b044d4128f9f495 lrc: 3/0,1 mode: PW/PW res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 26608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938521.743650:0:26608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057a00/0x7b044d4128f9f495 lrc: 3/0,1 mode: TXN/TXN res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938521.743659:0:26608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f2387231200) 00010000:00010000:0.0:1784938521.743662:0:26608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938521.743666:0:26608:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784938521.743676:0:26608:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1784938521.744336:0:26608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24bd256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+8:17734:x1871643337641472:12345-192.168.202.54@tcp:36:touch.0 Request processed in 5534us (5720us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1784938521.744347:0:26608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 29 00010000:00010000:1.0:1784938522.543878:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938523.560784:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938524.584598:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938524.928366:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938524.928415:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1784938524.928451:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938524.928624:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337641856 00000100:00100000:3.0:1784938524.928634:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337641856 00000100:00100000:3.0:1784938524.928701:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337641728 00000100:00100000:3.0:1784938524.928704:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337641728 00000100:00100000:3.0:1784938524.928729:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337641600 00000100:00100000:3.0:1784938524.928732:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337641600 00000100:00100000:3.0:1784938524.928751:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 37 00000100:00100000:3.0:1784938524.928762:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24c5a45050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8ccc7f77-7c1a-4025-b77c-8021722e21dc+12:10958:x1871643337641856:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938524.928783:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938524.928805:0:25731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f238c558000/0x7b044d4128f9f41e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664e11 expref: 12 pid: 26600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938524.929016:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938524.929075:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24c5a45050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8ccc7f77-7c1a-4025-b77c-8021722e21dc+11:10958:x1871643337641856:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 315us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938524.929083:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 37 00000100:00100000:1.0:1784938524.929141:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 38 00000100:00100000:1.0:1784938524.929189:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ccc7f77-7c1a-4025-b77c-8021722e21dc+10:10958:x1871643337641728:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938524.929209:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938524.929222:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f238c559400/0x7b044d4128f9f417 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664e0a expref: 10 pid: 26600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938524.929232:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938524.929256:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ccc7f77-7c1a-4025-b77c-8021722e21dc+9:10958:x1871643337641728:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 70us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938524.929653:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 39 00000100:00100000:3.0:1784938524.929674:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8ccc7f77-7c1a-4025-b77c-8021722e21dc+9:10960:x1871643337641600:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938524.929685:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938524.929696:0:25731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f238d3a6800/0x7b044d4128f9f410 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664dd9 expref: 9 pid: 26598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938524.929713:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938524.929736:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8ccc7f77-7c1a-4025-b77c-8021722e21dc+8:10960:x1871643337641600:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 74us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938524.929745:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 39 00000100:00100000:3.0:1784938524.931181:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938524.931233:0:21149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337641984 00000100:00100000:3.0:1784938524.931242:0:21149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337641984 00000100:00100000:3.0:1784938524.931308:0:21149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 1000 00000100:00100000:3.0:1784938524.931321:0:21149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+5:10956:x1871643337641984:12345-192.168.202.54@tcp:9:umount.0 00000020:00000080:3.0:1784938524.931353:0:21149:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9f43a 00000100:00080000:3.0:1784938524.931364:0:21149:0:(import.c:65:import_set_state_nolock()) ffff9f24b2d35800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784938524.931414:0:21149:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967574 00000100:00100000:3.0:1784938524.931579:0:21149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+2:10956:x1871643337641984:12345-192.168.202.54@tcp:9:umount.0 Request processed in 259us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938524.931586:0:21149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 1000 00000100:00080000:3.0:1784938524.932254:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784938524.932273:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938524.935016:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 38 00000100:00100000:2.0:1784938524.940676:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938524.941425:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337642112 00000100:00100000:1.0:1784938524.941438:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337642112 00000100:00100000:1.0:1784938524.941507:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 1001 00000100:00100000:1.0:1784938524.941517:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+5:10956:x1871643337642112:12345-192.168.202.54@tcp:9:umount.0 00000020:00000080:1.0:1784938524.941558:0:25722:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9f433 00000100:00080000:1.0:1784938524.941567:0:25722:0:(import.c:65:import_set_state_nolock()) ffff9f24b2d34800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784938524.941619:0:25722:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967574 00010000:00010000:2.0:1784938524.941686:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938524.941814:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+2:10956:x1871643337642112:12345-192.168.202.54@tcp:9:umount.0 Request processed in 299us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938524.941823:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 1001 00000100:00080000:3.0:1784938524.944302:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938524.953321:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1784938524.953642:0:26607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337642368 00000100:00100000:2.0:1784938524.953652:0:26607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337642368 00000100:00100000:2.0:1784938524.953753:0:26607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 30 00000100:00100000:2.0:1784938524.953765:0:26607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386361c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+8:10956:x1871643337642368:12345-192.168.202.54@tcp:39:umount.0 00000020:00000080:2.0:1784938524.953820:0:26607:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9f425 00000020:00010000:2.0:1784938524.953830:0:26607:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9f24b2ce1000: total 0 00000100:00080000:2.0:1784938524.953835:0:26607:0:(import.c:65:import_set_state_nolock()) ffff9f24b2ce2800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784938524.953880:0:26607:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901893 00000100:00100000:2.0:1784938524.954056:0:26607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386361c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+7:10956:x1871643337642368:12345-192.168.202.54@tcp:39:umount.0 Request processed in 292us (747us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1784938524.954066:0:26607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 30 00000020:00010000:1.0:1784938524.954513:0:22954:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9f24b2ce1000: total 0 00010000:00010000:1.0:1784938524.954570:0:22954:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9f24b2ce1000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1784938524.954624:0:22954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f24898e0600) 00010000:00010000:1.0:1784938524.954628:0:22954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784938524.954636:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f238d17b600/0x7b044d4128f9f472 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664e50 expref: 6 pid: 26608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938524.954669:0:22954:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9f24b2ce1000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1784938524.954683:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938524.954685:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938524.954687:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938524.954936:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057a00/0x7b044d4128f9f495 lrc: 3/0,1 mode: TXN/TXN res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938524.954946:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057a00/0x7b044d4128f9f495 lrc: 2/0,0 mode: TXN/TXN res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 26608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938524.954953:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057a00/0x7b044d4128f9f495 lrc: 3/0,0 mode: TXN/TXN res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938524.954960:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057a00 already unused, calling callback (ffffffffc19a14f0) 00010000:00010000:0.0:1784938524.954965:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057a00/0x7b044d4128f9f495 lrc: 3/0,0 mode: TXN/TXN res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938524.954973:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057a00/0x7b044d4128f9f495 lrc: 4/0,0 mode: TXN/TXN res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 26608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938524.954983:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f2387231200) 00010000:00010000:0.0:1784938524.954986:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938524.954990:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057a00/0x7b044d4128f9f495 lrc: 2/0,0 mode: --/TXN res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938524.954996:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24b4057a00/0x7b044d4128f9f495 lrc: 0/0,0 mode: --/TXN res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26608 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784938524.955687:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938525.001987:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1784938525.002940:0:27313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337642496 00000100:00100000:3.0:1784938525.002953:0:27313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337642496 00000100:00100000:3.0:1784938525.003032:0:27313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 31 00000100:00100000:3.0:1784938525.003048:0:27313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+5:10956:x1871643337642496:12345-192.168.202.54@tcp:39:umount.0 00000020:00000080:3.0:1784938525.003090:0:27313:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9f42c 00000100:00080000:3.0:1784938525.003099:0:27313:0:(import.c:65:import_set_state_nolock()) ffff9f24b2ce7000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784938525.003128:0:27313:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1784938525.003352:0:27313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8ac2e24a-3d40-4d85-8f00-33cba44b76c9+3:10956:x1871643337642496:12345-192.168.202.54@tcp:39:umount.0 Request processed in 308us (1376us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1784938525.003360:0:27313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 31 00000100:00080000:2.0:1784938525.003537:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1784938525.003894:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938525.066829:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1784938525.066930:0:26600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643337642752 00000100:00100000:1.0:1784938525.066940:0:26600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643337642752 00000100:00100000:1.0:1784938525.067006:0:26600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 95 00000100:00100000:1.0:1784938525.067016:0:26600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b2ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ccc7f77-7c1a-4025-b77c-8021722e21dc+7:10956:x1871643337642752:12345-192.168.202.54@tcp:251:umount.0 00000020:00000080:1.0:1784938525.067274:0:26600:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9f402 00000020:00010000:1.0:1784938525.067282:0:26600:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9f24bd50a800: total 0 00000100:00080000:1.0:1784938525.067287:0:26600:0:(import.c:65:import_set_state_nolock()) ffff9f24bd50d000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1784938525.067352:0:26600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b2ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ccc7f77-7c1a-4025-b77c-8021722e21dc+3:10956:x1871643337642752:12345-192.168.202.54@tcp:251:umount.0 Request processed in 337us (533us total) trans 0 rc 0/0 00000020:00010000:0.0:1784938525.067435:0:25733:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9f24bd50a800: total 0 00010000:00010000:0.0:1784938525.067440:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938525.067493:0:25733:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9f24bd50a800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784938525.067528:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f238c558c00/0x7b044d4128f9f409 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x571025e947664dd2 expref: 3 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938525.067544:0:25733:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9f24bd50a800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1784938525.067560:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938525.067562:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938525.067564:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938525.067597:0:26600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 95 00000020:00000080:1.0:1784938525.067607:0:26600:0:(genops.c:906:class_export_put()) final put ffff9f24bd50a800/8ccc7f77-7c1a-4025-b77c-8021722e21dc 00000020:00000080:0.0:1784938525.068304:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f24bd50a800/8ccc7f77-7c1a-4025-b77c-8021722e21dc for MGS 00000020:00000080:0.0:1784938525.068341:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f24bd50d000 for MGS 00000100:00100000:0.0:1784938525.354177:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238d4e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350949376:192.168.202.154@tcp:13:osp-pre-1-1.0 00000100:00100000:3.0:1784938525.354932:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938525.355057:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e07296-2a01-411c-abf2-6d190cb69ef0:16389:1871643350949504:0@lo:400:kworker.0 00000100:00100000:0.0:1784938525.355100:0:16389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938525.355158:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:16389:1871643350950016:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938525.355160:0:26601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350949504 00000100:00100000:2.0:1784938525.355168:0:26601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350949504 00000100:00100000:2.0:1784938525.355212:0:26601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1784938525.355212:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:16389:1871643350950528:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938525.355221:0:26601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b2ee6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+24:16389:x1871643350949504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938525.355239:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b3f3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:16389:1871643350951040:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938525.355270:0:26601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b2ee6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+24:16389:x1871643350949504:12345-0@lo:400:kworker.0 Request processed in 51us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938525.355278:0:26601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1784938525.355288:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e07296-2a01-411c-abf2-6d190cb69ef0:16389:1871643350949504:0@lo:400:kworker.0 00000100:00100000:0.0:1784938525.355300:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1784938525.355307:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:16389:1871643350949632:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938525.355332:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350950144:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938525.355356:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350950656:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938525.355379:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386361500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350951168:192.168.202.154@tcp:41:osp-pre-0-1.0 00000100:00100000:0.0:1784938525.355417:0:21154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350949376 00000100:00100000:0.0:1784938525.355422:0:21154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350949376 00000100:00100000:0.0:1784938525.355458:0:21154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 100 00000100:00100000:3.0:1784938525.355459:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938525.355465:0:21154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16392:x1871643350949376:12345-192.168.202.154@tcp:13:osp-pre-1-1.0 00002000:00000024:0.0:1784938525.355489:0:21154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 271040 pending 0 free 313057280 avail 285245440 00000100:00100000:3.0:1784938525.355491:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938525.355536:0:21154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16392:x1871643350949376:12345-192.168.202.154@tcp:13:osp-pre-1-1.0 Request processed in 71us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938525.355546:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938525.355551:0:21154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 100 00000100:00100000:0.0:1784938525.355578:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:16391:1871643350949760:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938525.355595:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938525.355618:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938525.355636:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938525.355654:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938525.355700:0:25714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350950656 00000100:00100000:3.0:1784938525.355704:0:25714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350950656 00000100:00100000:3.0:1784938525.355725:0:25714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350950144 00000100:00100000:3.0:1784938525.355728:0:25714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350950144 00000100:00100000:3.0:1784938525.355738:0:25714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350951168 00000100:00100000:3.0:1784938525.355740:0:25714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350951168 00000100:00100000:3.0:1784938525.355750:0:25714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 125 00000100:00100000:3.0:1784938525.355755:0:25714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:16389:x1871643350950656:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938525.355790:0:25714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:16389:x1871643350950656:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 35us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938525.355797:0:25714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 125 00000100:00100000:3.0:1784938525.355812:0:25714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 126 00000100:00100000:3.0:1784938525.355818:0:25714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:16389:x1871643350950144:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938525.355840:0:25714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:16389:x1871643350950144:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 23us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938525.355849:0:25714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 126 00000100:00100000:3.0:1784938525.355862:0:25714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 127 00000100:00100000:3.0:1784938525.355868:0:25714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:16389:x1871643350951168:12345-192.168.202.154@tcp:41:osp-pre-0-1.0 00000004:00000024:3.0:1784938525.355888:0:25714:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 218345472 avail 191320064 00000100:00100000:3.0:1784938525.355917:0:25714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:16389:x1871643350951168:12345-192.168.202.154@tcp:41:osp-pre-0-1.0 Request processed in 50us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938525.355923:0:25714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 127 00000100:00100000:3.0:1784938525.355946:0:26608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350950016 00000100:00100000:3.0:1784938525.355949:0:26608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350950016 00000100:00100000:3.0:1784938525.355966:0:26608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350950528 00000100:00100000:3.0:1784938525.355968:0:26608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350950528 00000100:00100000:3.0:1784938525.355975:0:26608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350949632 00000100:00100000:3.0:1784938525.355978:0:26608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350949632 00000100:00100000:3.0:1784938525.355986:0:26608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350951040 00000100:00100000:3.0:1784938525.355989:0:26608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350951040 00000100:00100000:3.0:1784938525.356002:0:26608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 21 00000100:00100000:3.0:1784938525.356007:0:26608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:16389:x1871643350950016:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938525.356048:0:26608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:16389:x1871643350950016:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 41us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938525.356054:0:26608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 21 00000100:00100000:3.0:1784938525.356065:0:26608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 22 00000100:00100000:3.0:1784938525.356070:0:26608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:16389:x1871643350950528:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938525.356091:0:26608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:16389:x1871643350950528:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 20us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938525.356096:0:26608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 22 00000100:00100000:3.0:1784938525.356105:0:26608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 23 00000100:00100000:3.0:1784938525.356110:0:26608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:16389:x1871643350949632:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938525.356132:0:26608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:16389:x1871643350949632:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 22us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938525.356137:0:26608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 23 00000100:00100000:3.0:1784938525.356168:0:26608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 24 00000100:00100000:3.0:1784938525.356175:0:26608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:16389:x1871643350951040:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938525.356197:0:26608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:16389:x1871643350951040:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 23us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938525.356202:0:26608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 24 00000100:00100000:0.0:1784938525.356410:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350950272:192.168.202.154@tcp:400:kworker.0 00000100:00080000:2.0:1784938525.356492:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784938525.356497:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784938525.356499:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784938525.356734:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:16392:1871643350949888:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938525.359360:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938525.359415:0:26608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350949760 00000100:00100000:3.0:1784938525.359423:0:26608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350949760 00000100:00100000:3.0:1784938525.359486:0:26608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 25 00000100:00100000:3.0:1784938525.359494:0:26608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:16391:x1871643350949760:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938525.359557:0:26608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:16391:x1871643350949760:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 63us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938525.359563:0:26608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 25 00000100:00080000:3.0:1784938525.359586:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784938525.359624:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:16389:1871643350949632:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938525.359639:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350950144:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938525.359652:0:16389:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884901892 gen 2 00000004:00080000:3.0:1784938525.359667:0:16389:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901889 committed transno 12884901892 00000004:00080000:3.0:1784938525.359686:0:16389:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901890 committed transno 12884901892 00000004:00080000:3.0:1784938525.359695:0:16389:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901891 committed transno 12884901892 00000004:00080000:3.0:1784938525.359703:0:16389:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901892 committed transno 12884901892 00000100:00100000:3.0:1784938525.359718:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350950656:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938525.359738:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386361500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350951168:192.168.202.154@tcp:41:osp-pre-0-1.0 00010000:00080000:3.0:1784938525.359754:0:16389:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f24b68aad80 x1871643350950016/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938525.359765:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:16389:1871643350950016:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938525.359778:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:16389:1871643350950528:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938525.359790:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b3f3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:16389:1871643350951040:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938525.364764:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350950784:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938525.364824:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f22a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350951296:192.168.202.154@tcp:13:osp-pre-0-1.0 00000100:00100000:2.0:1784938525.373085:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938525.373113:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938525.373133:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938525.373173:0:25721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350950272 00000100:00100000:2.0:1784938525.373181:0:25721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350950272 00000100:00100000:2.0:1784938525.373230:0:25721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350950784 00000100:00100000:2.0:1784938525.373233:0:25721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350950784 00000100:00100000:2.0:1784938525.373256:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 112 00000100:00100000:2.0:1784938525.373265:0:25721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:16391:x1871643350950272:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938525.373329:0:25721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:16391:x1871643350950272:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 65us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938525.373335:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 112 00000100:00100000:2.0:1784938525.373350:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 113 00000100:00100000:2.0:1784938525.373355:0:25721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:16391:x1871643350950784:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938525.373375:0:25721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:16391:x1871643350950784:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 20us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938525.373381:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 113 00000100:00080000:2.0:1784938525.373398:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938525.374810:0:21154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350951296 00000100:00100000:0.0:1784938525.374824:0:21154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350951296 00000100:00100000:0.0:1784938525.374893:0:21154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 101 00000100:00100000:0.0:1784938525.374903:0:21154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16391:x1871643350951296:12345-192.168.202.154@tcp:13:osp-pre-0-1.0 00002000:00000024:0.0:1784938525.374947:0:21154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 271040 pending 0 free 313057280 avail 285245440 00000100:00100000:0.0:1784938525.375020:0:21154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16391:x1871643350951296:12345-192.168.202.154@tcp:13:osp-pre-0-1.0 Request processed in 119us (1884us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938525.375042:0:21154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 101 00010000:00080000:0.0:1784938525.375246:0:16391:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f24b68a9500 x1871643350949760/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938525.375260:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:16391:1871643350949760:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938525.375278:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350950272:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938525.375288:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350950784:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938525.375302:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f22a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350951296:192.168.202.154@tcp:13:osp-pre-0-1.0 00000100:00100000:1.0:1784938525.379310:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350950400:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938525.379378:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350950912:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938525.379406:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b3f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350951424:192.168.202.154@tcp:41:osp-pre-1-0.0 00000100:00100000:1.0:1784938525.379470:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238d4e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350949376:192.168.202.154@tcp:13:osp-pre-1-1.0 00000100:00100000:2.0:1784938525.379753:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938525.379795:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938525.379814:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938525.379834:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938525.379904:0:25727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350950400 00000100:00100000:1.0:1784938525.379912:0:25727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350950400 00000100:00100000:1.0:1784938525.379991:0:25727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350950912 00000100:00100000:1.0:1784938525.379995:0:25727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350950912 00000100:00100000:1.0:1784938525.380017:0:25727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 114 00000100:00080000:2.0:1784938525.380257:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784938525.380320:0:26607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350949888 00000100:00100000:3.0:1784938525.380325:0:26607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350949888 00000100:00100000:3.0:1784938525.380362:0:26607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 26 00000100:00100000:3.0:1784938525.380368:0:26607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:16392:x1871643350949888:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938525.380430:0:26607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:16392:x1871643350949888:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 61us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938525.380438:0:26607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 26 00000100:00100000:3.0:1784938525.380463:0:25714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350951424 00000100:00100000:3.0:1784938525.380466:0:25714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350951424 00000100:00100000:3.0:1784938525.380493:0:25714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 128 00000100:00100000:3.0:1784938525.380499:0:25714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:16392:x1871643350951424:12345-192.168.202.154@tcp:41:osp-pre-1-0.0 00000004:00000024:3.0:1784938525.380525:0:25714:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 218472448 avail 191447040 00000100:00100000:3.0:1784938525.380552:0:25714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:16392:x1871643350951424:12345-192.168.202.154@tcp:41:osp-pre-1-0.0 Request processed in 53us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938525.380562:0:25714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 128 00000100:00100000:1.0:1784938525.382242:0:25727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387daea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:16392:x1871643350950400:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938525.382305:0:25727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387daea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:16392:x1871643350950400:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 2279us (2510us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938525.382316:0:25727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 114 00000100:00100000:1.0:1784938525.382345:0:25727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 115 00000100:00100000:0.0:1784938525.386847:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:16392:1871643350949888:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938525.386864:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350950400:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938525.386881:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b3f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350951424:192.168.202.154@tcp:41:osp-pre-1-0.0 00000100:00080000:2.0:1784938525.394888:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938525.395180:0:25727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:16392:x1871643350950912:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938525.395366:0:25727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:16392:x1871643350950912:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 13010us (15548us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938525.395377:0:25727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 115 00000100:00100000:2.0:1784938525.395707:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350950912:192.168.202.154@tcp:400:kworker.0 00010000:00010000:3.0:1784938525.608495:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938525.866322:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350951552:192.168.202.154@tcp:13:osp-pre-0-0.0 00000100:00100000:3.0:1784938525.866666:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938525.866704:0:21154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350951552 00000100:00100000:3.0:1784938525.866714:0:21154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350951552 00000100:00100000:3.0:1784938525.866771:0:21154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 102 00000100:00100000:3.0:1784938525.866780:0:21154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:16389:x1871643350951552:12345-192.168.202.154@tcp:13:osp-pre-0-0.0 00002000:00000024:3.0:1784938525.866811:0:21154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 271040 pending 0 free 313057280 avail 285245440 00000100:00100000:3.0:1784938525.866855:0:21154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:16389:x1871643350951552:12345-192.168.202.154@tcp:13:osp-pre-0-0.0 Request processed in 76us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938525.866863:0:21154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 102 00000100:00100000:3.0:1784938525.868270:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350951552:192.168.202.154@tcp:13:osp-pre-0-0.0 00000100:00100000:3.0:1784938525.870131:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350951680:192.168.202.154@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938525.871129:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938525.871608:0:21154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350951680 00000100:00100000:3.0:1784938525.871621:0:21154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350951680 00000100:00100000:3.0:1784938525.871690:0:21154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 103 00000100:00100000:3.0:1784938525.871701:0:21154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:16390:x1871643350951680:12345-192.168.202.154@tcp:13:osp-pre-1-0.0 00002000:00000024:3.0:1784938525.871734:0:21154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 271040 pending 0 free 313057280 avail 285245440 00000100:00100000:3.0:1784938525.871790:0:21154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:16390:x1871643350951680:12345-192.168.202.154@tcp:13:osp-pre-1-0.0 Request processed in 91us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938525.871810:0:21154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 103 00000100:00100000:3.0:1784938525.871966:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350951680:192.168.202.154@tcp:13:osp-pre-1-0.0 00010000:00010000:2.0:1784938526.633306:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784938527.058854:0:27954:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1784938527.060235:0:27954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24b379d600/0x7b044d4128f9ef7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9ef86 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938527.060255:0:27954:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24b379d600/0x7b044d4128f9ef7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9ef86 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938527.060262:0:27954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24b379d600/0x7b044d4128f9ef7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b044d4128f9ef86 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938527.060270:0:27954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff9f24b379d600/0x7b044d4128f9ef7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b044d4128f9ef86 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938527.060297:0:27954:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784938527.060303:0:27954:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1784938527.060334:0:27954:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784938527.060340:0:27954:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1784938527.060345:0:27954:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784938527.060370:0:27954:0:(import.c:65:import_set_state_nolock()) ffff9f238d120800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1784938527.060539:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:16388:1871643350951808:192.168.202.154@tcp:39:umount.0 00000100:00100000:3.0:1784938527.061280:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00010000:00010000:2.0:1784938527.061617:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938527.061626:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9f24b379d600/0x7b044d4128f9ef7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b044d4128f9ef86 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938527.061635:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b379d600 already unused, calling callback (ffffffffc1390c20) 10000000:00010000:2.0:1784938527.061640:0:22954:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9f24b379d600/0x7b044d4128f9ef7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b044d4128f9ef86 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938527.061661:0:22954:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f24b379d600/0x7b044d4128f9ef7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b044d4128f9ef86 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938527.061669:0:22954:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f24b379d600/0x7b044d4128f9ef7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b044d4128f9ef86 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938527.061676:0:22954:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784938527.061679:0:22954:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1784938527.061682:0:22954:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1784938527.061712:0:22954:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9f24b379d600/0x7b044d4128f9ef7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f9ef86 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938527.061719:0:22954:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938527.061745:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9f24b379d600/0x7b044d4128f9ef7f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f9ef86 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938527.061753:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f24b379d600/0x7b044d4128f9ef7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f9ef86 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938527.061769:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938527.061771:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938527.061773:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938527.061818:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387daf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e07296-2a01-411c-abf2-6d190cb69ef0:16391:1871643350951936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938527.061862:0:16391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938527.062071:0:26608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350951808 00000100:00100000:0.0:1784938527.062079:0:26608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350951808 00000100:00100000:0.0:1784938527.062130:0:26608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 32 00000100:00100000:0.0:1784938527.062140:0:26608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:16388:x1871643350951808:12345-192.168.202.154@tcp:39:umount.0 00000020:00000080:0.0:1784938527.062725:0:26608:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9f020 00000100:00080000:0.0:1784938527.062734:0:26608:0:(import.c:65:import_set_state_nolock()) ffff9f238dba1800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1784938527.062811:0:26608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:16388:x1871643350951808:12345-192.168.202.154@tcp:39:umount.0 Request processed in 671us (1533us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938527.062820:0:26608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 32 00000020:00000080:0.0:1784938527.062832:0:26608:0:(genops.c:906:class_export_put()) final put ffff9f238dba6800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1784938527.063107:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938527.063231:0:25731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350951936 00000100:00100000:2.0:1784938527.063237:0:25731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350951936 00000100:00100000:2.0:1784938527.063287:0:25731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784938527.063295:0:25731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:73e07296-2a01-411c-abf2-6d190cb69ef0+24:16391:x1871643350951936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784938527.063306:0:25731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938527.063323:0:25731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f24b379c800/0x7b044d4128f9ef86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f9ef7f expref: 24 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938527.063338:0:25731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938527.063387:0:25731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:73e07296-2a01-411c-abf2-6d190cb69ef0+23:16391:x1871643350951936:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (1524us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938527.063394:0:25731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000020:00000080:0.0:1784938527.066406:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f238dba6800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1784938527.066473:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f238dba1800 for lustre-MDT0000 00000100:00080000:2.0:1784938527.066744:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f238d120800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1784938527.066772:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:16388:1871643350951808:192.168.202.154@tcp:39:umount.0 00000100:00100000:1.0:1784938527.066923:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387daf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e07296-2a01-411c-abf2-6d190cb69ef0:16391:1871643350951936:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1784938527.067422:0:27954:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784938527.067427:0:27954:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1784938527.067432:0:27954:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1784938527.068838:0:27954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24b379ca00/0x7b044d4128f9eebb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9eec2 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938527.068861:0:27954:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24b379ca00/0x7b044d4128f9eebb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9eec2 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938527.069108:0:27954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24b379ca00/0x7b044d4128f9eebb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b044d4128f9eec2 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938527.069117:0:27954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff9f24b379ca00/0x7b044d4128f9eebb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b044d4128f9eec2 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938527.070135:0:27954:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938527.070234:0:27954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238db39a00/0x7b044d4128f9f288 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f28f expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938527.070245:0:27954:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238db39a00/0x7b044d4128f9f288 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9f28f expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938527.070252:0:27954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238db39a00/0x7b044d4128f9f288 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b044d4128f9f28f expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938527.070260:0:27954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff9f238db39a00/0x7b044d4128f9f288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b044d4128f9f28f expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938527.070288:0:27954:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784938527.070296:0:27954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24827c7000/0x7b044d4128f9ef71 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9ef78 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938527.070302:0:27954:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24827c7000/0x7b044d4128f9ef71 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9ef78 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938527.070312:0:27954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24827c7000/0x7b044d4128f9ef71 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b044d4128f9ef78 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938527.070318:0:27954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff9f24827c7000/0x7b044d4128f9ef71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b044d4128f9ef78 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938527.070450:0:27954:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1784938527.070459:0:27954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f2386e00600/0x7b044d4128f9eead lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9eeb4 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938527.070465:0:27954:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f2386e00600/0x7b044d4128f9eead lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9eeb4 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938527.070471:0:27954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f2386e00600/0x7b044d4128f9eead lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b044d4128f9eeb4 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938527.070478:0:27954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff9f2386e00600/0x7b044d4128f9eead lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b044d4128f9eeb4 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938527.077367:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1784938527.077384:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9f24b379ca00/0x7b044d4128f9eebb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b044d4128f9eec2 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938527.077397:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b379ca00 already unused, calling callback (ffffffffc1390c20) 10000000:00010000:1.0:1784938527.077402:0:19223:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9f24b379ca00/0x7b044d4128f9eebb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b044d4128f9eec2 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938527.077414:0:19223:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f24b379ca00/0x7b044d4128f9eebb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b044d4128f9eec2 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784938527.077422:0:19223:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f24b379ca00/0x7b044d4128f9eebb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b044d4128f9eec2 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938527.077428:0:19223:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784938527.077431:0:19223:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1784938527.077478:0:19223:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9f24b379ca00/0x7b044d4128f9eebb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f9eec2 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938527.077501:0:19223:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784938527.077544:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9f24b379ca00/0x7b044d4128f9eebb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f9eec2 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938527.077551:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f24b379ca00/0x7b044d4128f9eebb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f9eec2 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938527.077572:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784938527.077576:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9f238db39a00/0x7b044d4128f9f288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b044d4128f9f28f expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938527.077582:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238db39a00 already unused, calling callback (ffffffffc1390c20) 10000000:00010000:1.0:1784938527.077584:0:19223:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9f238db39a00/0x7b044d4128f9f288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b044d4128f9f28f expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938527.077591:0:19223:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f238db39a00/0x7b044d4128f9f288 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b044d4128f9f28f expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784938527.077596:0:19223:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f238db39a00/0x7b044d4128f9f288 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b044d4128f9f28f expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938527.077601:0:19223:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1784938527.077603:0:19223:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1784938527.077606:0:19223:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1784938527.077620:0:19223:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9f238db39a00/0x7b044d4128f9f288 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f9f28f expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938527.077626:0:19223:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784938527.077640:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9f238db39a00/0x7b044d4128f9f288 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f9f28f expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938527.077681:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f238db39a00/0x7b044d4128f9f288 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f9f28f expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938527.077690:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784938527.077694:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9f24827c7000/0x7b044d4128f9ef71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b044d4128f9ef78 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938527.077698:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24827c7000 already unused, calling callback (ffffffffc1390c20) 10000000:00010000:1.0:1784938527.077701:0:19223:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9f24827c7000/0x7b044d4128f9ef71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b044d4128f9ef78 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938527.077706:0:19223:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f24827c7000/0x7b044d4128f9ef71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b044d4128f9ef78 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784938527.077712:0:19223:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f24827c7000/0x7b044d4128f9ef71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b044d4128f9ef78 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938527.077716:0:19223:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1784938527.077719:0:19223:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1784938527.077720:0:19223:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1784938527.077737:0:19223:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9f24827c7000/0x7b044d4128f9ef71 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f9ef78 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938527.077742:0:19223:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784938527.077748:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9f24827c7000/0x7b044d4128f9ef71 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f9ef78 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938527.077753:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f24827c7000/0x7b044d4128f9ef71 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f9ef78 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938527.077766:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938527.077770:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9f2386e00600/0x7b044d4128f9eead lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b044d4128f9eeb4 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938527.077775:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00600 already unused, calling callback (ffffffffc1390c20) 10000000:00010000:1.0:1784938527.077777:0:19223:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9f2386e00600/0x7b044d4128f9eead lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b044d4128f9eeb4 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938527.077784:0:19223:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f2386e00600/0x7b044d4128f9eead lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b044d4128f9eeb4 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784938527.077790:0:19223:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f2386e00600/0x7b044d4128f9eead lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b044d4128f9eeb4 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938527.077794:0:19223:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1784938527.077797:0:19223:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:1.0:1784938527.077808:0:19223:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9f2386e00600/0x7b044d4128f9eead lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f9eeb4 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938527.077813:0:19223:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784938527.077818:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9f2386e00600/0x7b044d4128f9eead lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f9eeb4 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938527.077824:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938527.077826:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938527.077828:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938527.077854:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e07296-2a01-411c-abf2-6d190cb69ef0:16391:1871643350952448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938527.077939:0:16391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938527.078597:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784938527.078606:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e07296-2a01-411c-abf2-6d190cb69ef0:16391:1871643350952064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938527.078636:0:16391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938527.078679:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350952448 00000100:00100000:1.0:1784938527.078688:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350952448 00000100:00100000:1.0:1784938527.078740:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350952064 00000100:00100000:1.0:1784938527.078743:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350952064 00000100:00100000:1.0:1784938527.078769:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784938527.078777:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e07296-2a01-411c-abf2-6d190cb69ef0+24:16391:x1871643350952448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938527.078794:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938527.078812:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f238217d800/0x7b044d4128f9eeb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f9eead expref: 24 pid: 26600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938527.078826:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938527.078859:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e07296-2a01-411c-abf2-6d190cb69ef0+23:16391:x1871643350952448:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938527.079261:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784938527.079283:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784938527.079290:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e07296-2a01-411c-abf2-6d190cb69ef0+22:16391:x1871643350952064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938527.079299:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938527.079309:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f24827c6800/0x7b044d4128f9eec2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f9eebb expref: 22 pid: 26598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938527.079318:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938527.079341:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e07296-2a01-411c-abf2-6d190cb69ef0+21:16391:x1871643350952064:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938527.079346:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784938527.079381:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e07296-2a01-411c-abf2-6d190cb69ef0:16391:1871643350952064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938527.079389:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e07296-2a01-411c-abf2-6d190cb69ef0:16391:1871643350952448:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938527.079493:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938527.079512:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e07296-2a01-411c-abf2-6d190cb69ef0:16389:1871643350952192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938527.079544:0:16389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938527.079576:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784938527.079582:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e07296-2a01-411c-abf2-6d190cb69ef0:16389:1871643350952320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938527.079604:0:16389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938527.079631:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350952192 00000100:00100000:3.0:1784938527.079636:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350952192 00000100:00100000:3.0:1784938527.079671:0:19220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350952320 00000100:00100000:3.0:1784938527.079674:0:19220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350952320 00000100:00100000:3.0:1784938527.079687:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784938527.079692:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e07296-2a01-411c-abf2-6d190cb69ef0+22:16389:x1871643350952192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938527.079700:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938527.079709:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f238db38a00/0x7b044d4128f9f28f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f9f288 expref: 22 pid: 26598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938527.079719:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938527.079744:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e07296-2a01-411c-abf2-6d190cb69ef0+21:16389:x1871643350952192:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938527.079750:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784938527.079766:0:19220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784938527.079771:0:19220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24c5a47450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e07296-2a01-411c-abf2-6d190cb69ef0+20:16389:x1871643350952320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938527.079779:0:19220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938527.079787:0:19220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f24827c7e00/0x7b044d4128f9ef78 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f9ef71 expref: 20 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938527.079796:0:19220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938527.079816:0:19220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24c5a47450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e07296-2a01-411c-abf2-6d190cb69ef0+19:16389:x1871643350952320:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938527.079822:0:19220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784938527.079880:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e07296-2a01-411c-abf2-6d190cb69ef0:16389:1871643350952320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938527.079891:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e07296-2a01-411c-abf2-6d190cb69ef0:16389:1871643350952192:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784938527.083611:0:27954:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784938527.083628:0:27954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f2386e00600/0x7b044d4128f9eead lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b044d4128f9eeb4 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938527.083660:0:27954:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:0.0:1784938527.083670:0:27954:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1784938527.083673:0:27954:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1784938527.083721:0:27954:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1784938527.083726:0:27954:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:0.0:1784938527.083730:0:27954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1784938527.083736:0:27954:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:1.0:1784938527.085747:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938527.085840:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:0.0:1784938527.090198:0:27954:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00100000:1.0:1784938527.094011:0:26594:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8ac2e24a-3d40-4d85-8f00-33cba44b76c9 00000001:00080000:1.0:1784938527.094029:0:26594:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901894 is committed 00000020:00000080:1.0:1784938527.094037:0:26594:0:(genops.c:906:class_export_put()) final put ffff9f24b2ce1000/8ac2e24a-3d40-4d85-8f00-33cba44b76c9 00000020:00000080:2.0:1784938527.094420:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f24b2ce1000/8ac2e24a-3d40-4d85-8f00-33cba44b76c9 for lustre-MDT0000 00000020:00000080:2.0:1784938527.094490:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f24b2ce2800 for lustre-MDT0000 00000020:00000080:0.0:1784938527.094742:0:27954:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:0.0:1784938527.094761:0:27954:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9f238ce51800 lustre-MDT0000-lwp-MDT0001_UUID 192.168.202.154@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784938527.094769:0:27954:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9f238d124800 lustre-MDT0000-lwp-OST0000_UUID 192.168.202.154@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784938527.094774:0:27954:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9f238d126800 lustre-MDT0000-lwp-OST0001_UUID 192.168.202.154@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784938527.094779:0:27954:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9f238f34d000 lustre-MDT0001-mdtlov_UUID 192.168.202.154@tcp 5 (0 0 0) 0 0 0 0: 0000000000000000 12884901892 stale:0 00000020:00080000:0.0:1784938527.094786:0:27954:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9f2483220000) has exports, disconnecting them 00000020:00080000:0.0:1784938527.094791:0:27954:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.154@tcp (ffff9f238ce51800), last request at 1784938509 00000020:00000080:0.0:1784938527.094800:0:27954:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9f115 00000100:00080000:0.0:1784938527.094813:0:27954:0:(import.c:65:import_set_state_nolock()) ffff9f238ce50800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1784938527.094847:0:27954:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.154@tcp (ffff9f238ce51800): rc 0 00000020:00000080:0.0:1784938527.094849:0:27954:0:(genops.c:906:class_export_put()) final put ffff9f238ce51800/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:1.0:1784938527.094870:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1784938527.094980:0:27954:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.154@tcp (ffff9f238d124800), last request at 1784938525 00000020:00000080:0.0:1784938527.094986:0:27954:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9f02e 00000100:00080000:0.0:1784938527.094994:0:27954:0:(import.c:65:import_set_state_nolock()) ffff9f238d124000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1784938527.095015:0:27954:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.154@tcp (ffff9f238d124800): rc 0 00000020:00000080:0.0:1784938527.095018:0:27954:0:(genops.c:906:class_export_put()) final put ffff9f238d124800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:2.0:1784938527.095046:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784938527.095077:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f238ce51800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00080000:0.0:1784938527.095122:0:27954:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.154@tcp (ffff9f238d126800), last request at 1784938525 00000020:00000080:0.0:1784938527.095128:0:27954:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9f027 00000020:00000080:1.0:1784938527.095235:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f238d124800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1784938527.095257:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f238ce50800 for lustre-MDT0000 00000020:00000080:1.0:1784938527.095261:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f238d124000 for lustre-MDT0000 00000100:00080000:0.0:1784938527.095959:0:27954:0:(import.c:65:import_set_state_nolock()) ffff9f238d125000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1784938527.096022:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1784938527.096044:0:27954:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.154@tcp (ffff9f238d126800): rc 0 00000020:00000080:0.0:1784938527.096049:0:27954:0:(genops.c:906:class_export_put()) final put ffff9f238d126800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1784938527.096076:0:27954:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.154@tcp (ffff9f238f34d000), last request at 1784938491 00000020:00000080:0.0:1784938527.096081:0:27954:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9eefa 00000100:00080000:0.0:1784938527.096096:0:27954:0:(import.c:65:import_set_state_nolock()) ffff9f238ce53800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1784938527.096225:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f238d126800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1784938527.096283:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f238d125000 for lustre-MDT0000 00000020:00080000:0.0:1784938527.096722:0:27954:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.154@tcp (ffff9f238f34d000): rc 0 00000020:00000080:0.0:1784938527.096725:0:27954:0:(genops.c:906:class_export_put()) final put ffff9f238f34d000/lustre-MDT0001-mdtlov_UUID 00000004:00000080:0.0:1784938527.096736:0:27954:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbfdb49e07ae0 00000100:00080000:0.0:1784938527.096764:0:27954:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784938527.096770:0:27954:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00000080:2.0:1784938527.099007:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f238f34d000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1784938527.099106:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f238ce53800 for lustre-MDT0000 00010000:00010000:1.0:1784938527.100539:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784938527.101237:0:27954:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1784938527.101278:0:27954:0:(import.c:65:import_set_state_nolock()) ffff9f2387dd9800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1784938527.101357:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350952576:192.168.202.154@tcp:39:umount.0 00000100:00100000:0.0:1784938527.101976:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938527.102069:0:21161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350952576 00000100:00100000:1.0:1784938527.102079:0:21161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350952576 00000100:00100000:1.0:1784938527.102184:0:21161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 129 00000100:00100000:1.0:1784938527.102197:0:21161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:16388:x1871643350952576:12345-192.168.202.154@tcp:39:umount.0 00000020:00000080:1.0:1784938527.102235:0:21161:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9f29d 00000100:00080000:1.0:1784938527.102247:0:21161:0:(import.c:65:import_set_state_nolock()) ffff9f2383aea000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784938527.102281:0:21161:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901889 00000100:00100000:1.0:1784938527.102473:0:21161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:16388:x1871643350952576:12345-192.168.202.154@tcp:39:umount.0 Request processed in 278us (499us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1784938527.102482:0:21161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 129 00010000:00010000:0.0:1784938527.102566:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784938527.103099:0:27954:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784938527.103110:0:27954:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967574 gen 3 00000004:00080000:3.0:1784938527.103138:0:27954:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1784938527.103390:0:27954:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1784938527.103421:0:27954:0:(import.c:65:import_set_state_nolock()) ffff9f238f2e9800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1784938527.103444:0:27954:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784938527.103448:0:27954:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967574 gen 3 00000004:00080000:3.0:1784938527.103465:0:27954:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784938527.103570:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350952704:192.168.202.154@tcp:9:umount.0 00000100:00080000:2.0:1784938527.103673:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f2387dd9800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1784938527.103683:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350952576:192.168.202.154@tcp:39:umount.0 00000100:00100000:1.0:1784938527.103856:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938527.103910:0:25725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350952704 00000100:00100000:2.0:1784938527.103919:0:25725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350952704 00000100:00100000:2.0:1784938527.103998:0:25725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 1002 00000100:00100000:2.0:1784938527.104011:0:25725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:16388:x1871643350952704:12345-192.168.202.154@tcp:9:umount.0 00000020:00000080:2.0:1784938527.104039:0:25725:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9ef4e 00000100:00080000:2.0:1784938527.104050:0:25725:0:(import.c:65:import_set_state_nolock()) ffff9f24b14ab800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1784938527.104082:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1784938527.104107:0:25725:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967574 00000100:00080000:0.0:1784938527.104238:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938527.104995:0:25725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+2:16388:x1871643350952704:12345-192.168.202.154@tcp:9:umount.0 Request processed in 983us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938527.105007:0:25725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 1002 00000100:00080000:3.0:1784938527.105368:0:27954:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1784938527.105403:0:27954:0:(import.c:65:import_set_state_nolock()) ffff9f2388196800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1784938527.105555:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f238f2e9800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1784938527.105576:0:16388:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1784938527.105578:0:16388:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784938527.105583:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350952704:192.168.202.154@tcp:9:umount.0 00000100:00100000:2.0:1784938527.110886:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350952832:192.168.202.154@tcp:9:umount.0 00000020:00080000:3.0:1784938527.115401:0:27954:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9f2483220000) has no exports 00000100:00100000:0.0:1784938527.118524:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938527.118566:0:21629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350952832 00000100:00100000:2.0:1784938527.118581:0:21629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350952832 00000100:00100000:2.0:1784938527.118677:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 1003 00000100:00100000:2.0:1784938527.118690:0:21629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:16388:x1871643350952832:12345-192.168.202.154@tcp:9:umount.0 00000020:00000080:2.0:1784938527.118721:0:21629:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9ef5c 00000100:00080000:2.0:1784938527.118730:0:21629:0:(import.c:65:import_set_state_nolock()) ffff9f238c7d5000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784938527.118787:0:21629:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967574 00000100:00100000:2.0:1784938527.118965:0:21629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:16388:x1871643350952832:12345-192.168.202.154@tcp:9:umount.0 Request processed in 266us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938527.118973:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 1003 00000100:00080000:2.0:1784938527.119220:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f2388196800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1784938527.119234:0:16388:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1784938527.119236:0:16388:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784938527.119240:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350952832:192.168.202.154@tcp:9:umount.0 00000100:00080000:0.0:1784938527.119809:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:3.0:1784938527.119942:0:27954:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9f2483220000) has no exports 00010000:00010000:1.0:1784938527.120677:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784938527.222310:0:27954:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9ef0f 00000020:00000080:3.0:1784938527.222325:0:27954:0:(genops.c:906:class_export_put()) final put ffff9f24b407a000/lustre-QMT0000_UUID 00000020:01000000:3.0:1784938527.222348:0:27954:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1784938527.222423:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f24b407a000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1784938527.226163:0:27954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784938527.226181:0:27954:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1784938527.226187:0:27954:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9f24b87c8000) has no exports 00000020:00000080:2.0:1784938527.232524:0:27954:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9ef08 00000020:00000080:2.0:1784938527.232539:0:27954:0:(genops.c:906:class_export_put()) final put ffff9f238ef99800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784938527.232617:0:27954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938527.232629:0:27954:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1784938527.232632:0:27954:0:(genops.c:906:class_export_put()) final put ffff9f23839f1800/lustre-QMT0000_UUID 00000020:00000080:2.0:1784938527.232636:0:27954:0:(genops.c:865:class_export_destroy()) destroying export ffff9f23839f1800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1784938527.232658:0:27954:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1784938527.232901:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f238ef99800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1784938527.232968:0:27954:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9f2389d31240 - data ffff9f248a3105e8/ffff9f24b6e10c00 00000020:01000000:2.0:1784938527.233101:0:27954:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9f24b89110c0 - data ffff9f24846cd288/ffff9f238ed5c400 00000100:00080000:0.0:1784938527.299612:0:27954:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784938527.299622:0:27954:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1784938527.299652:0:27954:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9f2387fd0000 x1871643350952576/t12884901890(12884901890) o39->lustre-MDT0001-osp-MDT0000@192.168.202.154@tcp:24/4 lens 224/224 e 0 to 0 dl 1784938537 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938527.299677:0:27954:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1784938527.301486:0:27954:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784938527.301493:0:27954:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967574 gen 4 00000004:00080000:0.0:1784938527.301506:0:27954:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784938527.301509:0:27954:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1784938527.301869:0:26629:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1784938527.301875:0:26629:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:2.0:1784938527.301885:0:26629:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 3 count 2 00000100:00080000:0.0:1784938527.302747:0:27954:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784938527.302751:0:27954:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967574 gen 4 00000004:00080000:0.0:1784938527.302797:0:27954:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784938527.302801:0:27954:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1784938527.303036:0:26631:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1784938527.303039:0:26631:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:3.0:1784938527.303048:0:26631:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 3 count 2 00000020:00000080:0.0:1784938527.303973:0:27954:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9eed0 00000020:00000080:0.0:1784938527.303982:0:27954:0:(genops.c:906:class_export_put()) final put ffff9f238c7d5800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784938527.304787:0:27954:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9eee5 00000020:00000080:0.0:1784938527.304794:0:27954:0:(genops.c:906:class_export_put()) final put ffff9f24b4159800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784938527.304839:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f238c7d5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1784938527.304907:0:27954:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1784938527.304914:0:27954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784938527.304925:0:27954:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784938527.304930:0:27954:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9f24832219c0) has no exports 00000004:01000000:0.0:1784938527.305200:0:27954:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1784938527.305214:0:27954:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9ef55 00000020:00000080:0.0:1784938527.305219:0:27954:0:(genops.c:906:class_export_put()) final put ffff9f2388190800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784938527.305286:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f24b4159800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1784938527.305348:0:27954:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1784938527.305353:0:27954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784938527.305359:0:27954:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784938527.305362:0:27954:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9f24b2cc8000) has no exports 00000020:00000080:0.0:1784938527.305367:0:27954:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9ef47 00000020:00000080:0.0:1784938527.305372:0:27954:0:(genops.c:906:class_export_put()) final put ffff9f2388191000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784938527.305394:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f2388190800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:0.0:1784938527.305836:0:27954:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1784938527.305841:0:27954:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784938527.305846:0:27954:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967574 gen 5 00000004:00080000:0.0:1784938527.305851:0:27954:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784938527.305853:0:27954:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784938527.305885:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f2388191000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784938527.305972:0:27954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784938527.305980:0:27954:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784938527.305987:0:27954:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9ef39 00000020:00000080:0.0:1784938527.305992:0:27954:0:(genops.c:906:class_export_put()) final put ffff9f2388193000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784938527.306015:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f2388196800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1784938527.306020:0:36:0:(genops.c:906:class_export_put()) final put ffff9f2388190000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784938527.306022:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f2388190000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1784938527.306027:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1784938527.306253:0:27954:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1784938527.306258:0:27954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784938527.306262:0:27954:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784938527.306265:0:27954:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9f24b87ccd40) has no exports 00000020:00000080:0.0:1784938527.306269:0:27954:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9ef32 00000020:00000080:0.0:1784938527.306274:0:27954:0:(genops.c:906:class_export_put()) final put ffff9f238ef98800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784938527.306296:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f2388193000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:0.0:1784938527.306887:0:27954:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1784938527.306891:0:27954:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784938527.306893:0:27954:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967574 gen 5 00000004:00080000:0.0:1784938527.306897:0:27954:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784938527.306899:0:27954:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784938527.306927:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f238ef98800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784938527.307012:0:27954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784938527.307018:0:27954:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1784938527.307032:0:27954:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1784938527.307038:0:27954:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9ef24 00000020:00000080:0.0:1784938527.307045:0:27954:0:(genops.c:906:class_export_put()) final put ffff9f238ef9c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784938527.307070:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f238f2e9800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1784938527.307077:0:36:0:(genops.c:906:class_export_put()) final put ffff9f238ef9f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784938527.307079:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f238ef9f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1784938527.307085:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1784938527.307269:0:27954:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1784938527.307274:0:27954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784938527.307279:0:27954:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784938527.307282:0:27954:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff9f24b2e30000) has no exports 00000020:00000080:0.0:1784938527.307287:0:27954:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9ef1d 00000020:00000080:0.0:1784938527.307291:0:27954:0:(genops.c:906:class_export_put()) final put ffff9f238f2ec000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784938527.307318:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f238ef9c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1784938527.308270:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f238f2ec000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1784938527.310213:0:27954:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1784938527.310221:0:27954:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784938527.310230:0:27954:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784938527.310237:0:27954:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784938527.310317:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f2387dd9800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1784938527.310354:0:27954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938527.310365:0:27954:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784938527.310370:0:27954:0:(genops.c:906:class_export_put()) final put ffff9f238f2eb800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784938527.310374:0:27954:0:(genops.c:865:class_export_destroy()) destroying export ffff9f238f2eb800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1784938527.310380:0:27954:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784938527.310491:0:27954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938527.310496:0:27954:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784938527.310499:0:27954:0:(genops.c:906:class_export_put()) final put ffff9f24b43d6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784938527.310502:0:27954:0:(genops.c:865:class_export_destroy()) destroying export ffff9f24b43d6000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1784938527.310506:0:27954:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784938527.310567:0:27954:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9eeec 00000020:00000080:2.0:1784938527.310574:0:27954:0:(genops.c:906:class_export_put()) final put ffff9f24b4158800/lustre-MDD0000_UUID 00000020:01000000:2.0:1784938527.310592:0:27954:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1784938527.310596:0:27954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784938527.310601:0:27954:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784938527.310604:0:27954:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9f24b176cd40) has no exports 00000020:00000080:2.0:1784938527.310623:0:27954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938527.310667:0:27954:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1784938527.310673:0:27954:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9eef3 00000020:00000080:2.0:1784938527.310677:0:27954:0:(genops.c:906:class_export_put()) final put ffff9f24b415d000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1784938527.310684:0:27954:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f238e2b0800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1784938527.310688:0:27954:0:(obd_mount.c:706:lustre_put_lsi()) put ffff9f238e2b0800 3 00000020:01000004:2.0:1784938527.310691:0:27954:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f238e2b0800 from lustre-MDT0000 00000020:00000080:2.0:1784938527.310706:0:27954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938527.310711:0:27954:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1784938527.310713:0:27954:0:(genops.c:906:class_export_put()) final put ffff9f238c7d3800/lustre-MDT0000_UUID 00000020:00000080:2.0:1784938527.310715:0:27954:0:(genops.c:865:class_export_destroy()) destroying export ffff9f238c7d3800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1784938527.310747:0:27954:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:3.0:1784938527.310763:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f24b4158800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1784938527.310768:0:36:0:(genops.c:906:class_export_put()) final put ffff9f24b43d3000/lustre-MDD0000_UUID 00000020:00000080:3.0:1784938527.310770:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f24b43d3000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1784938527.310774:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1784938527.310865:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f24b415d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:2.0:1784938527.310890:0:27954:0:(obd_mount.c:574:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1784938527.310895:0:27954:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1784938527.310898:0:27954:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1784938527.310902:0:27954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784938527.310905:0:27954:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784938527.310911:0:27954:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9f2489214000 73e07296-2a01-411c-abf2-6d190cb69ef0 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784938527.310916:0:27954:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9f24b87c99c0) has exports, disconnecting them 00000020:00080000:2.0:1784938527.310925:0:27954:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9f2489214000), last request at 1784938491 00000020:00000080:2.0:1784938527.310939:0:27954:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9ee91 00000020:00010000:2.0:1784938527.310943:0:27954:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9f2489214000: total 0 00000100:00080000:2.0:1784938527.310947:0:27954:0:(import.c:65:import_set_state_nolock()) ffff9f2489211000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784938527.310965:0:27954:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f2489214000): rc 0 00000020:00080000:2.0:1784938527.310969:0:27954:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9f24b87c99c0) has no exports 00000100:00100000:2.0:1784938527.311045:0:26601:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9f238f260c00:26601] 2 exiting: rc = 0 00000020:00010000:3.0:1784938527.311180:0:19222:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9f2489214000: total 0 00010000:00010000:3.0:1784938527.311205:0:19222:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9f2489214000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1784938527.311235:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f24827c7600/0x7b044d4128f9efe1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f9efda expref: 14 pid: 26598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938527.311250:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2386e01000/0x7b044d4128f9efef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f9efe8 expref: 13 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938527.311261:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f24b379d000/0x7b044d4128f9f100 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f9f0f9 expref: 12 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938527.311272:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f24827c7a00/0x7b044d4128f9effd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f9eff6 expref: 11 pid: 26598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938527.311281:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f24b379da00/0x7b044d4128f9f00b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f9f004 expref: 10 pid: 26598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938527.311296:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f238217d400/0x7b044d4128f9f04a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f9f043 expref: 9 pid: 26600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938527.311312:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f24b379c200/0x7b044d4128f9efb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f9efb0 expref: 8 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938527.311322:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2386e01800/0x7b044d4128f9f019 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f9f012 expref: 7 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938527.311331:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f238217c600/0x7b044d4128f9f058 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f9f051 expref: 6 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938527.311341:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f238d17a000/0x7b044d4128f9f281 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f9f27a expref: 5 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938527.311354:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f238217c000/0x7b044d4128f9f0f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f9f0eb expref: 4 pid: 26601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938527.311363:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2386e00a00/0x7b044d4128f9efc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f9efbe expref: 3 pid: 26598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938527.311373:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2386e00400/0x7b044d4128f9efd3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b044d4128f9efcc expref: 2 pid: 26600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938527.311383:0:19222:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9f2489214000, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1784938527.311395:0:19222:0:(genops.c:906:class_export_put()) final put ffff9f2489214000/73e07296-2a01-411c-abf2-6d190cb69ef0 00010000:00010000:3.0:1784938527.311410:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938527.311411:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938527.311413:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784938527.311457:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f2489214000/73e07296-2a01-411c-abf2-6d190cb69ef0 for MGS 00000020:00000080:2.0:1784938527.311488:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f2489211000 for MGS 00000100:00100000:1.0:1784938527.311697:0:26600:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9f24985b8800:26600] 1 exiting: rc = 0 00000100:00100000:0.0:1784938527.314770:0:26598:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9f238d3d5800:26598] 0 exiting: rc = 1 00000100:00100000:2.0:1784938527.314973:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.314985:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.314994:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315002:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315013:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315024:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315035:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315041:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315046:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315057:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315126:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315135:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315239:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315254:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315261:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315269:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315275:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315282:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315289:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315296:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315307:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315319:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315331:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315336:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315341:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315354:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315361:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315413:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315424:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315431:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315439:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315448:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315456:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315465:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315473:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315482:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315490:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315499:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315507:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315514:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315522:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315530:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315538:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315547:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315556:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315565:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315571:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315583:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315595:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315603:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315609:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315623:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315629:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.315635:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.319323:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.319349:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.319358:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.319367:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.319376:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.319384:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.319391:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.319399:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.319407:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938527.319415:0:27954:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1784938527.321091:0:27954:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9f238114bc00 - data ffff9f248a184ca8/ffff9f238f267c00 00000020:01000000:2.0:1784938527.321384:0:27954:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9f238e692540 - data ffff9f238655fa20/ffff9f248ffca000 00000020:00000080:2.0:1784938527.321918:0:27954:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9ee8a 00000020:00000080:2.0:1784938527.321929:0:27954:0:(genops.c:906:class_export_put()) final put ffff9f238f8b8000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1784938527.322064:0:27954:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f238e2b0800 from MGS, refs=2 00000020:01000004:2.0:1784938527.322069:0:27954:0:(obd_mount.c:706:lustre_put_lsi()) put ffff9f238e2b0800 2 00000020:01000004:2.0:1784938527.322073:0:27954:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f238e2b0800 from MGS 00000020:00000080:2.0:1784938527.322096:0:27954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938527.322103:0:27954:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1784938527.322106:0:27954:0:(genops.c:906:class_export_put()) final put ffff9f238f8bb800/MGS 00000020:00000080:2.0:1784938527.322109:0:27954:0:(genops.c:865:class_export_destroy()) destroying export ffff9f238f8bb800/MGS for MGS 00000020:01000000:2.0:1784938527.322116:0:27954:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1784938527.322233:0:27954:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1784938527.322239:0:27954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784938527.322245:0:27954:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784938527.322254:0:27954:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9f238d127000 lustre-MDT0000-lwp-MDT0000 192.168.202.154@tcp 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784938527.322261:0:27954:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff9f238c834d40) has exports, disconnecting them 00000020:00080000:2.0:1784938527.322266:0:27954:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 192.168.202.154@tcp (ffff9f238d127000), last request at 1784938492 00000020:00000080:2.0:1784938527.322270:0:27954:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9ef94 00000020:00080000:2.0:1784938527.322279:0:27954:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.154@tcp (ffff9f238d127000): rc 0 00000020:00000080:2.0:1784938527.322284:0:27954:0:(genops.c:906:class_export_put()) final put ffff9f238d127000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1784938527.322419:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f238f8b8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784938527.323605:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f238d127000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1784938527.324289:0:27954:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1784938527.324295:0:27954:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784938527.324299:0:27954:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1784938527.324306:0:27954:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784938527.324581:0:27954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784938527.324591:0:27954:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1784938527.324597:0:27954:0:(obd_mount.c:706:lustre_put_lsi()) put ffff9f238e2b0800 1 00000020:00000080:3.0:1784938527.324603:0:27954:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7b044d4128f9ee7c 00000020:00000080:3.0:1784938527.324610:0:27954:0:(genops.c:906:class_export_put()) final put ffff9f238f8bd800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784938527.324634:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f238d120800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1784938527.324650:0:38:0:(genops.c:906:class_export_put()) final put ffff9f238ef9a800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1784938527.324653:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f238ef9a800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1784938527.324664:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:3.0:1784938527.324940:0:27954:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1784938527.324945:0:27954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784938527.324950:0:27954:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784938527.324954:0:27954:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9f2483224d40) has no exports 00000020:00000080:0.0:1784938527.329712:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f238f8bd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784938527.402403:0:27954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784938527.402416:0:27954:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1784938527.402421:0:27954:0:(genops.c:906:class_export_put()) final put ffff9f238e2b4800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784938527.402426:0:27954:0:(genops.c:865:class_export_destroy()) destroying export ffff9f238e2b4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1784938527.402438:0:27954:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1784938527.402549:0:27954:0:(obd_mount.c:664:lustre_free_lsi()) Freeing lsi ffff9f238e2b7000 00000020:02000400:3.0:1784938527.402603:0:27954:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1784938527.679711:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938528.681706:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938529.704657:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938530.475246:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350952960:192.168.202.154@tcp:41:osp-pre-0-1.0 00000100:00100000:1.0:1784938530.475513:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938530.475540:0:21160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350952960 00000100:00100000:1.0:1784938530.475547:0:21160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350952960 00000100:00100000:1.0:1784938530.475582:0:21160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 130 00000100:00100000:1.0:1784938530.475588:0:21160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:16392:x1871643350952960:12345-192.168.202.154@tcp:41:osp-pre-0-1.0 00000020:00080000:1.0:1784938530.475596:0:21160:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-192.168.202.154@tcp 00000100:00100000:1.0:1784938530.475644:0:21160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:16392:x1871643350952960:12345-192.168.202.154@tcp:41:osp-pre-0-1.0 Request processed in 55us (132us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784938530.475652:0:21160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 130 00000100:00100000:3.0:1784938530.475906:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350953088:192.168.202.154@tcp:13:osp-pre-1-1.0 00000100:00100000:3.0:1784938530.476070:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938530.476090:0:21154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350953088 00000100:00100000:3.0:1784938530.476094:0:21154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350953088 00000100:00100000:3.0:1784938530.476168:0:21154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 104 00000100:00100000:3.0:1784938530.476176:0:21154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16389:x1871643350953088:12345-192.168.202.154@tcp:13:osp-pre-1-1.0 00002000:00000024:3.0:1784938530.476204:0:21154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 271040 pending 0 free 313057280 avail 285245440 00000100:00100000:3.0:1784938530.476238:0:21154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16389:x1871643350953088:12345-192.168.202.154@tcp:13:osp-pre-1-1.0 Request processed in 63us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938530.476244:0:21154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 104 00000100:02020000:1.0:1784938530.476459:0:16392:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 192.168.202.154@tcp failed: rc = -107 00000100:00080000:0.0:1784938530.480664:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938530.480788:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350953088:192.168.202.154@tcp:13:osp-pre-1-1.0 00000100:00100000:3.0:1784938530.480926:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784938530.480940:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350953216:192.168.202.154@tcp:13:osp-pre-0-1.0 00000100:00100000:3.0:1784938530.481084:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:16389:1871643350953600:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938530.481112:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:16389:1871643350954112:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938530.481179:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784938530.481185:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:16389:1871643350953728:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938530.481629:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938530.481661:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938530.481681:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938530.481698:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938530.481720:0:26607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350953600 00000100:00100000:0.0:1784938530.481726:0:26607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350953600 00000100:00100000:0.0:1784938530.481774:0:26607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350954112 00000100:00100000:0.0:1784938530.481778:0:26607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350954112 00000100:00100000:0.0:1784938530.481787:0:26607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350953728 00000100:00100000:0.0:1784938530.481789:0:26607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350953728 00000100:00100000:0.0:1784938530.481801:0:26607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 27 00000100:00100000:0.0:1784938530.481809:0:26607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:16389:x1871643350953600:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938530.481859:0:26607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:16389:x1871643350953600:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 50us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938530.481867:0:26607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 27 00000100:00100000:0.0:1784938530.481885:0:26607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 33 00000100:00100000:0.0:1784938530.481889:0:26607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16389:x1871643350954112:12345-192.168.202.154@tcp:400:kworker.0 00000020:00080000:0.0:1784938530.481895:0:26607:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.154@tcp 00000100:00100000:0.0:1784938530.481918:0:26607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16389:x1871643350954112:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 27us (236us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784938530.481924:0:26607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 33 00000100:00100000:0.0:1784938530.481938:0:26607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 34 00000100:00100000:0.0:1784938530.481942:0:26607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16389:x1871643350953728:12345-192.168.202.154@tcp:400:kworker.0 00000020:00080000:0.0:1784938530.481947:0:26607:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.154@tcp 00000100:00100000:0.0:1784938530.481965:0:26607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16389:x1871643350953728:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 22us (266us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784938530.481971:0:26607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 34 00000100:00080000:0.0:1784938530.481990:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784938530.482097:0:21154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350953216 00000100:00100000:0.0:1784938530.482102:0:21154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350953216 00000100:00100000:0.0:1784938530.482169:0:21154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 105 00000100:00100000:0.0:1784938530.482177:0:21154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16389:x1871643350953216:12345-192.168.202.154@tcp:13:osp-pre-0-1.0 00002000:00000024:0.0:1784938530.482199:0:21154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 271040 pending 0 free 313057280 avail 285245440 00000100:00100000:0.0:1784938530.482229:0:21154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16389:x1871643350953216:12345-192.168.202.154@tcp:13:osp-pre-0-1.0 Request processed in 54us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938530.482235:0:21154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 105 00000100:00080000:0.0:1784938530.482249:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938530.482331:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e07296-2a01-411c-abf2-6d190cb69ef0:16391:1871643350953344:0@lo:400:kworker.0 00000400:00000100:0.0:1784938530.482356:0:16391:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871643350953344 offset 0 length 224: 4 00000100:00100000:0.0:1784938530.482381:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:16391:1871643350953856:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938530.482415:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784938530.482421:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:16391:1871643350953472:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938530.482443:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350953984:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938530.482526:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938530.482547:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938530.482570:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938530.482586:0:26607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350953856 00000100:00100000:0.0:1784938530.482590:0:26607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350953856 00000100:00100000:0.0:1784938530.482625:0:26607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350953472 00000100:00100000:0.0:1784938530.482629:0:26607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350953472 00000100:00100000:0.0:1784938530.482645:0:26607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 28 00000100:00100000:0.0:1784938530.482651:0:26607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238d4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:16391:x1871643350953856:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938530.482681:0:26607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238d4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:16391:x1871643350953856:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 30us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938530.482688:0:26607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 28 00000100:00100000:0.0:1784938530.482701:0:26607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 35 00000100:00100000:0.0:1784938530.482705:0:26607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b3f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16391:x1871643350953472:12345-192.168.202.154@tcp:400:kworker.0 00000020:00080000:0.0:1784938530.482709:0:26607:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.154@tcp 00000100:00100000:0.0:1784938530.482726:0:26607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b3f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16391:x1871643350953472:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 20us (179us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784938530.482732:0:26607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 35 00000100:00100000:0.0:1784938530.482749:0:25719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350953984 00000100:00100000:0.0:1784938530.482751:0:25719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350953984 00000100:00100000:0.0:1784938530.482776:0:25719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 116 00000100:00100000:0.0:1784938530.482781:0:25719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f22a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:16391:x1871643350953984:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938530.482806:0:25719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f22a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:16391:x1871643350953984:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 24us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938530.482812:0:25719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 116 00000100:00080000:0.0:1784938530.482825:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784938530.482936:0:16391:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@192.168.202.154@tcp abruptly disconnected: reconnecting 00000100:00080000:0.0:1784938530.482942:0:16391:0:(import.c:65:import_set_state_nolock()) ffff9f24b4116800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784938530.482946:0:16391:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 192.168.202.154@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1784938530.483035:0:16389:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@192.168.202.154@tcp abruptly disconnected: reconnecting 00000100:00080000:3.0:1784938530.483039:0:16389:0:(import.c:65:import_set_state_nolock()) ffff9f2383aea800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1784938530.483043:0:16389:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 192.168.202.154@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1784938530.483047:0:16389:0:(import.c:65:import_set_state_nolock()) ffff9f2383aea800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938530.483052:0:16389:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 192.168.202.154@tcp last attempt 769 00000100:00080000:3.0:1784938530.483059:0:16389:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f2383aea800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:3.0:1784938530.483087:0:16389:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b68a8000 x1871643350954240/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784938530.483109:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:16389:1871643350953728:192.168.202.154@tcp:400:kworker.0 00010000:00080000:3.0:1784938530.483124:0:16389:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9f2387fd1500 x1871643350953600/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938530.483135:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:16389:1871643350953600:192.168.202.154@tcp:400:kworker.0 00000100:00080000:3.0:1784938530.483167:0:16389:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@192.168.202.154@tcp abruptly disconnected: reconnecting 00000100:00080000:3.0:1784938530.483170:0:16389:0:(import.c:65:import_set_state_nolock()) ffff9f24b36a7000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1784938530.483173:0:16389:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 192.168.202.154@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1784938530.483177:0:16389:0:(import.c:65:import_set_state_nolock()) ffff9f24b36a7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938530.483180:0:16389:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 192.168.202.154@tcp last attempt 776 00000100:00080000:3.0:1784938530.483185:0:16389:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9f24b36a7000 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:3.0:1784938530.483198:0:16389:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b68aa680 x1871643350954368/t0(0) o38->lustre-MDT0000-lwp-MDT0001@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784938530.483208:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:16389:1871643350954112:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938530.483229:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350953216:192.168.202.154@tcp:13:osp-pre-0-1.0 00000100:00100000:3.0:1784938530.483256:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:16388:1871643350954240:192.168.202.154@tcp:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1784938530.483289:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:16388:1871643350954368:192.168.202.154@tcp:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1784938530.493249:0:16392:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@192.168.202.154@tcp abruptly disconnected: reconnecting 00000100:00080000:1.0:1784938530.493257:0:16392:0:(import.c:65:import_set_state_nolock()) ffff9f24b4113800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784938530.493263:0:16392:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 192.168.202.154@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1784938530.493269:0:16392:0:(import.c:65:import_set_state_nolock()) ffff9f24b4113800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784938530.493273:0:16392:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 192.168.202.154@tcp last attempt 776 00000100:00080000:1.0:1784938530.493287:0:16392:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9f24b4113800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:1.0:1784938530.493325:0:16392:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b68c1500 x1871643350954496/t0(0) o38->lustre-MDT0000-osp-MDT0001@192.168.202.154@tcp:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784938530.493398:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:16388:1871643350954496:192.168.202.154@tcp:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1784938530.496482:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938530.496509:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938530.496528:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938530.496552:0:26607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350954240 00000100:00100000:1.0:1784938530.496561:0:26607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350954240 00000100:00100000:1.0:1784938530.496594:0:26607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350954368 00000100:00100000:1.0:1784938530.496597:0:26607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350954368 00000100:00100000:1.0:1784938530.496612:0:26607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 36 00000100:00100000:1.0:1784938530.496636:0:26607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16388:x1871643350954240:12345-192.168.202.154@tcp:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1784938530.496662:0:26607:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.154@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784938530.496712:0:26607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16388:x1871643350954240:12345-192.168.202.154@tcp:38:ptlrpcd_00_00.0 Request processed in 76us (241us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784938530.496719:0:26607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 36 00000100:00100000:1.0:1784938530.496736:0:26607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 37 00000100:00100000:1.0:1784938530.496740:0:26607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16388:x1871643350954368:12345-192.168.202.154@tcp:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1784938530.496748:0:26607:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.154@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784938530.496765:0:26607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16388:x1871643350954368:12345-192.168.202.154@tcp:38:ptlrpcd_00_00.0 Request processed in 24us (256us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784938530.496771:0:26607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 37 00000100:00100000:1.0:1784938530.496790:0:21161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350954496 00000100:00100000:1.0:1784938530.496792:0:21161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350954496 00000100:00100000:1.0:1784938530.496811:0:21161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 131 00000100:00100000:1.0:1784938530.496815:0:21161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:16388:x1871643350954496:12345-192.168.202.154@tcp:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1784938530.496823:0:21161:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.154@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784938530.496840:0:21161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:16388:x1871643350954496:12345-192.168.202.154@tcp:38:ptlrpcd_00_03.0 Request processed in 24us (311us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784938530.496845:0:21161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 131 00000100:00080000:2.0:1784938530.500578:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f2383aea800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784938530.500593:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.154@tcp failed (-19) 00000100:00100000:2.0:1784938530.500598:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:16388:1871643350954240:192.168.202.154@tcp:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1784938530.500613:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b36a7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784938530.500630:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.154@tcp failed (-19) 00000100:00100000:2.0:1784938530.500634:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:16388:1871643350954368:192.168.202.154@tcp:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1784938530.500666:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b4113800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784938530.500671:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.154@tcp failed (-19) 00000100:00100000:2.0:1784938530.500674:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:16388:1871643350954496:192.168.202.154@tcp:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1784938530.506691:0:16391:0:(import.c:65:import_set_state_nolock()) ffff9f24b4116800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784938530.506706:0:16391:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 192.168.202.154@tcp last attempt 769 00000100:00080000:0.0:1784938530.506724:0:16391:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f24b4116800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:0.0:1784938530.506802:0:16391:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b6b8fb80 x1871643350954624/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784938530.506835:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:16391:1871643350953472:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938530.506880:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350953984:192.168.202.154@tcp:400:kworker.0 00010000:00080000:0.0:1784938530.506895:0:16391:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9f2387fd3480 x1871643350953856/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938530.506904:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:16391:1871643350953856:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938530.506951:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b6b8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:16388:1871643350954624:192.168.202.154@tcp:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1784938530.507509:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938530.507538:0:26607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350954624 00000100:00100000:0.0:1784938530.507545:0:26607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350954624 00000100:00100000:0.0:1784938530.507584:0:26607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 38 00000100:00100000:0.0:1784938530.507591:0:26607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16388:x1871643350954624:12345-192.168.202.154@tcp:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1784938530.507627:0:26607:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.154@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784938530.507678:0:26607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16388:x1871643350954624:12345-192.168.202.154@tcp:38:ptlrpcd_00_02.0 Request processed in 84us (169us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784938530.507688:0:26607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 38 00000100:00080000:1.0:1784938530.507814:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b4116800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784938530.507823:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.154@tcp failed (-19) 00000100:00100000:1.0:1784938530.507827:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b6b8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:16388:1871643350954624:192.168.202.154@tcp:38:ptlrpcd_00_02.0 00010000:00010000:3.0:1784938530.729917:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784938530.990131:0:21144:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784938530.990140:0:21144:0:(genops.c:906:class_export_put()) final put ffff9f238f8bf000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1784938530.990200:0:21144:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8ac2e24a-3d40-4d85-8f00-33cba44b76c9 00000020:00000080:3.0:1784938530.990203:0:21144:0:(genops.c:906:class_export_put()) final put ffff9f24b2d32000/8ac2e24a-3d40-4d85-8f00-33cba44b76c9 00000020:00000080:0.0:1784938530.990451:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f238f8bf000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1784938530.990507:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f24b2d32000/8ac2e24a-3d40-4d85-8f00-33cba44b76c9 for lustre-OST0000 00000020:00000080:0.0:1784938530.990525:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f24b14ab800 for lustre-OST0000 00000020:00000080:0.0:1784938530.990530:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f24b2d34800 for lustre-OST0000 00000001:00100000:0.0:1784938530.990861:0:22178:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784938530.990866:0:22178:0:(genops.c:906:class_export_put()) final put ffff9f24b415a800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1784938530.990882:0:22178:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8ac2e24a-3d40-4d85-8f00-33cba44b76c9 00000020:00000080:0.0:1784938530.990884:0:22178:0:(genops.c:906:class_export_put()) final put ffff9f24b2d33000/8ac2e24a-3d40-4d85-8f00-33cba44b76c9 00000020:00000080:3.0:1784938530.990997:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f24b415a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1784938530.991034:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f24b2d33000/8ac2e24a-3d40-4d85-8f00-33cba44b76c9 for lustre-OST0001 00000020:00000080:3.0:1784938530.991050:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f238c7d5000 for lustre-OST0001 00000020:00000080:3.0:1784938530.991054:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f24b2d35800 for lustre-OST0001 00000001:00100000:2.0:1784938530.991433:0:27341:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1784938530.991445:0:27341:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 12884901890 is committed 00000020:00000080:2.0:1784938530.991448:0:27341:0:(genops.c:906:class_export_put()) final put ffff9f2490617000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1784938530.991467:0:27341:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8ac2e24a-3d40-4d85-8f00-33cba44b76c9 00000001:00080000:2.0:1784938530.991472:0:27341:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 12884901889 is committed 00000020:00000080:2.0:1784938530.991474:0:27341:0:(genops.c:906:class_export_put()) final put ffff9f24b2ce1800/8ac2e24a-3d40-4d85-8f00-33cba44b76c9 00000020:00000080:3.0:1784938530.991561:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f2490617000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1784938530.991635:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f24b2ce1800/8ac2e24a-3d40-4d85-8f00-33cba44b76c9 for lustre-MDT0001 00000020:00000080:3.0:1784938530.991680:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f2383aea000 for lustre-MDT0001 00000020:00000080:3.0:1784938530.991685:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f24b2ce7000 for lustre-MDT0001 00010000:00010000:3.0:1784938531.754827:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938532.777538:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938533.800442:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938534.824431:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784938535.598733:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784938535.598740:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784938535.598743:0:38:0:(import.c:65:import_set_state_nolock()) ffff9f24b4116800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938535.598754:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 192.168.202.154@tcp last attempt 796 00000100:00080000:3.0:1784938535.598765:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784938535.598772:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f24b4116800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:3.0:1784938535.598797:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b68abb80 x1871643350955136/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784938535.598833:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784938535.598836:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784938535.598838:0:38:0:(import.c:65:import_set_state_nolock()) ffff9f2383aea800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938535.598842:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 192.168.202.154@tcp last attempt 796 00000100:00080000:3.0:1784938535.598846:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784938535.598850:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f2383aea800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:3.0:1784938535.598861:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b68a8a80 x1871643350955392/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784938535.598878:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784938535.598881:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784938535.598882:0:38:0:(import.c:65:import_set_state_nolock()) ffff9f24b4113800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938535.598886:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 192.168.202.154@tcp last attempt 796 00000100:00080000:3.0:1784938535.598888:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784938535.598892:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9f24b4113800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:3.0:1784938535.598904:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b68ab800 x1871643350955648/t0(0) o38->lustre-MDT0000-osp-MDT0001@192.168.202.154@tcp:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784938535.598927:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784938535.598930:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784938535.598932:0:38:0:(import.c:65:import_set_state_nolock()) ffff9f24b36a7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938535.598936:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 192.168.202.154@tcp last attempt 796 00000100:00080000:3.0:1784938535.598939:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784938535.598942:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9f24b36a7000 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:3.0:1784938535.598954:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f2387fd3480 x1871643350956032/t0(0) o38->lustre-MDT0000-lwp-MDT0001@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784938535.598997:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e07296-2a01-411c-abf2-6d190cb69ef0:16392:1871643350955008:0@lo:400:kworker.0 00000400:00000100:3.0:1784938535.599051:0:16392:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871643350955008 offset 0 length 224: 4 00000100:00100000:3.0:1784938535.599099:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350955904:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938535.599588:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:16388:1871643350955136:192.168.202.154@tcp:38:kworker.0 00000100:00100000:1.0:1784938535.599655:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:16388:1871643350955392:192.168.202.154@tcp:38:kworker.0 00000100:00100000:1.0:1784938535.599690:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:16388:1871643350955648:192.168.202.154@tcp:38:kworker.0 00000100:00100000:1.0:1784938535.599715:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:16388:1871643350956032:192.168.202.154@tcp:38:kworker.0 00000100:00100000:2.0:1784938535.600839:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938535.600899:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938535.600942:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938535.600964:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938535.600996:0:26608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350955136 00000100:00100000:2.0:1784938535.601005:0:26608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350955136 00000100:00100000:2.0:1784938535.601041:0:26608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350955392 00000100:00100000:2.0:1784938535.601044:0:26608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350955392 00000100:00100000:2.0:1784938535.601053:0:26608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350956032 00000100:00100000:2.0:1784938535.601055:0:26608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350956032 00000100:00100000:2.0:1784938535.601069:0:26608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 39 00000100:00100000:2.0:1784938535.601079:0:26608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387daf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:16388:x1871643350955136:12345-192.168.202.154@tcp:38:kworker.0 00010000:00020000:2.0:1784938535.601114:0:26608:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.154@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784938535.601673:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1784938535.601689:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350954880:192.168.202.154@tcp:13:osp-pre-0-1.0 00000100:00100000:3.0:1784938535.601734:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350955776:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938535.601772:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:16389:1871643350955264:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938535.601801:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784938535.601808:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350954752:192.168.202.154@tcp:13:osp-pre-1-1.0 00000100:00100000:3.0:1784938535.601832:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:16389:1871643350955520:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938535.602408:0:26608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387daf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:16388:x1871643350955136:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 1326us (1572us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784938535.602419:0:26608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 39 00000100:00100000:2.0:1784938535.602447:0:26608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 40 00000100:00100000:2.0:1784938535.602453:0:26608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:16388:x1871643350955392:12345-192.168.202.154@tcp:38:kworker.0 00010000:00020000:2.0:1784938535.602471:0:26608:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.154@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784938535.603391:0:26608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:16388:x1871643350955392:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 932us (2487us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784938535.603401:0:26608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 40 00000100:00100000:2.0:1784938535.603425:0:26608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 41 00000100:00100000:2.0:1784938535.603432:0:26608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:16388:x1871643350956032:12345-192.168.202.154@tcp:38:kworker.0 00010000:00020000:2.0:1784938535.603449:0:26608:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.154@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784938535.603474:0:26608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:16388:x1871643350956032:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 41us (2509us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784938535.603481:0:26608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 41 00000100:00100000:2.0:1784938535.603632:0:25714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350955648 00000100:00100000:2.0:1784938535.603641:0:25714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350955648 00000100:00100000:2.0:1784938535.603684:0:25714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 132 00000100:00100000:2.0:1784938535.603690:0:25714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:16388:x1871643350955648:12345-192.168.202.154@tcp:38:kworker.0 00010000:00020000:2.0:1784938535.603702:0:25714:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.154@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784938535.603722:0:25714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:16388:x1871643350955648:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 31us (2779us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784938535.603728:0:25714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 132 00000100:00100000:2.0:1784938535.604012:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938535.604077:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938535.604107:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938535.604127:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938535.604174:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938535.604213:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938535.607089:0:26607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350955264 00000100:00100000:0.0:1784938535.607110:0:26607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350955264 00000100:00100000:2.0:1784938535.607199:0:25730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350955904 00000100:00100000:2.0:1784938535.607205:0:25730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350955904 00000100:00100000:0.0:1784938535.609322:0:26607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350955520 00000100:00100000:0.0:1784938535.609334:0:26607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350955520 00000100:00100000:2.0:1784938535.611318:0:25730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350955776 00000100:00100000:2.0:1784938535.611328:0:25730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350955776 00000100:00100000:2.0:1784938535.611362:0:25730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 117 00000100:00100000:2.0:1784938535.611372:0:25730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:16392:x1871643350955904:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938535.611458:0:25730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:16392:x1871643350955904:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 88us (7447us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938535.611465:0:25730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 117 00000100:00100000:2.0:1784938535.611480:0:25730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 118 00000100:00100000:2.0:1784938535.611485:0:25730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:16392:x1871643350955776:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938535.611505:0:25730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:16392:x1871643350955776:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 20us (7429us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938535.611510:0:25730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 118 00000100:00100000:2.0:1784938535.611535:0:21154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350954880 00000100:00100000:2.0:1784938535.611539:0:21154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350954880 00000100:00100000:2.0:1784938535.611554:0:21154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350954752 00000100:00100000:2.0:1784938535.611557:0:21154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350954752 00000100:00100000:2.0:1784938535.611566:0:21154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 106 00000100:00100000:2.0:1784938535.611571:0:21154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387daed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16392:x1871643350954880:12345-192.168.202.154@tcp:13:osp-pre-0-1.0 00002000:00000024:2.0:1784938535.611606:0:21154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 271040 pending 0 free 313057280 avail 285245440 00000100:00100000:2.0:1784938535.611628:0:21154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387daed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16392:x1871643350954880:12345-192.168.202.154@tcp:13:osp-pre-0-1.0 Request processed in 57us (7521us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938535.611633:0:21154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 106 00000100:00100000:2.0:1784938535.611643:0:21154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 107 00000100:00100000:2.0:1784938535.611648:0:21154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387daf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16389:x1871643350954752:12345-192.168.202.154@tcp:13:osp-pre-1-1.0 00002000:00000024:2.0:1784938535.611660:0:21154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 271040 pending 0 free 313057280 avail 285245440 00000100:00100000:2.0:1784938535.611677:0:21154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387daf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16389:x1871643350954752:12345-192.168.202.154@tcp:13:osp-pre-1-1.0 Request processed in 28us (7549us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938535.611682:0:21154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 107 00000100:00100000:2.0:1784938535.611704:0:26608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 29 00000100:00100000:2.0:1784938535.611712:0:26608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387daca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:16389:x1871643350955264:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938535.611736:0:26608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387daca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:16389:x1871643350955264:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 25us (7561us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938535.611741:0:26608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 29 00000100:00080000:2.0:1784938535.611791:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b4116800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784938535.611797:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.154@tcp failed (-19) 00000100:00100000:2.0:1784938535.611801:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:16388:1871643350955136:192.168.202.154@tcp:38:kworker.0 00000100:00080000:2.0:1784938535.611812:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f2383aea800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784938535.611815:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.154@tcp failed (-19) 00000100:00100000:2.0:1784938535.611818:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:16388:1871643350955392:192.168.202.154@tcp:38:kworker.0 00000100:00080000:2.0:1784938535.611829:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b4113800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784938535.611832:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.154@tcp failed (-19) 00000100:00100000:2.0:1784938535.611835:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:16388:1871643350955648:192.168.202.154@tcp:38:kworker.0 00000100:00080000:2.0:1784938535.611848:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b36a7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784938535.611851:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.154@tcp failed (-19) 00000100:00100000:2.0:1784938535.611855:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:16388:1871643350956032:192.168.202.154@tcp:38:kworker.0 00000100:00100000:3.0:1784938535.614741:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350954880:192.168.202.154@tcp:13:osp-pre-0-1.0 00000100:00100000:3.0:1784938535.614760:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350955776:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938535.614773:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350955904:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938535.614818:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350954752:192.168.202.154@tcp:13:osp-pre-1-1.0 00010000:00080000:3.0:1784938535.614834:0:16389:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9f24b68aad80 x1871643350955264/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938535.614844:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:16389:1871643350955264:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938535.620348:0:26607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 30 00000100:00100000:0.0:1784938535.620364:0:26607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:16389:x1871643350955520:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938535.620451:0:26607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:16389:x1871643350955520:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 90us (16236us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938535.620459:0:26607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 30 00000100:00080000:0.0:1784938535.620713:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784938535.620718:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784938535.620721:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1784938535.620934:0:16389:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9f24b68a9c00 x1871643350955520/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938535.620956:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:16389:1871643350955520:192.168.202.154@tcp:400:kworker.0 00010000:00010000:3.0:1784938535.849462:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938536.876892:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784938537.564270:0:28403:0:(obd_mount.c:919:lmd_print()) mount data: 00000020:01000004:2.0:1784938537.564279:0:28403:0:(obd_mount.c:922:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1784938537.564280:0:28403:0:(obd_mount.c:925:lmd_print()) options: user_xattr,errors=remount-ro,user_xattr 00000080:01200004:2.0:1784938537.564604:0:28403:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9f2383ab1800 00000020:01000004:2.0:1784938537.564624:0:28403:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1784938537.564640:0:28403:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1784938537.564724:0:28403:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9f248faccd40) 00000020:00000080:2.0:1784938537.564744:0:28403:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1784938537.658071:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1784938537.659992:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1784938537.662195:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1784938537.663612:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1784938537.664183:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1784938537.664397:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1784938537.664640:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1784938537.665014:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1784938537.665288:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1784938537.665513:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1784938537.665814:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1784938537.666273:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1784938537.666498:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1784938537.666813:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1784938537.667196:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1784938537.667407:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1784938537.667598:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1784938537.667969:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1784938537.668219:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1784938537.668497:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1784938537.668687:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1784938537.669024:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1784938537.670071:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1784938537.670546:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1784938537.670817:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1784938537.671189:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1784938537.671373:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1784938537.671593:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1784938537.671901:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1784938537.672091:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1784938537.672589:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1784938537.672938:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1784938537.673212:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1784938537.673459:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1784938537.673722:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1784938537.674482:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1784938537.674774:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1784938537.675254:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1784938537.675478:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1784938537.675779:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1784938537.676074:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1784938537.676326:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1784938537.676506:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1784938537.676786:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1784938537.677087:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1784938537.677830:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1784938537.678259:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1784938537.679001:0:28403:0:(scrub.c:116:scrub_file_reset()) lustre-MDT0000: reset OI scrub file, old flags = 0x0, add flags = 0x2 00100000:10000000:0.0:1784938537.679053:0:28403:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1784938537.680284:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1784938537.680768:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1784938537.681291:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1784938537.682189:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1784938537.682427:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1784938537.682613:0:28403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1784938537.683595:0:28407:0:(scrub.c:294:scrub_thread_prep()) lustre-MDT0000: OI scrub prep, flags = 0x8 00100000:10000000:2.0:1784938537.683634:0:28407:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1784938537.683748:0:28407:0:(osd_scrub.c:1263:osd_scrub_main()) lustre-MDT0000: OI scrub start, flags = 0x8, pos = 12 00080000:01000000:0.0:1784938537.684503:0:28403:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1784938537.684903:0:28403:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1784938537.684911:0:28403:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:0.0:1784938537.684922:0:28403:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b044d4128f9f4a3 00000020:01000004:0.0:1784938537.684928:0:28403:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1784938537.684940:0:28403:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1784938537.684945:0:28403:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f2383ab1800 from MGS 00000020:01000004:0.0:1784938537.684949:0:28403:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1784938537.684958:0:28403:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9f2389e7cd40) 00000020:00000080:0.0:1784938537.684967:0:28403:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1784938537.685023:0:28403:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f2383ab1800 from MGS, refs=2 00080000:01000000:0.0:1784938537.685026:0:28403:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:0.0:1784938537.685030:0:28403:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b044d4128f9f4b1 00010000:00010000:0.0:1784938537.685194:0:28403:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:0.0:1784938537.718181:0:28403:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1784938537.722988:0:28409:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1784938537.723023:0:28403:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1784938537.723082:0:28403:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00100000:10000000:0.0:1784938537.724903:0:28407:0:(scrub.c:368:scrub_thread_post()) lustre-MDT0000: OI scrub post with result = 1 00100000:10000000:0.0:1784938537.724939:0:28407:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1784938537.724942:0:28407:0:(osd_scrub.c:1303:osd_scrub_main()) lustre-MDT0000: OI scrub: stop, pos = 160001: rc = 1 20000000:01000000:1.0:1784938537.727337:0:28403:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1784938537.727631:0:28403:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784938537.727787:0:28403:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1784938537.727794:0:28403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1784938537.728786:0:28403:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1784938537.728795:0:28403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1784938537.729300:0:28403:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1784938537.729307:0:28403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1784938537.729804:0:28403:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1784938537.729847:0:28403:0:(obd_mount.c:395:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1784938537.729849:0:28403:0:(obd_mount.c:406:lustre_start_mgc()) MGC192.168.202.154@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1784938537.729852:0:28403:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.154@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:2.0:1784938537.729858:0:28403:0:(import.c:65:import_set_state_nolock()) ffff9f2490614000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1784938537.729864:0:28403:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.154@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1784938537.740018:0:28403:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.154@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1784938537.740025:0:28403:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1784938537.740035:0:28403:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f2387fd2300 x1871643350953344/t0(0) o400->MGC192.168.202.154@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784938546 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938537.740237:0:28403:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f24b68a9500 x1871643350955008/t0(0) o400->MGC192.168.202.154@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784938551 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1784938537.740255:0:28403:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1784938537.740258:0:28403:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1784938537.740260:0:28403:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1784938537.740263:0:28403:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00000100:00100000:2.0:1784938537.741468:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e07296-2a01-411c-abf2-6d190cb69ef0:16392:1871643350955008:0@lo:400:kworker.0 00000100:00100000:1.0:1784938537.742315:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e07296-2a01-411c-abf2-6d190cb69ef0:16391:1871643350953344:0@lo:400:kworker.0 10000000:01000000:2.0:1784938537.745401:0:28403:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:2.0:1784938537.745426:0:28403:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f24827c6c00/0x7b044d4128f9f004 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x7b044d4128f9f00b expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938537.745439:0:28403:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f24827c6c00/0x7b044d4128f9f004 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x7b044d4128f9f00b expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938537.745445:0:28403:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784938537.745728:0:28403:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784938537.745740:0:28403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f24827c6c00/0x7b044d4128f9f004 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x7b044d4128f9f00b expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938537.745760:0:28403:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f238217dc00/0x7b044d4128f9efb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x7b044d4128f9efb7 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938537.745767:0:28403:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f238217dc00/0x7b044d4128f9efb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x7b044d4128f9efb7 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938537.745773:0:28403:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938537.745776:0:28403:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784938537.745779:0:28403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f238217dc00/0x7b044d4128f9efb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x7b044d4128f9efb7 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938537.745789:0:28403:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f24b379d400/0x7b044d4128f9efbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x7b044d4128f9efc5 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938537.745795:0:28403:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f24b379d400/0x7b044d4128f9efbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x7b044d4128f9efc5 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938537.745805:0:28403:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938537.745809:0:28403:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784938537.745812:0:28403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f24b379d400/0x7b044d4128f9efbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x7b044d4128f9efc5 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938537.745820:0:28403:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f2386e01c00/0x7b044d4128f9efda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x7b044d4128f9efe1 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938537.745825:0:28403:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f2386e01c00/0x7b044d4128f9efda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x7b044d4128f9efe1 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938537.745830:0:28403:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938537.745833:0:28403:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784938537.745836:0:28403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f2386e01c00/0x7b044d4128f9efda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x7b044d4128f9efe1 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938537.745851:0:28403:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f238217d000/0x7b044d4128f9efe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x7b044d4128f9efef expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938537.745857:0:28403:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f238217d000/0x7b044d4128f9efe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x7b044d4128f9efef expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938537.745862:0:28403:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938537.745865:0:28403:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784938537.745868:0:28403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f238217d000/0x7b044d4128f9efe8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x7b044d4128f9efef expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938537.745876:0:28403:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f24827c6200/0x7b044d4128f9f012 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x7b044d4128f9f019 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938537.745887:0:28403:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f24827c6200/0x7b044d4128f9f012 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x7b044d4128f9f019 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938537.745892:0:28403:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938537.745895:0:28403:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784938537.745898:0:28403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f24827c6200/0x7b044d4128f9f012 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x7b044d4128f9f019 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938537.745905:0:28403:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f24827c6a00/0x7b044d4128f9f051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x7b044d4128f9f058 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938537.745911:0:28403:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f24827c6a00/0x7b044d4128f9f051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x7b044d4128f9f058 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938537.745916:0:28403:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938537.745919:0:28403:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784938537.745921:0:28403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f24827c6a00/0x7b044d4128f9f051 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x7b044d4128f9f058 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938537.745929:0:28403:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f238217c400/0x7b044d4128f9f0f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x7b044d4128f9f100 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938537.745935:0:28403:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f238217c400/0x7b044d4128f9f0f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x7b044d4128f9f100 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938537.745939:0:28403:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938537.745942:0:28403:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784938537.745945:0:28403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f238217c400/0x7b044d4128f9f0f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x7b044d4128f9f100 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938537.745961:0:28403:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f238db39c00/0x7b044d4128f9f27a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x7b044d4128f9f281 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938537.745968:0:28403:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f238db39c00/0x7b044d4128f9f27a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x7b044d4128f9f281 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938537.745973:0:28403:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938537.745976:0:28403:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784938537.745979:0:28403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f238db39c00/0x7b044d4128f9f27a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x7b044d4128f9f281 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938537.745988:0:28403:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f24827c6600/0x7b044d4128f9f043 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x7b044d4128f9f04a expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938537.745994:0:28403:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f24827c6600/0x7b044d4128f9f043 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x7b044d4128f9f04a expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938537.745998:0:28403:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938537.746001:0:28403:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784938537.746004:0:28403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f24827c6600/0x7b044d4128f9f043 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x7b044d4128f9f04a expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938537.746014:0:28403:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f24827c7c00/0x7b044d4128f9efcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x7b044d4128f9efd3 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938537.746019:0:28403:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f24827c7c00/0x7b044d4128f9efcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x7b044d4128f9efd3 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938537.746024:0:28403:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784938537.746028:0:28403:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784938537.746031:0:28403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f24827c7c00/0x7b044d4128f9efcc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x7b044d4128f9efd3 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938537.746042:0:28403:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f238217c800/0x7b044d4128f9eff6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x7b044d4128f9effd expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938537.746048:0:28403:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f238217c800/0x7b044d4128f9eff6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x7b044d4128f9effd expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938537.746053:0:28403:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784938537.746056:0:28403:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784938537.746060:0:28403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f238217c800/0x7b044d4128f9eff6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x7b044d4128f9effd expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938537.746067:0:28403:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f24b379d200/0x7b044d4128f9f0eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x7b044d4128f9f0f2 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938537.746073:0:28403:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f24b379d200/0x7b044d4128f9f0eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x7b044d4128f9f0f2 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938537.746078:0:28403:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784938537.746081:0:28403:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784938537.746085:0:28403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f24b379d200/0x7b044d4128f9f0eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x7b044d4128f9f0f2 expref: -99 pid: 27340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784938537.746101:0:28403:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9f2490614000 already not connected (conn 7, was 0): DISCONN 00000100:00080000:3.0:1784938537.746108:0:28403:0:(import.c:65:import_set_state_nolock()) ffff9f2490614000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938537.746114:0:28403:0:(import.c:510:import_select_connection()) MGC192.168.202.154@tcp: connect to NID 0@lo last attempt 757 00000100:00080000:3.0:1784938537.746132:0:28403:0:(import.c:624:import_select_connection()) MGC192.168.202.154@tcp: import ffff9f2490614000 using connection 73e07296-2a01-411c-abf2-6d190cb69ef0/0@lo 00000100:00100000:3.0:1784938537.746191:0:28403:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f2387fd0000 x1871643350956160/t0(0) o250->MGC192.168.202.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784938537.746216:0:28403:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:0.0:1784938537.746346:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73e07296-2a01-411c-abf2-6d190cb69ef0:16388:1871643350956160:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1784938537.746419:0:16388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938537.746478:0:28410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350956160 00000100:00100000:0.0:1784938537.746485:0:28410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350956160 00000100:00100000:0.0:1784938537.746513:0:28410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784938537.746520:0:28410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2383a14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:16388:x1871643350956160:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1784938537.746541:0:28410:0:(ldlm_lib.c:1468:target_handle_connect()) MGS: connection from 73e07296-2a01-411c-abf2-6d190cb69ef0@0@lo t0 exp 0000000000000000 cur 803 last 0 00000020:00000080:0.0:1784938537.746576:0:28410:0:(genops.c:1406:class_connect()) connect: client 73e07296-2a01-411c-abf2-6d190cb69ef0, cookie 0x7b044d4128f9f4b8 00000100:00080000:0.0:1784938537.746689:0:28410:0:(import.c:65:import_set_state_nolock()) ffff9f2488a45000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784938537.746733:0:28410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2383a14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+5:16388:x1871643350956160:12345-0@lo:250:mount.lustre.0 Request processed in 213us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938537.746744:0:28410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784938537.746777:0:16388:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.154@tcp: committing for last_committed 0 gen 4 00000100:00080000:0.0:1784938537.746784:0:16388:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.154@tcp: connect to target with instance 0 00000100:00080000:0.0:1784938537.746790:0:16388:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.154@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1784938537.746793:0:16388:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1784938537.746795:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f2490614000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1784938537.746797:0:16388:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1784938537.746819:0:16388:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1784938537.746825:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73e07296-2a01-411c-abf2-6d190cb69ef0:16388:1871643350956160:0@lo:250:mount.lustre.0 00000020:01000000:3.0:1784938537.747052:0:38:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.202.154@tcp 10000000:01000000:3.0:1784938537.747070:0:38:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:3.0:1784938537.747073:0:38:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1784938537.747075:0:38:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784938537.747077:0:38:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938537.747078:0:38:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938537.747079:0:38:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938537.747080:0:38:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938537.747082:0:38:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784938537.747083:0:38:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938537.747085:0:38:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1784938537.747131:0:38:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1784938537.747139:0:38:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:3.0:1784938537.747141:0:38:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1784938537.747168:0:38:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784938537.747170:0:38:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938537.747170:0:38:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938537.747171:0:38:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938537.747173:0:38:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938537.747174:0:38:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784938537.747175:0:38:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938537.747176:0:38:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1784938537.747190:0:38:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1784938537.747194:0:38:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:3.0:1784938537.747196:0:38:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1784938537.747197:0:38:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1784938537.747198:0:38:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938537.747199:0:38:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938537.747200:0:38:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938537.747202:0:38:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938537.747203:0:38:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784938537.747204:0:38:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938537.747205:0:38:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1784938537.747220:0:38:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1784938537.747248:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e07296-2a01-411c-abf2-6d190cb69ef0:16390:1871643350956416:0@lo:253:kworker.0 00000100:00100000:3.0:1784938537.747284:0:16390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938537.747309:0:16390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784938537.747314:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e07296-2a01-411c-abf2-6d190cb69ef0:16390:1871643350956288:0@lo:253:kworker.0 00000100:00100000:3.0:1784938537.747340:0:16390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938537.747366:0:28410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350956416 00000100:00100000:3.0:1784938537.747372:0:28410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350956416 00000100:00100000:3.0:1784938537.747398:0:28410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350956288 00000100:00100000:3.0:1784938537.747401:0:28410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350956288 00000100:00100000:3.0:1784938537.747414:0:28410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784938537.747420:0:28410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2383a16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+6:16390:x1871643350956416:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1784938537.747441:0:28410:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00080000:3.0:1784938537.747597:0:28403:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:3.0:1784938537.747608:0:28403:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1784938537.747644:0:28403:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1784938537.747649:0:28403:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.154@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1784938537.747961:0:28403:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.154@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784938537.747985:0:28403:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.154@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1784938537.747988:0:28403:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784938537.747990:0:28403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784938537.747991:0:28403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938537.747992:0:28403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938537.747993:0:28403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938537.747994:0:28403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938537.747996:0:28403:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784938537.747998:0:28403:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784938537.747999:0:28403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938537.748000:0:28403:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784938537.748002:0:28403:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1784938537.748004:0:28403:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784938537.748006:0:28403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784938537.748007:0:28403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938537.748008:0:28403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938537.748009:0:28403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938537.748011:0:28403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938537.748012:0:28403:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784938537.748013:0:28403:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784938537.748014:0:28403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938537.748014:0:28403:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784938537.748029:0:28403:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1784938537.748040:0:28403:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:28403:1871643350956672:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784938537.748076:0:28403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938537.748087:0:28403:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b2d2c540 going to sleep for 11 seconds 00000100:00100000:3.0:1784938537.748106:0:28412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350956672 00000100:00100000:3.0:1784938537.748111:0:28412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350956672 00000100:00100000:2.0:1784938537.748229:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784938537.748240:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e07296-2a01-411c-abf2-6d190cb69ef0:16392:1871643350956544:0@lo:253:kworker.0 00000100:00100000:2.0:1784938537.748275:0:16392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938537.748344:0:28412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350956544 00000100:00100000:3.0:1784938537.748347:0:28412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350956544 00000100:00100000:3.0:1784938537.748359:0:28412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784938537.748366:0:28412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2383a16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+8:16390:x1871643350956288:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1784938537.748387:0:28412:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 10000000:01000000:0.0:1784938537.748597:0:28413:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1784938537.749170:0:28410:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 14 20000000:01000000:1.0:1784938537.751414:0:28414:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1784938537.751422:0:28414:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1784938537.751425:0:28414:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1784938537.751428:0:28414:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1784938537.751795:0:28414:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1784938537.752067:0:28410:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1784938537.752105:0:28410:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1784938537.754048:0:28410:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784938537.754070:0:28410:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1784938537.754368:0:28412:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1784938537.754610:0:28410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2383a16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+8:16390:x1871643350956416:12345-0@lo:253:kworker.0 Request processed in 7186us (7321us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938537.754625:0:28410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784938537.754743:0:28410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784938537.754754:0:28410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2383a17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+7:28403:x1871643350956672:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784938537.754797:0:28410:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1784938537.754799:0:28410:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1784938537.754801:0:28410:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:2.0:1784938537.754807:0:28410:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1784938537.754944:0:28413:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784938537.754949:0:28413:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784938537.754972:0:28413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f238c559a00/0x7b044d4128f9f4bf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.754988:0:28413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f238c559a00/0x7b044d4128f9f4bf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784938537.755002:0:28413:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000053828s 00010000:00010000:1.0:1784938537.755007:0:28413:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f238c559a00/0x7b044d4128f9f4bf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.755015:0:28413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f238c559a00/0x7b044d4128f9f4bf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.755022:0:28413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f238c559a00/0x7b044d4128f9f4bf lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.755029:0:28413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f238c559a00/0x7b044d4128f9f4bf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.755035:0:28413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c559a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938537.755039:0:28413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f238c559a00/0x7b044d4128f9f4bf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.755046:0:28413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f238c559a00/0x7b044d4128f9f4bf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.755058:0:28413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f238c559a00/0x7b044d4128f9f4bf lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.755067:0:28413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f238c559a00/0x7b044d4128f9f4bf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.755074:0:28413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f238c559a00/0x7b044d4128f9f4bf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784938537.755288:0:16390:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1784938537.755291:0:16390:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784938537.755292:0:16390:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938537.755293:0:16390:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784938537.755294:0:16390:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938537.755296:0:16390:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938537.755297:0:16390:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784938537.755299:0:16390:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938537.755300:0:16390:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1784938537.755304:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e07296-2a01-411c-abf2-6d190cb69ef0:16390:1871643350956416:0@lo:253:kworker.0 00000100:00100000:2.0:1784938537.757775:0:28410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2383a17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+7:28403:x1871643350956672:12345-0@lo:253:mount.lustre.0 Request processed in 3016us (9689us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938537.757800:0:28410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784938537.757854:0:28410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784938537.757865:0:28410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6e10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+6:16392:x1871643350956544:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1784938537.757895:0:28410:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1784938537.758061:0:28412:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784938537.758072:0:28412:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1784938537.758169:0:28413:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784938537.758173:0:28413:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784938537.758191:0:28413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f238c558000/0x7b044d4128f9f4c6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.758207:0:28413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f238c558000/0x7b044d4128f9f4c6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784938537.758216:0:28413:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000053828s 00010000:00010000:1.0:1784938537.758221:0:28413:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f238c558000/0x7b044d4128f9f4c6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.758228:0:28413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f238c558000/0x7b044d4128f9f4c6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.758236:0:28413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f238c558000/0x7b044d4128f9f4c6 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.758243:0:28413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f238c558000/0x7b044d4128f9f4c6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.758249:0:28413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238c558000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938537.758253:0:28413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f238c558000/0x7b044d4128f9f4c6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.758262:0:28413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f238c558000/0x7b044d4128f9f4c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.758274:0:28413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f238c558000/0x7b044d4128f9f4c6 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.758282:0:28413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f238c558000/0x7b044d4128f9f4c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.758289:0:28413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f238c558000/0x7b044d4128f9f4c6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938537.759022:0:28403:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:28403:1871643350956672:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784938537.759038:0:28403:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1784938537.759041:0:28403:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784938537.759043:0:28403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784938537.759045:0:28403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938537.759046:0:28403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938537.759047:0:28403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938537.759048:0:28403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938537.759050:0:28403:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784938537.759052:0:28403:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784938537.759053:0:28403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938537.759055:0:28403:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784938537.759080:0:28403:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f2383ab1800 from lustre-MDT0000 10000000:01000000:3.0:1784938537.759113:0:28403:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1784938537.759117:0:28403:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1784938537.759135:0:28403:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f2383ab1800 10000000:01000000:3.0:1784938537.759139:0:28403:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784938537.759162:0:28403:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9f2383ab1800 10000000:01000000:3.0:1784938537.759166:0:28403:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1784938537.759169:0:28403:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9f2383ab1800 from 1 10000000:01000000:3.0:1784938537.759172:0:28403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1784938537.759202:0:28403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7800/0x7b044d4128f9f4cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938537.759211:0:28403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7800/0x7b044d4128f9f4cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938537.759219:0:28403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7800/0x7b044d4128f9f4cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938537.759239:0:28403:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:28403:1871643350956800:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784938537.759284:0:28403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938537.759321:0:28403:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2489041000 going to sleep for 11 seconds 00000100:00100000:1.0:1784938537.759480:0:28411:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1784938537.759489:0:28411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 20000000:01000000:2.0:1784938537.759566:0:28410:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1784938537.760009:0:28411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350956800 00000100:00100000:1.0:1784938537.760016:0:28411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350956800 00000100:00100000:1.0:1784938537.760102:0:28415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784938537.760112:0:28415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6e10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:73e07296-2a01-411c-abf2-6d190cb69ef0+7:28403:x1871643350956800:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938537.760134:0:28415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938537.760164:0:28415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f238c558c00/0x7b044d4128f9f4d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9f4cd expref: -99 pid: 28415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.760186:0:28415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f238c558c00/0x7b044d4128f9f4d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9f4cd expref: 8 pid: 28415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.760196:0:28415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f238c558c00/0x7b044d4128f9f4d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9f4cd expref: 8 pid: 28415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.760205:0:28415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c558c00, rc 0) 00000100:00100000:1.0:1784938537.760243:0:28415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6e10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:73e07296-2a01-411c-abf2-6d190cb69ef0+8:28403:x1871643350956800:12345-0@lo:101:mount.lustre.0 Request processed in 133us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938537.760249:0:28415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784938537.760381:0:28412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2383a16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+7:16390:x1871643350956288:12345-0@lo:253:kworker.0 Request processed in 12013us (13039us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938537.760388:0:28412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784938537.760428:0:28403:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:28403:1871643350956800:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938537.760441:0:28403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7800/0x7b044d4128f9f4cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f4d4 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938537.760451:0:28403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7800/0x7b044d4128f9f4cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9f4d4 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938537.760465:0:28403:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1784938537.760483:0:28403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7800/0x7b044d4128f9f4cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f4d4 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938537.760495:0:28403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7800/0x7b044d4128f9f4cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f4d4 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938537.760502:0:28403:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1784938537.760507:0:28403:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784938537.760511:0:28403:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9f2383ab1800 10000000:01000000:3.0:1784938537.760514:0:28403:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1784938537.760517:0:28403:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1784938537.760519:0:28403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784938537.760536:0:28403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7a00/0x7b044d4128f9f4db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938537.760543:0:28403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7a00/0x7b044d4128f9f4db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938537.760551:0:28403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7a00/0x7b044d4128f9f4db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938537.760574:0:28403:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:28403:1871643350956928:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784938537.760597:0:28403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938537.760617:0:28411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350956928 00000100:00100000:3.0:1784938537.760620:0:28411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350956928 00000100:00100000:3.0:1784938537.760639:0:28411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784938537.760645:0:28411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6e11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+7:28403:x1871643350956928:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938537.760652:0:28411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938537.760673:0:28411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f238d3a6000/0x7b044d4128f9f4e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9f4db expref: -99 pid: 28411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938537.760688:0:28411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f238d3a6000/0x7b044d4128f9f4e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9f4db expref: 8 pid: 28411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938537.760696:0:28411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f238d3a6000/0x7b044d4128f9f4e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9f4db expref: 8 pid: 28411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938537.760702:0:28411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a6000, rc 0) 00000100:00100000:3.0:1784938537.760721:0:28411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6e11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+8:28403:x1871643350956928:12345-0@lo:101:mount.lustre.0 Request processed in 77us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938537.760726:0:28411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784938537.760748:0:28403:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2489041000 going to sleep for 11 seconds 00000100:00100000:3.0:1784938537.760760:0:28403:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:28403:1871643350956928:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938537.760770:0:28403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7a00/0x7b044d4128f9f4db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f4e2 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938537.760777:0:28403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7a00/0x7b044d4128f9f4db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9f4e2 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938537.760822:0:28403:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:28403:1871643350957056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938537.760859:0:28403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938537.760872:0:28403:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2489041000 going to sleep for 11 seconds 00000100:00100000:3.0:1784938537.760884:0:28415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350957056 00000100:00100000:3.0:1784938537.760888:0:28415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350957056 00000100:00100000:3.0:1784938537.760909:0:28411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784938537.760915:0:28411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b4fbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+8:28403:x1871643350957056:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938537.761025:0:28411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b4fbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+9:28403:x1871643350957056:12345-0@lo:501:mount.lustre.0 Request processed in 109us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938537.761032:0:28411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784938537.761062:0:28403:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:28403:1871643350957056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938537.761090:0:28403:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:28403:1871643350957184:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784938537.761128:0:28403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938537.761171:0:28411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350957184 00000100:00100000:3.0:1784938537.761175:0:28411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350957184 00000100:00100000:3.0:1784938537.761191:0:28411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784938537.761196:0:28411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b4fbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+9:28403:x1871643350957184:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784938537.761326:0:28403:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2489041000 going to sleep for 11 seconds 00000020:01000004:2.0:1784938537.762627:0:16390:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1784938537.762631:0:16390:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784938537.762633:0:16390:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784938537.762635:0:16390:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784938537.762636:0:16390:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784938537.762639:0:16390:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784938537.762641:0:16390:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784938537.762643:0:16390:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784938537.762644:0:16390:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1784938537.762649:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e07296-2a01-411c-abf2-6d190cb69ef0:16390:1871643350956288:0@lo:253:kworker.0 20000000:01000000:3.0:1784938537.764058:0:28410:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784938537.764082:0:28410:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1784938537.764276:0:28413:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784938537.764281:0:28413:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784938537.764305:0:28413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f24b4057a00/0x7b044d4128f9f4e9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938537.764322:0:28413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f24b4057a00/0x7b044d4128f9f4e9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784938537.764333:0:28413:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000053828s 00010000:00010000:0.0:1784938537.764338:0:28413:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f24b4057a00/0x7b044d4128f9f4e9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938537.764346:0:28413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f24b4057a00/0x7b044d4128f9f4e9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938537.764353:0:28413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f24b4057a00/0x7b044d4128f9f4e9 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938537.764360:0:28413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f24b4057a00/0x7b044d4128f9f4e9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938537.764366:0:28413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938537.764371:0:28413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f24b4057a00/0x7b044d4128f9f4e9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938537.764378:0:28413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f24b4057a00/0x7b044d4128f9f4e9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938537.764392:0:28413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f24b4057a00/0x7b044d4128f9f4e9 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938537.764400:0:28413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f24b4057a00/0x7b044d4128f9f4e9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938537.764406:0:28413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f24b4057a00/0x7b044d4128f9f4e9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938537.764675:0:28410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6e10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+9:16392:x1871643350956544:12345-0@lo:253:kworker.0 Request processed in 6809us (16395us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938537.764684:0:28410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:2.0:1784938537.764828:0:16392:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1784938537.764830:0:16392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784938537.764832:0:16392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784938537.764833:0:16392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784938537.764844:0:16392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784938537.764846:0:16392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784938537.764847:0:16392:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784938537.764849:0:16392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784938537.764851:0:16392:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1784938537.764854:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e07296-2a01-411c-abf2-6d190cb69ef0:16392:1871643350956544:0@lo:253:kworker.0 00000100:00100000:1.0:1784938537.765280:0:28411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b4fbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+8:28403:x1871643350957184:12345-0@lo:503:mount.lustre.0 Request processed in 4082us (4150us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938537.765288:0:28411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784938537.765632:0:28403:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:28403:1871643350957184:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784938537.766534:0:28416:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387dafb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e07296-2a01-411c-abf2-6d190cb69ef0:28416:1871643350957312:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938537.766612:0:28416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938537.766754:0:28412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350957312 00000100:00100000:0.0:1784938537.766773:0:28412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350957312 00000100:00100000:0.0:1784938537.766823:0:28412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784938537.766832:0:28412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b4fbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+8:28416:x1871643350957312:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938537.768002:0:28416:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248fb1c480 going to sleep for 11 seconds 00000100:00100000:0.0:1784938537.768285:0:28412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b4fbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+8:28416:x1871643350957312:12345-0@lo:502:llog_process_th.0 Request processed in 1452us (1670us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938537.768298:0:28412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784938537.768459:0:28416:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387dafb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e07296-2a01-411c-abf2-6d190cb69ef0:28416:1871643350957312:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784938537.768494:0:28416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784938537.768506:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938537.768508:0:28416:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784938537.768512:0:28416:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1784938537.768515:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784938537.768529:0:28416:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9f248fac99c0) 00000020:00000080:2.0:1784938537.768551:0:28416:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1784938537.768567:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1784938537.768724:0:28416:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:2.0:1784938537.768734:0:28416:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b044d4128f9f4f7 00000020:00000080:2.0:1784938537.769022:0:28416:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1784938537.769027:0:28416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938537.769030:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938537.769032:0:28416:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784938537.769035:0:28416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784938537.769038:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938537.769040:0:28416:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1784938537.769043:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784938537.769050:0:28416:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9f248facb380) 00000020:00000080:2.0:1784938537.769062:0:28416:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1784938537.769066:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1784938537.769068:0:28416:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1784938537.769071:0:28416:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1784938537.769078:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784938537.769458:0:28416:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f2383ab1800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1784938537.769473:0:28416:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9f2389c64d40) 00000020:00000080:3.0:1784938537.769484:0:28416:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1784938537.769546:0:28416:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1784938537.769552:0:28416:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b044d4128f9f50c 00000020:00000080:3.0:1784938537.769747:0:28416:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1784938537.769754:0:28416:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1784938537.769758:0:28416:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x7b044d4128f9f513 00080000:01000000:3.0:1784938537.769763:0:28416:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:3.0:1784938537.769766:0:28416:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b044d4128f9f51a 00010000:00010000:3.0:1784938537.850513:0:28416:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1784938537.851377:0:28416:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 8589934866 srv lr: 12884901893 lx: 0 gen 1 00000001:00000004:3.0:1784938537.851428:0:28416:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 4, last_transno is 12884901893 00000001:00080000:3.0:1784938537.851773:0:28416:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1784938537.851831:0:28416:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9f248529f540: xid 1871643350946560, transno 12884901892, client gen 1, slot idx 0 00000001:00080000:3.0:1784938537.852024:0:28416:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9f248529f9c0: xid 1871643350886656, transno 8589934862, client gen 1, slot idx 3 00000020:00000080:3.0:1784938537.852726:0:28416:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9f24b176cd40) 00000020:00000080:3.0:1784938537.852749:0:28416:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1784938537.852883:0:28416:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:3.0:1784938537.852893:0:28416:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b044d4128f9f52f 00000020:00000080:1.0:1784938537.854167:0:28416:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1784938537.863068:0:28416:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x7b044d4128f9f536 00000020:00000080:3.0:1784938537.863624:0:28416:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1784938537.863640:0:28416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938537.863648:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938537.863650:0:28416:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1784938537.863664:0:28416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784938537.863667:0:28416:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1784938537.863669:0:28416:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784938537.863670:0:28416:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784938537.863671:0:28416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784938537.863674:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938537.863675:0:28416:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784938537.863678:0:28416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938537.863683:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938537.863684:0:28416:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1784938537.863688:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1784938537.863729:0:28416:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1784938537.863745:0:28416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938537.863749:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938537.863750:0:28416:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1784938537.863753:0:28416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938537.863756:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938537.863757:0:28416:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1784938537.863760:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784938537.863765:0:28416:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.154@tcp to nid 0x20000c0a8ca9a (192.168.202.154@tcp) 00000020:00000080:3.0:1784938537.863793:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784938537.863813:0:28416:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9f24b2cc8000) 00000020:00000080:3.0:1784938537.863846:0:28416:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1784938537.863853:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784938537.863986:0:28416:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1784938537.863993:0:28416:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:3.0:1784938537.863999:0:28416:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b044d4128f9f544 00010000:00080000:3.0:1784938537.864050:0:28416:0:(ldlm_lib.c:125:import_set_conn()) imp ffff9f238f002800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.154@tcp at head 00010000:00010000:3.0:1784938537.873747:0:28416:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:1.0:1784938537.878730:0:28416:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784938537.878748:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1784938537.878796:0:28416:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1784938537.878818:0:28416:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b044d4128f9f54b 00000100:00080000:1.0:1784938537.878831:0:28416:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 192.168.202.154@tcp last attempt 0 00000100:00080000:1.0:1784938537.878852:0:28416:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f238f002800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:1.0:1784938537.879042:0:28416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b68c3100 x1871643350957440/t0(0) o38->lustre-MDT0001-osp-MDT0000@192.168.202.154@tcp:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784938537.879071:0:28416:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1784938537.879168:0:28416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938537.879173:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938537.879175:0:28416:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1784938537.879178:0:28416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784938537.879181:0:28416:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1784938537.879182:0:28416:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784938537.879184:0:28416:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784938537.879185:0:28416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784938537.879187:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938537.879189:0:28416:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784938537.879191:0:28416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784938537.879195:0:28416:0:(obd_mount.c:957:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1784938537.879198:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938537.879199:0:28416:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1784938537.879202:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784938537.879205:0:28416:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.154@tcp to nid 0x20000c0a8ca9a (192.168.202.154@tcp) 00000020:01000000:1.0:1784938537.879340:0:28416:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1784938537.879344:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784938537.879359:0:28416:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9f24b2e33380) 00000020:00000080:1.0:1784938537.879378:0:28416:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1784938537.879384:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784938537.879446:0:28416:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1784938537.879451:0:28416:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000020:00000080:1.0:1784938537.879458:0:28416:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b044d4128f9f559 00010000:00080000:1.0:1784938537.879489:0:28416:0:(ldlm_lib.c:125:import_set_conn()) imp ffff9f238f8bf000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.154@tcp at head 00010000:00010000:1.0:1784938537.879744:0:28416:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:0.0:1784938537.879955:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350957440:192.168.202.154@tcp:38:llog_process_th.0 00000100:00100000:0.0:1784938537.880643:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938537.880691:0:25714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350957440 00000100:00100000:0.0:1784938537.880700:0:25714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350957440 00000100:00100000:0.0:1784938537.880733:0:25714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 133 00000100:00100000:0.0:1784938537.880741:0:25714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b6b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:16388:x1871643350957440:12345-192.168.202.154@tcp:38:llog_process_th.0 00010000:00080000:0.0:1784938537.880770:0:25714:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@192.168.202.154@tcp t0 exp 0000000000000000 cur 804 last 0 00000020:00000080:0.0:1784938537.880802:0:25714:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b044d4128f9f560 00000004:00100000:0.0:1784938537.880814:0:25714:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784938537.881021:0:25714:0:(import.c:65:import_set_state_nolock()) ffff9f2488a43800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784938537.881082:0:25714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b6b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:16388:x1871643350957440:12345-192.168.202.154@tcp:38:llog_process_th.0 Request processed in 339us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938537.881090:0:25714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 133 00000100:00100000:0.0:1784938537.881425:0:16388:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784938537.881434:0:16388:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1784938537.881441:0:16388:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1784938537.881446:0:16388:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1784938537.881448:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f238f002800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784938537.881456:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350957440:192.168.202.154@tcp:38:llog_process_th.0 00000100:00100000:0.0:1784938537.881526:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b37cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350957568:192.168.202.154@tcp:41:osp-pre-1-0.0 00000100:00100000:0.0:1784938537.881641:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938537.881662:0:21160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350957568 00000100:00100000:0.0:1784938537.881665:0:21160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350957568 00000100:00100000:0.0:1784938537.881690:0:21160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 134 00000100:00100000:0.0:1784938537.881697:0:21160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:16392:x1871643350957568:12345-192.168.202.154@tcp:41:osp-pre-1-0.0 00000004:00000024:0.0:1784938537.881721:0:21160:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 218472448 avail 191447040 00000100:00100000:0.0:1784938537.881745:0:21160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:16392:x1871643350957568:12345-192.168.202.154@tcp:41:osp-pre-1-0.0 Request processed in 48us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938537.881751:0:21160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 134 00000100:00100000:0.0:1784938537.881826:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b37cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350957568:192.168.202.154@tcp:41:osp-pre-1-0.0 00000100:00080000:2.0:1784938537.882737:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784938537.882743:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784938537.882746:0:38:0:(import.c:65:import_set_state_nolock()) ffff9f24b4116800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784938537.882755:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 192.168.202.154@tcp last attempt 801 00000100:00080000:2.0:1784938537.882761:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784938537.882766:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f24b4116800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:2.0:1784938537.882786:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f2387daf800 x1871643350957824/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784938537.882807:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784938537.882810:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784938537.882811:0:38:0:(import.c:65:import_set_state_nolock()) ffff9f2383aea800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784938537.882815:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 192.168.202.154@tcp last attempt 801 00000100:00080000:2.0:1784938537.882818:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784938537.882821:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f2383aea800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:2.0:1784938537.882831:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b68a9c00 x1871643350958080/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:01000000:1.0:1784938537.883087:0:28416:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1784938537.883328:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387dafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e07296-2a01-411c-abf2-6d190cb69ef0:16389:1871643350957696:0@lo:400:kworker.0 00000100:00100000:0.0:1784938537.883388:0:16389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938537.883426:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938537.883433:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:16389:1871643350957952:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938537.883599:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938537.883627:0:26609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350957952 00000100:00100000:0.0:1784938537.883634:0:26609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350957952 00000040:01000000:1.0:1784938537.884054:0:28416:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00080000:2.0:1784938537.884245:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784938537.884249:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784938537.884252:0:38:0:(import.c:65:import_set_state_nolock()) ffff9f24b4113800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784938537.884258:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 192.168.202.154@tcp last attempt 801 00000100:00080000:2.0:1784938537.884262:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784938537.884266:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9f24b4113800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:2.0:1784938537.884281:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b68aa300 x1871643350958336/t0(0) o38->lustre-MDT0000-osp-MDT0001@192.168.202.154@tcp:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784938537.884301:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784938537.884304:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784938537.884306:0:38:0:(import.c:65:import_set_state_nolock()) ffff9f24b36a7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784938537.884310:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 192.168.202.154@tcp last attempt 801 00000100:00080000:2.0:1784938537.884312:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784938537.884315:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9f24b36a7000 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:2.0:1784938537.884323:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b68a8700 x1871643350958720/t0(0) o38->lustre-MDT0000-lwp-MDT0001@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784938537.884349:0:16390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784938537.884396:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350958592:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938537.884466:0:28410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350957696 00000100:00100000:2.0:1784938537.884471:0:28410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350957696 00000100:00100000:2.0:1784938537.884515:0:28410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784938537.884522:0:28410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b4fbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+8:16389:x1871643350957696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938537.884582:0:28410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b4fbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+8:16389:x1871643350957696:12345-0@lo:400:kworker.0 Request processed in 59us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938537.884588:0:28410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784938537.885540:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387daf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:16388:1871643350957824:192.168.202.154@tcp:38:kworker.0 00000100:00100000:2.0:1784938537.885604:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:16388:1871643350958080:192.168.202.154@tcp:38:kworker.0 00000100:00100000:2.0:1784938537.885628:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:16388:1871643350958336:192.168.202.154@tcp:38:kworker.0 00000100:00100000:2.0:1784938537.885650:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:16388:1871643350958720:192.168.202.154@tcp:38:kworker.0 00000100:00100000:0.0:1784938537.886392:0:26609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 31 00000100:00100000:0.0:1784938537.886405:0:26609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b37cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:16389:x1871643350957952:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938537.886452:0:26609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b37cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:16389:x1871643350957952:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 50us (2853us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938537.886458:0:26609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 31 00000100:00080000:0.0:1784938537.886485:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784938537.886521:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387dafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e07296-2a01-411c-abf2-6d190cb69ef0:16389:1871643350957696:0@lo:400:kworker.0 00000100:00100000:0.0:1784938537.886575:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:16391:1871643350958208:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938537.886609:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938537.886615:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350958464:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938537.889627:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938537.889776:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938537.889802:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00010000:00080000:0.0:1784938537.889877:0:16389:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9f24b68a9500 x1871643350957952/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938537.889894:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:16389:1871643350957952:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938537.890522:0:26607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350958208 00000100:00100000:0.0:1784938537.890529:0:26607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350958208 00000100:00100000:0.0:1784938537.890587:0:26607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350958720 00000100:00100000:0.0:1784938537.890591:0:26607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350958720 00000100:00100000:0.0:1784938537.890611:0:26607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 32 00000100:00100000:0.0:1784938537.890620:0:26607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:16391:x1871643350958208:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938537.890821:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00080000:2.0:1784938537.890975:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1784938537.891010:0:28416:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784938537.891207:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938537.891403:0:26608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350957824 00000100:00100000:2.0:1784938537.891408:0:26608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350957824 00000100:00100000:2.0:1784938537.891422:0:26608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350958080 00000100:00100000:2.0:1784938537.891438:0:26608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350958080 00000100:00100000:2.0:1784938537.891452:0:26608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 42 00000100:00100000:2.0:1784938537.891457:0:26608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:16388:x1871643350958720:12345-192.168.202.154@tcp:38:kworker.0 00000100:00100000:0.0:1784938537.891610:0:26607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:16391:x1871643350958208:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 989us (1832us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938537.891618:0:26607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 32 00000100:00100000:0.0:1784938537.891642:0:26607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 43 00000100:00100000:0.0:1784938537.891646:0:26607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16388:x1871643350957824:12345-192.168.202.154@tcp:38:kworker.0 00000100:00100000:0.0:1784938537.891687:0:26607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16388:x1871643350957824:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 39us (867us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784938537.891693:0:26607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 43 00000100:00100000:0.0:1784938537.891707:0:26607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 44 00000100:00100000:0.0:1784938537.891711:0:26607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16388:x1871643350958080:12345-192.168.202.154@tcp:38:kworker.0 00000100:00100000:0.0:1784938537.891739:0:26607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16388:x1871643350958080:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 26us (533us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784938537.891746:0:26607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 44 00010000:00080000:0.0:1784938537.892031:0:16391:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9f24b68aad80 x1871643350958208/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938537.892046:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:16391:1871643350958208:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938537.892959:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350958592 00000100:00100000:0.0:1784938537.892969:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350958592 00000100:00100000:0.0:1784938537.893023:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 119 00000100:00100000:0.0:1784938537.893031:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:16390:x1871643350958592:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938537.893088:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:16390:x1871643350958592:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 57us (3468us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938537.893095:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 119 00000100:00080000:0.0:1784938537.893130:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784938537.893423:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938537.893498:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938537.893542:0:21151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350958464 00000100:00100000:1.0:1784938537.893546:0:21151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350958464 00000100:00100000:1.0:1784938537.893594:0:21151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 120 00000100:00100000:1.0:1784938537.893601:0:21151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:16391:x1871643350958464:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938537.893637:0:21151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:16391:x1871643350958464:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 36us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938537.893644:0:21151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 120 00000100:00100000:2.0:1784938537.893800:0:26608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:16388:x1871643350958720:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 2338us (3994us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784938537.893809:0:26608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 42 00000100:00100000:2.0:1784938537.893868:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350958592:192.168.202.154@tcp:400:kworker.0 00000100:00080000:3.0:1784938537.894419:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b4116800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784938537.894426:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.154@tcp failed (-11) 00000100:00100000:3.0:1784938537.894430:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387daf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:16388:1871643350957824:192.168.202.154@tcp:38:kworker.0 00000100:00080000:3.0:1784938537.894443:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f2383aea800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784938537.894447:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.154@tcp failed (-11) 00000100:00100000:3.0:1784938537.894451:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:16388:1871643350958080:192.168.202.154@tcp:38:kworker.0 00000100:00080000:3.0:1784938537.894460:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b36a7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784938537.894464:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.154@tcp failed (-11) 00000100:00100000:3.0:1784938537.894467:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:16388:1871643350958720:192.168.202.154@tcp:38:kworker.0 00000040:00080000:2.0:1784938537.894635:0:28416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].4, 64 off8448 00000100:00080000:3.0:1784938537.895250:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1784938537.896011:0:28416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00010000:00010000:1.0:1784938537.897417:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938537.897647:0:21161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350958336 00000100:00100000:2.0:1784938537.897792:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350958464:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938537.897952:0:21161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350958336 00000100:00100000:0.0:1784938537.898031:0:21161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 135 00000100:00100000:0.0:1784938537.898040:0:21161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:16388:x1871643350958336:12345-192.168.202.154@tcp:38:kworker.0 00000100:00100000:0.0:1784938537.898136:0:21161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:16388:x1871643350958336:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 94us (4713us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784938537.898159:0:21161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 135 00000100:00080000:3.0:1784938537.898610:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b4113800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784938537.898618:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.154@tcp failed (-11) 00000100:00100000:3.0:1784938537.898622:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:16388:1871643350958336:192.168.202.154@tcp:38:kworker.0 00000040:00080000:3.0:1784938537.898743:0:28422:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1784938537.898749:0:28422:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1784938537.899649:0:28416:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784938537.899675:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784938537.899711:0:28416:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1784938537.899730:0:28416:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b044d4128f9f567 00000100:00080000:2.0:1784938537.899740:0:28416:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 192.168.202.154@tcp last attempt 0 00000100:00080000:2.0:1784938537.899747:0:28416:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f238f8bf000 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:2.0:1784938537.899778:0:28416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b68a8000 x1871643350958848/t0(0) o8->lustre-OST0000-osc-MDT0000@192.168.202.154@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784938537.899803:0:28416:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1784938537.899859:0:28416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938537.899863:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938537.899864:0:28416:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1784938537.899867:0:28416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784938537.899870:0:28416:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1784938537.899871:0:28416:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784938537.899873:0:28416:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784938537.899874:0:28416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784938537.899876:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938537.899877:0:28416:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784938537.899880:0:28416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784938537.899884:0:28416:0:(obd_mount.c:957:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1784938537.899887:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938537.899888:0:28416:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1784938537.899891:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784938537.899895:0:28416:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.154@tcp to nid 0x20000c0a8ca9a (192.168.202.154@tcp) 00000020:01000000:2.0:1784938537.900082:0:28416:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1784938537.900085:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784938537.900097:0:28416:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9f248fac8000) 00000020:00000080:2.0:1784938537.900114:0:28416:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1784938537.900210:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784938537.900336:0:28416:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1784938537.900342:0:28416:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:2.0:1784938537.900348:0:28416:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b044d4128f9f575 00010000:00080000:2.0:1784938537.900378:0:28416:0:(ldlm_lib.c:125:import_set_conn()) imp ffff9f2389c2f000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.154@tcp at head 00010000:00010000:2.0:1784938537.900586:0:28416:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:2.0:1784938537.900663:0:28416:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1784938537.900678:0:28416:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1784938537.901259:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350958848:192.168.202.154@tcp:8:llog_process_th.0 00000100:00100000:3.0:1784938537.901514:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938537.901543:0:25723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350958848 00000100:00100000:3.0:1784938537.901549:0:25723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350958848 00000100:00100000:3.0:1784938537.901602:0:25723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 1004 00000100:00100000:3.0:1784938537.901609:0:25723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:16388:x1871643350958848:12345-192.168.202.154@tcp:8:llog_process_th.0 00010000:00080000:3.0:1784938537.901639:0:25723:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@192.168.202.154@tcp t0 exp 0000000000000000 cur 804 last 0 00000020:00000080:3.0:1784938537.901665:0:25723:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b044d4128f9f57c 00002000:00100000:3.0:1784938537.901675:0:25723:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9f2386217800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cb ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1784938537.901679:0:25723:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1784938537.901682:0:25723:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1784938537.901747:0:25723:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1784938537.901769:0:25723:0:(import.c:65:import_set_state_nolock()) ffff9f2386216000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784938537.901807:0:25723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:16388:x1871643350958848:12345-192.168.202.154@tcp:8:llog_process_th.0 Request processed in 197us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938537.901815:0:25723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 1004 00000100:00100000:3.0:1784938537.901927:0:16388:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784938537.901935:0:16388:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1784938537.901943:0:16388:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1784938537.901948:0:16388:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1784938537.901951:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f238f8bf000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1784938537.901958:0:16388:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1784938537.901963:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350958848:192.168.202.154@tcp:8:llog_process_th.0 00000004:00080000:3.0:1784938537.901984:0:28422:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1784938537.902035:0:28422:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804068889357ns, next at 0ns, rc = 0 00080000:00080000:3.0:1784938537.902042:0:28422:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1784938537.903750:0:16389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000040:00080000:2.0:1784938537.906589:0:28416:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784938537.907044:0:28416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].4, 64 off8448 00000040:00080000:2.0:1784938537.907235:0:28416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:0.0:1784938537.908031:0:28424:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1784938537.908036:0:28424:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 4 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1784938537.909987:0:28416:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784938537.910000:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784938537.910042:0:28416:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1784938537.910069:0:28416:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b044d4128f9f583 00000100:00080000:0.0:1784938537.910082:0:28416:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 192.168.202.154@tcp last attempt 0 00000100:00080000:0.0:1784938537.910094:0:28416:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f2389c2f000 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:0.0:1784938537.910586:0:28416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b68d9c00 x1871643350959104/t0(0) o8->lustre-OST0001-osc-MDT0000@192.168.202.154@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784938537.910657:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350959104:192.168.202.154@tcp:8:llog_process_th.0 00000100:00080000:0.0:1784938537.910813:0:28416:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1784938537.910893:0:28416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938537.910963:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938537.910966:0:28416:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1784938537.910970:0:28416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938537.910974:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938537.910975:0:28416:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784938537.910978:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784938537.910980:0:28416:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784938537.910982:0:28416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938537.910984:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938537.910985:0:28416:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1784938537.910987:0:28416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938537.910990:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938537.910991:0:28416:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784938537.910995:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1784938537.911031:0:28416:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68d9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e07296-2a01-411c-abf2-6d190cb69ef0:28416:1871643350959232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938537.911094:0:28416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938537.911132:0:28416:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24850230c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938537.911578:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938537.911906:0:28415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350959232 00000100:00100000:1.0:1784938537.911914:0:28415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350959232 00000100:00100000:1.0:1784938537.912195:0:28415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784938537.912205:0:28415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b4fbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:73e07296-2a01-411c-abf2-6d190cb69ef0+8:28416:x1871643350959232:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938537.912797:0:28415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b4fbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:73e07296-2a01-411c-abf2-6d190cb69ef0+8:28416:x1871643350959232:12345-0@lo:502:llog_process_th.0 Request processed in 591us (1700us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938537.912806:0:28415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784938537.913319:0:28416:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68d9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e07296-2a01-411c-abf2-6d190cb69ef0:28416:1871643350959232:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784938537.913357:0:28416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938537.913363:0:28416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938537.913366:0:28416:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784938537.913370:0:28416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:0.0:1784938537.913503:0:25729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350959104 00000100:00100000:0.0:1784938537.913511:0:25729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350959104 00000100:00100000:0.0:1784938537.913541:0:25729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 1005 00000100:00100000:0.0:1784938537.913547:0:25729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:16388:x1871643350959104:12345-192.168.202.154@tcp:8:llog_process_th.0 00010000:00080000:0.0:1784938537.913587:0:25729:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@192.168.202.154@tcp t0 exp 0000000000000000 cur 804 last 0 00000020:00000080:0.0:1784938537.913617:0:25729:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b044d4128f9f58a 00002000:00100000:0.0:1784938537.913628:0:25729:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9f24bd50c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cb ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1784938537.913632:0:25729:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000100:00100000:1.0:1784938537.913635:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350958976:192.168.202.154@tcp:13:osp-pre-0-0.0 00002000:00100000:0.0:1784938537.913635:0:25729:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784938537.913712:0:25729:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784938537.913736:0:25729:0:(import.c:65:import_set_state_nolock()) ffff9f24bd50c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784938537.913771:0:25729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:16388:x1871643350959104:12345-192.168.202.154@tcp:8:llog_process_th.0 Request processed in 223us (2194us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938537.913779:0:25729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 1005 00000100:00100000:2.0:1784938537.913974:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938537.914022:0:21154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350958976 00000100:00100000:2.0:1784938537.914026:0:21154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350958976 00000100:00100000:2.0:1784938537.914065:0:21154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 108 00000100:00100000:2.0:1784938537.914072:0:21154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:16389:x1871643350958976:12345-192.168.202.154@tcp:13:osp-pre-0-0.0 00002000:00000024:2.0:1784938537.914094:0:21154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 271040 pending 0 free 313057280 avail 285245440 00000100:00100000:2.0:1784938537.914136:0:21154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:16389:x1871643350958976:12345-192.168.202.154@tcp:13:osp-pre-0-0.0 Request processed in 63us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938537.914164:0:21154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 108 00000100:00100000:1.0:1784938537.914545:0:16388:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784938537.914565:0:16388:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1784938537.914573:0:16388:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784938537.914579:0:16388:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1784938537.914581:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f2389c2f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1784938537.914601:0:16388:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784938537.914607:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:16388:1871643350959104:192.168.202.154@tcp:8:llog_process_th.0 00000100:00100000:1.0:1784938537.914641:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350958976:192.168.202.154@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938537.914796:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350959360:192.168.202.154@tcp:13:osp-pre-1-0.0 00000004:00080000:0.0:1784938537.914884:0:28404:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1784938537.914998:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000020:01000000:3.0:1784938537.915165:0:28403:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1784938537.915203:0:28403:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1784938537.915392:0:28403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7a00/0x7b044d4128f9f4db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f4e2 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938537.915405:0:28403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7a00/0x7b044d4128f9f4db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f4e2 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938537.915414:0:28403:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9f2383ab1800 from 1 10000000:01000000:3.0:1784938537.915417:0:28403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000004:00080000:0.0:1784938537.915422:0:28424:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00010000:3.0:1784938537.915443:0:28403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6200/0x7b044d4128f9f591 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938537.915450:0:28403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6200/0x7b044d4128f9f591 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938537.915458:0:28403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6200/0x7b044d4128f9f591 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938537.915472:0:28403:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:28403:1871643350959488:0@lo:101:mount.lustre.0 00000004:00080000:0.0:1784938537.915482:0:28424:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804082336390ns, next at 0ns, rc = 0 00080000:00080000:0.0:1784938537.915488:0:28424:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1784938537.915508:0:28403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938537.915532:0:28403:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b6a64d80 going to sleep for 11 seconds 00000100:00080000:3.0:1784938537.915547:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938537.915577:0:28410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350959488 00000100:00100000:3.0:1784938537.915583:0:28410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350959488 00000100:00100000:3.0:1784938537.915617:0:28410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784938537.915625:0:28410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b4fbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+8:28403:x1871643350959488:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938537.915636:0:28410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938537.915650:0:28410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f238d3a7200/0x7b044d4128f9f598 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9f591 expref: -99 pid: 28410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938537.916360:0:28410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f238d3a7200/0x7b044d4128f9f598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9f591 expref: 9 pid: 28410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938537.916371:0:28410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f238d3a7200/0x7b044d4128f9f598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9f591 expref: 9 pid: 28410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938537.916380:0:28410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a7200, rc 0) 00000100:00100000:3.0:1784938537.916539:0:28410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b4fbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+9:28403:x1871643350959488:12345-0@lo:101:mount.lustre.0 Request processed in 914us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938537.916547:0:28410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784938537.916620:0:28403:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:28403:1871643350959488:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938537.916636:0:28403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6200/0x7b044d4128f9f591 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f598 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938537.916645:0:28403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6200/0x7b044d4128f9f591 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9f598 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938537.916781:0:21154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350959360 00000100:00100000:2.0:1784938537.916787:0:21154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350959360 00000100:00100000:2.0:1784938537.916938:0:21154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 109 00000100:00100000:2.0:1784938537.916945:0:21154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:16391:x1871643350959360:12345-192.168.202.154@tcp:13:osp-pre-1-0.0 00002000:00000024:2.0:1784938537.916972:0:21154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 271040 pending 0 free 313057280 avail 285245440 00000100:00100000:2.0:1784938537.917021:0:21154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:16391:x1871643350959360:12345-192.168.202.154@tcp:13:osp-pre-1-0.0 Request processed in 76us (2024us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938537.917027:0:21154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 109 00000100:00100000:2.0:1784938537.917456:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350959360:192.168.202.154@tcp:13:osp-pre-1-0.0 00000100:00080000:1.0:1784938537.917540:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938537.917584:0:28403:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:28403:1871643350959616:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1784938537.917620:0:28403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938537.917648:0:28403:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24850230c0 going to sleep for 11 seconds 00000004:00080000:0.0:1784938537.918215:0:28404:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1784938537.918512:0:28415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350959616 00000100:00100000:1.0:1784938537.918519:0:28415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350959616 00000100:00100000:1.0:1784938537.918608:0:28415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784938537.918618:0:28415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b4fbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:73e07296-2a01-411c-abf2-6d190cb69ef0+9:28403:x1871643350959616:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1784938537.918637:0:28415:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1784938537.918665:0:28415:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1784938537.918670:0:28415:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1784938537.918672:0:28415:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1784938537.918674:0:28415:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 17 00000100:00100000:1.0:1784938537.918777:0:28415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b4fbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:73e07296-2a01-411c-abf2-6d190cb69ef0+9:28403:x1871643350959616:12345-0@lo:256:mount.lustre.0 Request processed in 161us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938537.918785:0:28415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784938537.918867:0:28403:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:28403:1871643350959616:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1784938537.919527:0:28403:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784938537.919551:0:28403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6200/0x7b044d4128f9f591 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f598 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938537.919572:0:28403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6200/0x7b044d4128f9f591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f598 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938537.919580:0:28403:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9f2383ab1800 from 1 10000000:01000000:3.0:1784938537.919583:0:28403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784938537.919622:0:28403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7000/0x7b044d4128f9f59f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938537.919630:0:28403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7000/0x7b044d4128f9f59f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938537.919639:0:28403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7000/0x7b044d4128f9f59f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938537.919663:0:28403:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:28403:1871643350959744:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784938537.919705:0:28403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938537.920509:0:28403:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d077cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938537.920589:0:28412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350959744 00000100:00100000:0.0:1784938537.920597:0:28412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350959744 00000100:00100000:0.0:1784938537.920691:0:28412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784938537.920701:0:28412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b4fbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+9:28403:x1871643350959744:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938537.920716:0:28412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938537.920735:0:28412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f24b4056200/0x7b044d4128f9f5a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9f59f expref: -99 pid: 28412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938537.920760:0:28412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f24b4056200/0x7b044d4128f9f5a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9f59f expref: 10 pid: 28412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938537.920771:0:28412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f24b4056200/0x7b044d4128f9f5a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9f59f expref: 10 pid: 28412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938537.920780:0:28412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b4056200, rc 0) 00000100:00100000:0.0:1784938537.920823:0:28412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b4fbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+10:28403:x1871643350959744:12345-0@lo:101:mount.lustre.0 Request processed in 125us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938537.920831:0:28412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784938537.921126:0:28403:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:28403:1871643350959744:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938537.921163:0:28403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7000/0x7b044d4128f9f59f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f5a6 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938537.921173:0:28403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7000/0x7b044d4128f9f59f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9f5a6 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938537.921255:0:28403:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:28403:1871643350959872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938537.921288:0:28403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938537.921309:0:28403:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d077cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938537.921326:0:28411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350959872 00000100:00100000:3.0:1784938537.921330:0:28411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350959872 00000100:00100000:3.0:1784938537.921352:0:28411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784938537.921359:0:28411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b4fbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+10:28403:x1871643350959872:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938537.921491:0:28411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b4fbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+10:28403:x1871643350959872:12345-0@lo:501:mount.lustre.0 Request processed in 132us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938537.921498:0:28411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784938537.921530:0:28403:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:28403:1871643350959872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938537.921570:0:28403:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:28403:1871643350960000:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784938537.921614:0:28403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938537.921627:0:28403:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238d077cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938537.921639:0:28411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350960000 00000100:00100000:3.0:1784938537.921642:0:28411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350960000 00000100:00100000:3.0:1784938537.921671:0:28411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784938537.921676:0:28411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248f91fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+10:28403:x1871643350960000:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784938537.921742:0:28411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248f91fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+10:28403:x1871643350960000:12345-0@lo:503:mount.lustre.0 Request processed in 65us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938537.921748:0:28411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784938537.921784:0:28403:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:28403:1871643350960000:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784938537.922675:0:28426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68dbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e07296-2a01-411c-abf2-6d190cb69ef0:28426:1871643350960128:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938537.922726:0:28426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938537.922798:0:28426:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828cee40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938537.923011:0:28411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350960128 00000100:00100000:3.0:1784938537.923017:0:28411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350960128 00000100:00100000:3.0:1784938537.923096:0:28411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784938537.923105:0:28411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248f91f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+10:28426:x1871643350960128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938537.923876:0:28411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248f91f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+10:28426:x1871643350960128:12345-0@lo:502:llog_process_th.0 Request processed in 770us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938537.923886:0:28411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784938537.924060:0:28426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68dbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e07296-2a01-411c-abf2-6d190cb69ef0:28426:1871643350960128:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784938537.924096:0:28426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784938537.924109:0:28426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938537.924113:0:28426:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1784938537.924132:0:28426:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f2383ab1800 00000020:00000080:1.0:1784938537.924136:0:28426:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784938537.924171:0:28426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938537.924175:0:28426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938537.924177:0:28426:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1784938537.924180:0:28426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784938537.924183:0:28426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938537.924184:0:28426:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1784938537.924187:0:28426:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f2383ab1800 00000020:00000080:1.0:1784938537.924189:0:28426:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784938537.924287:0:28426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388246300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e07296-2a01-411c-abf2-6d190cb69ef0:28426:1871643350960256:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938537.924336:0:28426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938537.924371:0:28415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350960256 00000100:00100000:1.0:1784938537.924376:0:28415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350960256 00000100:00100000:1.0:1784938537.924403:0:28415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784938537.924410:0:28415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248f91ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:73e07296-2a01-411c-abf2-6d190cb69ef0+11:28426:x1871643350960256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938537.924495:0:28415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248f91ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:73e07296-2a01-411c-abf2-6d190cb69ef0+11:28426:x1871643350960256:12345-0@lo:502:llog_process_th.0 Request processed in 85us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938537.924502:0:28415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784938537.924545:0:28426:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f249042ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938537.924571:0:28426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388246300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e07296-2a01-411c-abf2-6d190cb69ef0:28426:1871643350960256:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784938537.924591:0:28426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938537.924595:0:28426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938537.924596:0:28426:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1784938537.924600:0:28426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1784938537.927262:0:28403:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1784938537.927305:0:28403:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784938537.927326:0:28403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7000/0x7b044d4128f9f59f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f5a6 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938537.927339:0:28403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7000/0x7b044d4128f9f59f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f5a6 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938537.927401:0:28403:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784938537.927406:0:28403:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f2383ab1800 10000000:01000000:2.0:1784938537.927409:0:28403:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f2383ab1800 10000000:01000000:2.0:1784938537.927413:0:28403:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784938537.927420:0:28403:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9f2383ab1800 from 1 10000000:01000000:2.0:1784938537.927422:0:28403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784938537.927458:0:28403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238d17a200/0x7b044d4128f9f5ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938537.927467:0:28403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f238d17a200/0x7b044d4128f9f5ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938537.927477:0:28403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f238d17a200/0x7b044d4128f9f5ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938537.927501:0:28403:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:28403:1871643350960384:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784938537.927575:0:28403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938537.927604:0:28403:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238ee370c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938537.928012:0:28415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350960384 00000100:00100000:1.0:1784938537.928020:0:28415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350960384 00000100:00100000:1.0:1784938537.928072:0:28415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784938537.928081:0:28415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248f91f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:73e07296-2a01-411c-abf2-6d190cb69ef0+10:28403:x1871643350960384:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938537.928095:0:28415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938537.928110:0:28415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f238c559a00/0x7b044d4128f9f5b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9f5ad expref: -99 pid: 28415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.928163:0:28415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f238c559a00/0x7b044d4128f9f5b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9f5ad expref: 11 pid: 28415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.928175:0:28415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f238c559a00/0x7b044d4128f9f5b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9f5ad expref: 11 pid: 28415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.928184:0:28415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c559a00, rc 0) 00000100:00100000:1.0:1784938537.928237:0:28415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248f91f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:73e07296-2a01-411c-abf2-6d190cb69ef0+11:28403:x1871643350960384:12345-0@lo:101:mount.lustre.0 Request processed in 157us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938537.928244:0:28415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784938537.928788:0:28403:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:28403:1871643350960384:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784938537.928806:0:28403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f238d17a200/0x7b044d4128f9f5ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f5b4 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938537.928816:0:28403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f238d17a200/0x7b044d4128f9f5ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9f5b4 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938537.928892:0:28403:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:28403:1871643350960512:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784938537.929028:0:28403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938537.929059:0:28403:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238ee370c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938537.929076:0:28410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350960512 00000100:00100000:2.0:1784938537.929081:0:28410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350960512 00000100:00100000:2.0:1784938537.929111:0:28410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784938537.929131:0:28410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248f91d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+11:28403:x1871643350960512:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784938537.929647:0:28410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248f91d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+11:28403:x1871643350960512:12345-0@lo:501:mount.lustre.0 Request processed in 516us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938537.929731:0:28410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784938537.930039:0:28403:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:28403:1871643350960512:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938537.930077:0:28403:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:28403:1871643350960640:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784938537.931018:0:28403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938537.931065:0:28403:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24867a3180 going to sleep for 11 seconds 00000100:00100000:2.0:1784938537.931233:0:28411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350960640 00000100:00100000:2.0:1784938537.931240:0:28411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350960640 00000100:00100000:2.0:1784938537.931286:0:28411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784938537.931295:0:28411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248f91f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+11:28403:x1871643350960640:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784938537.931410:0:28411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248f91f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+11:28403:x1871643350960640:12345-0@lo:503:mount.lustre.0 Request processed in 116us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938537.931418:0:28411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784938537.931581:0:28403:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:28403:1871643350960640:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784938537.934082:0:28428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68d9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e07296-2a01-411c-abf2-6d190cb69ef0:28428:1871643350960768:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938537.934353:0:28428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938537.934397:0:28428:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828ce300 going to sleep for 11 seconds 00000100:00100000:2.0:1784938537.934465:0:28415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350960768 00000100:00100000:2.0:1784938537.934472:0:28415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350960768 00000100:00100000:2.0:1784938537.934523:0:28415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784938537.934532:0:28415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248f91d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:73e07296-2a01-411c-abf2-6d190cb69ef0+11:28428:x1871643350960768:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938537.934783:0:28415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248f91d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:73e07296-2a01-411c-abf2-6d190cb69ef0+11:28428:x1871643350960768:12345-0@lo:502:llog_process_th.0 Request processed in 250us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938537.934792:0:28415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784938537.935751:0:28428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68d9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e07296-2a01-411c-abf2-6d190cb69ef0:28428:1871643350960768:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1784938537.935825:0:28428:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1784938537.936009:0:28428:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9f2389e799c0) 00000020:00000080:0.0:1784938537.936039:0:28428:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1784938537.937719:0:28428:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f2383ab1800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1784938537.937725:0:28428:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f2383ab1800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1784938537.937729:0:28428:0:(obd_mount.c:706:lustre_put_lsi()) put ffff9f2383ab1800 4 00010000:00080000:0.0:1784938537.937769:0:28428:0:(ldlm_lib.c:125:import_set_conn()) imp ffff9f24b4078000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.154@tcp at head 00010000:00010000:0.0:1784938537.943584:0:28428:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1784938537.943988:0:28428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1784938537.944038:0:28428:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1784938537.944052:0:28428:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x7b044d4128f9f5c2 00000100:00080000:0.0:1784938537.944064:0:28428:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 192.168.202.154@tcp last attempt 0 00000100:00080000:0.0:1784938537.944075:0:28428:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9f24b4078000 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:0.0:1784938537.945280:0:28428:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24b68d9180 x1871643350960896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784938537.945333:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:16388:1871643350960896:192.168.202.154@tcp:38:llog_process_th.0 00000100:00100000:0.0:1784938537.945608:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938537.945639:0:26607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350960896 00000100:00100000:0.0:1784938537.945646:0:26607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350960896 00000100:00100000:0.0:1784938537.946568:0:26607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 45 00000100:00100000:0.0:1784938537.946577:0:26607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16388:x1871643350960896:12345-192.168.202.154@tcp:38:llog_process_th.0 00000100:00100000:0.0:1784938537.946636:0:26607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:16388:x1871643350960896:12345-192.168.202.154@tcp:38:llog_process_th.0 Request processed in 58us (1029us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784938537.946643:0:26607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 45 00000100:00080000:2.0:1784938537.947422:0:28428:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1784938537.949774:0:28428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68a8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e07296-2a01-411c-abf2-6d190cb69ef0:28428:1871643350961024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938537.949998:0:28428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938537.950028:0:28410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350961024 00000100:00100000:3.0:1784938537.950035:0:28410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350961024 00000100:00100000:2.0:1784938537.950037:0:28428:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f248fb1cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938537.950077:0:28410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784938537.950085:0:28410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248f91e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+11:28428:x1871643350961024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938537.950221:0:28410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248f91e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+11:28428:x1871643350961024:12345-0@lo:502:llog_process_th.0 Request processed in 137us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938537.950230:0:28410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784938537.950397:0:28428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68a8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e07296-2a01-411c-abf2-6d190cb69ef0:28428:1871643350961024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938537.950436:0:28428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68a8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e07296-2a01-411c-abf2-6d190cb69ef0:28428:1871643350961152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938537.950466:0:28428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938537.950490:0:28428:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b14869c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938537.950495:0:28411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350961152 00000100:00100000:3.0:1784938537.950498:0:28411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350961152 00000100:00100000:3.0:1784938537.950518:0:28411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784938537.950524:0:28411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248f91e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+11:28428:x1871643350961152:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938537.950568:0:16388:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784938537.950576:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b4078000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784938537.950583:0:16388:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.154@tcp failed (-11) 00000100:00100000:1.0:1784938537.950586:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:16388:1871643350960896:192.168.202.154@tcp:38:llog_process_th.0 00000100:00100000:3.0:1784938537.950603:0:28411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248f91e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+11:28428:x1871643350961152:12345-0@lo:502:llog_process_th.0 Request processed in 79us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938537.950610:0:28411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784938537.950677:0:28428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68a8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e07296-2a01-411c-abf2-6d190cb69ef0:28428:1871643350961152:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784938537.950695:0:28428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1784938537.950752:0:28403:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1784938537.950780:0:28403:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784938537.950804:0:28403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238d17a200/0x7b044d4128f9f5ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f5b4 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938537.950814:0:28403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f238d17a200/0x7b044d4128f9f5ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f5b4 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1784938537.950859:0:28403:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1784938537.950862:0:28403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784938537.950864:0:28403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938537.950865:0:28403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938537.950866:0:28403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938537.950868:0:28403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938537.950869:0:28403:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784938537.950870:0:28403:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784938537.950872:0:28403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938537.950874:0:28403:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784938537.950878:0:28403:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1784938537.950881:0:28403:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784938537.950882:0:28403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784938537.950883:0:28403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938537.950884:0:28403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938537.950886:0:28403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938537.950887:0:28403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938537.950888:0:28403:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784938537.950889:0:28403:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784938537.950890:0:28403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938537.950891:0:28403:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784938537.950904:0:28403:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1784938537.950913:0:28403:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:28403:1871643350961280:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784938537.950943:0:28403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938537.950965:0:28403:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24906db900 going to sleep for 11 seconds 00000100:00100000:2.0:1784938537.951014:0:28410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350961280 00000100:00100000:2.0:1784938537.951018:0:28410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350961280 00000100:00100000:2.0:1784938537.951049:0:28410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784938537.951056:0:28410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248f91c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+11:28403:x1871643350961280:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784938537.951077:0:28410:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1784938537.951092:0:28410:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1784938537.953713:0:28410:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784938537.953764:0:28410:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1784938537.954330:0:28410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248f91c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+11:28403:x1871643350961280:12345-0@lo:253:mount.lustre.0 Request processed in 3268us (3379us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938537.954342:0:28410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 20000000:01000000:0.0:1784938537.954490:0:28413:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784938537.954496:0:28413:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784938537.954516:0:28413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f24b4056000/0x7b044d4128f9f5c9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938537.954530:0:28413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f238d3a7200/0x7b044d4128f9f598 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9f591 expref: 10 pid: 28410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938537.954538:0:28413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f24b4056000/0x7b044d4128f9f5c9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938537.954591:0:28413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f238d3a7200/0x7b044d4128f9f598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b044d4128f9f591 expref: 10 pid: 28410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938537.954608:0:28413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f238d3a7200/0x7b044d4128f9f598 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b044d4128f9f591 expref: 10 pid: 28410 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938537.954621:0:28413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68d9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:28413:1871643350961408:0@lo:104: 00000100:00100000:0.0:1784938537.954674:0:28413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938537.954713:0:28413:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828ce780 going to sleep for 11 seconds 00000100:00100000:1.0:1784938537.954779:0:19218:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784938537.954803:0:19218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350961408 00000100:00100000:1.0:1784938537.954809:0:19218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350961408 00000100:00100000:1.0:1784938537.954983:0:19218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784938537.954994:0:19218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238890c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73e07296-2a01-411c-abf2-6d190cb69ef0+3:28413:x1871643350961408:12345-0@lo:104: 00010000:00010000:1.0:1784938537.955008:0:19218:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6200/0x7b044d4128f9f591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b044d4128f9f598 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.955068:0:19218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784938537.955074:0:19218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238890c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73e07296-2a01-411c-abf2-6d190cb69ef0+3:28413:x1871643350961408:12345-0@lo:104: Request processed in 83us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938537.955080:0:19218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:1.0:1784938537.955345:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938537.955354:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6200/0x7b044d4128f9f591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b044d4128f9f598 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.955362:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a6200 already unused, calling callback (ffffffffc1390c20) 10000000:00010000:1.0:1784938537.955365:0:25733:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6200/0x7b044d4128f9f591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b044d4128f9f598 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.955374:0:25733:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6200/0x7b044d4128f9f591 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b044d4128f9f598 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784938537.955382:0:25733:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6200/0x7b044d4128f9f591 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b044d4128f9f598 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938537.955388:0:25733:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784938537.955419:0:25733:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6200/0x7b044d4128f9f591 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b044d4128f9f598 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.955425:0:25733:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784938537.955447:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6200/0x7b044d4128f9f591 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b044d4128f9f598 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.955454:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6200/0x7b044d4128f9f591 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b044d4128f9f598 expref: -99 pid: 28403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.955475:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938537.955477:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938537.955479:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938537.955569:0:28413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68d9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:28413:1871643350961408:0@lo:104: 00010000:00010000:0.0:1784938537.955588:0:28413:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f24b4056000/0x7b044d4128f9f5c9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938537.955732:0:28403:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e07296-2a01-411c-abf2-6d190cb69ef0:28403:1871643350961280:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784938537.955745:0:28403:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784938537.955748:0:28403:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784938537.955750:0:28403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784938537.955751:0:28403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784938537.955753:0:28403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784938537.955754:0:28403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784938537.955755:0:28403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784938537.955756:0:28403:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784938537.955758:0:28403:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784938537.955760:0:28403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784938537.955761:0:28403:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784938537.955775:0:28403:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1784938537.958391:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e07296-2a01-411c-abf2-6d190cb69ef0:16392:1871643350961536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938537.958481:0:16392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938537.962202:0:22955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350961536 00000100:00100000:1.0:1784938537.962282:0:22955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350961536 00010000:00010000:1.0:1784938537.962325:0:22955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f238d3a7200/0x7b044d4128f9f598 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b044d4128f9f591 expref: 11 pid: 28410 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938537.962361:0:22955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:1.0:1784938537.962371:0:22955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:73e07296-2a01-411c-abf2-6d190cb69ef0+11:16392:x1871643350961536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938537.962386:0:22955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938537.962392:0:22955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f238d3a7200/0x7b044d4128f9f598 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b044d4128f9f591 expref: 11 pid: 28410 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.962405:0:22955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f238d3a7200/0x7b044d4128f9f598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b044d4128f9f591 expref: 11 pid: 28410 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.962422:0:22955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f238d3a7200/0x7b044d4128f9f598 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b044d4128f9f591 expref: 11 pid: 28410 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.962437:0:22955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f24b4056000/0x7b044d4128f9f5c9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.962445:0:22955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f24b4056000/0x7b044d4128f9f5c9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784938537.962463:0:22955:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007968038s 00010000:00010000:1.0:1784938537.962467:0:22955:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f24b4056000/0x7b044d4128f9f5c9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.962478:0:22955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f24b4056000/0x7b044d4128f9f5c9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.962484:0:22955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f24b4056000/0x7b044d4128f9f5c9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.962490:0:22955:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f24b4056000/0x7b044d4128f9f5c9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.962496:0:22955:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4056000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:1.0:1784938537.962500:0:22955:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f24b4056000/0x7b044d4128f9f5c9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.962507:0:22955:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f24b4056000/0x7b044d4128f9f5c9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.962520:0:22955:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f24b4056000/0x7b044d4128f9f5c9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.962529:0:22955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938537.962619:0:22955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:73e07296-2a01-411c-abf2-6d190cb69ef0+10:16392:x1871643350961536:12345-0@lo:103:ldlm_bl.0 Request processed in 249us (4138us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938537.962626:0:22955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00010000:00010000:1.0:1784938537.963361:0:28413:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f24b4056000/0x7b044d4128f9f5c9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.963372:0:28413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f24b4056000/0x7b044d4128f9f5c9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938537.963379:0:28413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f24b4056000/0x7b044d4128f9f5c9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 28413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938537.967570:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e07296-2a01-411c-abf2-6d190cb69ef0:16392:1871643350961536:0@lo:103:ldlm_bl.0 00000040:01000000:1.0:1784938537.984856:0:28403:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1784938537.985482:0:28435:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1784938537.985635:0:28403:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1784938537.986680:0:28436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388246300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:28436:1871643350961664:192.168.202.154@tcp:1000:lod0000_rec0001.0 00000100:00100000:1.0:1784938537.986782:0:28436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34300 going to sleep for 11 seconds 00000040:01000000:3.0:1784938537.987229:0:28403:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1784938537.987269:0:28403:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1784938537.987697:0:28403:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1784938537.987706:0:28403:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1784938537.987739:0:28403:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784938537.988759:0:28403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1784938537.989332:0:28403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1784938537.989365:0:28403:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1784938537.989432:0:28403:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1784938537.989948:0:28403:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/32) registered 00000040:00080000:0.0:1784938537.991054:0:28435:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784938537.993264:0:28435:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1784938537.993359:0:28435:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1784938537.993646:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938537.993681:0:25714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350961664 00000100:00100000:0.0:1784938537.993688:0:25714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350961664 00000100:00100000:0.0:1784938537.993730:0:25714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 136 00000100:00100000:0.0:1784938537.993739:0:25714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:28436:x1871643350961664:12345-192.168.202.154@tcp:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784938537.993834:0:25714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:28436:x1871643350961664:12345-192.168.202.154@tcp:1000:lod0000_rec0001.0 Request processed in 96us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938537.993842:0:25714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 136 00000100:00100000:0.0:1784938537.993975:0:28436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388246300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:28436:1871643350961664:192.168.202.154@tcp:1000:lod0000_rec0001.0 00000040:01000000:0.0:1784938537.994012:0:28436:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1784938537.994059:0:28436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68db100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:28436:1871643350961792:192.168.202.154@tcp:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784938537.994201:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938537.994220:0:21161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350961792 00000100:00100000:0.0:1784938537.994224:0:21161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350961792 00000100:00100000:0.0:1784938537.994247:0:21161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 137 00000100:00100000:0.0:1784938537.994253:0:21161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:28436:x1871643350961792:12345-192.168.202.154@tcp:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784938537.994462:0:21161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:28436:x1871643350961792:12345-192.168.202.154@tcp:1000:lod0000_rec0001.0 Request processed in 209us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938537.994470:0:21161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 137 00000100:00100000:0.0:1784938537.994546:0:28436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24828cec00 going to sleep for 11 seconds 00000020:00080000:2.0:1784938537.995365:0:28434:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1784938537.995372:0:28434:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1784938537.995636:0:28436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68db100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:28436:1871643350961792:192.168.202.154@tcp:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784938537.996068:0:28436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68a8000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:28436:1871643350961920:192.168.202.154@tcp:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784938537.996600:0:28436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b4050300 going to sleep for 11 seconds 00000100:00100000:0.0:1784938537.996849:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938537.997192:0:21160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350961920 00000100:00100000:3.0:1784938537.997200:0:21160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350961920 00000100:00100000:3.0:1784938537.997264:0:21160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 138 00000100:00100000:3.0:1784938537.997273:0:21160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:28436:x1871643350961920:12345-192.168.202.154@tcp:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784938537.997356:0:21160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:28436:x1871643350961920:12345-192.168.202.154@tcp:1000:lod0000_rec0001.0 Request processed in 83us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938537.997364:0:21160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 138 00000100:00100000:3.0:1784938537.997521:0:28436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68a8000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:28436:1871643350961920:192.168.202.154@tcp:1000:lod0000_rec0001.0 00000040:00080000:3.0:1784938537.997596:0:28436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784938538.002403:0:28436:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784938538.002494:0:28436:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 1, retries 0 00000004:00080000:3.0:1784938538.002498:0:28436:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:0.0:1784938538.005523:0:28403:0:(ldlm_lib.c:3076:target_recovery_init()) RECOVERY: service lustre-MDT0000, 1 recoverable clients, last_transno 12884901893 00010000:00080000:0.0:1784938538.006594:0:28437:0:(ldlm_lib.c:2876:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 28437 00010000:02000000:0.0:1784938538.006811:0:28437:0:(ldlm_lib.c:2358:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00000020:01000004:1.0:1784938538.012614:0:28403:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784938538.012637:0:28403:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.154@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784938538.012992:0:28403:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1784938538.013016:0:28403:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00010000:00080000:0.0:1784938538.018495:0:28437:0:(ldlm_lib.c:2568:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 1 abort 0 expired 0 00010000:00080000:0.0:1784938538.018503:0:28437:0:(ldlm_lib.c:2568:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 1 abort 0 expired 0 00000020:00000004:1.0:1784938538.019312:0:28403:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784938538.019639:0:28403:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784938538.922000:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784938539.560300:0:19231:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784938539.560309:0:19231:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9f2383ab1800 from 18 10000000:01000000:1.0:1784938539.560316:0:19231:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784938539.560366:0:19231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238c559e00/0x7b044d4128f9f5d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938539.560380:0:19231:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f238c559e00/0x7b044d4128f9f5d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938539.560392:0:19231:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f238c559e00/0x7b044d4128f9f5d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938539.560421:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388244700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350962048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784938539.560492:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938539.560558:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238eb34780 going to sleep for 11 seconds 00000100:00100000:3.0:1784938539.560721:0:28411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350962048 00000100:00100000:3.0:1784938539.560730:0:28411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350962048 00000100:00100000:3.0:1784938539.560785:0:28411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784938539.560794:0:28411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248f91c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+10:19231:x1871643350962048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938539.560809:0:28411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938539.560822:0:28411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f238d3a6400/0x7b044d4128f9f5d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9f5d0 expref: -99 pid: 28411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.560845:0:28411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f238d3a6400/0x7b044d4128f9f5d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9f5d0 expref: 11 pid: 28411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.560856:0:28411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f238d3a6400/0x7b044d4128f9f5d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9f5d0 expref: 11 pid: 28411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.560865:0:28411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a6400, rc 0) 00000100:00100000:3.0:1784938539.560917:0:28411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248f91c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+11:19231:x1871643350962048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938539.560924:0:28411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784938539.560976:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388244700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350962048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938539.560992:0:19231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f238c559e00/0x7b044d4128f9f5d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f5d7 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.561001:0:19231:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f238c559e00/0x7b044d4128f9f5d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9f5d7 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938539.561056:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350962176:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784938539.561087:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938539.561102:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238edcda80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938539.561483:0:28415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350962176 00000100:00100000:1.0:1784938539.561489:0:28415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350962176 00000100:00100000:1.0:1784938539.561525:0:28415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784938539.561532:0:28415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248f91cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:73e07296-2a01-411c-abf2-6d190cb69ef0+11:19231:x1871643350962176:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784938539.561559:0:28415:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784938539.561576:0:28415:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784938539.561580:0:28415:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 18 00000100:00100000:1.0:1784938539.561661:0:28415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248f91cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:73e07296-2a01-411c-abf2-6d190cb69ef0+11:19231:x1871643350962176:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 129us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938539.561671:0:28415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784938539.561757:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350962176:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1784938539.561801:0:19231:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784938539.561809:0:19231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238c559e00/0x7b044d4128f9f5d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f5d7 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.561817:0:19231:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f238c559e00/0x7b044d4128f9f5d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f5d7 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938539.561825:0:19231:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784938539.561827:0:19231:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9f2489215800 from 52 10000000:01000000:3.0:1784938539.561830:0:19231:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784938539.561850:0:19231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6c00/0x7b044d4128f9f5de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.561857:0:19231:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6c00/0x7b044d4128f9f5de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.561864:0:19231:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6c00/0x7b044d4128f9f5de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938539.561877:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350962304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938539.561903:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938539.561934:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238edcda80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938539.562499:0:28411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350962304 00000100:00100000:1.0:1784938539.562506:0:28411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350962304 00000100:00100000:1.0:1784938539.562555:0:28411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784938539.562564:0:28411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248f91e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+11:19231:x1871643350962304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938539.562574:0:28411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938539.562587:0:28411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f238c558200/0x7b044d4128f9f5e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9f5de expref: -99 pid: 28411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938539.562607:0:28411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f238c558200/0x7b044d4128f9f5e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9f5de expref: 12 pid: 28411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938539.562617:0:28411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f238c558200/0x7b044d4128f9f5e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9f5de expref: 12 pid: 28411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938539.562625:0:28411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c558200, rc 0) 00000100:00100000:1.0:1784938539.562669:0:28411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248f91e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+12:19231:x1871643350962304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938539.562675:0:28411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784938539.562753:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350962304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938539.562766:0:19231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6c00/0x7b044d4128f9f5de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f5e5 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.562778:0:19231:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6c00/0x7b044d4128f9f5de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9f5e5 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938539.562834:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350962432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938539.562864:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938539.562893:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238edcda80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938539.562946:0:28412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350962432 00000100:00100000:1.0:1784938539.562951:0:28412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350962432 00000100:00100000:1.0:1784938539.563578:0:28412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784938539.563588:0:28412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248f91dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+12:19231:x1871643350962432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938539.563723:0:28412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248f91dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+12:19231:x1871643350962432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938539.563730:0:28412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784938539.563791:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350962432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938539.563825:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350962560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938539.563871:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938539.575426:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24b6a64d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938539.575560:0:28410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350962560 00000100:00100000:3.0:1784938539.575570:0:28410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350962560 00000100:00100000:3.0:1784938539.575625:0:28410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784938539.575633:0:28410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238cf52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+12:19231:x1871643350962560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938539.575785:0:28410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238cf52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+12:19231:x1871643350962560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (11912us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938539.575793:0:28410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784938539.577454:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350962560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784938539.582606:0:28504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1784938539.582691:0:19231:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1784938539.582715:0:19231:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784938539.582730:0:19231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6c00/0x7b044d4128f9f5de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f5e5 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938539.582743:0:19231:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6c00/0x7b044d4128f9f5de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f5e5 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938539.582755:0:19231:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784938539.582758:0:19231:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9f2489215800 from 15 10000000:01000000:0.0:1784938539.582761:0:19231:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784938539.582808:0:19231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24b4056a00/0x7b044d4128f9f5ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938539.582816:0:19231:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f24b4056a00/0x7b044d4128f9f5ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938539.582830:0:19231:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f24b4056a00/0x7b044d4128f9f5ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938539.583475:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350962688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784938539.591595:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938539.591692:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2498650180 going to sleep for 11 seconds 00000100:00100000:0.0:1784938539.594800:0:28410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350962688 00000100:00100000:0.0:1784938539.594814:0:28410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350962688 00000100:00100000:0.0:1784938539.595607:0:28410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784938539.595620:0:28410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238cf51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+12:19231:x1871643350962688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938539.595638:0:28410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938539.595657:0:28410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f24b4056400/0x7b044d4128f9f5f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9f5ec expref: -99 pid: 28410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938539.595691:0:28410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f24b4056400/0x7b044d4128f9f5f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9f5ec expref: 13 pid: 28410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938539.595703:0:28410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f24b4056400/0x7b044d4128f9f5f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9f5ec expref: 13 pid: 28410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938539.595713:0:28410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24b4056400, rc 0) 00000100:00100000:0.0:1784938539.595813:0:28410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238cf51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+13:19231:x1871643350962688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (4225us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938539.595821:0:28410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784938539.596425:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350962688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938539.596447:0:19231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f24b4056a00/0x7b044d4128f9f5ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f5f3 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.596459:0:19231:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f24b4056a00/0x7b044d4128f9f5ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9f5f3 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938539.596529:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350962816:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784938539.596587:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938539.598830:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238edcd780 going to sleep for 11 seconds 00000100:00100000:1.0:1784938539.598904:0:28415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350962816 00000100:00100000:1.0:1784938539.598912:0:28415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350962816 00000100:00100000:1.0:1784938539.598965:0:28415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784938539.598974:0:28415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238cf50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:73e07296-2a01-411c-abf2-6d190cb69ef0+13:19231:x1871643350962816:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784938539.598997:0:28415:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784938539.599024:0:28415:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784938539.599029:0:28415:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1784938539.599032:0:28415:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1784938539.599034:0:28415:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1784938539.599036:0:28415:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 18 00000100:00100000:1.0:1784938539.599400:0:28415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238cf50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:73e07296-2a01-411c-abf2-6d190cb69ef0+13:19231:x1871643350962816:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 426us (2810us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938539.599408:0:28415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784938539.599485:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350962816:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1784938539.599581:0:19231:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784938539.599592:0:19231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24b4056a00/0x7b044d4128f9f5ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f5f3 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.599602:0:19231:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f24b4056a00/0x7b044d4128f9f5ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f5f3 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938539.599612:0:19231:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1784938539.599615:0:19231:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:3.0:1784938539.599618:0:19231:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1784938539.599651:0:19231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7200/0x7b044d4128f9f5fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.599659:0:19231:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7200/0x7b044d4128f9f5fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.599668:0:19231:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7200/0x7b044d4128f9f5fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938539.599686:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350962944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938539.599717:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938539.599739:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238edcd780 going to sleep for 11 seconds 00000100:00100000:1.0:1784938539.599780:0:28412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350962944 00000100:00100000:1.0:1784938539.599784:0:28412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350962944 00000100:00100000:1.0:1784938539.599816:0:28412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784938539.599823:0:28412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238cf53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+13:19231:x1871643350962944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938539.599831:0:28412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938539.599842:0:28412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f238c559800/0x7b044d4128f9f601 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9f5fa expref: -99 pid: 28412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938539.599860:0:28412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f238c559800/0x7b044d4128f9f601 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9f5fa expref: 14 pid: 28412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938539.599875:0:28412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f238c559800/0x7b044d4128f9f601 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9f5fa expref: 14 pid: 28412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938539.599883:0:28412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c559800, rc 0) 00000100:00100000:1.0:1784938539.599909:0:28412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238cf53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+14:19231:x1871643350962944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938539.599914:0:28412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784938539.599971:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350962944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938539.599983:0:19231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7200/0x7b044d4128f9f5fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f601 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.599992:0:19231:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7200/0x7b044d4128f9f5fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9f601 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938539.600055:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350963072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938539.600079:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938539.600099:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238edcd780 going to sleep for 11 seconds 00000100:00100000:1.0:1784938539.600357:0:28412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350963072 00000100:00100000:1.0:1784938539.600362:0:28412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350963072 00000100:00100000:1.0:1784938539.600387:0:28412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784938539.600393:0:28412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238cf52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+14:19231:x1871643350963072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938539.600524:0:28412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238cf52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+14:19231:x1871643350963072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938539.600532:0:28412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784938539.600620:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350963072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938539.600646:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350963200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938539.600682:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938539.600702:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238edcd780 going to sleep for 11 seconds 00000100:00100000:1.0:1784938539.600735:0:28412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350963200 00000100:00100000:1.0:1784938539.600739:0:28412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350963200 00000100:00100000:1.0:1784938539.600763:0:28412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784938539.600768:0:28412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238cf51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+14:19231:x1871643350963200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938539.601568:0:28412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238cf51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+14:19231:x1871643350963200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 795us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938539.601578:0:28412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784938539.602380:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350963200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784938539.603611:0:28506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:3.0:1784938539.607477:0:19231:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:3.0:1784938539.607513:0:19231:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1784938539.607525:0:19231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7200/0x7b044d4128f9f5fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f601 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.607538:0:19231:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7200/0x7b044d4128f9f5fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f601 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938539.607558:0:19231:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:3.0:1784938539.607561:0:19231:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9f2489215800 from 1 10000000:01000000:3.0:1784938539.607564:0:19231:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1784938539.607606:0:19231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6200/0x7b044d4128f9f608 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.607614:0:19231:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6200/0x7b044d4128f9f608 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.607626:0:19231:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6200/0x7b044d4128f9f608 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938539.607654:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350963328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938539.607729:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938539.607817:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238edcd780 going to sleep for 11 seconds 00000100:00100000:1.0:1784938539.607859:0:28415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350963328 00000100:00100000:1.0:1784938539.607866:0:28415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350963328 00000100:00100000:1.0:1784938539.607947:0:28415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784938539.607956:0:28415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238cf52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:73e07296-2a01-411c-abf2-6d190cb69ef0+14:19231:x1871643350963328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938539.607970:0:28415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938539.607986:0:28415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f238c558a00/0x7b044d4128f9f60f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9f608 expref: -99 pid: 28415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938539.608008:0:28415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f238c558a00/0x7b044d4128f9f60f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9f608 expref: 15 pid: 28415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938539.608342:0:28415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f238c558a00/0x7b044d4128f9f60f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9f608 expref: 15 pid: 28415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938539.608353:0:28415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c558a00, rc 0) 00000100:00100000:1.0:1784938539.608450:0:28415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238cf52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:73e07296-2a01-411c-abf2-6d190cb69ef0+15:19231:x1871643350963328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 495us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938539.608459:0:28415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784938539.608691:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350963328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938539.608709:0:19231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6200/0x7b044d4128f9f608 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f60f expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938539.608719:0:19231:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6200/0x7b044d4128f9f608 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9f60f expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938539.608738:0:19231:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1784938539.608742:0:19231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6200/0x7b044d4128f9f608 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f60f expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938539.608749:0:19231:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6200/0x7b044d4128f9f608 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f60f expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938539.608757:0:19231:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784938539.608759:0:19231:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9f2489215800 from 7 10000000:01000000:0.0:1784938539.608761:0:19231:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784938539.608780:0:19231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24b4056000/0x7b044d4128f9f616 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938539.608788:0:19231:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f24b4056000/0x7b044d4128f9f616 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938539.608794:0:19231:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f24b4056000/0x7b044d4128f9f616 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938539.608810:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350963456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784938539.608838:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938539.608903:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2489041600 going to sleep for 11 seconds 00000100:00100000:1.0:1784938539.608937:0:28415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350963456 00000100:00100000:1.0:1784938539.608941:0:28415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350963456 00000100:00100000:1.0:1784938539.608973:0:28415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784938539.608979:0:28415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238cf50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:73e07296-2a01-411c-abf2-6d190cb69ef0+15:19231:x1871643350963456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938539.608986:0:28415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938539.608994:0:28415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f238c558400/0x7b044d4128f9f61d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9f616 expref: -99 pid: 28415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938539.609007:0:28415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f238c558400/0x7b044d4128f9f61d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9f616 expref: 16 pid: 28415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938539.609015:0:28415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f238c558400/0x7b044d4128f9f61d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9f616 expref: 16 pid: 28415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938539.609021:0:28415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c558400, rc 0) 00000100:00100000:1.0:1784938539.609052:0:28415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238cf50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:73e07296-2a01-411c-abf2-6d190cb69ef0+16:19231:x1871643350963456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938539.609061:0:28415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784938539.609463:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350963456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938539.609475:0:19231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f24b4056000/0x7b044d4128f9f616 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f61d expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938539.609482:0:19231:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f24b4056000/0x7b044d4128f9f616 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9f61d expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938539.609537:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350963584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938539.609575:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938539.609595:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2489041600 going to sleep for 11 seconds 00000100:00100000:1.0:1784938539.609712:0:28412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350963584 00000100:00100000:1.0:1784938539.609716:0:28412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350963584 00000100:00100000:1.0:1784938539.609752:0:28412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784938539.609759:0:28412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238cf51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+16:19231:x1871643350963584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938539.609857:0:28412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238cf51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+16:19231:x1871643350963584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 98us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938539.609864:0:28412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784938539.609923:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350963584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938539.609950:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350963712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938539.609992:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938539.610014:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2489041600 going to sleep for 11 seconds 00000100:00100000:1.0:1784938539.610051:0:28411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350963712 00000100:00100000:1.0:1784938539.610055:0:28411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350963712 00000100:00100000:1.0:1784938539.610086:0:28411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784938539.610093:0:28411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238cf52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+16:19231:x1871643350963712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938539.610206:0:28411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238cf52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+16:19231:x1871643350963712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938539.610214:0:28411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784938539.610418:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350963712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784938539.611480:0:28507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1784938539.612028:0:19231:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1784938539.612058:0:19231:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784938539.612068:0:19231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f24b4056000/0x7b044d4128f9f616 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f61d expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938539.612079:0:19231:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f24b4056000/0x7b044d4128f9f616 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f61d expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938539.612089:0:19231:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784938539.612092:0:19231:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9f24b2d31000 from 52 10000000:01000000:1.0:1784938539.612095:0:19231:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784938539.612429:0:19231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238c559000/0x7b044d4128f9f624 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938539.612440:0:19231:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f238c559000/0x7b044d4128f9f624 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938539.612450:0:19231:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f238c559000/0x7b044d4128f9f624 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938539.612471:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388246d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350963840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784938539.612535:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938539.612610:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f23862783c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938539.615574:0:28415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350963840 00000100:00100000:0.0:1784938539.615590:0:28415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350963840 00000100:00100000:1.0:1784938539.617864:0:28415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784938539.617878:0:28415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238cf50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:73e07296-2a01-411c-abf2-6d190cb69ef0+16:19231:x1871643350963840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938539.617895:0:28415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938539.617913:0:28415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f238c559200/0x7b044d4128f9f62b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9f624 expref: -99 pid: 28415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938539.617942:0:28415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f238c559200/0x7b044d4128f9f62b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9f624 expref: 17 pid: 28415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938539.617954:0:28415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f238c559200/0x7b044d4128f9f62b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9f624 expref: 17 pid: 28415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938539.617963:0:28415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c559200, rc 0) 00000100:00100000:1.0:1784938539.618061:0:28415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238cf50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:73e07296-2a01-411c-abf2-6d190cb69ef0+17:19231:x1871643350963840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (5525us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938539.618069:0:28415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784938539.618267:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388246d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350963840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938539.618286:0:19231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f238c559000/0x7b044d4128f9f624 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f62b expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938539.618295:0:19231:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f238c559000/0x7b044d4128f9f624 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9f62b expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938539.618372:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350963968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938539.618407:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938539.618439:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2489041240 going to sleep for 11 seconds 00000100:00100000:1.0:1784938539.618633:0:28412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350963968 00000100:00100000:1.0:1784938539.618640:0:28412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350963968 00000100:00100000:1.0:1784938539.618671:0:28412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784938539.618678:0:28412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238cf51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+17:19231:x1871643350963968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938539.618791:0:28412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238cf51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+17:19231:x1871643350963968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938539.618799:0:28412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784938539.619414:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350963968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938539.619451:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350964096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938539.619506:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938539.619536:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2489041240 going to sleep for 11 seconds 00000100:00100000:1.0:1784938539.619604:0:28415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350964096 00000100:00100000:1.0:1784938539.619609:0:28415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350964096 00000100:00100000:1.0:1784938539.619643:0:28415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784938539.619650:0:28415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:73e07296-2a01-411c-abf2-6d190cb69ef0+17:19231:x1871643350964096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938539.619747:0:28415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:73e07296-2a01-411c-abf2-6d190cb69ef0+17:19231:x1871643350964096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938539.619755:0:28415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784938539.619825:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350964096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784938539.625535:0:28509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1784938539.629369:0:19231:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1784938539.629421:0:19231:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784938539.629433:0:19231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238c559000/0x7b044d4128f9f624 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f62b expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938539.629446:0:19231:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f238c559000/0x7b044d4128f9f624 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f62b expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938539.629457:0:19231:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1784938539.629460:0:19231:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1784938539.629463:0:19231:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1784938539.629504:0:19231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238d17b000/0x7b044d4128f9f632 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938539.629513:0:19231:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f238d17b000/0x7b044d4128f9f632 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938539.629523:0:19231:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f238d17b000/0x7b044d4128f9f632 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938539.629559:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350964224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784938539.629628:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938539.629678:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24917e7600 going to sleep for 11 seconds 00000100:00100000:1.0:1784938539.630490:0:28410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350964224 00000100:00100000:1.0:1784938539.630501:0:28410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350964224 00000100:00100000:1.0:1784938539.630561:0:28410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784938539.630570:0:28410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+17:19231:x1871643350964224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938539.630583:0:28410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938539.630597:0:28410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f238c558e00/0x7b044d4128f9f639 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9f632 expref: -99 pid: 28410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938539.630623:0:28410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f238c558e00/0x7b044d4128f9f639 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9f632 expref: 18 pid: 28410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938539.630635:0:28410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f238c558e00/0x7b044d4128f9f639 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9f632 expref: 18 pid: 28410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938539.630643:0:28410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238c558e00, rc 0) 00000100:00100000:1.0:1784938539.630887:0:28410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+18:19231:x1871643350964224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 317us (1258us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938539.630894:0:28410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784938539.630976:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350964224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938539.630993:0:19231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f238d17b000/0x7b044d4128f9f632 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f639 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938539.631002:0:19231:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f238d17b000/0x7b044d4128f9f632 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9f639 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938539.632979:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350964352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938539.633471:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938539.633518:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24917e7600 going to sleep for 11 seconds 00000100:00100000:3.0:1784938539.636400:0:28415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350964352 00000100:00100000:3.0:1784938539.636415:0:28415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350964352 00000100:00100000:3.0:1784938539.636568:0:28415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784938539.636580:0:28415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:73e07296-2a01-411c-abf2-6d190cb69ef0+18:19231:x1871643350964352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938539.637475:0:28415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:73e07296-2a01-411c-abf2-6d190cb69ef0+18:19231:x1871643350964352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 894us (4000us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938539.637486:0:28415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784938539.643862:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350964352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938539.643936:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350964480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938539.646721:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938539.646792:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24917e7600 going to sleep for 11 seconds 00000100:00100000:0.0:1784938539.646852:0:28411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350964480 00000100:00100000:0.0:1784938539.646860:0:28411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350964480 00000100:00100000:0.0:1784938539.646920:0:28411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784938539.646930:0:28411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+18:19231:x1871643350964480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938539.648357:0:28411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+18:19231:x1871643350964480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1424us (1636us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938539.648369:0:28411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784938539.648602:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350964480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784938539.649662:0:28511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1784938539.650205:0:19231:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1784938539.650232:0:19231:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1784938539.650254:0:19231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238d17b000/0x7b044d4128f9f632 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f639 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.650266:0:19231:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f238d17b000/0x7b044d4128f9f632 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f639 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938539.650278:0:19231:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784938539.650281:0:19231:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9f24b2d31000 from 7 10000000:01000000:3.0:1784938539.650284:0:19231:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784938539.650323:0:19231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6600/0x7b044d4128f9f640 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.650331:0:19231:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6600/0x7b044d4128f9f640 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.650341:0:19231:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6600/0x7b044d4128f9f640 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938539.650366:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350964608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938539.650430:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938539.650470:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2487e94e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938539.650672:0:28412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350964608 00000100:00100000:2.0:1784938539.650680:0:28412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350964608 00000100:00100000:2.0:1784938539.650721:0:28412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784938539.650730:0:28412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+18:19231:x1871643350964608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938539.650742:0:28412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938539.650757:0:28412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f238d17ac00/0x7b044d4128f9f647 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9f640 expref: -99 pid: 28412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938539.650782:0:28412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f238d17ac00/0x7b044d4128f9f647 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9f640 expref: 19 pid: 28412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938539.650792:0:28412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f238d17ac00/0x7b044d4128f9f647 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9f640 expref: 19 pid: 28412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938539.650802:0:28412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17ac00, rc 0) 00000100:00100000:2.0:1784938539.650839:0:28412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+19:19231:x1871643350964608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938539.650847:0:28412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784938539.651392:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350964608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938539.651410:0:19231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6600/0x7b044d4128f9f640 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f647 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.651421:0:19231:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6600/0x7b044d4128f9f640 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9f647 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938539.651483:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350964736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938539.651515:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938539.651538:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2487e94e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938539.651567:0:28415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350964736 00000100:00100000:3.0:1784938539.651571:0:28415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350964736 00000100:00100000:3.0:1784938539.651600:0:28415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784938539.651606:0:28415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:73e07296-2a01-411c-abf2-6d190cb69ef0+19:19231:x1871643350964736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938539.651715:0:28415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:73e07296-2a01-411c-abf2-6d190cb69ef0+19:19231:x1871643350964736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938539.651722:0:28415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784938539.651755:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350964736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938539.651782:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350964864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938539.651825:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938539.651837:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2487e94e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938539.651919:0:28410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350964864 00000100:00100000:2.0:1784938539.651923:0:28410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350964864 00000100:00100000:2.0:1784938539.651953:0:28410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784938539.651960:0:28410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+19:19231:x1871643350964864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938539.652055:0:28410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+19:19231:x1871643350964864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938539.652062:0:28410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784938539.652515:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350964864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784938539.653564:0:28512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1784938539.653728:0:19231:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1784938539.653748:0:19231:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784938539.653758:0:19231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6600/0x7b044d4128f9f640 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f647 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938539.653768:0:19231:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6600/0x7b044d4128f9f640 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f647 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938539.653777:0:19231:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784938539.653779:0:19231:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9f24b65ac800 from 52 10000000:01000000:2.0:1784938539.653782:0:19231:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784938539.653815:0:19231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238d17a400/0x7b044d4128f9f64e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938539.653823:0:19231:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f238d17a400/0x7b044d4128f9f64e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938539.653832:0:19231:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f238d17a400/0x7b044d4128f9f64e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938539.653852:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350964992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784938539.653903:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938539.653938:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24917e7780 going to sleep for 11 seconds 00000100:00100000:3.0:1784938539.654086:0:28410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350964992 00000100:00100000:3.0:1784938539.654093:0:28410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350964992 00000100:00100000:3.0:1784938539.654141:0:28410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784938539.654181:0:28410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+19:19231:x1871643350964992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938539.654194:0:28410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938539.654208:0:28410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f238d3a6e00/0x7b044d4128f9f655 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9f64e expref: -99 pid: 28410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.654231:0:28410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f238d3a6e00/0x7b044d4128f9f655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9f64e expref: 20 pid: 28410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.654398:0:28410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f238d3a6e00/0x7b044d4128f9f655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9f64e expref: 20 pid: 28410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.654409:0:28410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a6e00, rc 0) 00000100:00100000:3.0:1784938539.654460:0:28410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+20:19231:x1871643350964992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 280us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938539.654468:0:28410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784938539.654561:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350964992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938539.654575:0:19231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f238d17a400/0x7b044d4128f9f64e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f655 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938539.654584:0:19231:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f238d17a400/0x7b044d4128f9f64e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9f655 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938539.654646:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350965120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938539.654673:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938539.654708:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24917e7780 going to sleep for 11 seconds 00000100:00100000:3.0:1784938539.654810:0:28412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350965120 00000100:00100000:3.0:1784938539.654814:0:28412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350965120 00000100:00100000:3.0:1784938539.654845:0:28412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784938539.654851:0:28412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+20:19231:x1871643350965120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938539.654964:0:28412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+20:19231:x1871643350965120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938539.654970:0:28412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784938539.655043:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350965120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938539.655071:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350965248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938539.655114:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938539.655141:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f24917e7780 going to sleep for 11 seconds 00000100:00100000:3.0:1784938539.655373:0:28411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350965248 00000100:00100000:3.0:1784938539.655378:0:28411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350965248 00000100:00100000:3.0:1784938539.655409:0:28411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784938539.655417:0:28411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+20:19231:x1871643350965248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938539.655491:0:28411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+20:19231:x1871643350965248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938539.655499:0:28411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784938539.655579:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350965248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784938539.660583:0:28513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1784938539.660866:0:19231:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1784938539.660894:0:19231:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784938539.660906:0:19231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238d17a400/0x7b044d4128f9f64e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f655 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.660918:0:19231:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f238d17a400/0x7b044d4128f9f64e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f655 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938539.660929:0:19231:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1784938539.660932:0:19231:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1784938539.660935:0:19231:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784938539.660977:0:19231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7e00/0x7b044d4128f9f65c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.660985:0:19231:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7e00/0x7b044d4128f9f65c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.660995:0:19231:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7e00/0x7b044d4128f9f65c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938539.661022:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350965376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938539.661089:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938539.661140:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2487e94cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938539.661275:0:28412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350965376 00000100:00100000:2.0:1784938539.661283:0:28412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350965376 00000100:00100000:2.0:1784938539.661340:0:28412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784938539.661350:0:28412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+20:19231:x1871643350965376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938539.661364:0:28412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938539.661378:0:28412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f238d17a600/0x7b044d4128f9f663 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9f65c expref: -99 pid: 28412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938539.661400:0:28412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f238d17a600/0x7b044d4128f9f663 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9f65c expref: 21 pid: 28412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938539.661413:0:28412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f238d17a600/0x7b044d4128f9f663 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9f65c expref: 21 pid: 28412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938539.661422:0:28412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17a600, rc 0) 00000100:00100000:2.0:1784938539.661463:0:28412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+21:19231:x1871643350965376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938539.661471:0:28412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784938539.661618:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350965376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938539.661635:0:19231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7e00/0x7b044d4128f9f65c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f663 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.661645:0:19231:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7e00/0x7b044d4128f9f65c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9f663 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938539.661703:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350965504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938539.661729:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938539.661751:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2487e94cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938539.661792:0:28411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350965504 00000100:00100000:2.0:1784938539.661797:0:28411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350965504 00000100:00100000:2.0:1784938539.661827:0:28411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784938539.661835:0:28411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+21:19231:x1871643350965504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938539.661976:0:28411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+21:19231:x1871643350965504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938539.661983:0:28411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784938539.662047:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350965504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938539.662072:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350965632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938539.662134:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938539.662177:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2487e94cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938539.662340:0:28412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350965632 00000100:00100000:2.0:1784938539.662344:0:28412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350965632 00000100:00100000:2.0:1784938539.662376:0:28412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784938539.662383:0:28412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b87d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+21:19231:x1871643350965632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938539.663486:0:28412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b87d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e07296-2a01-411c-abf2-6d190cb69ef0+21:19231:x1871643350965632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1098us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938539.663497:0:28412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784938539.668484:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350965632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784938539.671725:0:28515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1784938539.671977:0:19231:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1784938539.672005:0:19231:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784938539.672017:0:19231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7e00/0x7b044d4128f9f65c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f663 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.672029:0:19231:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f238d3a7e00/0x7b044d4128f9f65c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f663 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938539.672039:0:19231:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784938539.672042:0:19231:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9f24b65ac800 from 7 10000000:01000000:3.0:1784938539.672046:0:19231:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784938539.672087:0:19231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6800/0x7b044d4128f9f66a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.672094:0:19231:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6800/0x7b044d4128f9f66a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.672117:0:19231:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6800/0x7b044d4128f9f66a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938539.672164:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350965760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938539.672299:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938539.672343:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2487e94cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938539.672497:0:28411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350965760 00000100:00100000:2.0:1784938539.672505:0:28411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350965760 00000100:00100000:2.0:1784938539.672564:0:28411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784938539.672574:0:28411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b87d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+21:19231:x1871643350965760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938539.672588:0:28411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938539.672602:0:28411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f238d17aa00/0x7b044d4128f9f671 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9f66a expref: -99 pid: 28411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938539.672625:0:28411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f238d17aa00/0x7b044d4128f9f671 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9f66a expref: 22 pid: 28411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938539.672634:0:28411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f238d17aa00/0x7b044d4128f9f671 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9f66a expref: 22 pid: 28411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938539.672643:0:28411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d17aa00, rc 0) 00000100:00100000:2.0:1784938539.672745:0:28411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b87d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+22:19231:x1871643350965760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938539.672753:0:28411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784938539.675554:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350965760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938539.675583:0:19231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6800/0x7b044d4128f9f66a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f671 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938539.675596:0:19231:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6800/0x7b044d4128f9f66a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9f671 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938539.677485:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350965888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938539.677565:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938539.677613:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f2488a62300 going to sleep for 11 seconds 00000100:00100000:3.0:1784938539.677675:0:28415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350965888 00000100:00100000:3.0:1784938539.677683:0:28415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350965888 00000100:00100000:3.0:1784938539.677739:0:28415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784938539.677748:0:28415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b87da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:73e07296-2a01-411c-abf2-6d190cb69ef0+22:19231:x1871643350965888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938539.677886:0:28415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b87da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:73e07296-2a01-411c-abf2-6d190cb69ef0+22:19231:x1871643350965888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938539.677894:0:28415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784938539.677976:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350965888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938539.678013:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388247480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350966016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938539.678060:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938539.678088:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f23862786c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938539.678245:0:28411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350966016 00000100:00100000:3.0:1784938539.678250:0:28411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350966016 00000100:00100000:3.0:1784938539.678285:0:28411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784938539.678292:0:28411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b87dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+22:19231:x1871643350966016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938539.678371:0:28411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b87dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+22:19231:x1871643350966016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938539.678377:0:28411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784938539.678523:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388247480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350966016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784938539.679785:0:28516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1784938539.681385:0:19231:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1784938539.681424:0:19231:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784938539.681436:0:19231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6800/0x7b044d4128f9f66a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f671 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938539.681449:0:19231:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f238d3a6800/0x7b044d4128f9f66a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f671 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938539.681460:0:19231:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784938539.681463:0:19231:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9f24b17699c0 from 1 10000000:01000000:1.0:1784938539.681465:0:19231:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784938539.681507:0:19231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238c559600/0x7b044d4128f9f678 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938539.681516:0:19231:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f238c559600/0x7b044d4128f9f678 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938539.681526:0:19231:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f238c559600/0x7b044d4128f9f678 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938539.681563:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388247480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350966144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784938539.681632:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938539.682351:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f23862786c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938539.682436:0:28415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350966144 00000100:00100000:3.0:1784938539.682445:0:28415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350966144 00000100:00100000:3.0:1784938539.682506:0:28415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784938539.682517:0:28415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483918850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:73e07296-2a01-411c-abf2-6d190cb69ef0+22:19231:x1871643350966144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938539.682530:0:28415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938539.682556:0:28415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f238d3a7c00/0x7b044d4128f9f67f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9f678 expref: -99 pid: 28415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.682579:0:28415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f238d3a7c00/0x7b044d4128f9f67f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9f678 expref: 23 pid: 28415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.682591:0:28415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f238d3a7c00/0x7b044d4128f9f67f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9f678 expref: 23 pid: 28415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.682600:0:28415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a7c00, rc 0) 00000100:00100000:3.0:1784938539.682657:0:28415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483918850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:73e07296-2a01-411c-abf2-6d190cb69ef0+23:19231:x1871643350966144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938539.682665:0:28415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784938539.682784:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388247480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350966144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938539.682800:0:19231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f238c559600/0x7b044d4128f9f678 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f67f expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938539.682809:0:19231:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f238c559600/0x7b044d4128f9f678 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9f67f expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938539.682828:0:19231:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784938539.682832:0:19231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238c559600/0x7b044d4128f9f678 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f67f expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938539.682839:0:19231:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f238c559600/0x7b044d4128f9f678 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f67f expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938539.682847:0:19231:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1784938539.682850:0:19231:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9f24b17699c0 from 1 10000000:01000000:1.0:1784938539.682852:0:19231:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784938539.682872:0:19231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238c559c00/0x7b044d4128f9f686 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938539.682879:0:19231:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff9f238c559c00/0x7b044d4128f9f686 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938539.682887:0:19231:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff9f238c559c00/0x7b044d4128f9f686 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938539.682903:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388247480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350966272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784938539.682935:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938539.682995:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f23862786c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938539.687382:0:28410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350966272 00000100:00100000:3.0:1784938539.687397:0:28410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350966272 00000100:00100000:3.0:1784938539.688637:0:28410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784938539.688654:0:28410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248391a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+23:19231:x1871643350966272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938539.688675:0:28410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938539.688695:0:28410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f238d3a6a00/0x7b044d4128f9f68d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b044d4128f9f686 expref: -99 pid: 28410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.688726:0:28410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f238d3a6a00/0x7b044d4128f9f68d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b044d4128f9f686 expref: 24 pid: 28410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.688738:0:28410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f238d3a6a00/0x7b044d4128f9f68d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b044d4128f9f686 expref: 24 pid: 28410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.688749:0:28410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f238d3a6a00, rc 0) 00000100:00100000:3.0:1784938539.688842:0:28410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248391a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+24:19231:x1871643350966272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (5905us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938539.688852:0:28410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784938539.688939:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388247480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350966272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938539.688960:0:19231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff9f238c559c00/0x7b044d4128f9f686 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f68d expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938539.688970:0:19231:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff9f238c559c00/0x7b044d4128f9f686 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b044d4128f9f68d expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938539.689074:0:19231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350966400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938539.689112:0:19231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938539.691936:0:19231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238601e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938539.692065:0:28412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350966400 00000100:00100000:0.0:1784938539.692075:0:28412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350966400 00000100:00100000:0.0:1784938539.692222:0:28411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784938539.692231:0:28411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483918c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+24:19231:x1871643350966400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938539.696351:0:28411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483918c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+24:19231:x1871643350966400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4117us (7234us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784938539.696363:0:28411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784938539.699390:0:19231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e07296-2a01-411c-abf2-6d190cb69ef0:19231:1871643350966400:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1784938539.699440:0:19231:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784938539.699450:0:19231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff9f238c559c00/0x7b044d4128f9f686 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f68d expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938539.699460:0:19231:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff9f238c559c00/0x7b044d4128f9f686 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b044d4128f9f68d expref: -99 pid: 19231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938539.948568:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938540.712586:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350966528:192.168.202.154@tcp:13:osp-pre-1-1.0 00000100:00100000:3.0:1784938540.712910:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938540.712942:0:21154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350966528 00000100:00100000:3.0:1784938540.712950:0:21154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350966528 00000100:00100000:3.0:1784938540.713008:0:21154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 110 00000100:00100000:3.0:1784938540.713018:0:21154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16389:x1871643350966528:12345-192.168.202.154@tcp:13:osp-pre-1-1.0 00002000:00000024:3.0:1784938540.713050:0:21154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 271040 pending 0 free 313057280 avail 285245440 00000100:00100000:3.0:1784938540.713095:0:21154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16389:x1871643350966528:12345-192.168.202.154@tcp:13:osp-pre-1-1.0 Request processed in 78us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938540.713103:0:21154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 110 00000100:00080000:3.0:1784938540.713128:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938540.713373:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350966656:192.168.202.154@tcp:13:osp-pre-0-1.0 00000100:00100000:0.0:1784938540.713506:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938540.713526:0:21154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350966656 00000100:00100000:0.0:1784938540.713530:0:21154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350966656 00000100:00100000:0.0:1784938540.713572:0:21154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 111 00000100:00100000:0.0:1784938540.713579:0:21154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16390:x1871643350966656:12345-192.168.202.154@tcp:13:osp-pre-0-1.0 00002000:00000024:0.0:1784938540.713597:0:21154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 271040 pending 0 free 313057280 avail 285245440 00000100:00100000:0.0:1784938540.713625:0:21154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16390:x1871643350966656:12345-192.168.202.154@tcp:13:osp-pre-0-1.0 Request processed in 47us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938540.713636:0:21154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 111 00000100:00080000:0.0:1784938540.713716:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938540.713751:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350966656:192.168.202.154@tcp:13:osp-pre-0-1.0 00000100:00100000:3.0:1784938540.713901:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350966528:192.168.202.154@tcp:13:osp-pre-1-1.0 00010000:00010000:1.0:1784938540.968934:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938541.993175:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938543.023134:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784938543.204820:0:28688:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1784938543.272353:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938543.272360:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784938543.272364:0:38:0:(import.c:65:import_set_state_nolock()) ffff9f24b4116800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784938543.272378:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f24b4116800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:1.0:1784938543.272399:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f2388244a80 x1871643350966912/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784938543.272555:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938543.272559:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784938543.272560:0:38:0:(import.c:65:import_set_state_nolock()) ffff9f2383aea800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784938543.272566:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f2383aea800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:1.0:1784938543.272579:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f2388247480 x1871643350967168/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784938543.272604:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938543.272607:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784938543.272609:0:38:0:(import.c:65:import_set_state_nolock()) ffff9f24b4113800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784938543.272614:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9f24b4113800 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:1.0:1784938543.272626:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f2388244700 x1871643350967424/t0(0) o38->lustre-MDT0000-osp-MDT0001@192.168.202.154@tcp:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784938543.272651:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938543.272653:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784938543.272655:0:38:0:(import.c:65:import_set_state_nolock()) ffff9f24b36a7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784938543.272660:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9f24b36a7000 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:1.0:1784938543.272671:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f238e0ef480 x1871643350967808/t0(0) o38->lustre-MDT0000-lwp-MDT0001@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784938543.272694:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1784938543.272697:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784938543.272699:0:38:0:(import.c:65:import_set_state_nolock()) ffff9f24b4078000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784938543.272703:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9f24b4078000 using connection 192.168.202.154@tcp/192.168.202.154@tcp 00000100:00100000:1.0:1784938543.272713:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f23882bd880 x1871643350968320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@192.168.202.154@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784938543.272758:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e07296-2a01-411c-abf2-6d190cb69ef0:16391:1871643350966784:0@lo:400:kworker.0 00000100:00100000:1.0:1784938543.272833:0:16391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938543.272878:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350967680:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938543.272933:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784938543.272940:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:16391:1871643350967040:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938543.272970:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350967936:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938543.273008:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350967552:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938543.273033:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23882bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350968192:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938543.273055:0:16390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784938543.273061:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:16390:1871643350967296:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938543.273098:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23882bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350968064:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938543.273132:0:28411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350966784 00000100:00100000:1.0:1784938543.273139:0:28411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350966784 00000100:00100000:1.0:1784938543.273214:0:28411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784938543.273223:0:28411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483919c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+24:16391:x1871643350966784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784938543.273278:0:28411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483919c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e07296-2a01-411c-abf2-6d190cb69ef0+24:16391:x1871643350966784:12345-0@lo:400:kworker.0 Request processed in 56us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938543.273286:0:28411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784938543.273507:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938543.273620:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938543.273643:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938543.273666:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938543.273688:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938543.273708:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938543.273726:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938543.273753:0:26609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350967040 00000100:00100000:1.0:1784938543.273758:0:26609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350967040 00000100:00100000:1.0:1784938543.273793:0:26609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350967296 00000100:00100000:1.0:1784938543.273796:0:26609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350967296 00000100:00100000:1.0:1784938543.273819:0:26609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 33 00000100:00100000:1.0:1784938543.273826:0:26609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:16391:x1871643350967040:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938543.273874:0:26609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:16391:x1871643350967040:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 49us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938543.273881:0:26609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 33 00000100:00100000:1.0:1784938543.273895:0:26609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 34 00000100:00100000:1.0:1784938543.273901:0:26609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:16390:x1871643350967296:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938543.273927:0:26609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:16390:x1871643350967296:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 26us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938543.273933:0:26609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 34 00000100:00100000:1.0:1784938543.273952:0:25727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350967680 00000100:00100000:1.0:1784938543.273955:0:25727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350967680 00000100:00100000:1.0:1784938543.273982:0:25727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350967552 00000100:00100000:1.0:1784938543.273984:0:25727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350967552 00000100:00100000:1.0:1784938543.274002:0:25727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350968192 00000100:00100000:1.0:1784938543.274005:0:25727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350968192 00000100:00100000:1.0:1784938543.274023:0:25727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350968064 00000100:00100000:1.0:1784938543.274025:0:25727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350968064 00000100:00100000:1.0:1784938543.274045:0:25727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 121 00000100:00100000:1.0:1784938543.274051:0:25727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:16391:x1871643350967680:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938543.274078:0:25727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:16391:x1871643350967680:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 27us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938543.274084:0:25727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 121 00000100:00100000:1.0:1784938543.274096:0:25727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 122 00000100:00100000:1.0:1784938543.274102:0:25727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:16390:x1871643350967552:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938543.274123:0:25727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:16390:x1871643350967552:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 22us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938543.274129:0:25727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 122 00000100:00100000:1.0:1784938543.274139:0:25727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 123 00000100:00100000:1.0:1784938543.274169:0:25727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:16390:x1871643350968192:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938543.274192:0:25727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:16390:x1871643350968192:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 47us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938543.274201:0:25727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 123 00000100:00100000:1.0:1784938543.274213:0:25727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 124 00000100:00100000:1.0:1784938543.274218:0:25727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:16390:x1871643350968064:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938543.274236:0:25727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:16390:x1871643350968064:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 18us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938543.274241:0:25727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 124 00000100:00080000:1.0:1784938543.274267:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784938543.274271:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784938543.274274:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1784938543.274500:0:16390:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f2388246d80 x1871643350967296/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938543.274528:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:16390:1871643350967296:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938543.274543:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23882bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350968064:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938543.274552:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:16390:1871643350967552:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938543.274562:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23882bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350968192:192.168.202.154@tcp:400:kworker.0 00010000:00080000:1.0:1784938543.274602:0:16391:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f2388244e00 x1871643350967040/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938543.274613:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:16391:1871643350967040:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938543.274624:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e07296-2a01-411c-abf2-6d190cb69ef0:16391:1871643350966784:0@lo:400:kworker.0 00000100:00100000:1.0:1784938543.274633:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350967680:192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938543.274768:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:16388:1871643350966912:192.168.202.154@tcp:38:kworker.0 00000100:00100000:3.0:1784938543.274820:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:16388:1871643350967168:192.168.202.154@tcp:38:kworker.0 00000100:00100000:3.0:1784938543.274852:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:16388:1871643350967424:192.168.202.154@tcp:38:kworker.0 00000100:00100000:3.0:1784938543.274879:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:16388:1871643350967808:192.168.202.154@tcp:38:kworker.0 00000100:00100000:3.0:1784938543.274900:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23882bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:16388:1871643350968320:192.168.202.154@tcp:38:kworker.0 00000100:00100000:3.0:1784938543.275049:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938543.275102:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938543.275121:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938543.275158:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938543.275183:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938543.275204:0:21160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350967936 00000100:00100000:3.0:1784938543.275210:0:21160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350967936 00000100:00100000:3.0:1784938543.275243:0:21160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350967424 00000100:00100000:3.0:1784938543.275246:0:21160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350967424 00000100:00100000:3.0:1784938543.275259:0:21160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 139 00000100:00100000:3.0:1784938543.275265:0:21160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:16391:x1871643350967936:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:3.0:1784938543.275303:0:21160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:16391:x1871643350967936:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 37us (1636us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938543.275309:0:21160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 139 00000100:00100000:3.0:1784938543.275323:0:21160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 140 00000100:00100000:3.0:1784938543.275328:0:21160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:16388:x1871643350967424:12345-192.168.202.154@tcp:38:kworker.0 00010000:00080000:3.0:1784938543.275349:0:21160:0:(ldlm_lib.c:961:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9f24b43d2800, cookie 0x7b044d4128f9f521 00010000:00080000:3.0:1784938543.275354:0:21160:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@192.168.202.154@tcp recovering/t0 exp ffff9f24b43d2800 cur 809 last 1784938537 00010000:02000400:3.0:1784938543.275361:0:21160:0:(ldlm_lib.c:2059:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 1 client reconnects 00000100:00100000:2.0:1784938543.279348:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784938543.279373:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350968448:192.168.202.154@tcp:41:osp-pre-1-0.0 00000100:00100000:2.0:1784938543.280268:0:26608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350967168 00000100:00100000:2.0:1784938543.280280:0:26608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350967168 00000100:00100000:2.0:1784938543.280312:0:26608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350967808 00000100:00100000:2.0:1784938543.280315:0:26608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350967808 00000100:00100000:2.0:1784938543.280323:0:26608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350966912 00000100:00100000:2.0:1784938543.280325:0:26608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350966912 00000100:00100000:2.0:1784938543.280332:0:26608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350968320 00000100:00100000:2.0:1784938543.280334:0:26608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350968320 00000100:00100000:2.0:1784938543.280351:0:26608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 46 00000100:00100000:2.0:1784938543.280358:0:26608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:16388:x1871643350967168:12345-192.168.202.154@tcp:38:kworker.0 00010000:00080000:2.0:1784938543.280385:0:26608:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@192.168.202.154@tcp recovering/t0 exp 0000000000000000 cur 809 last 0 00000020:00000080:2.0:1784938543.280499:0:26608:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x7b044d4128f9f694 00000004:00100000:2.0:1784938543.280523:0:26608:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784938543.280654:0:26608:0:(import.c:65:import_set_state_nolock()) ffff9f238f2ef000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938543.280704:0:26608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:16388:x1871643350967168:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 344us (5655us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938543.280712:0:26608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 46 00000100:00100000:2.0:1784938543.280733:0:26608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 47 00000100:00100000:2.0:1784938543.280738:0:26608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:16388:x1871643350967808:12345-192.168.202.154@tcp:38:kworker.0 00010000:00080000:2.0:1784938543.280751:0:26608:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@192.168.202.154@tcp recovering/t0 exp 0000000000000000 cur 809 last 0 00000020:00000080:2.0:1784938543.280773:0:26608:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x7b044d4128f9f69b 00000004:00100000:2.0:1784938543.280779:0:26608:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784938543.280794:0:26608:0:(import.c:65:import_set_state_nolock()) ffff9f238f2ec000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938543.280817:0:26608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:16388:x1871643350967808:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 77us (5715us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938543.280822:0:26608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 47 00000100:00100000:2.0:1784938543.280836:0:26608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 48 00000100:00100000:2.0:1784938543.280840:0:26608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:16388:x1871643350966912:12345-192.168.202.154@tcp:38:kworker.0 00010000:00080000:2.0:1784938543.280871:0:26608:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@192.168.202.154@tcp recovering/t0 exp 0000000000000000 cur 809 last 0 00000020:00000080:2.0:1784938543.280896:0:26608:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x7b044d4128f9f6a2 00000004:00100000:2.0:1784938543.280901:0:26608:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784938543.280919:0:26608:0:(import.c:65:import_set_state_nolock()) ffff9f24b4115800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938543.280943:0:26608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:16388:x1871643350966912:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 100us (5819us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938543.280949:0:26608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 48 00000100:00100000:2.0:1784938543.280963:0:26608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 49 00000100:00100000:2.0:1784938543.280967:0:26608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387dad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:16388:x1871643350968320:12345-192.168.202.154@tcp:38:kworker.0 00010000:00080000:2.0:1784938543.280977:0:26608:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@192.168.202.154@tcp recovering/t0 exp 0000000000000000 cur 809 last 0 00000020:00000080:2.0:1784938543.280999:0:26608:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x7b044d4128f9f6a9 00000004:00100000:2.0:1784938543.281004:0:26608:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784938543.281018:0:26608:0:(import.c:65:import_set_state_nolock()) ffff9f2383ab3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938543.281041:0:26608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387dad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:16388:x1871643350968320:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 72us (5857us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938543.281047:0:26608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 49 00000100:00100000:2.0:1784938543.283892:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938543.285668:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350967936:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938543.286318:0:21161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350968448 00000100:00100000:1.0:1784938543.286327:0:21161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350968448 00000100:00100000:1.0:1784938543.286378:0:21161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 141 00000100:00100000:1.0:1784938543.286386:0:21161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:16392:x1871643350968448:12345-192.168.202.154@tcp:41:osp-pre-1-0.0 00000004:00000024:1.0:1784938543.286507:0:21161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 218472448 avail 191447040 00000100:00100000:1.0:1784938543.286609:0:21161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:16392:x1871643350968448:12345-192.168.202.154@tcp:41:osp-pre-1-0.0 Request processed in 222us (2728us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938543.286616:0:21161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 141 00000100:00100000:2.0:1784938543.286872:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350968448:192.168.202.154@tcp:41:osp-pre-1-0.0 00010000:00080000:3.0:1784938543.287541:0:21160:0:(ldlm_lib.c:2123:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00010000:00080000:3.0:1784938543.287579:0:16388:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f2388244a80 x1871643350966912/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.202.154@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784938543.287594:0:16388:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 4 00000004:00100000:2.0:1784938543.289323:0:21160:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784938543.289479:0:21160:0:(import.c:65:import_set_state_nolock()) ffff9f2383ab7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938543.289578:0:21160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:16388:x1871643350967424:12345-192.168.202.154@tcp:38:kworker.0 Request processed in 14245us (14431us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938543.289590:0:21160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 140 00010000:00080000:1.0:1784938543.291461:0:28437:0:(ldlm_lib.c:2568:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 1 abort 0 expired 0 00010000:00080000:1.0:1784938543.291470:0:28437:0:(ldlm_lib.c:2706:replay_request_or_update()) Waiting for transno 12884901894 00000020:00080000:1.0:1784938543.291475:0:28437:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784938543.291478:0:28437:0:(ldlm_lib.c:2251:check_for_next_transno()) max: 1, connected: 1, completed: 0, queue_len: 0, req_transno: 0, next_transno: 12884901894 00000020:00080000:1.0:1784938543.291481:0:28437:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784938543.291483:0:28437:0:(ldlm_lib.c:2251:check_for_next_transno()) max: 1, connected: 1, completed: 0, queue_len: 0, req_transno: 0, next_transno: 12884901894 00000100:00080000:3.0:1784938543.291880:0:16388:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9f2388244a80 x1871643350966912/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.202.154@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938563 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784938543.291889:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b4116800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1784938543.291893:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b4116800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1784938543.291897:0:16388:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 192.168.202.154@tcp (at 192.168.202.154@tcp) 00000100:00100000:3.0:1784938543.328087:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:16388:1871643350966912:192.168.202.154@tcp:38:kworker.0 00010000:00080000:2.0:1784938543.330111:0:16388:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f2388247480 x1871643350967168/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.202.154@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784938543.330135:0:16388:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 4 00000100:00080000:2.0:1784938543.331700:0:16388:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9f2388247480 x1871643350967168/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.202.154@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938563 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784938543.331715:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f2383aea800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1784938543.331721:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f2383aea800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1784938543.331726:0:16388:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 192.168.202.154@tcp (at 192.168.202.154@tcp) 00000100:00100000:2.0:1784938543.331732:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:16388:1871643350967168:192.168.202.154@tcp:38:kworker.0 00000100:00080000:2.0:1784938543.331771:0:16388:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 4 00000100:00080000:2.0:1784938543.331781:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b4113800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1784938543.331785:0:16388:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1784938543.331787:0:16388:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884901892 gen 2 00000100:00080000:2.0:1784938543.331791:0:16388:0:(recover.c:53:ptlrpc_replay_next()) import ffff9f24b4113800 from lustre-MDT0000_UUID committed 12884901892 last 0 00000100:00080000:2.0:1784938543.331794:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b4113800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:2.0:1784938543.332570:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:16388:1871643350967424:192.168.202.154@tcp:38:kworker.0 00010000:00080000:2.0:1784938543.332595:0:16388:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f238e0ef480 x1871643350967808/t0(0) o38->lustre-MDT0000-lwp-MDT0001@192.168.202.154@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784938543.332607:0:16388:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 4 00010000:00080000:1.0:1784938543.333395:0:28693:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@192.168.202.154@tcp 00010000:00010000:1.0:1784938543.333410:0:28693:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:1.0:1784938543.333416:0:28693:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:1.0:1784938543.333855:0:28693:0:(import.c:65:import_set_state_nolock()) ffff9f24b4113800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00080000:2.0:1784938543.334962:0:16388:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9f238e0ef480 x1871643350967808/t0(0) o38->lustre-MDT0000-lwp-MDT0001@192.168.202.154@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938563 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784938543.334977:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b36a7000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1784938543.334982:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b36a7000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1784938543.334987:0:16388:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 192.168.202.154@tcp (at 192.168.202.154@tcp) 00000100:00100000:2.0:1784938543.334995:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:16388:1871643350967808:192.168.202.154@tcp:38:kworker.0 00010000:00080000:2.0:1784938543.335348:0:16388:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f23882bd880 x1871643350968320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@192.168.202.154@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784938543.335367:0:16388:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 4 00000100:00080000:2.0:1784938543.335375:0:16388:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1784938543.335380:0:16388:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784938543.335383:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b4078000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784938543.335388:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23882bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:16388:1871643350968320:192.168.202.154@tcp:38:kworker.0 00000100:00100000:2.0:1784938543.335530:0:16388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23882bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:16388:1871643350968576:192.168.202.154@tcp:400:ldlm_lock_repla.0 00000100:00100000:1.0:1784938543.344181:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938543.344636:0:21161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350968576 00000100:00100000:0.0:1784938543.344646:0:21161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350968576 00000100:00100000:0.0:1784938543.344698:0:21161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 142 00000100:00100000:0.0:1784938543.344708:0:21161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:16388:x1871643350968576:12345-192.168.202.154@tcp:400:ldlm_lock_repla.0 00010000:00080000:0.0:1784938543.344748:0:21161:0:(ldlm_lib.c:3160:target_queue_recovery_request()) @@@ queue final req req@ffff9f23882bc000 x1871643350968576/t0(0) o400->lustre-MDT0001-mdtlov_UUID@192.168.202.154@tcp:19/0 lens 224/0 e 0 to 0 dl 1784938554 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938543.344766:0:21161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:16388:x1871643350968576:12345-192.168.202.154@tcp:400:ldlm_lock_repla.0 Request processed in 60us (598us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784938543.344774:0:21161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 142 00000020:00080000:0.0:1784938543.344794:0:28437:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784938543.344798:0:28437:0:(ldlm_lib.c:2251:check_for_next_transno()) max: 1, connected: 1, completed: 1, queue_len: 0, req_transno: 0, next_transno: 12884901894 00010000:00080000:0.0:1784938543.344802:0:28437:0:(ldlm_lib.c:2285:check_for_next_transno()) waking for completed recovery 00000020:00080000:0.0:1784938543.344805:0:28437:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784938543.344810:0:28437:0:(ldlm_lib.c:2475:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1784938543.344813:0:28437:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1784938543.344908:0:28437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 4, last_transno is 17179869184 00000001:00100000:0.0:1784938543.351575:0:28404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1784938543.351663:0:28437:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1784938543.351700:0:28437:0:(ldlm_lib.c:2019:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1784938543.351718:0:28437:0:(ldlm_lib.c:2963:target_recovery_thread()) @@@ processing final ping from 192.168.202.154@tcp: req@ffff9f23882bc000 x1871643350968576/t0(0) o400->lustre-MDT0001-mdtlov_UUID@192.168.202.154@tcp:19/0 lens 224/0 e 0 to 0 dl 1784938554 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1784938543.351827:0:28437:0:(ldlm_lib.c:1891:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:01, of 1 clients 1 recovered and 0 were evicted. 00000100:00080000:0.0:1784938543.352645:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b4113800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1784938543.352656:0:16388:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff9f23882bed80 x1871643350968576/t0(0) o400->lustre-MDT0000-osp-MDT0001@192.168.202.154@tcp:24/4 lens 224/224 e 0 to 0 dl 1784938559 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784938543.352666:0:16388:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9f23882bed80 x1871643350968576/t0(0) o400->lustre-MDT0000-osp-MDT0001@192.168.202.154@tcp:24/4 lens 224/224 e 0 to 0 dl 1784938559 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784938543.352680:0:16388:0:(import.c:65:import_set_state_nolock()) ffff9f24b4113800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1784938543.352691:0:16388:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 192.168.202.154@tcp (at 192.168.202.154@tcp) 00000100:00080000:0.0:1784938543.352698:0:16388:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000e28b6281): req@ffff9f2387fd2a00 x1871643350952960/t0(0) o41->lustre-MDT0000-osp-MDT0001@192.168.202.154@tcp:24/4 lens 224/224 e 0 to 0 dl 1784938546 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938543.352713:0:16388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23882bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:16388:1871643350968576:192.168.202.154@tcp:400:ldlm_lock_repla.0 00000100:00100000:1.0:1784938543.354090:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938543.354123:0:21160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350952960 00000100:00100000:1.0:1784938543.354158:0:21160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350952960 00000100:00100000:1.0:1784938543.355493:0:21160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 143 00000100:00100000:1.0:1784938543.355525:0:21160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:16392:x1871643350952960:12345-192.168.202.154@tcp:41:osp-pre-0-1.0 00000004:00000024:1.0:1784938543.355566:0:21160:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 218345472 avail 191320064 00000100:00100000:1.0:1784938543.355637:0:21160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:16392:x1871643350952960:12345-192.168.202.154@tcp:41:osp-pre-0-1.0 Request processed in 130us (1553us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938543.355645:0:21160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 143 00000100:00100000:1.0:1784938543.355860:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350952960:192.168.202.154@tcp:41:osp-pre-0-1.0 00000100:00100000:0.0:1784938543.361663:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938543.361695:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350968704:192.168.202.154@tcp:41:osp-pre-0-1.0 00000100:00100000:1.0:1784938543.364721:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938543.366391:0:25714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350968704 00000100:00100000:0.0:1784938543.366811:0:25714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350968704 00000100:00100000:0.0:1784938543.366885:0:25714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 144 00000100:00100000:0.0:1784938543.366897:0:25714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23882be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:16391:x1871643350968704:12345-192.168.202.154@tcp:41:osp-pre-0-1.0 00000004:00000024:0.0:1784938543.366932:0:25714:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 218345472 avail 191320064 00000100:00100000:0.0:1784938543.368587:0:25714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23882be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:16391:x1871643350968704:12345-192.168.202.154@tcp:41:osp-pre-0-1.0 Request processed in 1043us (3229us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938543.368603:0:25714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 144 00000100:00100000:1.0:1784938543.369601:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350968704:192.168.202.154@tcp:41:osp-pre-0-1.0 00000004:00000080:2.0:1784938543.422661:0:28437:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbfdb4cbdbe10 00100000:10000000:2.0:1784938543.422677:0:28437:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:2.0:1784938543.430823:0:28423:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x69:0x0] 00000100:00100000:2.0:1784938543.430874:0:28423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68a8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:28423:1871643350968832:192.168.202.154@tcp:5:osp-pre-0-0.0 00000100:00100000:2.0:1784938543.432251:0:28423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238601e540 going to sleep for 11 seconds 00000004:00080000:2.0:1784938543.432270:0:28425:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x68:0x0] 00000100:00100000:2.0:1784938543.432308:0:28425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68aad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:28425:1871643350968960:192.168.202.154@tcp:5:osp-pre-1-0.0 00000100:00100000:2.0:1784938543.432365:0:28425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238601e780 going to sleep for 11 seconds 00000100:00100000:3.0:1784938543.433550:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938543.433599:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938543.434666:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350968832 00000100:00100000:3.0:1784938543.434691:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350968832 00000100:00100000:3.0:1784938543.434768:0:25716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350968960 00000100:00100000:3.0:1784938543.434783:0:25716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350968960 00000100:00100000:3.0:1784938543.434826:0:25716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 1006 00000100:00100000:3.0:1784938543.434845:0:25716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2387daf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:28423:x1871643350968832:12345-192.168.202.154@tcp:5:osp-pre-0-0.0 00002000:00080000:3.0:1784938543.434911:0:25716:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 161 -> diff = -56 00002000:02000040:3.0:1784938543.434922:0:25716:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:106 to 0x280000401:161) 00000100:00100000:0.0:1784938543.438616:0:25720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 1007 00000100:00100000:0.0:1784938543.438648:0:25720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386361500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:28425:x1871643350968960:12345-192.168.202.154@tcp:5:osp-pre-1-0.0 00002000:00080000:0.0:1784938543.438687:0:25720:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 161 -> diff = -57 00002000:02000040:0.0:1784938543.438692:0:25720:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:105 to 0x2c0000401:161) 00002000:00010000:2.0:1784938543.453180:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938543.453195:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090273ca6/0x7b044d4128f9f6b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.453213:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa1:0x0].0x0 since=809s v=(0 0) 00010000:00010000:2.0:1784938543.453218:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938543.453225:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090273ca6/0x7b044d4128f9f6b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.453242:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090273ca6/0x7b044d4128f9f6b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.453252:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090273ca6/0x7b044d4128f9f6b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.453261:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090273ca6/0x7b044d4128f9f6b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.453282:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938543.453297:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938543.453302:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090273ca6/0x7b044d4128f9f6b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.453317:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17bc00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938543.453322:0:25732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090273ca6/0x7b044d4128f9f6b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.453331:0:25732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090273ca6/0x7b044d4128f9f6b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.453345:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090273ca6/0x7b044d4128f9f6b0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.453358:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090273ca6/0x7b044d4128f9f6b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.453379:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.453381:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.453383:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938543.454099:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938543.454107:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091814461/0x7b044d4128f9f6b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.454117:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa0:0x0].0x0 since=809s v=(0 0) 00010000:00010000:2.0:1784938543.454121:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938543.454126:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091814461/0x7b044d4128f9f6b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.454136:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091814461/0x7b044d4128f9f6b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.454175:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091814461/0x7b044d4128f9f6b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.454183:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091814461/0x7b044d4128f9f6b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.454198:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938543.454208:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938543.454213:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091814461/0x7b044d4128f9f6b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.454221:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17a800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938543.454224:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091814461/0x7b044d4128f9f6b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.454232:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091814461/0x7b044d4128f9f6b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.454243:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091814461/0x7b044d4128f9f6b7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.454249:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091814461/0x7b044d4128f9f6b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.454265:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.454267:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.454269:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938543.454314:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938543.454320:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f9d2d67/0x7b044d4128f9f6be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.454328:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f:0x0].0x0 since=809s v=(0 0) 00010000:00010000:2.0:1784938543.454331:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938543.454334:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f9d2d67/0x7b044d4128f9f6be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.454347:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f9d2d67/0x7b044d4128f9f6be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.454354:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f9d2d67/0x7b044d4128f9f6be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.454361:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f9d2d67/0x7b044d4128f9f6be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.454374:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938543.454381:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938543.454386:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f9d2d67/0x7b044d4128f9f6be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.454392:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17b400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938543.454395:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f9d2d67/0x7b044d4128f9f6be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.454628:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f9d2d67/0x7b044d4128f9f6be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.454644:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f9d2d67/0x7b044d4128f9f6be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.454652:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f9d2d67/0x7b044d4128f9f6be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.454670:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.454671:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.454673:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938543.454722:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938543.454973:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b9ed1c8/0x7b044d4128f9f6c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.454984:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e:0x0].0x0 since=809s v=(0 0) 00010000:00010000:2.0:1784938543.454986:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938543.454991:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b9ed1c8/0x7b044d4128f9f6c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.455001:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b9ed1c8/0x7b044d4128f9f6c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.455008:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b9ed1c8/0x7b044d4128f9f6c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.455167:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b9ed1c8/0x7b044d4128f9f6c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.455186:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938543.455196:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938543.455201:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b9ed1c8/0x7b044d4128f9f6c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.455213:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17b600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938543.455217:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b9ed1c8/0x7b044d4128f9f6c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.455225:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b9ed1c8/0x7b044d4128f9f6c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.455238:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b9ed1c8/0x7b044d4128f9f6c5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.455245:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b9ed1c8/0x7b044d4128f9f6c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.455263:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.455265:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.455267:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938543.455322:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938543.455328:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000057fcbbb/0x7b044d4128f9f6cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.455336:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d:0x0].0x0 since=809s v=(0 0) 00010000:00010000:2.0:1784938543.455339:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938543.455344:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000057fcbbb/0x7b044d4128f9f6cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.455353:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000057fcbbb/0x7b044d4128f9f6cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.455362:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000057fcbbb/0x7b044d4128f9f6cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.455369:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000057fcbbb/0x7b044d4128f9f6cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.455383:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784938543.455830:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938543.455838:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000247bc25a/0x7b044d4128f9f6d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.455847:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c:0x0].0x0 since=809s v=(0 0) 00010000:00010000:2.0:1784938543.455850:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938543.455854:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000247bc25a/0x7b044d4128f9f6d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.455864:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000247bc25a/0x7b044d4128f9f6d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.455872:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000247bc25a/0x7b044d4128f9f6d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.455880:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000247bc25a/0x7b044d4128f9f6d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.455900:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784938543.455909:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938543.455914:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000057fcbbb/0x7b044d4128f9f6cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.455921:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17ae00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938543.455925:0:25732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000057fcbbb/0x7b044d4128f9f6cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.455934:0:25732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000057fcbbb/0x7b044d4128f9f6cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.456505:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000057fcbbb/0x7b044d4128f9f6cc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.456526:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000057fcbbb/0x7b044d4128f9f6cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.456548:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938543.456551:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000247bc25a/0x7b044d4128f9f6d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.456558:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17b200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938543.456561:0:25732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000247bc25a/0x7b044d4128f9f6d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.456573:0:25732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000247bc25a/0x7b044d4128f9f6d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.456584:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000247bc25a/0x7b044d4128f9f6d3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.456591:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000247bc25a/0x7b044d4128f9f6d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.456603:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.456605:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.456607:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938543.456676:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938543.456681:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfc96367/0x7b044d4128f9f6da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.456691:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9b:0x0].0x0 since=809s v=(0 0) 00010000:00010000:2.0:1784938543.456694:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938543.456698:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfc96367/0x7b044d4128f9f6da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.456706:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfc96367/0x7b044d4128f9f6da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.456713:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfc96367/0x7b044d4128f9f6da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.456720:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfc96367/0x7b044d4128f9f6da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.457524:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938543.457539:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938543.457545:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfc96367/0x7b044d4128f9f6da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.457554:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17be00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938543.457558:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfc96367/0x7b044d4128f9f6da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.457567:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfc96367/0x7b044d4128f9f6da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.457582:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfc96367/0x7b044d4128f9f6da lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.457590:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfc96367/0x7b044d4128f9f6da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.457607:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.457609:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.457610:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938543.457669:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938543.457677:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d1223b5/0x7b044d4128f9f6e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.457687:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9a:0x0].0x0 since=809s v=(0 0) 00010000:00010000:2.0:1784938543.457690:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938543.457695:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d1223b5/0x7b044d4128f9f6e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.457704:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d1223b5/0x7b044d4128f9f6e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.457712:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d1223b5/0x7b044d4128f9f6e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.457720:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d1223b5/0x7b044d4128f9f6e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.458843:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938543.458858:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938543.458865:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d1223b5/0x7b044d4128f9f6e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.458875:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17b800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938543.458880:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d1223b5/0x7b044d4128f9f6e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.458890:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d1223b5/0x7b044d4128f9f6e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.458909:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d1223b5/0x7b044d4128f9f6e1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.458917:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d1223b5/0x7b044d4128f9f6e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.458939:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.458942:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.458943:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938543.459607:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x99:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938543.459615:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006472ffd4/0x7b044d4128f9f6e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.459627:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x99:0x0].0x0 since=809s v=(0 0) 00010000:00010000:2.0:1784938543.459631:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x99:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938543.459637:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006472ffd4/0x7b044d4128f9f6e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.459647:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006472ffd4/0x7b044d4128f9f6e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.459655:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006472ffd4/0x7b044d4128f9f6e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.459662:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006472ffd4/0x7b044d4128f9f6e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.459682:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938543.459690:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938543.459695:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006472ffd4/0x7b044d4128f9f6e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.459702:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17a000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938543.459705:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006472ffd4/0x7b044d4128f9f6e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.459712:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006472ffd4/0x7b044d4128f9f6e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.459723:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006472ffd4/0x7b044d4128f9f6e8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.460834:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006472ffd4/0x7b044d4128f9f6e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.460861:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.460863:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.460865:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938543.460935:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x98:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938543.460941:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cac31b6d/0x7b044d4128f9f6ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.461159:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x98:0x0].0x0 since=809s v=(0 0) 00010000:00010000:2.0:1784938543.461164:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x98:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938543.461170:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cac31b6d/0x7b044d4128f9f6ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.461183:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cac31b6d/0x7b044d4128f9f6ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.461193:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cac31b6d/0x7b044d4128f9f6ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.461202:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cac31b6d/0x7b044d4128f9f6ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.461218:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938543.461226:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938543.461230:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cac31b6d/0x7b044d4128f9f6ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.461238:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d17ba00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938543.461242:0:25732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cac31b6d/0x7b044d4128f9f6ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.461250:0:25732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cac31b6d/0x7b044d4128f9f6ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.461263:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cac31b6d/0x7b044d4128f9f6ef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.461277:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cac31b6d/0x7b044d4128f9f6ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.461292:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.461293:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.461295:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938543.461333:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x97:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938543.461338:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa0855cc/0x7b044d4128f9f6f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.461346:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x97:0x0].0x0 since=809s v=(0 0) 00010000:00010000:2.0:1784938543.461350:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x97:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938543.461354:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa0855cc/0x7b044d4128f9f6f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.461362:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa0855cc/0x7b044d4128f9f6f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.461370:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa0855cc/0x7b044d4128f9f6f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.461378:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa0855cc/0x7b044d4128f9f6f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.461390:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938543.461396:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938543.462837:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa0855cc/0x7b044d4128f9f6f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.462860:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e01c00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938543.462866:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa0855cc/0x7b044d4128f9f6f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.462876:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa0855cc/0x7b044d4128f9f6f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.462896:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa0855cc/0x7b044d4128f9f6f6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.462904:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa0855cc/0x7b044d4128f9f6f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.462934:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.462936:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.462939:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938543.464347:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938543.464606:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x96:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938543.464617:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbf2ea91/0x7b044d4128f9f6fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.464634:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x96:0x0].0x0 since=809s v=(0 0) 00010000:00010000:2.0:1784938543.464638:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x96:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938543.464645:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbf2ea91/0x7b044d4128f9f6fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.464664:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbf2ea91/0x7b044d4128f9f6fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.464674:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbf2ea91/0x7b044d4128f9f6fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.464682:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbf2ea91/0x7b044d4128f9f6fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.464700:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938543.464710:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938543.464714:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbf2ea91/0x7b044d4128f9f6fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.464722:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938543.465018:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbf2ea91/0x7b044d4128f9f6fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.465031:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbf2ea91/0x7b044d4128f9f6fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.465047:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbf2ea91/0x7b044d4128f9f6fd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.465519:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbf2ea91/0x7b044d4128f9f6fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.465549:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.465551:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.465553:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938543.465627:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938543.465633:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a628baba/0x7b044d4128f9f704 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.465644:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x95:0x0].0x0 since=809s v=(0 0) 00010000:00010000:2.0:1784938543.465648:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x95:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938543.465654:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a628baba/0x7b044d4128f9f704 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.465665:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a628baba/0x7b044d4128f9f704 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.465674:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a628baba/0x7b044d4128f9f704 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.465681:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a628baba/0x7b044d4128f9f704 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.465696:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938543.465703:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938543.465707:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a628baba/0x7b044d4128f9f704 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.465721:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938543.465725:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a628baba/0x7b044d4128f9f704 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.465745:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a628baba/0x7b044d4128f9f704 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.465757:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a628baba/0x7b044d4128f9f704 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.465765:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a628baba/0x7b044d4128f9f704 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.465778:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.465779:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.465781:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938543.465819:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x94:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938543.465825:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090860e37/0x7b044d4128f9f70b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.465834:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x94:0x0].0x0 since=809s v=(0 0) 00010000:00010000:2.0:1784938543.465837:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x94:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938543.465842:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090860e37/0x7b044d4128f9f70b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.465852:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090860e37/0x7b044d4128f9f70b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1784938543.465861:0:21144:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1784938543.465861:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090860e37/0x7b044d4128f9f70b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.465873:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090860e37/0x7b044d4128f9f70b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.465886:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938543.465894:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938543.465898:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090860e37/0x7b044d4128f9f70b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.465904:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e01800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938543.465907:0:25732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090860e37/0x7b044d4128f9f70b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.465916:0:25732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090860e37/0x7b044d4128f9f70b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.465925:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090860e37/0x7b044d4128f9f70b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.465932:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090860e37/0x7b044d4128f9f70b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.468730:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.468743:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.468747:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784938543.468893:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x93:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938543.468904:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000866e2be0/0x7b044d4128f9f712 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.468921:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x93:0x0].0x0 since=809s v=(0 0) 00010000:00010000:3.0:1784938543.468925:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x93:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938543.468932:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000866e2be0/0x7b044d4128f9f712 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.468947:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000866e2be0/0x7b044d4128f9f712 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.468968:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000866e2be0/0x7b044d4128f9f712 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.468976:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000866e2be0/0x7b044d4128f9f712 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.469002:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784938543.469047:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x92:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938543.469052:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003d010a8/0x7b044d4128f9f719 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.469060:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x92:0x0].0x0 since=809s v=(0 0) 00010000:00010000:3.0:1784938543.469062:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x92:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938543.469066:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003d010a8/0x7b044d4128f9f719 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.469507:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938543.469525:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000866e2be0/0x7b044d4128f9f712 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.469535:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a7400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938543.469540:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000866e2be0/0x7b044d4128f9f712 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.469549:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000866e2be0/0x7b044d4128f9f712 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.469565:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000866e2be0/0x7b044d4128f9f712 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.469572:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000866e2be0/0x7b044d4128f9f712 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.469619:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.469621:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.469623:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938543.470364:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003d010a8/0x7b044d4128f9f719 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.470374:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003d010a8/0x7b044d4128f9f719 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.470381:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003d010a8/0x7b044d4128f9f719 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.470517:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938543.470543:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938543.470550:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003d010a8/0x7b044d4128f9f719 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.470558:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f238d3a7600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938543.470562:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003d010a8/0x7b044d4128f9f719 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.470570:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003d010a8/0x7b044d4128f9f719 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.470584:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003d010a8/0x7b044d4128f9f719 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.470591:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003d010a8/0x7b044d4128f9f719 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938543.470607:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x91:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938543.470616:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.470616:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce526df7/0x7b044d4128f9f720 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.470620:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938543.470623:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.470632:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x91:0x0].0x0 since=809s v=(0 0) 00010000:00010000:2.0:1784938543.470637:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x91:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938543.470643:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce526df7/0x7b044d4128f9f720 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.470651:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce526df7/0x7b044d4128f9f720 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.470658:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce526df7/0x7b044d4128f9f720 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.470665:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce526df7/0x7b044d4128f9f720 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.470687:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784938543.470723:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x90:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938543.471123:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006680760a/0x7b044d4128f9f727 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.471190:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938543.471195:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce526df7/0x7b044d4128f9f720 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.471210:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e01000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938543.471213:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce526df7/0x7b044d4128f9f720 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.471221:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce526df7/0x7b044d4128f9f720 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.471233:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce526df7/0x7b044d4128f9f720 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.471269:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x90:0x0].0x0 since=809s v=(0 0) 00010000:00010000:2.0:1784938543.471273:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x90:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938543.471278:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006680760a/0x7b044d4128f9f727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.471288:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006680760a/0x7b044d4128f9f727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.471298:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006680760a/0x7b044d4128f9f727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.471306:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006680760a/0x7b044d4128f9f727 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.471321:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938543.471330:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938543.471339:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce526df7/0x7b044d4128f9f720 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.471339:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006680760a/0x7b044d4128f9f727 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.471358:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938543.471363:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006680760a/0x7b044d4128f9f727 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.471372:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006680760a/0x7b044d4128f9f727 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.471383:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006680760a/0x7b044d4128f9f727 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.471390:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006680760a/0x7b044d4128f9f727 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.471391:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938543.471395:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938543.471399:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.472197:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.472202:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.472204:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938543.472294:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938543.472304:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a5e02e4/0x7b044d4128f9f72e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.472316:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8f:0x0].0x0 since=809s v=(0 0) 00010000:00010000:2.0:1784938543.472320:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938543.472325:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a5e02e4/0x7b044d4128f9f72e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.472336:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a5e02e4/0x7b044d4128f9f72e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.472344:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a5e02e4/0x7b044d4128f9f72e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.472351:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a5e02e4/0x7b044d4128f9f72e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.472373:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938543.472418:0:25732:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938543.472432:0:25732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a5e02e4/0x7b044d4128f9f72e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.472445:0:25732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00e00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938543.472449:0:25732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a5e02e4/0x7b044d4128f9f72e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.472457:0:25732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a5e02e4/0x7b044d4128f9f72e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.472472:0:25732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a5e02e4/0x7b044d4128f9f72e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.472479:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a5e02e4/0x7b044d4128f9f72e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.472494:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938543.472496:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938543.472498:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938543.473046:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938543.473316:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000507b298e/0x7b044d4128f9f735 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.473328:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8e:0x0].0x0 since=809s v=(0 0) 00010000:00010000:2.0:1784938543.473331:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938543.473336:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000507b298e/0x7b044d4128f9f735 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.473345:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000507b298e/0x7b044d4128f9f735 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.473353:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000507b298e/0x7b044d4128f9f735 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.473360:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000507b298e/0x7b044d4128f9f735 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.473381:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938543.473404:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938543.473411:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000507b298e/0x7b044d4128f9f735 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.473419:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00c00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938543.473422:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000507b298e/0x7b044d4128f9f735 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.473431:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000507b298e/0x7b044d4128f9f735 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.473444:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000507b298e/0x7b044d4128f9f735 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.473451:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000507b298e/0x7b044d4128f9f735 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.473467:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938543.473469:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938543.473470:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938543.474250:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938543.474258:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015193dfb/0x7b044d4128f9f73c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.474268:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8d:0x0].0x0 since=809s v=(0 0) 00010000:00010000:2.0:1784938543.474271:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938543.474276:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015193dfb/0x7b044d4128f9f73c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.474285:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015193dfb/0x7b044d4128f9f73c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.474294:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015193dfb/0x7b044d4128f9f73c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.474302:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015193dfb/0x7b044d4128f9f73c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.474326:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784938543.474375:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938543.474381:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ff6aa56/0x7b044d4128f9f743 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.474388:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8c:0x0].0x0 since=809s v=(0 0) 00010000:00010000:2.0:1784938543.474391:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938543.474394:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ff6aa56/0x7b044d4128f9f743 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.474659:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938543.474666:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015193dfb/0x7b044d4128f9f73c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.474675:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e01400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938543.474679:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015193dfb/0x7b044d4128f9f73c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.474688:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015193dfb/0x7b044d4128f9f73c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.474702:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015193dfb/0x7b044d4128f9f73c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.474709:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015193dfb/0x7b044d4128f9f73c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.474732:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938543.474734:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938543.474736:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.476268:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ff6aa56/0x7b044d4128f9f743 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.476291:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ff6aa56/0x7b044d4128f9f743 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.476300:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ff6aa56/0x7b044d4128f9f743 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.476323:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938543.476335:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938543.476341:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ff6aa56/0x7b044d4128f9f743 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.476349:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938543.476355:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ff6aa56/0x7b044d4128f9f743 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.476365:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ff6aa56/0x7b044d4128f9f743 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.476382:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ff6aa56/0x7b044d4128f9f743 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.476388:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ff6aa56/0x7b044d4128f9f743 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.476424:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.476427:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.476428:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938543.476544:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938543.476551:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fcea42e/0x7b044d4128f9f74a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.476561:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8b:0x0].0x0 since=809s v=(0 0) 00010000:00010000:2.0:1784938543.476565:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938543.476572:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fcea42e/0x7b044d4128f9f74a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.476583:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fcea42e/0x7b044d4128f9f74a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.476591:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fcea42e/0x7b044d4128f9f74a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.476601:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fcea42e/0x7b044d4128f9f74a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.476616:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938543.476624:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938543.476629:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fcea42e/0x7b044d4128f9f74a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.476636:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e01e00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938543.476640:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fcea42e/0x7b044d4128f9f74a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.476649:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fcea42e/0x7b044d4128f9f74a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.476661:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fcea42e/0x7b044d4128f9f74a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.476668:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fcea42e/0x7b044d4128f9f74a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.476680:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.476682:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.476684:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938543.476751:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938543.476759:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d2fa755/0x7b044d4128f9f751 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.476767:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8a:0x0].0x0 since=809s v=(0 0) 00010000:00010000:2.0:1784938543.476771:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938543.476775:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d2fa755/0x7b044d4128f9f751 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.476784:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d2fa755/0x7b044d4128f9f751 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.476792:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d2fa755/0x7b044d4128f9f751 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.476799:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d2fa755/0x7b044d4128f9f751 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.476814:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784938543.476861:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x89:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938543.476867:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e4a76a9/0x7b044d4128f9f758 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.476875:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x89:0x0].0x0 since=809s v=(0 0) 00010000:00010000:2.0:1784938543.476878:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x89:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938543.476882:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e4a76a9/0x7b044d4128f9f758 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.476891:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e4a76a9/0x7b044d4128f9f758 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.476899:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e4a76a9/0x7b044d4128f9f758 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.476906:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e4a76a9/0x7b044d4128f9f758 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.476921:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1784938543.476984:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x88:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938543.476990:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000308168bd/0x7b044d4128f9f75f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.476997:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x88:0x0].0x0 since=809s v=(0 0) 00010000:00010000:2.0:1784938543.477000:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x88:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938543.477004:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000308168bd/0x7b044d4128f9f75f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477012:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000308168bd/0x7b044d4128f9f75f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477019:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000308168bd/0x7b044d4128f9f75f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477026:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000308168bd/0x7b044d4128f9f75f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477047:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1784938543.477066:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784938543.477070:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d2fa755/0x7b044d4128f9f751 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477078:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e01a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938543.477082:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d2fa755/0x7b044d4128f9f751 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477089:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d2fa755/0x7b044d4128f9f751 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477101:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d2fa755/0x7b044d4128f9f751 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477108:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d2fa755/0x7b044d4128f9f751 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477121:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938543.477124:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e4a76a9/0x7b044d4128f9f758 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477131:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e01200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938543.477134:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e4a76a9/0x7b044d4128f9f758 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477171:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e4a76a9/0x7b044d4128f9f758 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477182:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e4a76a9/0x7b044d4128f9f758 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477189:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e4a76a9/0x7b044d4128f9f758 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477201:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938543.477205:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000308168bd/0x7b044d4128f9f75f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477211:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938543.477215:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000308168bd/0x7b044d4128f9f75f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477222:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000308168bd/0x7b044d4128f9f75f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477232:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000308168bd/0x7b044d4128f9f75f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477239:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000308168bd/0x7b044d4128f9f75f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477257:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.477259:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.477261:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938543.477309:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x87:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938543.477315:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026765547/0x7b044d4128f9f766 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477323:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x87:0x0].0x0 since=809s v=(0 0) 00010000:00010000:2.0:1784938543.477327:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x87:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938543.477331:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026765547/0x7b044d4128f9f766 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477340:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026765547/0x7b044d4128f9f766 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477348:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026765547/0x7b044d4128f9f766 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477356:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026765547/0x7b044d4128f9f766 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477371:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938543.477378:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938543.477382:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026765547/0x7b044d4128f9f766 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477394:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e00800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938543.477398:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026765547/0x7b044d4128f9f766 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477406:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026765547/0x7b044d4128f9f766 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477417:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026765547/0x7b044d4128f9f766 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477425:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026765547/0x7b044d4128f9f766 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477438:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.477440:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.477442:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938543.477487:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x86:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938543.477492:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093f69a35/0x7b044d4128f9f76d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477500:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x86:0x0].0x0 since=809s v=(0 0) 00010000:00010000:2.0:1784938543.477504:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x86:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938543.477508:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093f69a35/0x7b044d4128f9f76d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477528:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093f69a35/0x7b044d4128f9f76d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477536:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093f69a35/0x7b044d4128f9f76d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477543:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093f69a35/0x7b044d4128f9f76d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477557:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938543.477564:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938543.477568:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093f69a35/0x7b044d4128f9f76d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477574:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2386e01600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938543.477578:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093f69a35/0x7b044d4128f9f76d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477587:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093f69a35/0x7b044d4128f9f76d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.477592:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.477598:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093f69a35/0x7b044d4128f9f76d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.477601:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.477609:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093f69a35/0x7b044d4128f9f76d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477626:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.477628:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.477630:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938543.477674:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x85:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938543.477679:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ebdd9b5/0x7b044d4128f9f774 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477686:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x85:0x0].0x0 since=809s v=(0 0) 00010000:00010000:2.0:1784938543.477689:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x85:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938543.477692:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ebdd9b5/0x7b044d4128f9f774 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477699:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ebdd9b5/0x7b044d4128f9f774 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477706:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ebdd9b5/0x7b044d4128f9f774 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477712:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ebdd9b5/0x7b044d4128f9f774 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477733:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784938543.477770:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x84:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938543.477775:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000180f7329/0x7b044d4128f9f77b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477782:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x84:0x0].0x0 since=809s v=(0 0) 00010000:00010000:2.0:1784938543.477785:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x84:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938543.477789:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000180f7329/0x7b044d4128f9f77b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477798:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000180f7329/0x7b044d4128f9f77b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477806:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000180f7329/0x7b044d4128f9f77b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477814:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000180f7329/0x7b044d4128f9f77b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477827:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784938543.477834:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938543.477838:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ebdd9b5/0x7b044d4128f9f774 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477845:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b29200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938543.477848:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ebdd9b5/0x7b044d4128f9f774 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477856:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ebdd9b5/0x7b044d4128f9f774 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477867:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ebdd9b5/0x7b044d4128f9f774 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477874:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ebdd9b5/0x7b044d4128f9f774 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477890:0:19222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938543.477893:0:19222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000180f7329/0x7b044d4128f9f77b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477900:0:19222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b28c00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938543.477903:0:19222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000180f7329/0x7b044d4128f9f77b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477911:0:19222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000180f7329/0x7b044d4128f9f77b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477920:0:19222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000180f7329/0x7b044d4128f9f77b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477928:0:19222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000180f7329/0x7b044d4128f9f77b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477941:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.477943:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.477944:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938543.477985:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x83:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938543.477990:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b849a00e/0x7b044d4128f9f782 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.477998:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x83:0x0].0x0 since=809s v=(0 0) 00010000:00010000:2.0:1784938543.478001:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x83:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938543.478005:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b849a00e/0x7b044d4128f9f782 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.478013:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b849a00e/0x7b044d4128f9f782 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.478021:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b849a00e/0x7b044d4128f9f782 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.478029:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b849a00e/0x7b044d4128f9f782 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.478039:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784938543.478078:0:25716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x82:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938543.478082:0:25716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b50e285/0x7b044d4128f9f789 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.478090:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x82:0x0].0x0 since=809s v=(0 0) 00010000:00010000:2.0:1784938543.478092:0:25716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x82:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938543.478096:0:25716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b50e285/0x7b044d4128f9f789 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.478104:0:25716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b50e285/0x7b044d4128f9f789 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.478111:0:25716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b50e285/0x7b044d4128f9f789 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.478119:0:25716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b50e285/0x7b044d4128f9f789 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.478130:0:25716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:2.0:1784938543.478364:0:25716:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:105 00000100:00100000:2.0:1784938543.478453:0:25716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2387daf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:28423:x1871643350968832:12345-192.168.202.154@tcp:5:osp-pre-0-0.0 Request processed in 43609us (44918us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938543.478463:0:25716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 1006 00010000:00010000:3.0:1784938543.480430:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938543.480445:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b849a00e/0x7b044d4128f9f782 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.480458:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b28600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938543.480463:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b849a00e/0x7b044d4128f9f782 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.480475:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b849a00e/0x7b044d4128f9f782 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.480496:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b849a00e/0x7b044d4128f9f782 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.480503:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b849a00e/0x7b044d4128f9f782 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.480540:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938543.480544:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b50e285/0x7b044d4128f9f789 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.480556:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24c5b28a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938543.480559:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b50e285/0x7b044d4128f9f789 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.480567:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b50e285/0x7b044d4128f9f789 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.480577:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b50e285/0x7b044d4128f9f789 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.480583:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b50e285/0x7b044d4128f9f789 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.480595:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938543.480596:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938543.480598:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938543.480606:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938543.480610:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938543.483259:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938543.483274:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f10ec8f1/0x7b044d4128f9f790 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.483299:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa1:0x0].0x0 since=809s v=(0 0) 00010000:00010000:0.0:1784938543.483304:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938543.483310:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f10ec8f1/0x7b044d4128f9f790 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.483325:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f10ec8f1/0x7b044d4128f9f790 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.483334:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f10ec8f1/0x7b044d4128f9f790 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.483343:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f10ec8f1/0x7b044d4128f9f790 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.483366:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784938543.483883:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938543.483890:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db15c6a5/0x7b044d4128f9f797 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.483899:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa0:0x0].0x0 since=809s v=(0 0) 00010000:00010000:0.0:1784938543.483902:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938543.483907:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db15c6a5/0x7b044d4128f9f797 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.483916:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db15c6a5/0x7b044d4128f9f797 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.483928:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db15c6a5/0x7b044d4128f9f797 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.483935:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db15c6a5/0x7b044d4128f9f797 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.486093:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1784938543.486238:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938543.486247:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000239932ac/0x7b044d4128f9f79e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.486263:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f:0x0].0x0 since=809s v=(0 0) 00010000:00010000:0.0:1784938543.486268:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938543.486274:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000239932ac/0x7b044d4128f9f79e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.486287:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000239932ac/0x7b044d4128f9f79e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.486295:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000239932ac/0x7b044d4128f9f79e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.486302:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000239932ac/0x7b044d4128f9f79e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.489285:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784938543.489302:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f10ec8f1/0x7b044d4128f9f790 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.489317:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4056800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938543.489322:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f10ec8f1/0x7b044d4128f9f790 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.489336:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f10ec8f1/0x7b044d4128f9f790 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.489359:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f10ec8f1/0x7b044d4128f9f790 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.489367:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f10ec8f1/0x7b044d4128f9f790 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.489400:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938543.489415:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db15c6a5/0x7b044d4128f9f797 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.489422:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057e00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938543.489425:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db15c6a5/0x7b044d4128f9f797 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.489432:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db15c6a5/0x7b044d4128f9f797 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.489442:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db15c6a5/0x7b044d4128f9f797 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.489450:0:22954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db15c6a5/0x7b044d4128f9f797 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.489463:0:22954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938543.489467:0:22954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000239932ac/0x7b044d4128f9f79e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.489473:0:22954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:2.0:1784938543.489476:0:22954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000239932ac/0x7b044d4128f9f79e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.489489:0:22954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000239932ac/0x7b044d4128f9f79e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.489498:0:22954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000239932ac/0x7b044d4128f9f79e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938543.489506:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.489517:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.489519:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938543.489767:0:28423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68a8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:28423:1871643350968832:192.168.202.154@tcp:5:osp-pre-0-0.0 00000004:00080000:2.0:1784938543.489783:0:28423:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0xa1:0x0] from OST, last_created [0x280000401:0xa1:0x0]last_used is [0x280000401:0x69:0x0] 00000100:00100000:2.0:1784938543.489867:0:28423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68a9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:28423:1871643350969216:192.168.202.154@tcp:5:osp-pre-0-0.0 00000100:00100000:2.0:1784938543.489933:0:28423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238601e540 going to sleep for 11 seconds 00000100:00100000:2.0:1784938543.489960:0:16390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784938543.489974:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350969088:192.168.202.154@tcp:13:osp-pre-0-0.0 00010000:00010000:3.0:1784938543.491992:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938543.492430:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938543.492465:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938543.492499:0:25721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350969216 00000100:00100000:2.0:1784938543.492507:0:25721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350969216 00000100:00100000:2.0:1784938543.492564:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 1008 00000100:00100000:2.0:1784938543.492575:0:25721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:28423:x1871643350969216:12345-192.168.202.154@tcp:5:osp-pre-0-0.0 00002000:00080000:2.0:1784938543.492621:0:25721:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x280000401 at 162 00002000:00080000:2.0:1784938543.494391:0:25721:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x280000401 at 170 00000001:00080000:2.0:1784938543.494715:0:25721:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967575 00002000:00080000:2.0:1784938543.494871:0:25721:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x280000401 at 178 00000001:00080000:2.0:1784938543.496859:0:25721:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967576 00002000:00080000:2.0:1784938543.496895:0:25721:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x280000401 at 186 00000001:00080000:2.0:1784938543.497590:0:25721:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967577 00000100:00100000:2.0:1784938543.497839:0:25721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:28423:x1871643350969216:12345-192.168.202.154@tcp:5:osp-pre-0-0.0 Request processed in 5260us (5408us total) trans 4294967578 rc 0/0 00000100:00100000:2.0:1784938543.497851:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 1008 00000020:00080000:2.0:1784938543.497857:0:25721:0:(tgt_main.c:784:tgt_ses_key_exit()) total 4 transactions per RPC 00000100:00100000:2.0:1784938543.497898:0:21154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350969088 00000100:00100000:2.0:1784938543.497906:0:21154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350969088 00000100:00100000:2.0:1784938543.497960:0:21154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 112 00000100:00100000:2.0:1784938543.497969:0:21154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:16390:x1871643350969088:12345-192.168.202.154@tcp:13:osp-pre-0-0.0 00002000:00000024:2.0:1784938543.497991:0:21154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 270144 pending 0 free 313057280 avail 285245440 00010000:00010000:0.0:1784938543.498324:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784938543.498335:0:25720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000239932ac/0x7b044d4128f9f79e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938543.498336:0:21154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:16390:x1871643350969088:12345-192.168.202.154@tcp:13:osp-pre-0-0.0 Request processed in 368us (5869us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938543.498343:0:21154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 112 00002000:00010000:0.0:1784938543.498435:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938543.498442:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4e606ca/0x7b044d4128f9f7a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.498454:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e:0x0].0x0 since=809s v=(0 0) 00010000:00010000:0.0:1784938543.498458:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938543.498464:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4e606ca/0x7b044d4128f9f7a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.498476:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4e606ca/0x7b044d4128f9f7a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.498486:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4e606ca/0x7b044d4128f9f7a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.498493:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4e606ca/0x7b044d4128f9f7a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.498507:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784938543.498555:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938543.498561:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b14493c6/0x7b044d4128f9f7ac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.498568:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d:0x0].0x0 since=809s v=(0 0) 00010000:00010000:0.0:1784938543.498571:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938543.498575:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b14493c6/0x7b044d4128f9f7ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.498584:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b14493c6/0x7b044d4128f9f7ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.498592:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b14493c6/0x7b044d4128f9f7ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.498599:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b14493c6/0x7b044d4128f9f7ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.498609:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938543.498613:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938543.498617:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4e606ca/0x7b044d4128f9f7a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.498626:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938543.498630:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4e606ca/0x7b044d4128f9f7a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.498645:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4e606ca/0x7b044d4128f9f7a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938543.498646:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938543.498651:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a1e393b/0x7b044d4128f9f7b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.498658:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c:0x0].0x0 since=809s v=(0 0) 00010000:00010000:0.0:1784938543.498660:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938543.498662:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4e606ca/0x7b044d4128f9f7a5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.498664:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a1e393b/0x7b044d4128f9f7b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.498671:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4e606ca/0x7b044d4128f9f7a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.498673:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a1e393b/0x7b044d4128f9f7b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.498685:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938543.498687:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a1e393b/0x7b044d4128f9f7b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.498688:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b14493c6/0x7b044d4128f9f7ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.498695:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a1e393b/0x7b044d4128f9f7b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.498696:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938543.498699:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b14493c6/0x7b044d4128f9f7ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.498706:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b14493c6/0x7b044d4128f9f7ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.498707:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938543.498715:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b14493c6/0x7b044d4128f9f7ac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.498722:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b14493c6/0x7b044d4128f9f7ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938543.498739:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938543.498744:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004766fa96/0x7b044d4128f9f7ba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.498752:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9b:0x0].0x0 since=809s v=(0 0) 00010000:00010000:3.0:1784938543.498754:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938543.498755:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938543.498757:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a1e393b/0x7b044d4128f9f7b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.498759:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004766fa96/0x7b044d4128f9f7ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.498765:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057c00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938543.498768:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004766fa96/0x7b044d4128f9f7ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.498769:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a1e393b/0x7b044d4128f9f7b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.498778:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a1e393b/0x7b044d4128f9f7b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.498778:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004766fa96/0x7b044d4128f9f7ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.498786:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004766fa96/0x7b044d4128f9f7ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.498788:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a1e393b/0x7b044d4128f9f7b3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.498795:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a1e393b/0x7b044d4128f9f7b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.498804:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938543.498805:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938543.498808:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004766fa96/0x7b044d4128f9f7ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.498814:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4056600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938543.498817:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004766fa96/0x7b044d4128f9f7ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.498829:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004766fa96/0x7b044d4128f9f7ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938543.498835:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938543.498838:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004766fa96/0x7b044d4128f9f7ba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.498839:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000331fa39b/0x7b044d4128f9f7c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.498846:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004766fa96/0x7b044d4128f9f7ba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.498847:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9a:0x0].0x0 since=809s v=(0 0) 00010000:00010000:0.0:1784938543.498850:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938543.498854:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000331fa39b/0x7b044d4128f9f7c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.498858:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938543.498859:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938543.498861:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938543.498862:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000331fa39b/0x7b044d4128f9f7c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.498867:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938543.498869:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000331fa39b/0x7b044d4128f9f7c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.498872:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938543.498876:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000331fa39b/0x7b044d4128f9f7c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.498877:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938543.498894:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938543.498900:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938543.498904:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000331fa39b/0x7b044d4128f9f7c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.498910:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4056c00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938543.498913:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000331fa39b/0x7b044d4128f9f7c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.498921:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000331fa39b/0x7b044d4128f9f7c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938543.498927:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x99:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938543.498932:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b01e28b4/0x7b044d4128f9f7c8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.498936:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000331fa39b/0x7b044d4128f9f7c1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.498939:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x99:0x0].0x0 since=809s v=(0 0) 00010000:00010000:3.0:1784938543.498943:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000331fa39b/0x7b044d4128f9f7c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.498943:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x99:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938543.498946:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b01e28b4/0x7b044d4128f9f7c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.498955:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b01e28b4/0x7b044d4128f9f7c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.498963:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b01e28b4/0x7b044d4128f9f7c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.498968:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938543.498970:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938543.498970:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b01e28b4/0x7b044d4128f9f7c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.498971:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938543.498984:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938543.498989:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938543.498993:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b01e28b4/0x7b044d4128f9f7c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.498999:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938543.499002:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b01e28b4/0x7b044d4128f9f7c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499010:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b01e28b4/0x7b044d4128f9f7c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938543.499019:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x98:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938543.499025:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcd3e12b/0x7b044d4128f9f7cf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499031:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b01e28b4/0x7b044d4128f9f7c8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499032:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x98:0x0].0x0 since=809s v=(0 0) 00010000:00010000:0.0:1784938543.499035:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x98:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938543.499039:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b01e28b4/0x7b044d4128f9f7c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499039:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcd3e12b/0x7b044d4128f9f7cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499048:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcd3e12b/0x7b044d4128f9f7cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499056:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcd3e12b/0x7b044d4128f9f7cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499063:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938543.499064:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938543.499064:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcd3e12b/0x7b044d4128f9f7cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499066:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938543.499077:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784938543.499125:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x97:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938543.499131:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d815b0aa/0x7b044d4128f9f7d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499139:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x97:0x0].0x0 since=809s v=(0 0) 00010000:00010000:0.0:1784938543.499141:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x97:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938543.499164:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d815b0aa/0x7b044d4128f9f7d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499173:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d815b0aa/0x7b044d4128f9f7d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499180:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d815b0aa/0x7b044d4128f9f7d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499187:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d815b0aa/0x7b044d4128f9f7d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499198:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1784938543.499235:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x96:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938543.499241:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000684fc97c/0x7b044d4128f9f7dd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499250:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x96:0x0].0x0 since=809s v=(0 0) 00010000:00010000:0.0:1784938543.499253:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x96:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938543.499256:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000684fc97c/0x7b044d4128f9f7dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499264:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000684fc97c/0x7b044d4128f9f7dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499271:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000684fc97c/0x7b044d4128f9f7dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499278:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000684fc97c/0x7b044d4128f9f7dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499288:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1784938543.499325:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x95:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938543.499331:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001fa763f/0x7b044d4128f9f7e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499338:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x95:0x0].0x0 since=809s v=(0 0) 00010000:00010000:0.0:1784938543.499341:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x95:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938543.499345:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001fa763f/0x7b044d4128f9f7e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499354:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001fa763f/0x7b044d4128f9f7e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499366:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001fa763f/0x7b044d4128f9f7e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499373:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001fa763f/0x7b044d4128f9f7e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499383:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1784938543.499388:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784938543.499392:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcd3e12b/0x7b044d4128f9f7cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499399:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057a00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938543.499403:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcd3e12b/0x7b044d4128f9f7cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499411:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcd3e12b/0x7b044d4128f9f7cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938543.499416:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x94:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938543.499420:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032c0299a/0x7b044d4128f9f7eb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499422:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcd3e12b/0x7b044d4128f9f7cf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499428:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x94:0x0].0x0 since=809s v=(0 0) 00010000:00010000:3.0:1784938543.499430:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcd3e12b/0x7b044d4128f9f7cf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499430:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x94:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938543.499435:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032c0299a/0x7b044d4128f9f7eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499443:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784938543.499443:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032c0299a/0x7b044d4128f9f7eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499446:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d815b0aa/0x7b044d4128f9f7d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499451:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032c0299a/0x7b044d4128f9f7eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499453:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b4057600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938543.499457:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d815b0aa/0x7b044d4128f9f7d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499459:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032c0299a/0x7b044d4128f9f7eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499465:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d815b0aa/0x7b044d4128f9f7d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499473:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1784938543.499474:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d815b0aa/0x7b044d4128f9f7d6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499480:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d815b0aa/0x7b044d4128f9f7d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499490:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784938543.499493:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000684fc97c/0x7b044d4128f9f7dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499499:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2480030e00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938543.499502:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000684fc97c/0x7b044d4128f9f7dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938543.499502:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x93:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938543.499507:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000268e9728/0x7b044d4128f9f7f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499521:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000684fc97c/0x7b044d4128f9f7dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499525:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x93:0x0].0x0 since=809s v=(0 0) 00010000:00010000:0.0:1784938543.499528:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x93:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938543.499531:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000684fc97c/0x7b044d4128f9f7dd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499532:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000268e9728/0x7b044d4128f9f7f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499539:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000684fc97c/0x7b044d4128f9f7dd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499541:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000268e9728/0x7b044d4128f9f7f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499549:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000268e9728/0x7b044d4128f9f7f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499552:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938543.499556:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001fa763f/0x7b044d4128f9f7e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499557:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000268e9728/0x7b044d4128f9f7f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499563:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2480031400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938543.499565:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784938543.499566:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001fa763f/0x7b044d4128f9f7e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499572:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001fa763f/0x7b044d4128f9f7e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499581:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001fa763f/0x7b044d4128f9f7e4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499588:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001fa763f/0x7b044d4128f9f7e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938543.499593:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x92:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938543.499597:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb88e185/0x7b044d4128f9f7f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499600:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938543.499603:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032c0299a/0x7b044d4128f9f7eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499604:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x92:0x0].0x0 since=809s v=(0 0) 00010000:00010000:0.0:1784938543.499607:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x92:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938543.499610:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2480030800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938543.499612:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb88e185/0x7b044d4128f9f7f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499613:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032c0299a/0x7b044d4128f9f7eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499620:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb88e185/0x7b044d4128f9f7f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499628:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032c0299a/0x7b044d4128f9f7eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499629:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb88e185/0x7b044d4128f9f7f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499636:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb88e185/0x7b044d4128f9f7f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499637:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032c0299a/0x7b044d4128f9f7eb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499644:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784938543.499645:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032c0299a/0x7b044d4128f9f7eb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499654:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938543.499657:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000268e9728/0x7b044d4128f9f7f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499663:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2480031000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938543.499666:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000268e9728/0x7b044d4128f9f7f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938543.499671:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x91:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938543.499674:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000268e9728/0x7b044d4128f9f7f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499676:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce195e5a/0x7b044d4128f9f800 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499683:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x91:0x0].0x0 since=809s v=(0 0) 00010000:00010000:3.0:1784938543.499684:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000268e9728/0x7b044d4128f9f7f2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499686:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x91:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938543.499690:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce195e5a/0x7b044d4128f9f800 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499692:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000268e9728/0x7b044d4128f9f7f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499699:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce195e5a/0x7b044d4128f9f800 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499707:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce195e5a/0x7b044d4128f9f800 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499708:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938543.499711:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb88e185/0x7b044d4128f9f7f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499716:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce195e5a/0x7b044d4128f9f800 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499718:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2480030200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938543.499721:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb88e185/0x7b044d4128f9f7f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499723:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938543.499741:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb88e185/0x7b044d4128f9f7f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499750:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb88e185/0x7b044d4128f9f7f9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938543.499754:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x90:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938543.499758:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb88e185/0x7b044d4128f9f7f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499758:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000644dbc6b/0x7b044d4128f9f807 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499766:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x90:0x0].0x0 since=809s v=(0 0) 00010000:00010000:0.0:1784938543.499768:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x90:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938543.499770:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938543.499772:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000644dbc6b/0x7b044d4128f9f807 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499773:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce195e5a/0x7b044d4128f9f800 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499780:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2480030000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938543.499781:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000644dbc6b/0x7b044d4128f9f807 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499783:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce195e5a/0x7b044d4128f9f800 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499790:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000644dbc6b/0x7b044d4128f9f807 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499798:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce195e5a/0x7b044d4128f9f800 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499798:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000644dbc6b/0x7b044d4128f9f807 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499805:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938543.499807:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce195e5a/0x7b044d4128f9f800 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499812:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce195e5a/0x7b044d4128f9f800 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499823:0:25733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938543.499826:0:25733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000644dbc6b/0x7b044d4128f9f807 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499832:0:25733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2480031200 already unused, calling callback (ffffffffc0d954a0) 00002000:00010000:0.0:1784938543.499834:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938543.499835:0:25733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000644dbc6b/0x7b044d4128f9f807 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499839:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034c21370/0x7b044d4128f9f80e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499843:0:25733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000644dbc6b/0x7b044d4128f9f807 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499847:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8f:0x0].0x0 since=809s v=(0 0) 00010000:00010000:0.0:1784938543.499850:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938543.499853:0:25733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000644dbc6b/0x7b044d4128f9f807 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499854:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034c21370/0x7b044d4128f9f80e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499861:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000644dbc6b/0x7b044d4128f9f807 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499863:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034c21370/0x7b044d4128f9f80e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499871:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034c21370/0x7b044d4128f9f80e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499877:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938543.499877:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034c21370/0x7b044d4128f9f80e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499879:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938543.499881:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938543.499890:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938543.499894:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938543.499898:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034c21370/0x7b044d4128f9f80e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499904:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2480030400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938543.499907:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034c21370/0x7b044d4128f9f80e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499915:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034c21370/0x7b044d4128f9f80e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938543.499921:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938543.499924:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034c21370/0x7b044d4128f9f80e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499926:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a311b58c/0x7b044d4128f9f815 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.499932:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034c21370/0x7b044d4128f9f80e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499933:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8e:0x0].0x0 since=809s v=(0 0) 00010000:00010000:0.0:1784938543.499936:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938543.499940:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a311b58c/0x7b044d4128f9f815 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499948:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a311b58c/0x7b044d4128f9f815 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499973:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a311b58c/0x7b044d4128f9f815 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499981:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a311b58c/0x7b044d4128f9f815 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.499990:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784938543.500024:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938543.500029:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023799176/0x7b044d4128f9f81c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500036:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8d:0x0].0x0 since=809s v=(0 0) 00010000:00010000:0.0:1784938543.500039:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938543.500043:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023799176/0x7b044d4128f9f81c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500053:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023799176/0x7b044d4128f9f81c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500061:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023799176/0x7b044d4128f9f81c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500067:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023799176/0x7b044d4128f9f81c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500080:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1784938543.500114:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938543.500119:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fce19144/0x7b044d4128f9f823 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500126:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8c:0x0].0x0 since=809s v=(0 0) 00010000:00010000:0.0:1784938543.500128:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938543.500132:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fce19144/0x7b044d4128f9f823 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500140:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fce19144/0x7b044d4128f9f823 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500166:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fce19144/0x7b044d4128f9f823 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500173:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fce19144/0x7b044d4128f9f823 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500181:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1784938543.500214:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938543.500220:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000753d2ec8/0x7b044d4128f9f82a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500227:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8b:0x0].0x0 since=809s v=(0 0) 00010000:00010000:0.0:1784938543.500230:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938543.500233:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784938543.500234:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000753d2ec8/0x7b044d4128f9f82a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500238:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a311b58c/0x7b044d4128f9f815 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500243:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000753d2ec8/0x7b044d4128f9f82a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500245:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b379d200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938543.500249:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a311b58c/0x7b044d4128f9f815 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500251:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000753d2ec8/0x7b044d4128f9f82a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500258:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a311b58c/0x7b044d4128f9f815 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500258:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000753d2ec8/0x7b044d4128f9f82a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500266:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1784938543.500268:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a311b58c/0x7b044d4128f9f815 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500275:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a311b58c/0x7b044d4128f9f815 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500288:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784938543.500291:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023799176/0x7b044d4128f9f81c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938543.500296:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938543.500297:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b379d400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938543.500300:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078ac4352/0x7b044d4128f9f831 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500301:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023799176/0x7b044d4128f9f81c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500308:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8a:0x0].0x0 since=809s v=(0 0) 00010000:00010000:3.0:1784938543.500310:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023799176/0x7b044d4128f9f81c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500311:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938543.500315:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078ac4352/0x7b044d4128f9f831 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500319:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023799176/0x7b044d4128f9f81c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500324:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078ac4352/0x7b044d4128f9f831 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500327:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023799176/0x7b044d4128f9f81c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500332:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078ac4352/0x7b044d4128f9f831 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500337:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938543.500339:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078ac4352/0x7b044d4128f9f831 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500341:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fce19144/0x7b044d4128f9f823 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500348:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b379c200 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938543.500348:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784938543.500351:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fce19144/0x7b044d4128f9f823 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500357:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fce19144/0x7b044d4128f9f823 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500366:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fce19144/0x7b044d4128f9f823 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500373:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fce19144/0x7b044d4128f9f823 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938543.500376:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x89:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938543.500380:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af5a1535/0x7b044d4128f9f838 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500384:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938543.500387:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000753d2ec8/0x7b044d4128f9f82a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500387:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x89:0x0].0x0 since=809s v=(0 0) 00010000:00010000:0.0:1784938543.500390:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x89:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938543.500394:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b379da00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938543.500395:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af5a1535/0x7b044d4128f9f838 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500398:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000753d2ec8/0x7b044d4128f9f82a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500403:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af5a1535/0x7b044d4128f9f838 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500412:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000753d2ec8/0x7b044d4128f9f82a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500412:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af5a1535/0x7b044d4128f9f838 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500420:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af5a1535/0x7b044d4128f9f838 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500421:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000753d2ec8/0x7b044d4128f9f82a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500427:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784938543.500429:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000753d2ec8/0x7b044d4128f9f82a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500439:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938543.500442:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078ac4352/0x7b044d4128f9f831 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500448:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b379d000 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938543.500451:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078ac4352/0x7b044d4128f9f831 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938543.500454:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x88:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938543.500459:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078ac4352/0x7b044d4128f9f831 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500459:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3af62db/0x7b044d4128f9f83f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500467:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x88:0x0].0x0 since=809s v=(0 0) 00010000:00010000:3.0:1784938543.500469:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078ac4352/0x7b044d4128f9f831 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500470:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x88:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938543.500474:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3af62db/0x7b044d4128f9f83f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500477:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078ac4352/0x7b044d4128f9f831 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500482:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3af62db/0x7b044d4128f9f83f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500490:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3af62db/0x7b044d4128f9f83f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500493:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938543.500497:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af5a1535/0x7b044d4128f9f838 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500497:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3af62db/0x7b044d4128f9f83f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500504:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b379d800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938543.500505:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938543.500507:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af5a1535/0x7b044d4128f9f838 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500527:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af5a1535/0x7b044d4128f9f838 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500537:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af5a1535/0x7b044d4128f9f838 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500544:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af5a1535/0x7b044d4128f9f838 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938543.500550:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x87:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938543.500554:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000263edbee/0x7b044d4128f9f846 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500556:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938543.500559:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3af62db/0x7b044d4128f9f83f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500562:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x87:0x0].0x0 since=809s v=(0 0) 00010000:00010000:0.0:1784938543.500565:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x87:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938543.500566:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b379ca00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938543.500570:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3af62db/0x7b044d4128f9f83f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500570:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000263edbee/0x7b044d4128f9f846 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500579:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000263edbee/0x7b044d4128f9f846 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500584:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3af62db/0x7b044d4128f9f83f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500593:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000263edbee/0x7b044d4128f9f846 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500595:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3af62db/0x7b044d4128f9f83f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500602:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000263edbee/0x7b044d4128f9f846 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500603:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3af62db/0x7b044d4128f9f83f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500610:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938543.500613:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938543.500616:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000263edbee/0x7b044d4128f9f846 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500623:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b379c800 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938543.500626:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000263edbee/0x7b044d4128f9f846 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500633:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000263edbee/0x7b044d4128f9f846 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938543.500637:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x86:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938543.500641:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb633145/0x7b044d4128f9f84d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500643:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000263edbee/0x7b044d4128f9f846 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500649:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x86:0x0].0x0 since=809s v=(0 0) 00010000:00010000:3.0:1784938543.500651:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000263edbee/0x7b044d4128f9f846 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500651:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x86:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938543.500656:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb633145/0x7b044d4128f9f84d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500664:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb633145/0x7b044d4128f9f84d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500667:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938543.500668:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938543.500670:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938543.500672:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb633145/0x7b044d4128f9f84d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500677:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938543.500680:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb633145/0x7b044d4128f9f84d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.500682:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938543.500687:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938543.500705:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784938543.500742:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x85:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938543.500747:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a837456f/0x7b044d4128f9f854 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500754:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x85:0x0].0x0 since=809s v=(0 0) 00010000:00010000:0.0:1784938543.500757:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x85:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938543.500761:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a837456f/0x7b044d4128f9f854 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500768:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a837456f/0x7b044d4128f9f854 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500775:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a837456f/0x7b044d4128f9f854 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.500781:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a837456f/0x7b044d4128f9f854 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938543.501254:0:28423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68a9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:28423:1871643350969216:192.168.202.154@tcp:5:osp-pre-0-0.0 00000004:00080000:2.0:1784938543.501273:0:28423:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0xa1:0x0]-[0x280000401:0xc1:0x0] 00000100:00100000:2.0:1784938543.501314:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350969088:192.168.202.154@tcp:13:osp-pre-0-0.0 00010000:00010000:0.0:1784938543.503751:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784938543.503844:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938543.503855:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb633145/0x7b044d4128f9f84d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.503868:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b379d600 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938543.503873:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb633145/0x7b044d4128f9f84d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.503884:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb633145/0x7b044d4128f9f84d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938543.503884:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x84:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938543.503892:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000993f7fed/0x7b044d4128f9f85b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.503903:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x84:0x0].0x0 since=809s v=(0 0) 00010000:00010000:3.0:1784938543.503905:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb633145/0x7b044d4128f9f84d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.503908:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x84:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938543.503913:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb633145/0x7b044d4128f9f84d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.503915:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000993f7fed/0x7b044d4128f9f85b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.503927:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000993f7fed/0x7b044d4128f9f85b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.503935:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938543.503935:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000993f7fed/0x7b044d4128f9f85b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.503938:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a837456f/0x7b044d4128f9f854 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.503944:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000993f7fed/0x7b044d4128f9f85b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.503961:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b379de00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938543.503962:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938543.503964:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a837456f/0x7b044d4128f9f854 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.503971:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a837456f/0x7b044d4128f9f854 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.503981:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a837456f/0x7b044d4128f9f854 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.503988:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a837456f/0x7b044d4128f9f854 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938543.503995:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x83:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938543.503999:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938543.504000:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e8ea1de/0x7b044d4128f9f862 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.504002:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000993f7fed/0x7b044d4128f9f85b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.504008:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x83:0x0].0x0 since=809s v=(0 0) 00010000:00010000:3.0:1784938543.504009:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b379dc00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:0.0:1784938543.504011:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x83:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938543.504015:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e8ea1de/0x7b044d4128f9f862 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.504021:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000993f7fed/0x7b044d4128f9f85b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.504023:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e8ea1de/0x7b044d4128f9f862 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.504030:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000993f7fed/0x7b044d4128f9f85b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.504032:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e8ea1de/0x7b044d4128f9f862 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.504040:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000993f7fed/0x7b044d4128f9f85b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.504040:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e8ea1de/0x7b044d4128f9f862 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.504055:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938543.504056:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000993f7fed/0x7b044d4128f9f85b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.504068:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938543.504325:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e8ea1de/0x7b044d4128f9f862 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.504335:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b379ce00 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938543.504338:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e8ea1de/0x7b044d4128f9f862 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.504346:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e8ea1de/0x7b044d4128f9f862 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.504358:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e8ea1de/0x7b044d4128f9f862 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.504364:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e8ea1de/0x7b044d4128f9f862 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.504379:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938543.504381:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938543.504383:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938543.504418:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938543.504424:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938543.504431:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938543.504563:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938543.513756:0:25720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x82:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938543.513773:0:25720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000553e8c3f/0x7b044d4128f9f869 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.513791:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x82:0x0].0x0 since=809s v=(0 0) 00010000:00010000:0.0:1784938543.513795:0:25720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x82:0x0].0x0 since=0s v=(0 0) 00000001:00100000:3.0:1784938543.513799:0:22178:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1784938543.513802:0:25720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000553e8c3f/0x7b044d4128f9f869 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.513817:0:25720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000553e8c3f/0x7b044d4128f9f869 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.513829:0:25720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000553e8c3f/0x7b044d4128f9f869 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.513837:0:25720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000553e8c3f/0x7b044d4128f9f869 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938543.513862:0:25720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938543.513923:0:19223:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938543.513929:0:19223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000553e8c3f/0x7b044d4128f9f869 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.513938:0:19223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24b379c400 already unused, calling callback (ffffffffc0d954a0) 00010000:00010000:3.0:1784938543.513942:0:19223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000553e8c3f/0x7b044d4128f9f869 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1784938543.514201:0:25720:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:104 00010000:00010000:3.0:1784938543.514272:0:19223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000553e8c3f/0x7b044d4128f9f869 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938543.514291:0:19223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000553e8c3f/0x7b044d4128f9f869 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938543.514292:0:25720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386361500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:28425:x1871643350968960:12345-192.168.202.154@tcp:5:osp-pre-1-0.0 Request processed in 75657us (80689us total) trans 0 rc 0/0 00010000:00010000:3.0:1784938543.514300:0:19223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000553e8c3f/0x7b044d4128f9f869 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938543.514303:0:25720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 1007 00010000:00010000:3.0:1784938543.514323:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938543.514324:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938543.514327:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938543.515597:0:28425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68aad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:28425:1871643350968960:192.168.202.154@tcp:5:osp-pre-1-0.0 00000004:00080000:2.0:1784938543.515619:0:28425:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0xa1:0x0] from OST, last_created [0x2c0000401:0xa1:0x0]last_used is [0x2c0000401:0x68:0x0] 00000100:00100000:2.0:1784938543.515692:0:28425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68a8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:28425:1871643350969472:192.168.202.154@tcp:5:osp-pre-1-0.0 00000100:00100000:2.0:1784938543.515763:0:28425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9f238601e780 going to sleep for 11 seconds 00000100:00100000:2.0:1784938543.515782:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f24b68aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350969344:192.168.202.154@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938543.515915:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938543.515940:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938543.516883:0:25726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350969472 00000100:00100000:2.0:1784938543.516894:0:25726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350969472 00000100:00100000:3.0:1784938543.517224:0:25723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 1009 00000100:00100000:3.0:1784938543.517235:0:25723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24b68abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:28425:x1871643350969472:12345-192.168.202.154@tcp:5:osp-pre-1-0.0 00002000:00080000:3.0:1784938543.517279:0:25723:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x2c0000401 at 162 00002000:00080000:3.0:1784938543.518929:0:25723:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x2c0000401 at 170 00000100:00100000:0.0:1784938543.518938:0:21154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350969344 00000100:00100000:0.0:1784938543.518947:0:21154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350969344 00000100:00100000:0.0:1784938543.519006:0:21154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 113 00000100:00100000:0.0:1784938543.519016:0:21154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:16390:x1871643350969344:12345-192.168.202.154@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1784938543.519040:0:21154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 271040 pending 896 free 313057280 avail 285245440 00000100:00100000:0.0:1784938543.519115:0:21154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:16390:x1871643350969344:12345-192.168.202.154@tcp:13:osp-pre-1-0.0 Request processed in 100us (3173us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938543.519132:0:21154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 113 00000100:00100000:2.0:1784938543.520465:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:16390:1871643350969344:192.168.202.154@tcp:13:osp-pre-1-0.0 00000001:00080000:3.0:1784938543.521610:0:25723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967575 00002000:00080000:3.0:1784938543.521646:0:25723:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x2c0000401 at 178 00000001:00080000:0.0:1784938543.529352:0:25723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967576 00002000:00080000:0.0:1784938543.529395:0:25723:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x2c0000401 at 186 00000001:00080000:0.0:1784938543.533492:0:25723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967577 00000100:00100000:0.0:1784938543.533659:0:25723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24b68abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:28425:x1871643350969472:12345-192.168.202.154@tcp:5:osp-pre-1-0.0 Request processed in 16419us (17738us total) trans 4294967578 rc 0/0 00000100:00100000:0.0:1784938543.533671:0:25723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 1009 00000020:00080000:0.0:1784938543.533677:0:25723:0:(tgt_main.c:784:tgt_ses_key_exit()) total 4 transactions per RPC 00000100:00100000:2.0:1784938543.534266:0:28425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f24b68a8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:28425:1871643350969472:192.168.202.154@tcp:5:osp-pre-1-0.0 00000004:00080000:2.0:1784938543.534285:0:28425:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0xa1:0x0]-[0x2c0000401:0xc1:0x0] 00000001:00100000:1.0:1784938543.799371:0:27341:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1784938544.044663:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784938544.526962:0:28742:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784938544.530598:0:28742:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784938545.070037:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784938545.729774:0:28792:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784938545.730005:0:28792:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1784938545.833679:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386360700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350969600:192.168.202.154@tcp:13:osp-pre-1-1.0 00000100:00100000:3.0:1784938545.834050:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938545.834175:0:21154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350969600 00000100:00100000:1.0:1784938545.834183:0:21154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350969600 00000100:00100000:0.0:1784938545.834314:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938545.834325:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238f1b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350969728:192.168.202.154@tcp:13:osp-pre-0-1.0 00000100:00100000:0.0:1784938545.834447:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938545.834470:0:21153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350969728 00000100:00100000:0.0:1784938545.834473:0:21153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350969728 00000100:00100000:0.0:1784938545.834531:0:21153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 114 00000100:00100000:0.0:1784938545.834540:0:21153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16391:x1871643350969728:12345-192.168.202.154@tcp:13:osp-pre-0-1.0 00002000:00000024:0.0:1784938545.834568:0:21153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 270144 pending 0 free 313057280 avail 285245440 00000100:00100000:0.0:1784938545.834605:0:21153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16391:x1871643350969728:12345-192.168.202.154@tcp:13:osp-pre-0-1.0 Request processed in 65us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938545.834612:0:21153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 114 00000100:00080000:0.0:1784938545.834632:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938545.834719:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238f1b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350969728:192.168.202.154@tcp:13:osp-pre-0-1.0 00000100:00100000:1.0:1784938545.834874:0:21154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 115 00000100:00100000:1.0:1784938545.834882:0:21154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2386363480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16391:x1871643350969600:12345-192.168.202.154@tcp:13:osp-pre-1-1.0 00002000:00000024:1.0:1784938545.834899:0:21154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 270144 pending 0 free 313057280 avail 285245440 00000100:00100000:1.0:1784938545.834927:0:21154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2386363480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:16391:x1871643350969600:12345-192.168.202.154@tcp:13:osp-pre-1-1.0 Request processed in 46us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938545.834933:0:21154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 115 00000100:00100000:3.0:1784938545.835099:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386360700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:16391:1871643350969600:192.168.202.154@tcp:13:osp-pre-1-1.0 00000100:00080000:0.0:1784938545.835336:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784938546.097914:0:19222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938547.112553:0:22954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938548.152554:0:19223:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938548.392411:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2482b28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350969856:192.168.202.154@tcp:41:osp-pre-1-0.0 00000100:00100000:0.0:1784938548.392601:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23882be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:16389:1871643350970368:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938548.392667:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23882bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e07296-2a01-411c-abf2-6d190cb69ef0:16390:1871643350969984:0@lo:400:kworker.0 00000100:00100000:0.0:1784938548.392683:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23882bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350970880:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938548.392723:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350971392:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938548.393720:0:16390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938548.399245:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938548.399354:0:26608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350970368 00000100:00100000:0.0:1784938548.399366:0:26608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350970368 00000100:00100000:0.0:1784938548.399465:0:26608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 35 00000100:00100000:0.0:1784938548.399487:0:26608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:16389:x1871643350970368:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938548.399592:0:26608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:16389:x1871643350970368:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 109us (1377us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938548.399601:0:26608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 35 00000100:00080000:0.0:1784938548.399632:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938548.402113:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938548.402182:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938548.402262:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350970880 00000100:00100000:0.0:1784938548.402275:0:25715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350970880 00000100:00100000:2.0:1784938548.402287:0:28410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350969984 00000100:00100000:2.0:1784938548.402294:0:28410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350969984 00000100:00100000:2.0:1784938548.402360:0:28410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784938548.402360:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 125 00000100:00100000:2.0:1784938548.402378:0:28410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483919050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+24:16390:x1871643350969984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938548.402378:0:25715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:16389:x1871643350970880:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938548.403088:0:25715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:16389:x1871643350970880:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 711us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938548.403115:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 125 00000100:00080000:0.0:1784938548.403431:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784938548.404030:0:28410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483919050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e07296-2a01-411c-abf2-6d190cb69ef0+24:16390:x1871643350969984:12345-0@lo:400:kworker.0 Request processed in 1655us (10310us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938548.404043:0:28410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784938548.404128:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23882bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:16392:1871643350970240:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938548.404231:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23882bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350970752:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938548.404272:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350971264:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938548.404312:0:16392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1784938548.404322:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23882bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:16392:1871643350970112:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938548.404369:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23882bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350970624:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938548.404401:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f238e0ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350971136:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938548.404422:0:16392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2482b29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350971648:192.168.202.154@tcp:41:osp-pre-0-1.0 00000100:00100000:0.0:1784938548.404757:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938548.404830:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938548.404906:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938548.404981:0:21161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350969856 00000100:00100000:2.0:1784938548.404992:0:21161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350969856 00000100:00100000:2.0:1784938548.405033:0:21161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350970624 00000100:00100000:2.0:1784938548.405036:0:21161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350970624 00000100:00100000:2.0:1784938548.405050:0:21161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350971136 00000100:00100000:2.0:1784938548.405053:0:21161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350971136 00000100:00100000:2.0:1784938548.405068:0:21161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 145 00000100:00100000:2.0:1784938548.405077:0:21161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:16389:x1871643350969856:12345-192.168.202.154@tcp:41:osp-pre-1-0.0 00000004:00000024:2.0:1784938548.405319:0:21161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 218472448 avail 191447040 00000100:00100000:0.0:1784938548.405326:0:27313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350970112 00000100:00100000:0.0:1784938548.405332:0:27313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350970112 00000100:00100000:2.0:1784938548.405374:0:21161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:16389:x1871643350969856:12345-192.168.202.154@tcp:41:osp-pre-1-0.0 Request processed in 295us (3284us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938548.405384:0:21161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 145 00000100:00100000:0.0:1784938548.405389:0:27313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 36 00000100:00100000:0.0:1784938548.405400:0:27313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:16392:x1871643350970112:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938548.405406:0:21161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 146 00000100:00100000:2.0:1784938548.405415:0:21161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:16392:x1871643350970624:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938548.405437:0:27313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:16392:x1871643350970112:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 38us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938548.405446:0:21161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:16392:x1871643350970624:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 32us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938548.405453:0:21161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 146 00000100:00100000:2.0:1784938548.405466:0:21161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 147 00000100:00100000:2.0:1784938548.405485:0:21161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:16392:x1871643350971136:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938548.405504:0:21161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:16392:x1871643350971136:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 21us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938548.405510:0:21161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 147 00000100:00100000:0.0:1784938548.405584:0:27313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 36 00000100:00080000:0.0:1784938548.405612:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938548.410033:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23882bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e07296-2a01-411c-abf2-6d190cb69ef0:16390:1871643350969984:0@lo:400:kworker.0 00000100:00100000:1.0:1784938548.410059:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f23882bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:16390:1871643350970496:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938548.410164:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2387fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:16390:1871643350971008:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938548.410192:0:16390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2388247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:16390:1871643350971520:192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938548.413240:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938548.413284:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938548.413305:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938548.413325:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938548.413343:0:16382:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:0.0:1784938548.413380:0:25729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350971392 00000100:00100000:0.0:1784938548.413390:0:25729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350971392 00000100:00100000:0.0:1784938548.413461:0:25729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350970752 00000100:00100000:0.0:1784938548.413464:0:25729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350970752 00000100:00100000:0.0:1784938548.413493:0:25729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350971264 00000100:00100000:0.0:1784938548.413496:0:25729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350971264 00000100:00100000:0.0:1784938548.413515:0:25729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 126 00000100:00100000:0.0:1784938548.413524:0:25729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+9:16389:x1871643350971392:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938548.413864:0:25727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 127 00000100:00100000:1.0:1784938548.413876:0:25727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:16392:x1871643350970752:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938548.413939:0:25727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:16392:x1871643350970752:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 67us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938548.413948:0:25727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 127 00000100:00100000:1.0:1784938548.413970:0:25727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 128 00000100:00100000:1.0:1784938548.413977:0:25727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+9:16392:x1871643350971264:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938548.413999:0:25727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+9:16392:x1871643350971264:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 24us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938548.414005:0:25727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 128 00000100:00100000:1.0:1784938548.414079:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23882bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:16389:1871643350970880:192.168.202.154@tcp:400:kworker.0 00010000:00080000:1.0:1784938548.414112:0:16389:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f23882be680 x1871643350970368/t0(0) o400->lustre-MDT0000-lwp-OST0001@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938548.414125:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23882be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:16389:1871643350970368:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938548.414180:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2482b28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350969856:192.168.202.154@tcp:41:osp-pre-1-0.0 00000100:00100000:0.0:1784938548.414430:0:25729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+9:16389:x1871643350971392:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 907us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938548.414439:0:25729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 126 00000100:00100000:0.0:1784938548.414464:0:26608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350970240 00000100:00100000:0.0:1784938548.414478:0:26608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350970240 00000100:00100000:0.0:1784938548.414516:0:26608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 37 00000100:00100000:0.0:1784938548.414524:0:26608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:16392:x1871643350970240:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:0.0:1784938548.414549:0:26608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:16392:x1871643350970240:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 27us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938548.414684:0:26608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 37 00000100:00080000:0.0:1784938548.414709:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784938548.414714:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784938548.414716:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784938548.415082:0:21161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350971648 00000100:00100000:3.0:1784938548.415090:0:21161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350971648 00000100:00100000:3.0:1784938548.415133:0:21161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 148 00000100:00100000:3.0:1784938548.415142:0:21161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f238f1b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:16392:x1871643350971648:12345-192.168.202.154@tcp:41:osp-pre-0-1.0 00000004:00000024:3.0:1784938548.415200:0:21161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 218345472 avail 191320064 00000100:00100000:3.0:1784938548.415236:0:21161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f238f1b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:16392:x1871643350971648:12345-192.168.202.154@tcp:41:osp-pre-0-1.0 Request processed in 95us (1891us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938548.415242:0:21161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 148 00000100:00100000:1.0:1784938548.416264:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938548.416291:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:1.0:1784938548.416311:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00010000:00080000:1.0:1784938548.416397:0:16392:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f23882bf480 x1871643350970112/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938548.416416:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23882bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:16392:1871643350970112:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938548.416433:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23882bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350970624:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938548.416444:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350971136:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938548.416460:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2482b29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350971648:192.168.202.154@tcp:41:osp-pre-0-1.0 00010000:00080000:1.0:1784938548.416483:0:16392:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f23882bc380 x1871643350970240/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938548.416494:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23882bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:16392:1871643350970240:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938548.416507:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23882bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:16392:1871643350970752:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938548.416520:0:16392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f238e0ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:16392:1871643350971264:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938548.416689:0:27313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350970496 00000100:00100000:1.0:1784938548.416696:0:27313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350970496 00000100:00100000:1.0:1784938548.416751:0:27313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350971008 00000100:00100000:1.0:1784938548.416755:0:27313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350971008 00000100:00100000:1.0:1784938548.416769:0:27313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350971520 00000100:00100000:1.0:1784938548.416772:0:27313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350971520 00000100:00100000:1.0:1784938548.416854:0:27313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 38 00000100:00100000:1.0:1784938548.416865:0:27313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:16390:x1871643350970496:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938548.416923:0:27313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:16390:x1871643350970496:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 60us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938548.416931:0:27313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 38 00000100:00100000:1.0:1784938548.416950:0:27313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 39 00000100:00100000:1.0:1784938548.416956:0:27313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:16390:x1871643350971008:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938548.416979:0:27313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:16390:x1871643350971008:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 24us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938548.416986:0:27313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 39 00000100:00100000:1.0:1784938548.416997:0:27313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 40 00000100:00100000:1.0:1784938548.417003:0:27313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2388247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:16390:x1871643350971520:12345-192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938548.417023:0:27313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2388247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:16390:x1871643350971520:12345-192.168.202.154@tcp:400:kworker.0 Request processed in 21us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938548.417028:0:27313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 40 00000100:00080000:1.0:1784938548.417049:0:19230:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1784938548.417230:0:16390:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f23882bce00 x1871643350970496/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938548.417242:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f23882bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:16390:1871643350970496:192.168.202.154@tcp:400:kworker.0 00010000:00080000:1.0:1784938548.417256:0:16390:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f2387fd2a00 x1871643350971008/t0(0) o400->lustre-MDT0000-lwp-MDT0001@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938548.417265:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2387fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:16390:1871643350971008:192.168.202.154@tcp:400:kworker.0 00010000:00080000:1.0:1784938548.417277:0:16390:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f2388247480 x1871643350971520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.202.154@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938548.417285:0:16390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:16390:1871643350971520:192.168.202.154@tcp:400:kworker.0 00000100:00100000:1.0:1784938548.417327:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2388244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350971392:192.168.202.154@tcp:400:kworker.0 00000100:00100000:2.0:1784938548.908089:0:16391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938548.908142:0:16391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2386360700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350971776:192.168.202.154@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938548.908484:0:16389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9f2482b29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350971904:192.168.202.154@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938548.908977:0:16383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:3.0:1784938548.909020:0:16384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.154@tcp (source: 12345-192.168.202.154@tcp) 00000100:00100000:2.0:1784938548.909056:0:21154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350971904 00000100:00100000:3.0:1784938548.909064:0:21153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643350971776 00000100:00100000:2.0:1784938548.909069:0:21154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350971904 00000100:00100000:3.0:1784938548.909070:0:21153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643350971776 00000100:00100000:3.0:1784938548.909438:0:21153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 116 00000100:00100000:3.0:1784938548.909453:0:21153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f23823ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:16391:x1871643350971776:12345-192.168.202.154@tcp:13:osp-pre-1-0.0 00002000:00000024:3.0:1784938548.913251:0:21153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 270144 pending 0 free 313057280 avail 285245440 00000100:00100000:3.0:1784938548.913373:0:21153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f23823ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:16391:x1871643350971776:12345-192.168.202.154@tcp:13:osp-pre-1-0.0 Request processed in 3915us (4346us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938548.913386:0:21153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 116 00000100:00100000:3.0:1784938548.913430:0:21153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.154@tcp, seq: 117 00000100:00100000:3.0:1784938548.913445:0:21153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482b29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:16389:x1871643350971904:12345-192.168.202.154@tcp:13:osp-pre-0-0.0 00002000:00000024:3.0:1784938548.913474:0:21153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 270144 pending 0 free 313057280 avail 285245440 00000100:00100000:3.0:1784938548.913506:0:21153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482b29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:16389:x1871643350971904:12345-192.168.202.154@tcp:13:osp-pre-0-0.0 Request processed in 69us (4534us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938548.913515:0:21153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.154@tcp, seq: 117 00000100:00100000:3.0:1784938548.914614:0:16391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2386360700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:16391:1871643350971776:192.168.202.154@tcp:13:osp-pre-1-0.0 00000001:00080000:0.0:1784938548.915405:0:22178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967578 is committed 00000100:00100000:2.0:1784938548.915873:0:16389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9f2482b29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:16389:1871643350971904:192.168.202.154@tcp:13:osp-pre-0-0.0 00000001:00080000:3.0:1784938548.916583:0:21144:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967578 is committed 00000001:02000400:1.0:1784938548.997746:0:28889:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-scrub test_1a: @@@@@@ FAIL: (9) Expect 'inconsistent', but got '' 00010000:00010000:3.0:1784938549.166423:0:25733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938550.184397:0:25732:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 64300 lines, 64300 kept, 0 dropped, 0 bad.